Michael Zink. A Measurement Architecture for Software Defined

A Measurement Architecture
for Software Defined
Exchanges
Michael Zink
October 28th 2014
Networks 2014
Moscow State University
Department of Electrical and Computer Engineering
Agenda





What is an SDX?
SDX prototype
Nowcast
Measurement architecture
First results
Department of Electrical and Computer Engineering
1
The Internet Today
 Autonomous System (AS)

a unique entity with a routing policy,
e.g ISP
 Border Gateway Protocol
(BGP) - destination IPbased


i-BGP - interior routing Protocol used
to communicate within ASes (TCP)
e-BGP - exterior routing protocol used
to communicate between ASes
(Physical link)
 Internet Exchange Point (IXP)

Department of Electrical and Computer Engineering
Physical point used by ISPs for traffic
exchange
2
Into the Future - SDX-enabled Internet
SDN Domain
CPB1
SDX3
AS3
SDN Domain
AS4
Policy-based
Routing
SDX1
AS1
SDX5
CPA2
CPB2
CPB3
SDN Domain
SDX4
SDX2
AS5
CPA1
SDN Domain
AS2
Content Provider A
Software Defined
Exchange(SDX)
SDN Domain Engineering
Department of Electrical and Computer
Content Provider B
3
What is an SDX?
It’s OF on
steroids
It’s software
everything
It’s for adv.
BGP
It’s an
adv.
IXP
It’s multidomain SDN
It’s only for
research
Department of Electrical and Computer Engineering
4
Into the Future - SDX-enabled Internet
 Software-Defined Networking

Flow rules based not only on IP but also type-of-service, port,
VLAN ID, etc.
 Software Defined Exchange (v1.0)


Software-defined IXP that provides all the advantages of
Software Defined Networking
*Ref: Policy-based routing - Pyretic is used to define policies
*SDX: A Software Defined Internet Exchange - Arpit Gupta, Laurent Vanbever et Al. – ACM-SIGCOMM 2014
Department of Electrical and Computer Engineering
5
Our Vision – SDX-enabled Internet

Storage and compute nodes colocated with powerful network
infrastructure
Department of Electrical and Computer Engineering
6
How can applications benefit from SDX?
 Traffic Characterization

Application-based and Domain-based
 Reactive Flow Rule Installation
 Traffic Prioritization

Severe weather warning data has higher priority over
video traffic
 Third-party Policy Implementation

Content and File sharing
Department of Electrical and Computer Engineering
7
Where can we go?
 Lot’s of things we cannot do (or at least only in
complicated ways) in today’s Internet
 NDN
 Cyber-physical systems
 Clean slate
 In-network computation and storage
 …
Department of Electrical and Computer Engineering
8
Prototype Implementation of SDX
Department of Electrical and Computer Engineering
9
Nowcast Weather Application
Features:


Short-term (10-15 minute) weather
prediction
Severe-weather prediction for timely
evacuation
Department of Electrical and Computer Engineering
Requirements:



High-Bandwidth connection
Compute-intensive Resources for
Processing
Storage of Nowcasts for Web Server
10
Measurement







Scalability
Non-intrusive/Non-interfering
Ease of use
Calibration
Monitoring and measuring control vs. data plane
Legacy
From SDX to SDI
Department of Electrical and Computer Engineering
11
Scalability





Shear number of flows
Distributed controller(s)
Measurements across several SDXs
Observe subset of flows
Should experimenter be able to observe flows
from different slice(s)?
Department of Electrical and Computer Engineering
12
Non-intrusive/NonInterfering
 Avoid impact on measured data
• E.g., measurement process at VM adds to CPU load
• Transfer of measurement data – we have seen this in
wireless networks
 Transmit measurement data via control plane or
separate slice
Department of Electrical and Computer Engineering
13
Ease of Use
 Framework and tools easy to use
• Keep burden of measurement small
• Gain acceptance within community
 Build on top of proven tools that have been used
within GENI community
• OML/OMF
• LabWiki
• GIMI tools
Department of Electrical and Computer Engineering
14
Calibration
 Everyone does it!!
 Impacts quality of measurement
 Provide calibration tools
• Traffic generation
• Traffic injection
• Set of calibration cases
Department of Electrical and Computer Engineering
15
Control vs. Data Plane
 Hollistic approach
• Ability to monitor data AND control plane
• E.g., congesting in link between switch(es) and
controller can impact SDN performance
 What in the case of a distributed controller?
 What if SDN switches are “virtualized”?
Department of Electrical and Computer Engineering
16
Legacy
 Further develop tools from GENI GIMI project:
OMF
OML
iRODS
LabWiki
Integration with GENI AM API
Education
Evaluate approaches in GEMINI and other measurement
projects
• Interface with existing monitoring/measuring tools
•
•
•
•
•
•
•
Department of Electrical and Computer Engineering
17
From SDX to SDI
 In addition to network performance measure:
• Compute performance and
• Storage performance
 Some of it already included in GIMI toolset
• E.g., nmetrics to measure OS performance
Department of Electrical and Computer Engineering
18
GENI Slice
and
SDN
Control
Load Balancer
Learning
Controller
Controller
NUIG
Rack
StarLigh
t
OF
switch
AL2S
Switc
h
sdx
SoX
OF
switc
h
AL2S
Switc
h
SoXIG
Rack
sdx
GT-IG
Rack
Department of Electrical and Computer Engineering
19
TBD
Department of Electrical and Computer Engineering
20
Experiments – Application Based Statistics

Nowcast Statistics

Nowcast traffic carried by
each domain
Department of Electrical and Computer Engineering
21
Experiments - Applications
a) VLC DASH with 3 Iperf Flows
from each VM
b) Nowcast with 3 Iperf Flows
from each VM
c) Nowcast Application with VLC
DASH
Department of Electrical and Computer Engineering
22
Conclusions
 SDX/SDI => new approach
 Instrumentation and measurement absolutely
required
 Define requirements and build on existing tools
 Started this process
 Presented very preliminary experiment and
measurement results
Department of Electrical and Computer Engineering
23
Some (Wild) Ideas
 Can you use measurement data for OF controller
behavior – closed loop
 Send measurement data on different flow than
production traffic
• Isolation
• Measurement data collection will not interfere with
production traffic
Department of Electrical and Computer Engineering
24
Experiments - Controllers

Timer-based Controller
Lower Decision Rate =
Lower Quality
 Unequal bandwidth
utilization


Throughput-Based LoadBalancer
Higher Decision Rate =
Higher Quality
 Convergence to nearly
equal Bandwidth Utilization

Department of Electrical and Computer Engineering
25

Download Report