100G IP Backbone In Asia

100G IP Backbone In Asia
Challenges from L1 and L3 views
APRICOT 2014 in Malaysia
Hideo Ishii
Vice President, Engineering and Architecture
Agenda
•  Pacnet Networks
–  Subsea Network
–  IP Network
•  Recent observation and Trend
•  Pacnet IP backbone architecture
•  OTN (Optical Transport Network)
•  100G over Submarine Cable System
•  Challenges
•  IP and Optical Network
2
Pacnet Subsea Network
Pacnet IP network
To US
Seoul
London
China
To London
Nagoya
Osaka
San Jose
Tokyo
New York
Ashburn, VA
Los Angeles
Taipei
Hong
Kong
Chennai
Bangkok
Manila
Kuala
Lumpur
Singapore
Jakarta
Public Peering
Private Peering
Customers
Perth
Brisbane
Adelaide
Melbourne
Sydney
Auckland
4 February 2014
CONFIDENTIAL
4
Pacnet IP Network
IP Network AS10026 covers almost key cities in Asia-Pac and
US and Europe IXes
•  CS Core+ POP Core + Edge Router design
•  MPLS-TE is deployed partially
•  International IP backbone circuit is 10G only
•  Unprotected
•  IPv4 and IPv6 dual stacking
•  ISIS + BGP
5
Observations and Trends
IP MPLS
DWDM
SLTE
DWDM
SLTE
DWDM
SLTE
OTN/DWDM DWDM
SLTE
DWDM
SLTE
DWDM
SLTE
•  40GE/100GE requirement from IP MPLS layer
•  40G/100G technologies from Optical layer
•  Packet Transport technologies in Optical layer
•  OTN switching technology for multiple services in Optical layer
•  SDN has been expending coverage from Cloud to Optical
6
Pacnet IP backbone Architecture
- 2008
City
POP
Hong Kong
Korea
Japan
US
Router
Router
Router
Router
DWDM
ADM
DWDM
ADM
DWDM
ADM
DWDM
ADM
Backhaul
Cable
Landing
Station
DWDM
ADM
DWDM
ADM
SLTE
SLTE
Due to Ring
Protection,
all paths are
going
through
DWDM/ADM
equipments
DWDM
ADM
SLT
E
Router in
Japan
handles
Asia-US
traffic due
to traffic
aggregation
purpose
DWDM
ADM
SLTE
Not efficient due to bandwidth
demands are unique at each country
Ping Pong traffic between POP and
Cable Landing Station is not efficient
and adding latency
Pacnet IP backbone Architecture
- 2009
Hong Kong
Korea
Japan
US
Router
Router
Router
Router
City
POP
DWDM
ADM
Backhaul
Cable
Landing
Station
Router
handles
traffic that
drop to Tokyo
or go to US
Router
Router
Router
DWDM
ADM
Can manage traffic flow and capacity utilization
Pacnet IP backbone Architecture - 2013
KOREA
Router
EAC
SLTE
IP POP
Router
SLTE
SLTE
C2C
TAIWAN
IP POP
SLTE
Protection Route
Fast Reroute path
SLTE
JAPAN
IP POP
SLTE
Router
SLTE
Hong Kong
SLTE
Router
IP POP
Cable Landing Station
10GE WAN-PHY
STM64 SDH Interface
Pacnet IP backbone Architecture •  Our Backbone design is NOW;
POP Core Edge Routers
CS Core SLTE
10GbE
Subsea
Cable •  Our Backbone design will be;
L2 edge
N x 10GE
POP/CS Aggr
PTN Core
Subsea
Cable 10GbE-PHY
40/100GbE-PHY
- Trunk / Agg -
OTU3,4,flex
10
Network View – Layers DWDM-OTN-IP
IP
OTN
DWDM
IP Layer – Routers
Links – Not similar topology
to lower layers
Electrical: Client Mapping,
Connection Multiplexing,
Grooming, Monitoring,
No stranded BW
Protection/Restoration
Optical Layer:
Add/Drop, Express,
Protection/Restoration
OTUk and ODUk Overhead (k = 0,1,2,2e,3,4)
1
1
2
3
4
2
3
4
5
6
7
8
9
FAS2("F6F6F6282828")
MFAS
SM
RES2ODUk
DM TCM2ACT
TCM6
TCM5
TCM3
TCM2
TCM1
GCC12ODUk
GCC22ODUk
APS/PCC2ODUk
ACT
APS
EXP
FAS
FTFL
GCC
DM
MFAS
PCC
PM
PSI
PT
RES
SM
TCM
10
11
12
GCC02OTUk
TCM4
PM
RES2ODUK
13
14
RED2OTUk
FTFL
EXP
15
15
Mapping2&2
Concat.2
Specific
PSI
Activation / Deactivation Control channel
Automatic Protection Switching coordination channel
Experimental
Frame Alignment Signal
Fault Type and Fault Location reporting channel
General Communication channel
Delay Measurement
Multi-Frame Alignment Signal
Protection Communication Control channel
Path Monitoring
Payload Structure Identifier
Payload Type
Reserved for Future International Standardization
Section Monitoring
Tandem Connection Monitoring
12
OTN Multiplexing Hierarchy G.709/G.Sup43 Multiplexing Hierarchy
Low-Order ODUj
ODU1
Muxing
ODU2
Muxing
ODU3
Muxing
ODU4
Muxing
ODU0
2
8
32
80
4
16
40
8
32
80
4
10
ODU1
ODUflex
ODU2
ODU1
ODU2
High-Order ODUk
ODU1
ODU2
ODU3e1/2 Muxing
ODU2e
ODU3
3
10
ODU3
2
ODU4
4
ODU3e1
ODU3e1
ODU3e2
ODU3e2
ODU3
ODU4
OTN Multiplexing
Multiplexing Example
High Speed ODU (H) can encapsulate low speed ODU frames
OTU3
10
GE
10
GE
10
GE
OH
OUT
2e
OH
10
G
E
OTU
2e
OH
10
G
E
OTU
2e
OH
10
G
E
OTU3
40G
E
10
GE
10
GE
10
GE
40G
E
OTN vs. SDH
Function
OTN
SDH
DWDM
Part of the basic frame work
Not part of SDH
FEC
Supported Not supported
Standardized
Protection
Linear, Ring
Mesh is working in progress
Linear, Ring
Client rates
1Gbps – 100Gbps
( > 100Gbps will be
standardized in the future)
2Mbps (1.5M SONET) to 40Gbps
(no plan to standardization for
> 40Gbps)
Synchronization of
transport nodes
Free Running
Typically part of synchronization
hierarchy
TCM (Tandem
Connection
Monitoring)
6 Layers – Cleanly defined
1 Layer Client signal
transparency
Bit and timing
Bit and Timing
Recommendation ITU-T G.709 etc..
ITU-T G.707 etc..
OTN Switching
SLTE / DWDM support OTN switching to provide more flexibly Capacity
Management and Bandwidth efficiency for Carriers
OTN Switching Equipment
Digital
Client
interface
or
DWDM
Interface
Traditional OTN Equipment
Digital
interface
Client
Card
DWDM
Interface
Line
Card
Switching
Digital
Client
interface
or
DWDM
Interface
Technology
Evolution
Digital
Client
interface
or
DWDM
Interface
Switching
Digital
Client
interface
or
DWDM
Interface
100G over Submarine Cable Systems
17
Why 100G?
•  Improve spectral Efficiency
Bit Rate (Gbps) Carrier Spacing (GHz)
Spectral Efficiency (b/s/Hz)
10
50
0.2
10
33
0.3
40
50
0.8
40
33
1.2
100
100
1
100
80
1.25
100
50
2
100
40
2.5
18
QPSK
important in order to provide a seamless
spectr
inter-connection
with the rapidly growing
Submarine Cable System
on spe
from ocean to cloud
terrestrial 100Gbps systems. However,
mitiga
100Gbps signal has an inherent 4dB
To
andinc
to
•  Using OTN(G.709) !!
receiver sensitivity penalty with respect to
over le
thanks
of new
40Gbps as a result of the baud rate
Figureb
even
increase. Figure 5 shows the performance
impro
nonline
comparison of 40Gbps DP-QPSK signal
(a) NZ-DSF line
such
shapin
Fiber optics
and 100Gbps DP-QPSK signal over 7,000
superio
after 1
km
transmission
of
DMF
Fiber.
As
shown
100G
- Length
Spectrc
in this figure, the transmission distance of
distanc
enhan
extensi
100G
is
now
limited
to
4,000
km
due
to
- Characteristics
reduci
such
a
the above mentioned OSNR penalty.
penaltc
linear
Dispersion!
has
be
non-li
Q value (dB)
14
12
10
8
6
-4000
-3000
-2000
-1000
0
1000
2000
3000
4000
Dispersion [ps/nm]
Q Value [dB]
14
12
10
8
6
1535
1540
1545
1550
1555
1560
1565
Wavelength [nm]
(b) DMF line
Performance Margin
Q value
OSNR
Q value [dB]
Modulation
Figure
14
transmi
40G DP-QPSK
4: Transmission Performance of 40Gbps
DP-BPSK over 9,000 km
12
3
10
8
100G UPGRADES FOR LEGACY
CABLE SYSTEM
Capacity expansion using 100Gbps
wavelengths
is becoming of utmost
6
1000
3000
5000 to provide
7000
11000
important
in order
a9000
seamless
Transmission Distance [km]
inter-connection with the rapidly growing
Ref
: EC04_Poster_77
SubOptics2013
terrestrial
100Gbps
systems.
However,
Figure
5: Transmission
Performance
of
40Gbps
100Gbps
signal
inherent 4dB
DP-QPSK
andhas
100Gan
DP-QPSK
receiver sensitivity penalty with respect to
Optical Level
EFDA repeater
100G DP-QPSK
3.1
S
n
One of
mitigat
shows
QPSK
spectra
on spec
Fig
mitigat
and
19 to
thanks
100G Challenges
•  100G Coherent transceiver
Hard decision FEC
Operates with binary value
(1, 0, 1, ….)
EC
HD-F
SD-FEC
Soft decision FEC
Operates with Probabilities
(0.72, 0.32. 0.91….)
Bit Error Rate
–  Forward Error Correction
1. First Generation : Reed-Solomon FEC
2. Second Generation : Hard-decision FEC
3. Third Generation : Soft-decision FEC OSNR (dB)
20
Invention of Optical Fibre for Digital Coherent
NZDSF (non-zero dispersion Shifted Fibre)
long-wavelength
Traditional Optical Fiber
Km
short-wavelength
Uncompensated Fibre (Large Core)
New Submarine Cable
Km
21
Challenges – IP Layer
•  Traffic growth vs. CAPEX and OPEX reduction!!
–  L3 equipment are still expensive….40GE and 100GE
–  Maintenance service
•  10GE became standard Interfaces…
–  10GE access to Router directly or via switch?
•  Backbone capacity … n x 10G
– 
– 
– 
– 
Can your routers support 40 or 100GE with non-line blocking?
Line card of 40G/100G still so expensive
What is the forecast of international capacity growth?
Buy T4000 or CRS3???.......
•  No visibility of Layer0/1 transport layers
–  Pacnet is better position
•  One Engineering team look after all layers!!!
22
Next (ideal) Pacnet IP and Optical networks
IP MPLS
VLANs
over 100G
40G
DWDM
VLANs
SLTE
over 100G
DWDM
SLTE
DWDM
SLTE
GMPLS
OTU2/3/4/Flex
DWDM
SLTE
• 
• 
• 
• 
• 
• 
• 
DWDM
SLTE
3 x 10GE Subsea
OTN Domain
DWDM
SLTE
IP Core router connects to OTN equipment
OTN domain is virtually fully meshed
Multiple VLAN or PHY over 40GE / 100GE interfaces
Per VLAN goes to another POP using OTU frames
Flexible BW allocation per VLAN
Possibly RSVP-TE establish a path with BW, Protection, SRLG
MPLS-TP is also possible option within OTN Domain
23
THANKS
24

Download Report