Slides

Demystifying 40 Gigabit Ethernet
Physical Layer Interfaces
in Data Centers
Rita Horner
Synopsys
Santa Clara, CA USA
April-May 2014
1
Evolution of Ethernet Speeds
Data Rate
(Mbps)
10 Gigabit
Ethernet
100,000
10,000
40 GE
(4x10 GE)
Gigabit
Ethernet
1000
FDDI
100 GE
(10x10 GE)
100 GE
(4x25 GE)
Fast
Ethernet
100
Ethernet
10
1
1980
Santa Clara, CA USA
April-May 2014
1990
1995
1998
2002
2010
2014
2
Different Interfaces in a Chassis
1.
2.
3.
Chip-to-Chip Port side
Chip-to-Module (direct)
Chip-to-Backplane
2
3
1
2
3
1
2
1
3
Santa Clara, CA USA
April-May 2014
3
Evolution of 10 GE Port Side
Aggregated 10 GE (XAUI)  Serial 10 GE
 IEEE 802.3ae-2002 – 10 Gigabit Ethernet supporting both
port side and backplane using aggregated XAUI (3.125 Gbps
per lane in a x4 configuration) with 8b/10b encoding
10 GE Module form factor migration
Gen1
300 pins
16-lanes XSBI
X2
Gen2
4-lanes XAUI
Xenpak
4-lanes XAUI
XFP
1-lane 10G XFI
Modules with Gearbox, a.k.a. MUX/De-MUX
2000
Santa Clara, CA USA
April-May 2014
2001
2002
2003
Gen3
2004
SFP+
1-lane 10G SFI
Module with Retimer
2005
2006
2007
Un-retimed
2008
2009
4
10GE Port Side Module Interfaces
Size Reduction Requires Power Reduction
Port
ASIC
4x
3.125 Gbps
SerDes
PHY
4
XAUI
4
Port
ASIC
4
4x
3.125 Gbps
Gearbox
XFI Retimer
XAUI
SerDes
(4:1)
PHY
4
Port
ASIC
Santa Clara, CA USA
April-May 2014
XENPAK
Gearbox
or
(4:1)
X2
XFP
10 GE
SFP+
10 GE
10 GE
10.3 Gbps
SerDes
10 GE Retimer 10 GE
PHY
XFI
10 GE
SFI
5
Evolution of Port Densities
10GE  40GE
Single row 24 x 10 GE SFP+ ports  240 Gbps
Two rows 48 x 10 GE SFP+ ports  480 Gbps
Single row 4 x 40 GE CFP ports  160Gbps
Single row 12 or 16 x 40 GE QSFP ports  480 to 640 Gbps
Two rows 12 or 16 x 40 GE QSFP ports  960 to 1280 Gbps
Santa Clara, CA USA
April-May 2014
6
40GE Port Side Module Interfaces
Size Reduction Requires Power Reduction
Port
ASIC
Port
ASIC
4
4x
10.3 Gbps
SerDes
PHY
CFP
40 GE
4x
10.3 Gbps
40 GE Retimer 40 GE
SerDes
PHY
QSFP
40 GE
4x
10.3 Gbps
SerDes
PHY
QSFP
40 GE
4
Santa Clara, CA USA
April-May 2014
Retimer
XLAUI
Port
ASIC
Retimer
XLAUI
XLPPI
40 GE
XLPPI
7
Different Interfaces in a Chassis
1.
2.
3.
Chip-to-Chip Port side
Chip-to-Module (direct)
Chip-to-Backplane
2
3
1
2
3
1
2
1
3
Santa Clara, CA USA
April-May 2014
8
10GE and 40GE Interfaces
Port Side
Rate Interface
Electrical
10 GE
Module
types
Electrical
40 GE
Module
types
Santa Clara, CA USA
April-May 2014
Chip-to-Chip
Backplane
Chip-to-Module
Fiber Optic
Fiber Optic
Copper
XFI
SFI (limiting & linear)
SFI linear
SFP+, 10GBASE-SR SFP+, DAC
XFP, 10GBASE-SR
SFP+, 10GBASE-LR
(Direct
XFP, 10GBASE-LR
SFP+, 10GBASE-LRM Attached
XFP, 10GBASE-ER
SFP+, 10GBASE-ER
Copper)
XLAUI
XLPPI
CFP, 40GBASE-SR4 QSFP, 40GBASE-SR4
QSFP,
CFP, 40GBASE-LR4 QSFP, 40GBASE-LR4 40GBASECFP, 40GBASE-ER4 QSFP, 40GBASE-ER4
CR4
10GBASE-KR
-
40GBASE-KR4
-
9