40GE: Petabyte scale enterprise grade for demanding cloud

40GE: Petabyte scale enterprise grade for
demanding cloud applications
Ethernet Summit
4/16/15
/
Renu Raman, Aidan Shribman
e only with
Use this title slid
an image
Enterprise In Memory Clouds are Different
Enterprise InMemory Clouds
Traditional Clouds
1. 
Consumer
1. 
Large Enterprise
2. 
Web-scale apps
2. 
Mission Critical
3. 
Small Servers
3. 
Large Servers
4. 
Flash/Disk
4. 
RAM, RAM and RAM
5. 
Virtualized
5. 
Physical
©  2014 SAP AG or an SAP affiliate company. All rights reserved.
Early
Adopters
of Faster
Interconnects
Public
2
Networking/Interconnect trends
Standardizing Ethernet Speeds
TbE?
Link Speed (Gb/s)
1000
100
2.5x faster and
approaching 6X.
Gigabit Ethernet (GbE)
1
1G to 10G took 10 years
©  2014 SAP AG or an SAP affiliate company. All rights reserved.
10 GbE 10G
10
Growth Drivers/Limiters
2-3X cheaper per port
100 GbE
40 GbE 40G
0.1
1990
Ethernet Vs FC
400 GbE?
as
Fast Ethernet
1995
2000
2005
2010
2015
2020
© 2012 Ethernet Alliance
1
Tech Directions
Standards (Limiter)
Optics is around the
corner
Flash Adoption
SDN
Price/Perf
ECMP, VxLAN
Public
3
S4/HANA Enterprise Cloud Landscape (3 Tier Arch)
1.0
1.5
2.0
Cell 2
Arista 7048 Swh
CFM Server
Arista 7050 QX
Node-08
Node-07
Node-06
Node-05
T1
Node-04
T1
HUB
T1
spine
T1
T1
Shard Flash Array
T1
Node-03
Node-02
Node-01
SAP HANA Enterprise Cloud
Administration
4x10G -> 2x40GE -> 2x100GE
POD-DR (T2)
POD-B (T2)
POD-A (T2)
2x10GE -> 40GE
Archival (T3)
©  2014 SAP AG or an SAP affiliate company. All rights reserved.
POD-DR (T2)
Public
4
Design Re-think
Data Management (Tiers and Types) drives topology
T0
Primary Storage
Performance Tier
1. 
Adopt latest technologies (Flash,
NVM, PCIe, New Interconnects)
2. 
Performance optimized physical and
logical interfaces
3. 
Provide connectors to industry
standard media (logical and
physical)
Not Shared
T1
Persistence, Shared
HA/Recovery
T2
Management Tier
1. 
Adopt Industry standard interfaces
2. 
Handles DR, Global data store
3. 
TCO focus
Shared Globally
Hot
Warm
Cold
HA/DR/Archival
©  2014 SAP AG or an SAP affiliate company. All rights reserved.
Public
5
SAP Enterprise Cloud Networking Toplogy
SAP HANA
Cloud Platform
8x40GE
Spine
Spine
8x40G
E
Spine
8x40GE
Leaf #1
Leaf #2
Leaf #1
Leaf #1
Leaf #2
Leaf #2
2x40GE
#1
#2
#9
Rack #1
©  2014 SAP AG or an SAP affiliate company. All rights reserved.
#1
#2
#9
Rack #2
#1
#2
#9
Rack #3
Public
6
Storage: Key Use Cases
SAP Business
Suite
SAP Business
Warehouse
Customer
Apps
Services
SAP HANA
SAP IQ
Hadoop
Backup, DR
Store/Backup
Store/Backup
SAP HANA Cloud Platform
On-boarding
Cloud hosting
Custom
Services
Storage Pod
©  2014 SAP AG or an SAP affiliate company. All rights reserved.
Public
7
Typical Workflows
VLANs
202
20GB/s
5GB/s
10GB/s
20GB/s
HUB
HANA
VLANs
124, 202
10, 11, 12
SPOD
HDP
HANA
SPOD
VLANs
127, 202
10, 11
VLANs
128, 202
10, 11, 12
VLANs
129, 202
11, 12
VLANs
130, 202
11, 12
SW
SW
SW
SW
SW
40GbE
10GbE
SW
1GbE
©  2014 SAP AG or an SAP affiliate company. All rights reserved.
Public
8
3 ways to mount a Storage volume
Client
SPOD
-nfs-server
node-01
node-02
node-03
/spodmnt
NFSv3
-nfs- node-04
server
node-05
node-06
node-07
node-08
Relatively low performance, no deployment on client side needed
©  2014 SAP AG or an SAP affiliate company. All rights reserved.
Public
9
3 ways to mount a Storage volume
SPOD
Client
node-01
node-02
node-03
/spodmnt
NFS
v3
nfsserver
NFS Protocol
node-04
node-05
node-06
node-07
node-08
Higher performance, deployment procedure required
©  2014 SAP AG or an SAP affiliate company. All rights reserved.
Public
10
3 ways to mount a Storage volume
SPOD
Client
/spodmnt1
NFS
v3
nfsserver
NFS Protocol
node-01
node-02
/spodmnt2
NFS
v3
nfsserver
NFS Protocol
/spodmnt3
NFS
v3
nfsserver
NFS Protocol
node-03
node-04
node-05
/spodmnt4
NFS
v3
nfsserver
NFS Protocol
/spodmnt5
NFS
v3
nfsserver
NFSProtocol
node-06
node-07
node-08
Very high aggregate performance, deployment procedure and parallel I/O to different files
required
©  2014 SAP AG or an SAP affiliate company. All rights reserved.
Public
11
Storage POD Specifications
SPOD v1.0 Specification
--- System --Management Switch (1)
Rack Unit: 1U
Ports: 48 x 1G
Storage Switch (2)
Rack Unit: 1U
Ports: 36 x 40G
Management Node (1)
Rack Unit: 1U (Twin Unit)
1 Socket (WSM): 4 Core
2 DIMM Slots: 32 GB RAM
2 SAS Slots: 1 TB HDD
Storage Node (8)
Rack Unit: 4U
2 Socket (IvyBridge): 8 Core
8x32 DIMM Slots: 256 GB RAM
48x8 3.5” Slots: 384 TB HDD
©  2014 SAP AG or an SAP affiliate company. All rights reserved.
# of racks
1,2,3
Management Cloud API
OpenStack Manila API
Data Interface
FILE, NFSv3, HDFS
Availability
active-active
Replication
2+1
Encryption
Intel x86 AES
Compression
LZ4 (default), LZF, ZLIB
Snapshot’ing
supported
--- Rack --Power Intake
208v @ 30A (3-phase)
Outgoing Network
8 x 2 x 40G
--- Node --CPU
2 @ Intel Xeon E5-2600v2
Memory
256 GB
Storage
384 TB / 3 GBps / 5K IOPS
Network
2 x 40G
READ Throughput stream /
node / rack
400 / 2,400 / 10,000 MB/s
Public
12
Maching Disk Throughput to Network Throughput
1 x NIC
Board / QPI
2 x HBA
2x40 GbE
128G
DRAM
6 Gbps
SAS
2xIVB @
3.4
NVRAM
20xQPI
pair
CPU
8xPCI
8xPCI3.0
3.0
8xPCI 2.0
Rx
Tx
8xPCI 3.0
2x5=
10GB/s
3.4x4=
13GB/s
©  2014 SAP AG or an SAP affiliate company. All rights reserved.
2x4=
8GB/s
45 x HDD
4TB 3.5"
4TB 3.5"
4TB 3.5"
4TB 3.5"
4TB 3.5"
4TB 3.5"
4TB 3.5"
4TB 3.5"
45x0.15
= 7GB/s
Public
13
SPOD PoC READ Performance
Storage Performance, Read, BS=1M, Sequential, 8
Streams/Node
Throughput
Cluster aggregate
8000 MB/s
7500 MB/s
7000 MB/s
6500 MB/s
6000 MB/s
5500 MB/s
5000 MB/s
4500 MB/s
4000 MB/s
3500 MB/s
3000 MB/s
2500 MB/s
2000 MB/s
1500 MB/s
1000 MB/s
500 MB/s
MB/s
1 Node
Node average
2 Nodes
Stream average
3 Nodes
8 Streams
16 Streams
24 Streams
1
2
Node Scale-Out
3
©  2014 SAP AG or an SAP affiliate company. All rights reserved.
Public
14
Summary
1. 
Ethernet speed is growing faster than FC.
2. 
Ethernet provides flexibility in network topology to create different work
flows.
3. 
Price point (per port) of Ethernet is dropping faster than FC.
4. 
New media technologies (Flash) are first to attach with PCIe or Ethernet.
©  2014 SAP AG or an SAP affiliate company. All rights reserved.
Public
15
THANK YOU
© 2015 SAP AG or an SAP affiliate company.
All rights reserved.
No part of this publication may be reproduced or transmitted in any form or for any purpose without the express permission of SAP AG or an
SAP affiliate company.
SAP and other SAP products and services mentioned herein as well as their respective logos are trademarks or registered trademarks of SAP AG
(or an SAP affiliate company) in Germany and other countries. Please see http://global12.sap.com/corporate-en/legal/copyright/index.epx for additional
trademark information and notices.
Some software products marketed by SAP AG and its distributors contain proprietary software components of other software vendors.
National product specifications may vary.
These materials are provided by SAP AG or an SAP affiliate company for informational purposes only, without representation or warranty of any kind,
and SAP AG or its affiliated companies shall not be liable for errors or omissions with respect to the materials. The only warranties for SAP AG or
SAP affiliate company products and services are those that are set forth in the express warranty statements accompanying such products and
services, if any. Nothing herein should be construed as constituting an additional warranty.
In particular, SAP AG or its affiliated companies have no obligation to pursue any course of business outlined in this document or any related
presentation, or to develop or release any functionality mentioned therein. This document, or any related presentation, and SAP AG’s or its affiliated
companies’ strategy and possible future developments, products, and/or platform directions and functionality are all subject to change and may be
changed by SAP AG or its affiliated companies at any time for any reason without notice. The information in this document is not a commitment,
promise, or legal obligation to deliver any material, code, or functionality. All forward-looking statements are subject to various risks and uncertainties
that could cause actual results to differ materially from expectations. Readers are cautioned not to place undue reliance on these forward-looking
statements, which speak only as of their dates, and they should not be relied upon in making purchasing decisions.
©  2014 SAP AG or an SAP affiliate company. All rights reserved.
Public
17
© 2015 SAP AG oder ein SAP-Konzernunternehmen.
Alle Rechte vorbehalten.
Weitergabe und Vervielfältigung dieser Publikation oder von Teilen daraus sind, zu welchem Zweck und in welcher Form auch immer, ohne die
ausdrückliche schriftliche Genehmigung durch SAP AG oder ein SAP-Konzernunternehmen nicht gestattet.
SAP und andere in diesem Dokument erwähnte Produkte und Dienstleistungen von SAP sowie die dazugehörigen Logos sind Marken oder
eingetragene Marken der SAP AG (oder von einem SAP-Konzernunternehmen) in Deutschland und verschiedenen anderen Ländern weltweit.
Weitere Hinweise und Informationen zum Markenrecht finden Sie unter http://global.sap.com/corporate-de/legal/copyright/index.epx.
Die von SAP AG oder deren Vertriebsfirmen angebotenen Softwareprodukte können Softwarekomponenten auch anderer Softwarehersteller enthalten.
Produkte können länderspezifische Unterschiede aufweisen.
Die vorliegenden Unterlagen werden von der SAP AG oder einem SAP-Konzernunternehmen bereitgestellt und dienen ausschließlich zu Informationszwecken. Die SAP AG oder ihre Konzernunternehmen übernehmen keinerlei Haftung oder Gewährleistung für Fehler oder Unvollständigkeiten in
dieser Publikation. Die SAP AG oder ein SAP-Konzernunternehmen steht lediglich für Produkte und Dienstleistungen nach der Maßgabe ein, die in der
Vereinbarung über die jeweiligen Produkte und Dienstleistungen ausdrücklich geregelt ist. Keine der hierin enthaltenen Informationen ist als zusätzliche
Garantie zu interpretieren.
Insbesondere sind die SAP AG oder ihre Konzernunternehmen in keiner Weise verpflichtet, in dieser Publikation oder einer zugehörigen Präsentation
dargestellte Geschäftsabläufe zu verfolgen oder hierin wiedergegebene Funktionen zu entwickeln oder zu veröffentlichen. Diese Publikation oder
eine zugehörige Präsentation, die Strategie und etwaige künftige Entwicklungen, Produkte und/oder Plattformen der SAP AG oder ihrer Konzernunternehmen können von der SAP AG oder ihren Konzernunternehmen jederzeit und ohne Angabe von Gründen unangekündigt geändert werden.
Die in dieser Publikation enthaltenen Informationen stellen keine Zusage, kein Versprechen und keine rechtliche Verpflichtung zur Lieferung von
Material, Code oder Funktionen dar. Sämtliche vorausschauenden Aussagen unterliegen unterschiedlichen Risiken und Unsicherheiten, durch die
die tatsächlichen Ergebnisse von den Erwartungen abweichen können. Die vorausschauenden Aussagen geben die Sicht zu dem Zeitpunkt wieder,
zu dem sie getätigt wurden. Dem Leser wird empfohlen, diesen Aussagen kein übertriebenes Vertrauen zu schenken und sich bei Kaufentscheidungen
nicht auf sie zu stützen.
©  2014 SAP AG or an SAP affiliate company. All rights reserved.
Public
18

Download Report