Looking Beyond Platforms – Scale out NAS in the SDS World

Looking Beyond Platforms – Scale out
NAS in the SDS World
Karthik Ramamurthy
Group Product Manager, EMC
Santa Clara, CA USA
November 2014
1
Unstructured Data Growth
Total Capacity Shipped, Worldwide
Unstructured Data
80%
74%
67%
2013
2015
2017
37 EB
71 EB
133 EB
By 2020, over 30 billion connected devices will be exchanging more than 44 Zettabytes of
data1
1Source:
IDC Structured vs. Unstructured Data: The Balance of Power Continues to Shift, Mar, 2014
2Source:
IDC / EMC storage study, 2014
Industry Trends
Industry and Customer Trends
Consolidation through
virtualiztion
•
•
Virtualization continues to drive
consolidation
•
Ability to power public cloud
resident workloads
•
Not all workloads need internal
IT systems
•
Source directly from ODMs
•
Leveraging SW IP from branded
resilient storage software
Cloud vendors providing a
platform for all workloads
Storage as a part of
virtualization
consolidation
Value Migration
OEM and BYOH
New deployment models
Non-virtualized, Open
Standard Platform
From
To
From
To
Server
virtualization +
storage systems
Software defined
data center
Internal IT for all
workloads
Value driven IT
investments
Vendor specific
compute &
storage
hardware
ODM driven,
open standard
compute
hardware
Storage
hardware
driven
innovation
Storage
Software driven
innovation
Industry Trends
Industry and Customer Trends
OEM and BYOH for
on-prem IT
Consolidation through
virtualiztion
•
Source directly from ODMs
•
Leveraging SW IP from branded
resilient storage software
•
Virtualization continues to drive
consolidation
All of• these
require
Enables mobility to cloud
New deployment models
•
Not all workloads need internal
IT systems
•
Cloud vendors providing a
platform for all workloads
environments
• A resilient software infrastructure
• Enterprise services like predictability and data protection
• Open
AndStandards,
the ability to scale to meet data Virtualization
growth
/Cloud
Value Migration
non-virtualized
From
To
From
To
Vendor specific
compute
hardware
ODM driven,
open standard
compute
hardware
Server
virtualization +
storage systems
Software defined
storage systems
Internal IT for all
workloads
Value driven IT
investments
Storage
hardware
driven
innovation
Storage
Software driven
innovation
TRADITIONAL WORKLOADS
NEXT-GEN WORKLOADS
DAS
NAS
File Shares
Analytics
Isilon
Scale-Out
Data Lake
SAN
CLOUD
Mobile
HPC
TAPE
OBJECT
Cloud Apps
Backup/Archive
© Copyright 2014 EMC Corporation. All rights reserved.
5
Next-Gen Access Methods
FILE
File Shares
Analytics
FILE
HPC
Mobile
Cloud Apps
Backup/Archive
© Copyright 2014 EMC Corporation. All rights reserved.
6
EMC Isilon Scale-Out NAS Architecture
NFS
SMB
HTTP
FTP
Clients and Applications
HDFS
for
Hadoop
RESTful API
GET PUT POST DELETE
Gig-e
10 Gig-e
Network
Single FS / Volume
Protocols
REST
for Object
Multi-Protocol
Client/Application
Layer
Ethernet Layer
OneFS Operating
Environment
Intra-cluster
Communication
Evolution to software defined storage
EMC Isilon NAS
Software Defined Data Center
Software defined OneFS
• Proven storage OS
with OneFS and
enterprise data
services
• High-utilization
storage architecture
• Deploy on
commodity
hardware
• Support resource
pooling and service
orchestration
• Eliminates silos of
storage
• Provides platform
flexibility
• Makes it simple to
deploy
• Gives control back to
the user
8
Software OneFS
Flexibility and choice for storage appliance hardware
NFS / SMB/ HTTP / HDFS / Swift / etc.
Network
OneFS Storage OS
Storage I/O
HDD
HDD
HDD
HDD
SSD
Storage Controller
SSD
• Standardize data center
deployments
• Error protection and
disks control provided by
OneFS
• Flexible network
technologies for node
connections
• Native HDFS protocol
support
• OpenStack Swift API for
Object over File support
OneFS to enable new deployments
Agility with hyper-converged architecture
vOneFS VM
User VM(s)
VM LAN
Hypervisor
Storage I/O
HDD
HDD
HDD
HDD
SSD
Disk Controller
SSD
• Deploy over standard
virtualized
infrastructure
• Utilize existing or new
hardware
• Error protection and
disks control provided
by OneFS
• Low latency access
for converged
applications
Leading NAS solution in a softwaredefined world
Flexibility
• Deploy anywhere over standard hardware
• Utilize existing or new hardware with DAS
Expand file service
offerings
• Persistent storage services close to the application
• Deliver differentiated end-customer file services
• Enhance end-customer edge performance
Turn Big Data into
Big Insights
• No single points of failure
• High storage efficiency and utilization
• Full support for enterprise-class EMC Isilon data services
Santa Clara, CA USA
November 2014
12