IBM Network Virtualization Li Fei IBM PureFlex ATS (GCG) May 15th, 2014 1 © 2014 IBM Corporation Agenda State of the industry IBM VMready™ PureFlex vNIC 3 Mode 2 © 2014 IBM Corporation Impact of Server Virtualization Optimally utilized servers Fluid, dynamic, just in time server provisioning Easier Maintenance, HA Foundation technology for Cloud computing Server virtualization does not happen in isolation 3 © 2014 IBM Corporation Server Virtualization Impact In addition to compute resources, each VM needs • Network resources • Storage resources Each VM is a server entity in the network More server entities for the same square footage of servers More VM servers installed than physical servers 4 © 2014 IBM Corporation Server Virtualization Challenges in Data Center Networks Identify and track virtual machines in the network Apply per VM network configuration and policies Make network adaptive to the dynamic movement of VMs Management of large number of VMs in the network – virtual & physical Proliferation of unmanaged invisible virtual switches High bandwidth requirement to meet I/O load from VMs Network Engineers lack tools to troubleshoot VM traffic 5 © 2014 IBM Corporation The Network is getting in the way of large scale server virtualization! 6 © 2014 IBM Corporation Agenda State of the industry IBM VMready™ PureFlex vNIC 3 Mode 7 © 2014 IBM Corporation Challenges in Virtualization-Unaware Networks Cannot identify and track virtual machines (VM) in the network Cannot manage VM network configuration and policies Cannot adapt to the live migration of VMs No VM troubleshooting information Network administrators are blind to VMs but are expected to provide connectivity and troubleshooting of VMs in the network VMready: Hypervisor-independent Easily deployable Makes the network VM-aware 8 © 2014 IBM Corporation Physical Data Center Networking Server Server Server 10G 10G 10G physical ports 10’s of Physical ports Traditional Switches One OS per server • Remember when life was simple(r)? • Port based network configuration for servers • One Port – One network configuration Multiple VMs per server – life gets complicated • Port based network configuration does not work for VMs • Can’t separate VM traffic, can’t manage • VM mobility causes connectivity issues and security risks 9 © 2014 IBM Corporation VMready – Virtual Machine aware networking Server Server Server 10G 10G 10G v-ports 1000’s of Virtual ports VM-Aware Switches Virtual ports are the new switching unit • Fully aware of Virtual Machines • Configuration per virtual port • Automated Network mobility • Configuration follows Virtual Machines in real-time • Enables Multi-Tenancy 10 © 2014 IBM Corporation VMready Integration with VMware vCenter Virtual Machine 1 G1 G2 Virtual Machine 3 Virtual Machine 2 Virtual Machine 4 Virtual Switch Virtual Switch ESX 1 hypervisor ESX 2 hypervisor VM1, VM3 IBM VMready Switch VM2, VM4 vCenter server Integrates with VMware vCenter Seamless management of physical switch and VMware vSwitch Automatically creates port groups on ESX vSwitches Ensures VM network settings are consistent across virtual and physical networks Single pane of management of VMware vSwitches from IBM physical switches 11 © 2014 IBM Corporation VMready功能全景(一) 虚端口 普通交换机只明白物理端口和物理服务器 • 控制基于每个物理端口/物理服务器 • 配置基于每个物理端口/物理服务器 12 VMReady™ 交换机明白”v-ports“ • v-ports: v-NICs, vHBAs, MQ-NIC • 控制基于每个v-ports • 配置基于每个v-ports © 2014 IBM Corporation VMready功能全景(二) 1. 2. 3. 对每一个虚机或虚机组建立一个虚端口,端口的配置包括VLANs, ACLs, QoS 等. 虚端口配置通过API与 vSwitches同步(VMware环境) 当虚机迁移时,其虚端口随之迁移即实施nMotion • 虚机始终保持其原有的通信和安全状态 VM 1 VM 2 VM X Virtual Switch 2 Virtual Switch Virtual port VLAN 100 ACL filters TX/RX limits Virtual port VLAN 100 ACL filters TX/RX limits 1 VMready Switch 13 2 3 VMready Switch © 2014 IBM Corporation VMready功能全景(三) 实现数据中心范围内的虚机感知网络 vSwitch vSwitch Policy Policy VI A Browser SNEM BHM DB Central Policy DB - Domain Definitions - Switches - Hypervisors - VM Groups - VM Groups - Port Group - VLAN - Virtual Machines - Etc 14 PI VM Mgmt Server (eg. VMWare vCenter) vSwitch Policies Switch Switch Policy Policy ESX Hosts ESX Hosts SNMP SSH/CLI B B SP L/A SP L/A MB MB A MS Stacking 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 10101 Reset Mgmt A MS Stacking 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 10101 Reset Mgmt © 2014 IBM Corporation VMready领先地位 第一个为服务器虚拟化提供网络虚拟化解决方案 • 2009年2月VMready第一代和第二代产品发布 • 2010年8月VMready第三代产品发布 唯一提供基于交换机(Switch-based)的网络虚拟化解决方案 功能全部在交换机实现 • 不需要额外的服务器 • 不在Hypervisor上安装任何软件 支持所有虚拟化软件—即VMready是中性的 VMware, Hyper-v, Xen, PowerVM, Oracle… 支持Vmready的IBM交换机有:所有的机架交换机、所有的Flex System 交换机,所有带有万兆端口的BladeCenter交换模块 15 © 2014 IBM Corporation VMready功能概述 发现虚机(discover VMs) 对虚机进行分组(grouping VMs) 通过组对VM进行策略控制:VLAN,ACL,QoS 当VM进迁移时,策略随之迁移,动态同步,实现一次配置,永远生效 与VMware VI-API集成,实现集中管理物理交换机和vSwitches 对虚机进行临控和统计 与IBM 网管软件SNEM结合 • 实现集中的数据库—存储、管理VM配置 • 实现数据中心范围内的部署 实现整个数据中心虚机感知网络 16 © 2014 IBM Corporation VMready作用 使网络中的VMs可视化,以便管理员对虚机进行不同水平的配置和监视 • 提供对虚机可视化 • 提供对Hypervisor/Host可视化 对VMs进行管理 • 也可对单个VM进行一些特殊管理如QoS 由于与VMware VI-API进行集成 • 管理员只在物理交换机上配置,使物理交换机与vSwitch统一 • 减少工作负担 • 避免手工操作上的失误 17 © 2014 IBM Corporation Agenda State of the industry IBM VMready™ PureFlex vNIC 3 Modes 18 © 2014 IBM Corporation IBM System Networking - Bringing speed and intelligence to the edge of the network™ Legacy Adapter&Virtual Fabric Architecture Traditional Networking Production Network DMZ VM Network Console Network Vmotion Network Emulex Virtual Fabric Adapter 10GbE Pipe 5Gbps Production Network 3.9Gbps 100Mbps 1Gbps DMZ VM Network 5Gbps Console Network 3.9Gbps Vmotion Network 100Mbps 1Gbps 19 19 © 2014 IBM Corporation vNIC1 (Virtual Fabric Mode) with and without FCoE © 2014 IBM Corporation vNIC1 – Virtual Fabric Mode Available on; EN4093, CN4093, G8124, G8264/T, G8264CS (Switch aware) xNode 1 LoM or CN4054 pNode 3 CN4058 xNode 4 LoM or CN4054 vNIC 1-4 pNIC pNIC pNIC pNIC vNIC 1-4 vNIC Switch Port INTA INTB INTA INTB vNIC Switch Port vNIC Group 1 Uplink Port(s) 21 pNode 2 CN4058 FCoE VLAN 1001/1002 Uplink Port(s) vNIC Group 3 vNIC Group 4 Uplink Port(s) Uplink Port(s) © 2014 IBM Corporation vNIC1 – Pro’s and Con’s Pros: • • • • • Provides multiple vNIC’s to INTEL Nodes Works with pNodes in pNIC Mode only Ease of Management with VLAN Agnostic Mode (EasyConnect) Bandwidth and vNIC’s managed on the Switch Works with FCoE and FIPS Snooping Switch Switch EN/CN4093 EN/CN4093 Cons: • • • • Can only work in Dedicate Uplink Mode Requires separate uplink or Port Channel for each vNIC Group (Cable Management nightmare) Does not work with vLAG Forces separate uplink for FCoE (VLAN 1001 (SAN A) / 1002 (SAN B) recommended) Node Chassis Summary: • 22 Not the best option if you’re looking for cable consolidation © 2014 IBM Corporation vNIC2 (Switch Independent Mode) with and without FCoE © 2014 IBM Corporation vNIC2 – Switch Independent Mode Available on; All Switch Modules supported (Switch unaware) xNode 1 LoM or CN4054 pNode 2 CN4058 pNode 3 CN4058 xNode 4 LoM or CN4054 vNIC 1-4 Legacy NIC Legacy NIC vNIC 1-4 Legacy Switch Port Legacy Switch Port Legacy Switch Port Uplink Port(s) 24 Legacy Switch Port FCoE Support © 2014 IBM Corporation vNIC2 – Pro’s and Con’s Pros: • • • • • • Provides multiple vNIC’s to INTEL Nodes Works with pNodes in pNIC Mode only Works with Layer 2/3 Switch and EasyConnect Modes Works with vLAG across Switches (if supported) Works with FCoE and FIPS Snooping Works with IBM and non-IBM Switches • Switch SI/EN/CN4093 Cons: • Switch vNIC’s managed from the host, requires reboot to make changes to vNIC including bandwidth manipulation Bandwidth guaranteed only on transmit SI/EN/CN4093 Node Summary: • 25 Probably the not the best option as vNIC’s have to be managed through the uEFI and no current option to make changes on the fly Chassis © 2014 IBM Corporation UFP (Unified Fabric Port) Mode with and without FCoE © 2014 IBM Corporation Switch Characteristics of UFP Virtual Ports Virtual ports (vports) are accessed and displayed in the switch as PORT.VPORT (i.e. INTA2.1 or INTA2.2) where the VPORT is .1 thru .4 vPorts can be defined as one of 4 modes: • Access Port – the vPort is configured with no VLAN tagging and can only carry a single default PVID VLAN - The default VLAN for all vPorts on the same physical port must be unique • Trunk Port – the vPort can carry multiple tagged VLANs and must be added as members to the appropriate VLANs - The default VLAN must be unique across all vPorts on the same physical port - Trunk vPorts unique VLAN memberships (i.e. cannot have VLAN 10 on vport INTA2.1 and INTA2.2) • Tunnel Port (EasyConnect) – the vPort is a Q-in-Q tunnel - The default tunnel VLAN must be unique across all vPorts on the same physical port - A Q-in-Q tunnel must be created thru the switch (i.e. 4091-4094 as an example) • FCOE – Carries FCOE traffic - Only vPort 2 can be assigned as FCOE, this is an Emulex NIC hardware/firmware restriction (vport .2 can be configured as modes other than FCOE) 27 Note: the UFP vports (intA1.1 --intA1.4) default vlans MUST be unique and different than the switch default©vlan 2014 IBM Corporation UFP (vPort with Tunnel, Access and Trunk Mode options) Available on; EN4093 and CN4093 xNode 1 pNode 2 xNode N UFP NIC pNIC pNIC pNIC pNIC UFP NIC UFP Switch Port INTA INTB INTA INTB UFP Switch Port Trunk Mode MGMT/vMotion Access Mode FCoE VLAN 1001/1002 Uplink Port(s) 28 pNode 3 Access Mode Backup … Tunnel Mode (Easy-Connect) VM Data Uplink Port(s) © 2014 IBM Corporation UFP – Pro’s and Con’s Pros: • • • • • • Provides multiple vNIC’s to INTEL Nodes Works with pNodes in pNIC Mode only Works in Layer 2/3 and EasyConnect Mode Works with vLAG for Active/Active and Active/Passive (choice) Works with FCoE and FIPS Snooping Overcomes vNIC1/vNIC2 limitation of only one vNIC group per uplink or port channel Management of vPorts with vLAG consists of an understanding of how it all works to properly design and configure access, trunk and tunnel modes Summary: • Best option if vNIC’s is a requirement • Provides for the greatest flexibility across both the EN4093 and CN4093 29 SAN B ToR Switch ToR Switch LACP CN4093 Cons: • SAN A CN4093 Node Chassis © 2014 IBM Corporation Feature Description Platform UFP vNIC Support for 4K Inner VLAN’s on each vNIC Yes (Configure vNIC mode in “tunnel” mode) Yes Switching based on outer VLAN Yes (Configure vNIC mode in “tunnel” mode) Yes Configure Inner VLAN on vNIC Yes (Configure vNIC mode in “802.1q-trunk” mode) No Switching based on Inner VLAN Yes No Uplink shared by vNICs within a physical port Yes No Sharing unused bandwidth across vNICs Yes No vNIC association with ETS traffic class Yes No Special multicast traffic class Yes No Shaping (Better since it smooth out traffic flow) Policing (Drop packets during burst) vNIC bandwidth Min/Max separate control Yes No Access list for customer VLAN Yes No Support for FCoE on one vNIC Yes Yes (CEE only) vNIC bandwidth control mode Inner VLAN = Customer VLAN (a VLAN that will be defined by the customer) Outer VLAN = Q-n-Q VLAN (a VLAN created to tunnel inner VLAN’s through the Switch 30 © 2014 IBM Corporation SPAR (Switch Partitioning) with and without FCoE © 2014 IBM Corporation SPAR (Local Domain (Layer 2/3 Switch Mode)) Available on; SI4093, EN4093 and CN4093 xNode 1 LoM or CN4054 pNode 2 CN4058 pNode 3 CN4058 xNode 4 LoM or CN4054 vNIC2 1-4 pNIC pNIC pNIC Legacy Switch Port Legacy Switch Port Legacy Switch Port VLAN 200 32 VLAN 200 FCoE VLAN VLAN 100 Legacy Switch Port FCoE VLAN VLAN 100 SPAR 1 SPAR 2 Uplink Port(s) Uplink Port(s) © 2014 IBM Corporation SPAR (Pass-Through Domain (EasyConnect)) Available on; SI4093, EN4093 and CN4093 Note: SI4093 default configuration is using SPAR 1 on ALL Ports xNode 1 LoM or CN4054 pNode 2 CN4058 pNode 3 CN4058 xNode 4 LoM or CN4054 vNIC2 1-4 pNIC pNIC pNIC Legacy Switch Port 33 Legacy Switch Port Legacy Switch Port Legacy Switch Port VLAN Agnostic Supports FCoE VLAN Agnostic Supports FCoE SPAR 1 SPAR 2 Uplink Port(s) Uplink Port(s) © 2014 IBM Corporation SPAR – Pro’s and Con’s Pros: • • • • • • Provides for separation of Partitions when wanting Layer 2 separate of SAME VLAN’s within Same Switch. Example includes Multi Tenant environments for securing between layer 2 broadcast domains. Simple to no configuration required No Spanning Tree support LACP with loop protection support Support both pNIC and vNIC2 Up to 8 SPARS per Switch Supported Switch Switch SI/EN/CN4093 SI/EN/CN4093 Cons: • • No vLAG Support Single uplink port or Port Channel for each domain only Summary: • • 34 Best option for customers looking for a plug in play Switch (i.e. SI4093 in Pass-Through domain) Best option with customers looking for multi tenant solution where same VLAN’s span across multiple customers/domains. Node Chassis © 2014 IBM Corporation Thank you! Li Fei IBM PureFlex ATS (GCG) 35 © 2014 IBM Corporation
© Copyright 2025 ExpyDoc