Omneon MediaGrid Technical Overview www.harmonicinc.com Provided by Harmonic Inc.'s Platinum Reseller, DigitalGlue. www.digitalglue.com Introduction To MediaGrid www.harmonicinc.com Property Attributes Architecture Scale-out; MediaFS clustered file system Scalability 12TB to petabytes 375MB/s to tens of GB/s Linear, non-disruptive scaling Networking Ethernet – Both 10GBe and 1GbE Client Access File System Driver (FSD) NAS protocols (CIFS, FTP, NFS, AFP) High Availability No single point of failure Online maintenance Transparent recovery from hardware failures Application Integration Tested and optimized with dozens of leading media applications Provided by Harmonic Inc.'s Platinum Reseller, DigitalGlue. www.digitalglue.com MediaGrid Storage System Architecture and Key Components ü Clustered File System ContentDirectors File System Driver ContentServers Ethernet File Slice Storage File Slicing/Assembly File System Metadata www.harmonicinc.com Provided by Harmonic Inc.'s Platinum Reseller, DigitalGlue. www.digitalglue.com File System Driver Parallelizing Client Access FSD: a key enabler of the MediaGrid performance advantage Slicing/ Assembly File FSD For: Parallel access to slices www.harmonicinc.com Slices Provided by Harmonic Inc.'s Platinum Reseller, DigitalGlue. www.digitalglue.com File System Driver Maximizing Performance Variable slice size File Type Slice Size .ts 8MB .mov 2MB .aiff 512K .xyz 256K ü Can be configured based on file type and folder Optimizes performance for both small and large files! www.harmonicinc.com Intelligent Caching FSD Requested data (slice N) Slice N+1 Slice N+2 Slice N+3 Slice N+4 Slice N+5 Slice N+6 … ü Use client memory as a cache ü Great for sequential access Often enables performance levels of local storage! Provided by Harmonic Inc.'s Platinum Reseller, DigitalGlue. www.digitalglue.com MediaGrid I/O Flow ContentDirectors File System Directory File Slicing/Assembly Fi le cr ea te /o pe n/ clo se Slice Server – Data Read/Write FSD P rI e rv Se ap m rite w / ad e r ce i l es l i F Ethernet ContentServers www.harmonicinc.com RAID Groups Provided by Harmonic Inc.'s Platinum Reseller, DigitalGlue. www.digitalglue.com Other Clustered NAS Bottleneck prone and High Latency File System Meta Data Slice Storage File Slicing/Assembly Storage Nodes Ethernet Client NFS/CIFS NAS protocols don’t leverage distributed file systems www.harmonicinc.com Provided by Harmonic Inc.'s Platinum Reseller, DigitalGlue. www.digitalglue.com File System Driver Superior Single Client Performance ContentDirectors File System Driver ContentServers Ethernet File Slice Storage File System Metadata File Slicing/Assembly High bandwidth for a single client (>1GBs)) Consolidate to fewer and powerful servers (lower operational cost) Speed up workflows (ingest more streams, more transcode jobs, use uncompressed…) www.harmonicinc.com Provided by Harmonic Inc.'s Platinum Reseller, DigitalGlue. www.digitalglue.com File System Driver Add Clients Without Impacting Performance ContentDirectors File System Driver File System Driver ContentServers Ethernet File System Driver File Slice Storage File System Metadata File Slicing/Assembly Great aggregate bandwidth for multiple clients Add servers without worrying about performance impact Consistent latency with increasing client count www.harmonicinc.com Provided by Harmonic Inc.'s Platinum Reseller, DigitalGlue. www.digitalglue.com File System Driver No Fragmentation Issues as system fills up ContentDirectors File System Driver ContentServers Ethernet File Slice Storage File System Metadata File Slicing/Assembly Consistent performance at 10% full or 90% full No periodic defragmentation needed Improves operational efficiency www.harmonicinc.com Provided by Harmonic Inc.'s Platinum Reseller, DigitalGlue. www.digitalglue.com MediaGrid: Simple Ethernet Infrastructure Clients ü One network ü Simple, standard Ethernet LAN ü Integrated MediaFS file system ü Single vendor solution MediaGrid Storage www.harmonicinc.com Provided by Harmonic Inc.'s Platinum Reseller, DigitalGlue. www.digitalglue.com FC SANs: Complex And Expensive StorNext Clustered LAN Gateway StorNext LAN Clients StorNext Metadata controller ü Two networks $$ ü FC SAN HBAs $$ LAN ü HBA compatibility headaches SAN ü Need gateway if you cannot use HBA ü Different vendors for file system and storage SAN Storage StorNext SAN Clients www.harmonicinc.com Provided by Harmonic Inc.'s Platinum Reseller, DigitalGlue. www.digitalglue.com System Components ContentDirectors ü Deployed in failover pair ü 1U each ContentServers ü ü ü ü Dual controllers 1GbE or 10GbE 16 x 1, 2, or 3TB SATA Hot-swappable, 3U ContentStores (Cost-effective Scaling!) ü ü ü ü JBODs 0-5 per ContentServer 16 x 1, 2, or 3TB SATA Hot-swappable, 3U www.harmonicinc.com Provided by Harmonic Inc.'s Platinum Reseller, DigitalGlue. www.digitalglue.com Protection Against Drive Failures Advanced software RAID – Proven in 10 years of use with nonstop video servers Two RAID options – RAID 4 (2+1) for maximum performance – RAID 6 (6+2) for balanced capacity and performance Hot-swap failed drives – Spare drive available for RAID 4 Application I/O prioritized over rebuild I/O – Minimize performance impact during rebuilds www.harmonicinc.com Provided by Harmonic Inc.'s Platinum Reseller, DigitalGlue. www.digitalglue.com ContentServer Built in High Availability No single point of failure! ü Dual Hot-pluggable Power Supplies ü Dual active-active controllers ü Transparent failover www.harmonicinc.com Provided by Harmonic Inc.'s Platinum Reseller, DigitalGlue. www.digitalglue.com Campus-Level Disaster Recovery Synchronous Replications Under same file • Replicate across two groups of enclosures, physically separated but in a single file system • Groups can be up to 500M apart* • Active-active configuration Location 1 Benefit: Single File System, Replicated data • Instant, transparent failover upon site failures (fire, flood, power outage)! • Automatic failback and replication on recovery Group A www.harmonicinc.com Location 2 Group B Provided by Harmonic Inc.'s Platinum Reseller, DigitalGlue. www.digitalglue.com Thank You! www.harmonicinc.com Provided by Harmonic Inc.'s Platinum Reseller, DigitalGlue. www.digitalglue.com Optimized for Media File System tuned for media files and I/O – For Sequential access Qualified with dozens of media applications – Using the File System Driver – Performance tuning and sizing Add on Media Workflow Software – Media Application Server (Media Management and Automation) – MXFServer (Project Sharing and Collaborative Editing) www.harmonicinc.com Provided by Harmonic Inc.'s Platinum Reseller, DigitalGlue. www.digitalglue.com Qualified With Dozens Of Media Applications Ingest – – – – – – Spectrum/ MediaDeck ProMedia Capture Digital Rapids Amberfin iCR MOG SpeedRail EVS Editing – – – – – – Ingest Editing Apple Final Cut Pro Avid Media Composer Adobe Premiere Grass Valley Edius Autodesk Smoke MXFServer Transcoding Transcoding – ProMedia Carbon – Amberfin – Telestream www.harmonicinc.com QC QC – ProMedia QC – Interra Baton Archival Archival – – – – Atempo Front Porch Digital SGL Xendata Media Management Media Management – – – – Media Application Server MXF Server Ardendo Dalet Origin Serving Origin Serving – ProMedia Origin Server – Microsoft IIS – Adobe FMS Harmonic Provided byPartner Harmonic Inc.'s Platinum Reseller, DigitalGlue. www.digitalglue.com Edit Performance Industry-leading Edit-In-Place Seat Count Torture Timeline Edit Seat Count Testing – Edit playback performance/scalability with stringent timelines – Results using FCP, but applicable to Avid and Adobe as well 1x ContentServer 1xContentServer+1xContentStore Streams per Seat RAID 6 RAID 4 RAID 6 RAID 4 2x50Mb Streams 15 20 30 40 2x100Mb Streams 7 9 17 23 2x220Mb Streams 5 6 9 13 2x330Mb Streams 4 5 8 10 www.harmonicinc.com Provided by Harmonic Inc.'s Platinum Reseller, DigitalGlue. www.digitalglue.com AutoDesk Smoke on MediaGrid Smoke customers finally have an alternative to SANs! 2K/4K Editing – 10GbE clients Support for both uncompressed DPX and QT formats www.harmonicinc.com Provided by Harmonic Inc.'s Platinum Reseller, DigitalGlue. www.digitalglue.com 21 MXFserver Enabling Collaboration with Control Share project data between Editors – Avid MediaComposer, Apple Final Cut Pro and Adobe Premiere – MediaComposer style bin locking Control access to media – Restricts user access to authorized projects only • Prevent unauthorized users from corrupting, deleting source media files – Allows user’s rights to be managed • Allow browsing but not editing content • Restricts those who may delete media www.harmonicinc.com Provided by Harmonic Inc.'s Platinum Reseller, DigitalGlue. www.digitalglue.com Faster Transcoding With MediaGrid Promedia Carbon performance on MediaGrid: Relative Performance: MediaGrid vs. Isilon Up to 2.5X Isilon performance! www.harmonicinc.com Provided by Harmonic Inc.'s Platinum Reseller, DigitalGlue. *Both systems had same number of SATA drives www.digitalglue.com Optimized for Multiscreen Origin Storage MediaGrid optimized for Smooth and HLS Streaming – Qualified with Harmonic ProMedia Origin and Microsoft IIS – Consolidate to high performance shared storage – Server hundreds of streams per Origin Server MediaGrid www.harmonicinc.com Provided by Harmonic Inc.'s Platinum Reseller, DigitalGlue. www.digitalglue.com Media Application Server (MAS) Adding Media Intelligence to File System MAS is a Media Management Software Appliance that works with MediaGrid, Servers and 3rd Party storage Provides media awareness to files – Harness existing clip meta-data and add user meta-data – Organize and search content Manage file system operations – Purge old content – Mirror/Move files Trigger workflow tasks via API – – – – – Transcode (Rhozet) QC (Rhozet, Interra Baton) CC Extraction Archival (XenData, Quantum) Proxy Creation (IPV) www.harmonicinc.com Provided by Harmonic Inc.'s Platinum Reseller, DigitalGlue. www.digitalglue.com 25 MediaGrid Efficient Scaling Ethernet ContentServer ContentDirectors www.harmonicinc.com •4 Quad core CPU’s •24GB Memory •Up to 40Gb/s networking •16 Internal Drives Provided by Harmonic Inc.'s Platinum Reseller, DigitalGlue. www.digitalglue.com MediaGrid Efficient Scaling Ethernet ContentServer •4 Quad core CPU’s •24GB Memory •Up to 40Gb/s networking •16 Internal Drives ContentDirectors ContentStore •16 internal drives each •up to 5 ContentStores per ContentServer www.harmonicinc.com 2x24Gb SAS2 Provided by Harmonic Inc.'s Platinum Reseller, DigitalGlue. www.digitalglue.com MediaGrid Efficient Scaling ContentDirectors Ethernet ContentServers ContentStores www.harmonicinc.com Continue adding to linearly scale capacity and BW Provided by Harmonic Inc.'s Platinum Reseller, DigitalGlue. www.digitalglue.com MediaGrid Key Components Storage Nodes ü Building blocks for scaling ContentServer ContentStore Includes Storage and processing Storage only Rack Units 3U 3U Ethernet 12 x 1Gbe or 4 x 10Gbe Storage 16 x SATA2 Drives (1TB, 2TB, 3TB) 16 x SATA2 Drives (1TB, 2TB, 3TB) Reliability Dual Controllers Dual Power supplies Dual Controllers Dual Power supplies www.harmonicinc.com Provided by Harmonic Inc.'s Platinum Reseller, DigitalGlue. www.digitalglue.com ContentDirectors ü Stores file system structure (journaled) ü Serves file metadata ContentDirector High Performance ContentDirector Best For File count <1M, <500TB File count >1M, >500TB Rack Units 1U 1U Ethernet 4 x 1GbE 4 x 1GbE Storage 2 x 250GB SATA 2 x 1TB SATA and 300GB SSD RAM 12GB 32GB High Availability Redundant power supplies Redundant power supplies www.harmonicinc.com Provided by Harmonic Inc.'s Platinum Reseller, DigitalGlue. www.digitalglue.com ContentBridge Access via NAS Protocols ContentDirectors üCIFS üNFS üFTP ContentServers ContentBridge Ethernet FSD Ethernet ContentBridges for access via NAS protocols Scale protocol layer separately from backend storage www.harmonicinc.com Provided by Harmonic Inc.'s Platinum Reseller, DigitalGlue. www.digitalglue.com ContentBridge Specs For NFSv3, CIFS, and FTP Access ContentBridge High Bandwidth ContentBridge Rack Units 1U 1U Ethernet 2 x 1GbE 1 x 10GbE RAM 4GB 12GB High Availability Redundant power supplies Redundant power supplies www.harmonicinc.com Provided by Harmonic Inc.'s Platinum Reseller, DigitalGlue. www.digitalglue.com
© Copyright 2024 ExpyDoc
