LIBRARY: Tutorials Reviews Interviews Editorials Features Business Authors RSS Feed

Fast Enough? Data-Driven Broadcast Infrastructure

COW Library : SAN - Storage Area Networks : Bob Zelin : Fast Enough? Data-Driven Broadcast Infrastructure
FAST IS NEVER FAST ENOUGH

Two terabyte drives are now commonplace and inexpensive, so 8 bay drive arrays with 16 terabytes of storage, and 16 bay arrays with 32 terabytes of storage, were everywhere, and everyone was talking about arrays currently running 600 - 800 Mb/sec -- fast enough not only for uncompressed HD, but for 2K and 4K media. But as always, fast is never fast enough, so JMR was showing their split bus drive arrays that are like having two drive arrays in one box, with two SAS/SATA host controller cards -- one running each bus -- to achieve speeds of 1200 - 1400 Mb/sec. Real fast!

The big "speed" story was the announcement of 6 Gig drive technology, and 6 Gig support products, like the new ATTO R680 card. I was told at the ATTO booth that they estimate that a typical 6 Gig, 16 bay drive chassis with the new R680 card will probably do about 2200 Mb/sec. Why is this important when 2K DPX files only require about 300Mb/s? Shared storage, that's why!

There are lots of fantastic shared storage solutions on the market, but many are limited by the speed of the data connection per client computer, or the overall speed of the drive array. For example, at the Maxx Digital booth, I demonstrated uncompressed 2K DPX files running Autodesk Smoke on a Mac, over 10 Gig Ethernet cable to a shared disk drive array.

It worked, and it was impressive -- but it is a fantasy, because common drive arrays commonly run between 600 - 700 Mb/sec., enough for two guys to work at 300MB/s, tops. What if you want to attach more people? Your drives are not fast enough, and cannot support that many streams of video. Once drive arrays can do 2200Mb/sec, all of a sudden, an entire small company can be running uncompressed 2K media over shared storage, and not spending a fortune to make this happen.

While 6 Gig SAS/SATA host adaptors and drive arrays will be released in a couple of months, it may take till the end of 2010 for us to see 6 Gig SATA drives. This can be achieved now with SAS drives, but they are expensive, and as we all know too well, no one wants to spend too much money now, with all the new stuff coming out in a few months.

Many of the drive manufacturers like Rorke, JMR, and Sonnet were "ATTO FastStream" crazy. They were all promoting "instant shared storage" based on the fact that they incorporate the ATTO FastStream appliance into their drive arrays, which allows you to have shared storage without a server or fibre switch.

ATTO FibreConnect.
ATTO FibreConnect™


JMR FibreStream RAID Storage System.
JMR FibreStream RAID Storage System


But all of your computers must have fibre cards, fibre transceivers back to the ATTO FastStream in their drive arrays, and of course SAN management software (like Tiger Technology MetaSAN or Commandsoft FibreJet) running on each workstation. CalDigit showed a truly unique shared storage solution that used their new PCIe switch and PCIe hub.


CalDigit SuperShare.
CalDigit SuperShare


Because their drive arrays, such as the HDPro2, do not daisy chain for expansion, all the drives go into the hub, and you keep adding more and more drives to the hub as you expand. The hub ties to the switch, so that you can now connect multiple FCP systems to the switch via PCIe expansion cards. Using the PCIe switch allows you run at full uncompressed speeds, as you are not limited to the bandwidth of Ethernet.

As you look at these shared storage systems, and see the future of uncompressed HD, 2K and 4K workflows becoming a reality for many of us in the near future, you realize that having very fast drive arrays will become not a luxury, but a necessity to stay in business.



Comments

Re: Fast Enough? Data-Driven Broadcast Infrastructure
by Bob Zelin
Ryan -
please post your question on a regular Cow forum, like SAN networks, or Arrays and Storage.

I don't understand your question.

Bob Zelin

Re: Fast Enough? Data-Driven Broadcast Infrastructure
by Ryan Wu
has anyone used this copying to RAIDs.
I'd love to get this and put it through it's paces on a feature right now shooting with ARRI SxS cards.

Cus the Sony usb 2 reader is really inadequate for a multicamera show.

Anybody used this in the real deal yet?
Ready to drop some cash on it if it can handle the work via my 17" MBP.
Re: Fast Enough? Data-Driven Broadcast Infrastructure
by Loch Phillipps
Mr. Z - We miss you in the NY area. Nice to see that you still have that crazy energy that keeps you surfing the tech wave rather than trying to catch up like the many of us.

Loch Phillipp
Off Ramp Films
Re: Fast Enough? Data-Driven Broadcast Infrastructure
by Mike Cohen
That Qio device is interesting - combining P2 and SxS in one device - surprised that would be permitted by the makers of VHS and Betamax! It's like a half moon cookie - chocolate and vanilla living in harmony.

Always interesting reading about those shiny metal boxes we see advertised but never actually see in action.

Mike Cohen
Re: Article: Fast Enough? Data-Driven Broadcast Infrastructure
by Alex Udell
Very cool!

I'd like to know more about both Cal Digit Super Share and Cat DV.

Thanks for letting me know these exist.


Alex
Re: Article: Fast Enough? Data-Driven Broadcast Infrastructure
by Bob Zelin
I'd like to know more about both Cal Digit Super Share and Cat DV.



Lucky for you, Alex, that Creative Cow has a Cal Digit forum, and a CAT DV forum, that can answer all your questions about Super share, and CAT DV.

Bob Zelin


Re: Fast Enough? Data-Driven Broadcast Infrastructure
by Earle Nichol
Nice Job Mr Zelin! I had the exact same feeling on some DDR slomotion controllers from Tightrope...how did I miss that??
Thanks for the Hard Rock Centre Bar... great meeting!!

Earle

Communication! Communication! Communication!
Re: Article: Fast Enough? Data-Driven Broadcast Infrastructure
by Herb Sevush
Bob -

Thanks for the great article. You saved me the cost of flying to Vegas.

Herb Sevush
Zebra Productions
Re: Article: Fast Enough? Data-Driven Broadcast Infrastructure
by Simon Blackledge
Thanks Bob.. appreciated.

s




Related Articles / Tutorials:
SAN - Storage Area Networks
Navigating the Land Mine of Centralized Media Storage

Navigating the Land Mine of Centralized Media Storage

Storage and media asset management are probably the biggest category you will find on the NAB floor in the South Hall of the Las Vegas Convention Centre. Dennis Kutchera guides you with past experience how to Navigate the Land Mine of Centralized Media Storage in the Post-Production Storage Wars.

Editorial, Feature
Dennis Kutchera
SAN - Storage Area Networks
Affordable, Easy LTO Archiving

Affordable, Easy LTO Archiving

It's a simple idea: your stuff is precious, but there's too much of it to easily store. The world of LTO seems expensive and confusing, and straight talk is hard to come by. Well, it happens that Creative COW's Bob Zelin is the master of straight talk, and has had to learn a lot about archiving to help his clients meet their needs. Here's what Bob has found as he looks at the latest and greatest technology and projects for affordable, easy LTO archiving.

Editorial, Feature
Bob Zelin
SAN - Storage Area Networks
NAB 2012: ATTO Technology

NAB 2012: ATTO Technology

ATTO Technology showcased its entire line of storage and network connectivity products at NAB 2012, including its new Thunderbolt Desklink devices ThunderLink and ThunderStream. Also featured was a technology demonstration of the Celerity 16Gb/s Fibre Channel Host Bus Adapters (HBAs), the FastStream SC SAS/SATA RAID Storage Controller with 8Gb/s Fibre Channel connectivity to SAS/SATA storage, ExpressSAS 6Gb/x SAS/SATA Host Bus and RAID Adapters and FastFrame 10Gb/s Ethernet Network Interface Cards.

Feature
Debra Kaufman
SAN - Storage Area Networks
XenData and Harmonic Introduce Integrated Broadcast Archive System

XenData and Harmonic Introduce Integrated Broadcast Archive System

Two companies, XenData and Harmonic, enable LTO-5 robotic archive storage solution with Harmonic Media Application Server. Read on to preview the unveiling of this new interface that integrates XenData's archive server solutions with Harmonic's Media Application Server and ProXplore.

Feature, People / Interview
Debra Kaufman
SAN - Storage Area Networks
Changing the Game with the Blackmagic Design Broadcast Videohub

Changing the Game with the Blackmagic Design Broadcast Videohub

Bob Zelin is always willing to integrate the newest solutions for his systems integration clients. Only this one was VERY new... and if everything didn't go exactly right, it was game over.

Tutorial
Bob Zelin
SAN - Storage Area Networks
Shared Media Storage Without Breaking the Bank

Shared Media Storage Without Breaking the Bank

In this article Walter Biscardi, Jr. shows how he was able to add expandable, shared media storage in his facility for less than you would expect. And he was able to keep all of his current storage options in place, working right alongside the shared array.

Feature
Walter Biscardi
SAN - Storage Area Networks
Build your own affordable SAN -- that works!

Build your own affordable SAN -- that works!

Want to let everyone in your shop use the same media at the same time? The Cows Bob Zelin shares the secrets for affordable shared storage that you can build yourself, and that WORKS. Start with big, fast storage from your favorite pro vendor, then follow along. Bob even shows you a few hazards to avoid along the way.

Tutorial, Feature
Bob Zelin
SAN - Storage Area Networks
Charles McConathy discusses video system configuration

Charles McConathy discusses video system configuration

In this article, veteran pundit and respected industry system integrator Charles McConathy of Promax Systems Inc., gives users a look at the ins and outs of what goes into successfully configuring a nonlinear video editing system. Charles explores issues for both Mac and Windows users, the latest storage and BUS technologies, ''gotchas!'', as well as issues that plague users when choosing the right solution. He includes caveats and work-arounds, as well as a FAQ for many questions he regularly hears from users.

Tutorial
Charles McConathy
Recent Articles / Tutorials:
Adobe After Effects
Adobe After Effects Energy Ball

Adobe After Effects Energy Ball

In his latest high-energy Adobe After Effects tutorial, VFX guru Tobias Gleissenberger of Surfaced Studio combines a variety of effects to create the pulsating energy ball, composited with motion tracking, optical flares, and more.

Tutorial
Tobias Gleissenberger
Cinematography
Robert McLachlan: Cinematographer for Game of Thrones

Robert McLachlan: Cinematographer for Game of Thrones

Robert McLachlan is the cinematographer of Game of Thrones, Westworld and Ray Donovan, and he joins commercial director and Go Creative Show host Ben Consoli to share behind the scenes stories from some of his most iconic scenes including The Red Wedding and The Loot Train Battle.

Feature, People / Interview
Ben Consoli
MORE
© 2017 CreativeCOW.net All Rights Reserved
[TOP]