LIBRARY: Tutorials Reviews Interviews Editorials Features Business Authors RSS Feed

The New CalDigit HDPro2 Product Review

COW Library : CalDigit : David Roth Weiss : The New CalDigit HDPro2 Product Review
Creative COW CalDigit Article


Under the Hood & Behind the Scenes: Masters of Stereoscopic 3D Storytelling



David Roth WeissDavid Roth Weiss
Los Angeles California, USA

©2010 David Roth Weiss and CreativeCOW.net. All rights reserved.

Article Focus:

Buckle your seatbelts. In this review COW leader David Roth Weiss, an L.A. based director, editor, and colorist takes you inside CalDigit's brand new HDPro2; an advanced 8-drive video storage solution that will absolutely rock you with blistering performance and sustained video throughput unlike anything you've ever experienced before.




CalDigit has just unleashed its new HDPro2, the latest generation of their most advanced hardware RAID product, and I was lucky enough to be among the first to give it a test drive.

The first generation HDPro is still a hot performer in its own right, but the new HDPro2 is truly a quantum leap forward. It delivers unprecedented performance for an eight drive RAID, absolutely blowing away everything that's come before, and opening a new world of endless editing possibilities.


SO, HOW FAST IS FAST?

Don't worry; I won't make you wade through this entire article to get to the results. The CalDigit HDPro2 is so fast that I'm simply going to cut to the chase and spill the beans now. So, brace yourself, here goes...

Right out of the box, the HDPro2 delivers read/write times approaching, and in some cases exceeding, 700 MB/s. Yes, that's right, "700 megabytes per second," running in a protected Raid 5 or RAID 6 configuration, and with only eight standard SATA hard drives. That's just downright unheard of speed.


SO, WHAT DOES ALL THAT SPEED REALLY DO FOR ME?

Well, if you're an editor who knows about RAIDs, your antennae are most likely fully extended by now, because throughput at the 700MB/s level will radically throttle-up the capabilities of your workstation, dramatically improving your day to day editing experience.

Increased overhead at this order of magnitude significantly increases real-time editing operations, minimizing many of those agonizing renders, and providing smooth playback of more video and audio streams than ever before from only eight drives.

Smooth MultiClip FCP Playback
Example: Perfectly smooth multiclip playback in FCP 16 channels* of DVCProHD 720p60 in realtime (*application maximum)



SO, WHAT'S THE BIG DEAL?

If you don't know very much about RAID technology, keep reading. This is very important information, and it will become increasingly important to your future, because a new threshold has been broken, and it will further level the playing field for nearly everyone in the industry, because it will put more power into more hands. Yes, you've heard that before, it's a recurring theme, but this time it's a little different.

While extremely powerful multi-core/multi-threaded processors have been available at a reasonable cost for quite some time, affordable ultra-high-speed data storage at the 700MB/s level is brand new.

From this point forward there are virtually no barriers to hold us back from any level of content creation on the desktop. Layers upon layers of compressed and uncompressed high definition video, 3D high definition, and even uncompressed 2K video are in your arsenal. Suddenly, nothing is impossible.


SEE IT AND BELIEVE IT

Just take a look at these most impressive numbers below from benchmarks I've run using the AJA Disk Read/Write test.

AJA Speed Test


INTERPRETING THE TESTS

With the parameters set as you see above, the Disk Read/Write test first creates a 4GB file, then it times how long it takes to write the data from RAM to this file in "frame sized chunks" onto the raid, which in this case uses frames that are 2K (2048x1556 pixels), in 10-bit uncompressed RGB format. The test then reverses and measures the time necessary to read the same file from the raid back into RAM.

As you can see, the HDPro2 delivered an average write speed of 673.8 MB/s and an average read speed of 709.5 MB/s. Additionally, notice that the graph at bottom remains virtually flat; a clear indication that both reads and writes are extremely consistent throughout both operations. The exception is the green spike at the very beginning of the read, which is common with most storage units as they get up to speed.

AJA Speed Test 2

The speed test above is again set to read and write another 4GB file, but using smaller frame sized chunks, this time at 720p 10-bit uncompressed (1280x720 pixels).

In this case you'll notice that the speeds using the 720p frame size are slightly lower than those of the 2K files in the earlier test. This is because the 512 megabytes of RAM cache onboard the HDPro2's built-in controller is optimized for performance, and able to sense when a larger or smaller file is coming.

The controller adjusts, instantly caching more data for larger files when it needs to, and throttling back for smaller files that don't need to cache as much data in order to keep up without dropping frames. As Jared Picune of CalDigit explains, "Similar to driving, you need more gas when going up a hill and less when going down."

Again, if you carefully examine the green and purple graph at the bottom of the previous test results, you'll notice that read and write speeds are still very consistent, with only minor deviations from the average speeds throughout the entire range of the operations. This continuously smooth transfer rate is due to CalDigit's advanced Active Sustained Transfer Technology (ASTT), which is unique to CalDigit RAIDs. And, ASTT isn't just a feature in their top of line HDPro2; it's one of the hallmarks of all CalDigit RAID products.

ASTT


ASTT optimizes data transfer size and timing, and helps to maintain sustained data rates throughout the capacity of the entire RAID. It eliminates the inconsistencies in performance, referred to as "latency," insuring sustained data throughput and eliminating the risk of dropped frames during video playback.

HDPro2 Box


MORE THAN SPEED ALONE

Another very important and often overlooked distinction to keep in mind when considering the HDPro2 or any of the CalDigit RAID products, is that every RAID they build is an advanced single vendor RAID solution.

Unlike the "roll your own" RAIDs on the market, with parts assembled from several different suppliers, CalDigit RAID products are complete, single-box solutions. All parts are designed, developed, configured, and tested by CalDigit engineers. There's just one number to call with questions or for technical support, and in this business that's simply priceless.


UNDERSTANDING RAID PROTECTED MODES

The HDPro2 comes preconfigured from CalDigit in RAID 5 protected mode. RAID 5 offers the most efficient combination of both performance and data protection for most users. In this mode, should any one of the eight internal hard drives fail, the array is not destroyed; it continues operations at a slower speed, but without any loss of data. When a new drive is added in place of the failed drive, the full array rebuilds across all eight drives, restoring full capacity, speed, and security.

The HDPro2 is also easily reconfigured to operate in RAID 6, or "double protected mode," which substantially increases fault tolerance protection, even in cases involving the failure of two hard drives.

To achieve this high level of data protection, the CalDigit RAID engine stores so-called parity, or redundant data blocks, on two dedicated drives in the array, separated from the original data. This utilizes significantly more drive capacity than RAID 5 and reduces write speeds marginally. However, RAID 6 is extremely reliable, calculated to lessen the chance of catastrophic failure by approximately 1500 to 2000 times.

As you can see below, with reads exceeding 700MB/s, the HDPro2 benchmarks are still phenomenal when operating in RAID 6 double protected mode.

AJA Speed Test 3


HOW DOES IT WORK?

Inside the HDPro2 is a sophisticated RAID controller with 512MB of RAM cache onboard, upgradeable to 2GB. The controller does all the heavy lifting utilizing a built-in Intel XScale Core Processor to accelerate and optimize RAID performance, processing, power consumption, and data protection.

CalDigit HDPro2 Inside CalDigit Intel Chip

The HDPro2 also features a direct connection to the PCI Express bus, linking the internal RAID controller directly to the computer's internal bridge chip and memory system. This direct connection eliminates the major data bottleneck of the earlier interfaces such as fibre channel and SCSI, generating bandwidth that's nearly five times faster than traditional fibre solutions.


MODULAR DESIGN

CalDigit HDPro2 Chassis

Another great feature about the HDPro2 is its easy access and completely tool-free modular design that makes swapping out parts a breeze. The controller, power supply, and the two huge cooling fans are all user replaceable and very user friendly.

Computer Fan

I was able to strip every major component out of the chassis and then reassemble it all in just seconds. So, if anything should ever go wrong, you can order replacement parts overnight and you'll be back up and running in no time.

Hard Drive

The HDPro2's eight matching certified Hitachi hard drives come meticulously packed, each in its own anti-static pouch, and each safely shock-protected in its own secure foam slot. All drives come tested and ready to go right out of the box, preconfigured for RAID 5, with each drive numbered appropriately corresponding to its proper position in the HDPro2 enclosure.

Hard Drive Key

The drives are simple to install. Using the small supplied key, you simply pop open the hinged locking arm on the cover plate that comes pre-mounted on each drive. Then, each drive slides into its proper slot in the enclosure. The drives lock into place precisely, seating directly into the backplane without a single cable involved. Anyone can do it.


REDUNDANT POWER JUST IN CASE

Redundant Power Supply

If your work requires true mission-critical protection, a cool feature of the HDPro2 is its ability to accommodate an optional redundant power supply. This isn't a necessity for every user, so you don't have to pay extra for it unless you really need it. If you change your mind at any time, for just $299 you can add it in a snap. Combine this feature with RAID 6 protection, and you'll have ultimate data security.


SUMMARY

No doubt about it, the results speak for themselves; the HDPro2 faithfully delivers every ounce of performance, reliability, and uncompromising security that CalDigit promises.

Believe me, if you have a need for speed, and you crave the piece of mind that only advanced RAID 5 or RAID 6 protection can provide, the HDPro2 is one happening piece of hardware.

As you can see below, the front panel of the HDPRo2 enclosure is ported with hundreds of tiny perforations for improved ventilation and cooling of the eight hard drives inside. This does make the HDPro2 I tested is a bit noisier than the HDOne model I own, but that's a small price to pay for superior performance and greater data security.

CalDigit HDPro2 Chassis

Without question, the HDPro2 deserves a huge 5-Cow rating for its impressive combination of scorching speed and extreme reliability.
5 COWs5 COWs5 COWs5 COWs5 COWs


PRICING & AVAILABILITY

The HDPro2 is available immediately in 8TB, 12TB, and 16TB configurations, with 8TB systems starting at $5999. You can purchase online, directly from CalDigit, or through dealers from their worldwide network of certified resellers listed on the CalDigit website at: http://www.caldigit.com/purchase.asp. For more information call CalDigit at their headquarters in Placentia, California at: (714) 572-6668, or email them at: sales@caldigit.com.


###

Comments

Re: The New CalDigit HDPro2 Product Review
by Cody Foltz
Just purchased my HDPro2 for my company and it is blazing fast!! Going to be editing a 2K RED feature in a few months, will be interesting to see how it handles.

__________________________
Cody Foltz
http://www.LeftDigitalMedia.com
@Cody Foltz
by David Roth Weiss
So Cody, how's your new RAID working???
Chris, you've made an improper comparison
by David Roth Weiss
Actually Chris, I fail to see how your comparison is meaningful. Indeed, I'd have to say that it's quite misleading.

If you read my article in it's entirety, you will notice that I specifically state from the outset that the 700MB/s throughput of the CalDigit HDPro2 is with an eight drive RAID 5 configuration. Neither the Cineraid EditPro 8-bay RAID you own and are touting, nor any other 8-drive solution from two years ago was actually capable of delivering 700MB/s as you claim, even in a RAID 0 configuration.

For the record, CinePro's own literature on their EditPro T08 confirms the specs for that model are "RAID0: 600+ MB/s; RAID5: 500+ MB/s; and RAID6: 400+ MB/s." -- the only solutions capable of delivering 700MB/s throughput two years ago were doing so with at least sixteen or more drives...hardly an apples-to-apples comparison.

BTW, for your information, in the short time since I released my review, CalDigit has released new drivers for the HDPro2, and it now also has read/write times approaching and in some cases exceeding 800 MB/s.

When you purchase your new RAID I'm sure the COW will welcome a well-written and well-reasoned review; just be certain to try getting your facts straight in the future, and try to make sure that you compare apples to apples and oranges to oranges before you have anything published.

Regards,
David
Caldigit Finally Keeping up
by Chris Rye
"While extremely powerful multi-core/multi-threaded processors have been available at a reasonable cost for quite some time, affordable ultra-high-speed data storage at the 700MB/s level is brand new."

I've found a company called Cineraid 2 years ago at NAB, they have been delivering 700+ solutions before anyone else. To top it off, I bought my first 8 bay tower from them for $3999, now their currently selling this at $2999 with a new controller exceeding 800 MB/s mark! I've been a long supporter and user of Caldigit products, but after discovering Cineraid, it opened my eyes and realized there are much better systems out there at a lower price.

By the way, I've been running my EditPro 8 bay for two years with no issues (knock on wood). And currently saving up to purchased their latest product, The EditPro X, their expandable solution. I'll post some reviews when I get it.


Creative COW Admin Note: We from time to time check these kinds of posts to see if they have any ties to the product they are championing so aggressively. When we looked into this post, we found that the user hides the fact that they work for the company they are championing and that three accounts with different names all originate from the same IP address used to post this. (We also found multiple COW posts from this very user pointing to eBay auctions selling Areca/CineRaid products there, as well as other posts across our forums where this user/company goes into forums for competing products and acts as if they are users trying to help other users, while pointing to these competing products sold by them. We find that behavior from a company deplorable. This user claims here to being a longtime CalDigit fan but this could not be verified, as they never once in all the years posting here had a good word to say about CalDigit, anywhere in our site.) Our databases and IP log files show that the source of these posts is from 3 IPs that all belong to accounts that stem from the same IP addresses used by some of those that work with ArecaUS.com (CineRaid is a product of ArecaUS, a company that uses Areca Technology in their systems).
Thanks guys
by David Roth Weiss
Always good to see that somebody out there is paying attention...
Good thing Caldigit does not mention SAN and PCI-e switch this time.
by David Adkin
Good thing they don't mention "free SAN" and "low cost PCI-E switch" like they did on the HDPro.

HDPro2 review
by Bob Cole
Great review. I chose an HDOne rather than the original HDPro. But if the HDPro2 had been available, I would have found it much more difficult to decide on the HDOne. CalDigit has upped the ante for RAIDs.
Awesome.
by Illya Laney
This feels like a game changer to me. Absolutely incredible.


Related Articles / Tutorials:
CalDigit
CalDigit AV Drive with USB 3

CalDigit AV Drive with USB 3

Hard drives rarely feel fast enough, but CalDigit's new AV Drive ($258) is one of the first to use the new USB 3 interface, which is much faster than the USB 2, FireWire 800 and eSATA interfaces of yesteryear. You'll pay a little more for the AV Drive, but its speed easily makes up for the premium.

Review
Helmut Kobler
CalDigit
New VR Mini from CalDigit

New VR Mini from CalDigit

CreativeCOW leader Jerry Hofmann takes a look at CalDigit's new VR mini -- serious storage small enough for your pocket.

Review
Jerry Hofmann
CalDigit
CalDigit HDOneCalDigit HDOne

Los Angeles Director and Editor David Roth Weiss finally takes the plunge and tests CalDigits new HDOne, an affordable turnkey RAID-5 protected video storage system.

Review
David Roth Weiss
CalDigit
CalDigit HDPro: RAID 5 and Beyond!CalDigit HDPro: RAID 5 and Beyond!

Creative Cow Leader Shane Ross shares the great news: both performance and protection with CalDigits new HDPro RAID! Supporting RAID 0, 1, 5, and 6, the HDPro even works with your laptop. Its the answer to Shanes prayers. He thinks it might be the answer to yours too.

Review
Shane Ross
Recent Articles / Tutorials:
Field Production
“Before I forget: don’t wear any underwear.”

“Before I forget: don’t wear any underwear.”

Before coming to Creative COW, before his lives in product marketing and product management at Avid and Boris FX, Creative COW Editor-in-Chief Tim Wilson ran a video production company. As we also observe the 100th Anniversary of the founding of the US Parks Service, Tim recalls one one especially memorable adventure to Everglades National Park, wherein he found himself quite literally up to his armpits in alligators. He had no idea that this was going to happen when the day began. At the time, he was focused on a brand new fear: getting sliced in half by burning underwear.

Editorial, Feature, People / Interview
Tim Wilson
Art of the Edit
The Science of Editing

The Science of Editing

Sven Pape, aka @ThisGuyEdits, joins Dr. Karen Pearlman -- former President of the Australian Screen Editors Guild and a three-time nominee for Best Editing at the Australian Screen Editors Guild Annual Awards -- for a provocative look at "Editor's Thinking," a cognitive skill set that you can use to improve your screenplay before you start principal photography of your film.


Sven Pape
Panasonic Cameras
Shooting MTV's Mary + Jane with Panasonic VariCam 35

Shooting MTV's Mary + Jane with Panasonic VariCam 35

To shoot the ½ hour scripted comedy series for MTV, Mary + Jane, the producers at Television 360 enlisted cinematographer Charles Papert (Crazy Ex-Girlfriend, Key and Peele), who found that Panasonic VariCam is a great fit for moving fast and getting great images when time and resources are scarce.


COW News
Adobe After Effects
Imagineer mocha Pro 5 Plug-In for Adobe: An In Depth Review

Imagineer mocha Pro 5 Plug-In for Adobe: An In Depth Review

Imagineer mocha Pro 5 Plug-in for Adobe brings all the amazing features of the professional version of the mocha Planar Tracker directly into After Effects and Premiere Pro in the form of a plugin. In this in-depth review, After Effects tutorial guru Tobias Gleissenberger of Surfaced Studio will show you what you can do with this new plug-in, and discuss what he likes and doesn't like about the new update.

Tutorial
Tobias Gleissenberger
Apple Final Cut Pro X
Hawaiki Keyer 3.0 Upgrader Tutorial

Hawaiki Keyer 3.0 Upgrader Tutorial

After 25 years as an editor, compositor, and VFX artist, frequent Creative COW poster and tutorial author Simon Ubsdell knows what he needs from a keyer -- and knew he wasn't getting good enough results from FCPX or Motion. Discussions in COW forums led him to create the highly regarded Hawaiki Keyer for Mac users using Apple Final Cut Pro X, Apple Motion, and Adobe After Effects and Premiere Pro on Mac as well. Enthusiasm expressed by COW members for its latest release led us to ask Simon for a tour of the even more advanced Hawaiki Keyer 3.0.

Tutorial
Simon Ubsdell
Cinematography
All Eyes on IBC 2016 for Cameras and Lenses Galore

All Eyes on IBC 2016 for Cameras and Lenses Galore

What’s that you say? An IBC that’s not only relevant, but downright exhilarating? This used to not be news, of course. However, in recent years, IBC has too often become simply an opportunity for European audiences to see products already announced at NAB. In 2016, however, the focus swings sharply to Amsterdam, especially when it comes to cameras and lenses. IBC 2016 is shaping up to be one of the most dramatic trade shows for cinematographers, broadcasters, and videographers in years. Join Creative COW Editor-in-Chief Tim Wilson for a speedy overview of some of the highlights.

Feature
Tim Wilson
MORE
© 2016 CreativeCOW.net All Rights Reserved
[TOP]