Creative COW SIGN IN :: SPONSORS :: ADVERTISING :: ABOUT US :: CONTACT US :: FAQ
Creative COW's LinkedIn GroupCreative COW's Facebook PageCreative COW on TwitterCreative COW's Google+ PageCreative COW on YouTube
LIBRARY:TutorialsVideo TutorialsReviewsInterviewsEditorialsFeaturesBusinessAuthorsRSS Feed

Ryan Salazar & Pixar Discuss Render Farms

COW Library : Broadcasting : Ryan Salazar : Ryan Salazar & Pixar Discuss Render Farms
Share on Facebook
CreativeCOW presents Ryan Salazar & Pixar Discuss Render Farms -- Broadcasting Feature


Post Production Engineer | Columnist | Speaker
Ft. Lauderdale Florida USA

©2012 CreativeCOW.net. All rights reserved.


Teaming clusters of systems together to generate frames of videos is an amazing time-saver, especially when there are heavy scenes that need lots of processing power. Imagine now an animation that could take millions of hours to render, and one computer is no longer an option. With an in-house system, or a render farm using the latest Cloud Technology, speed and optimum results are what it's all about.




When you hear the word "farm", do you think of Old MacDonald or wheat fields, or yards and yards of cabling and computers?
When you hear the word "farm," you either think of "Old MacDonald" or a bunch of cows or fields of wheat, etc. "Render farms" evoke the same type of vision -- albeit one of many computers linked together with yards and yards of cabling, rather than animals grouped together in a barnyard. But the concept is similar. Many servers joined together for one purpose: to render -- or to take an artist's product and transform it into a complex animation for viewing.

It isn't because you can't render on single machines -- it is definitely possible. However, when you consider that rendering bits or parts of an animation can take into the millions of hours to render, the "one machine" possibility is no longer an option.

Teaming clusters of systems together to generate frames of videos is an amazing time-saver, especially when there are heavy scenes that need lots of processing power. A great example of what a render farm can do compared to one desktop machine: our company creates a decent amount of animation via Autodesk Maya and Maxon Cinema4D. I created a render farm with 20 nodes (BOXX Technologies server blades) along with a render controller (another server).

Contemplate this: a 192 frame national TV commercial job that we rendered (about 6 seconds of animation) took 4.5 hours (or about 1.5 minutes per frame) on the animator's computer (a MAC Dual-Hexa core or 12-cores, with 24G RAM). That same project rendered on our farm in 8 minutes (or about 2.5 seconds per frame)! Yes... the time saved is clear -- considering 30fps with a standard 22min TV show is 39,600 frames, at 1.5 min/frame = 990 hours (or over a month running 24 hrs/day) versus 2.5 sec/frame = 27.5 hours.

"Blinn's law which states that no matter how much computing resource is available, the overall rendering time of a frame will always remain constant, has proved remarkably resilient to date, says Chris Ford, RenderMan Business Director, Pixar Animation Studios, in a discussion I had with him. "Though CPU capacity continues to grow rapidly, and new infrastructure such as the cloud and GPU's may increase throughput and economy, it is equally true that ongoing developments in cinematic image rendering such as ray-traced global illumination combined with the always increasing artistic demands of the Director will continue to demand whatever resources are available."


As we all know, a render doesn't mean your job is complete. It just means you're ready to pop it into the timeline, make some more magic and send to your producer or client for approval. If they have a revision... then you have ANOTHER render to do. One of our artists has a poster on his wall, exclaiming: "Rendering Sucks!" Anyway, the farm speeds everything up thus allowing faster approvals and in the end, getting the final job quicker, too.

"The importance of the artist's time and what that is worth in regard to one's creative business; dedicated rendering allows you to off-load your designs saving valuable time," explains John Vondrak, Copy Writer/Video Producer at BOXX Technologies. "For many artists (especially indie operators), the limitations of space, sufficient electrical power, and finances makes a product like renderPRO an ideal choice; an artist can build a very formidable render farm using renderPRO modules."

"BOXX responds to popular demand for a personal render option (the Render PRO) for freelancers and entrepreneurs that don't have server closets," says Gerrie Schwartz, Performance Specialist at BOXX Technologies.

Motion Picture and Post Production Facilities (even broadcast!) use render farms on a daily basis. In my current situation, our post facility has several render farms:

We have a FlipFactory-Array running renders for over 10,000 files that are processed monthly. This cluster of systems is a render farm which processes .MOV files and creates .M4V, .FLV and .mpg media.

Our animation render farm uses hardware from BOXX Technologies called, "renderBOXX Pro." That hardware has Axceleon's Enfuzion running. EnFuzion is a great render manager which runs all of our 20 nodes (240 cores, 480 GB RAM). The animation work we create is generated from Maxon's Cinema4D and Autodesk's Maya.

Although Cinema4D doesn't seem as high-end as Maya, professionals routinely use it because it feels easier and less intimidating. Maxon produces a product called "NetRender" which is their own rendering engine -- one computer running the NetRender server suite can then access other computers running the NetRender Client application -- cross platform -- over the network, making the other computers render nodes within minutes! Naturally, Autodesk has a similar set-up for its Maya software called "Mental Ray." Utilizing parallel network rendering, mental ray for Maya is placed on all the master machines and mental ray standalone is placed on the subservient or "slave" machines, creating a fully-networked rendering environment capable of some powerful workloads.

Render managers distribute workload amongst many machines. The render controller (usually referred to as the "root controller," manages projects that are submitted to it via, for example, Axceleon's EnFuzion product. EnFuzion is a high-end render manager utilized by the motion picture & broadcast industries and also government organizations.

EnFuzion (and many other render management systems) handle split-frame rendering -- it can divide a single frame into multiple pieces, giving each piece to different computers, rendering them, then stitching the pieces back together into a final rendered frame for "distributed rendering" in order to speed things up.

There is also another world of rendering -- In the cloud... Huh? I have always had my reservations about rendering online. However, there are services like CloudFuzion and RebusFarm. Mike Duffy of CloudFuzion, also the manufacturer of EnFuzion, explains that an insatiable appetite for the "need for speed" and everyone wanting results quicker means that the "render cloud" is becoming a solution. Render farms with hundreds of render nodes can be built and on-line to the Studio within minutes. Add the auto expansion capability, bridging internal resources with external clouds delivering on-demand pay as you go 100% scalable computing all driven and managed by CloudFuzion® makes this an ideal solution for all areas of 3D community.

"Today, artists in 3D Studios in Hollywood CA can cost studios $1500 to $2500 a day, depending upon skill level and experience," says Duffy. "Creative Directors must assure these expensive resources are kept creating art forms for 3D animation movies, commercials and special effects and are not waiting around for their images to finish rendering on their local machines. This is where render farms come really into play."

"The Creative Director can be assured artists are creating and not waiting around for image processing," Duffy furthers.

Animation Studios ALL use rendering, including: Sony Pictures Entertainment, Digital Domain, Disney and Pixar.

Pixar's RenderMan Studio is an advanced rendering solution that used to be proprietary but was so powerful that everyone wanted the shading & lighting and deep textures shown in such films as "Toy Story," "Cars" and "Monsters, Inc." Similar superior visual effects are available in Pixar's RenderMan Studio, allowing any Maya artist to create VFX with Pixar's technology. As explained on the website: "The toolset of Pixar's RenderMan is broad and deep. It's one system that can deliver many types of effects which can be integrated in a variety of ways, but it is also customizable and flexible to accommodate any production pipeline."

"Contemporary feature film visual effects and animation render farms often now exceed 10,000 cores to meet the visual quality expectations of today's audiences," says Chris Ford. "For Pixar's RenderMan, we have developed highly scalable network render distribution tools such as Tractor to complement our latest rendering algorithms such as easy to setup physically plausible shading techniques that deliver images of the highest complexity and realism, and the results are evident in the majority of visual effect movies you see today."

Optimizing hardware and accelerating the rendering time of scenes & images for the artist allows a faster turnaround of changes required during production. And this is not limited to post-production houses, broadcasters or the motion picture community.

"There are 3D creative pros (in architecture firms, for example) who struggle to explain their needs to enterprise IT professionals who just don't get it, says Schwartz at BOXX. "IT often controls the budget, but they have no concept of what 'render nodes' are, yet insist on their 'server solutions' that don't cut or are overwhelmed with redundancy, security, firewalls, etc."

Keeping track of and auditing render farms is no easy task. Saving time and saving money equals an increase in productivity and, therefore, an increase of profits. "And queue management software is not as easy to use as designers might like it to be," continues Schwartz.

"Managing render farms is a significant challenge," says Dr. Tim Moreton, Founder & Chief Product Officer at Acunu -- The 'Big Data' specialists. "The operations teams require a deep understanding of the creative process as well as the technology that powers the rendering. Accurately predicting demand for the render farm and keeping a high throughput of render jobs is essential for meeting production deadlines as well as IT budgets. Alongside everything else they do, studios increasingly need to be sophisticated technology organizations to succeed."

"Acunu works with studios to help provide real time insights that join the dots between what work the render farm is doing and how the actual infrastructure is running," Dr. Moreton furthers.

Andrew Price, a 3D animation artist at Blender Guru (www.blenderguru.com), sums-up the rendering process and describes why a render project sucks:

1. There's no point It doesn't tell a story, it's not advertising anything and it's certainly not pretty. What exactly is the viewer getting from this? Nothing makes me close the window faster than a piece of art with no clear objective.

2. You use pre-made content Stock models are great for studios who want to save time and money by purchasing a pre-made model. But it has absolutely no place in your portfolio. Personally I find no pride in showing someone a render that I haven't created entirely by myself, but that's just me. If you don't know how to model it, why not learn?

3. You're copying something far more successful I love Wall-E as much as the next guy, but that doesn't mean I try to mimic what a professional studio has slaved over for years on end. Why? Because unless it's an uncanny comparison (which it won't be) viewers will only spot its flaws.

4. You didn't plan it on paper first It's easy to tell when an artist failed to put their idea on paper first: it's a confusing mess. They started with an idea, skipped the planning stage and jumped straight to their 3d program. Most artists cannot model/texture/render in 3d at the same speed as their imagination. The best thing you can do is put it on paper as soon as the idea strikes you, that way you have a reference in 2 weeks time when you're sitting at your computer and asking, "what was I making again?"

5. It's cliché If I see another cave troll or big breasted warrior, I'm going to puke. Be original and create something that everyone hasn't already seen a thousand times.

6. It's a test render Hey cool, you just got your head around the new array modifier! Don't post it on the net. Test renders are exactly that. Tests. They are a learning experience that should remain on your hard drive.

7. It's poorly lit Let me say this once and for all: Dark is not moody. If you want to create a moody atmosphere there are plenty of ways of doing it, but making your scene dimly lit is not one of them. Pick up a copy of Jeremy Birn's Digital Lighting and Rendering to learn how to light your scene like a pro.

8. You don't realise it sucks No one likes receiving bad feedback on their artwork, especially after you've spent weeks creating it, but to tell the hundreds of posters that they "just don't understand it" is like throwing salt on the wound. If you want to progress as an artist you need to be able to take critiques on-board and learn from your mistakes.

9. It's boring architecture Archiviz is great skill to have under your belt. There's a lot of work available and it pays quite well, but that doesn't mean it has to be boring and emotionless. Read my post on 20 Architectural renders that break the mold or watch Alex Roman's amazing short The Third and the Seventh and you'll pick up dozens of ways to make still architecture interesting.

10. It's overly post-processed There's nothing wrong with fixing the colour levels or altering the contrast in Photoshop, but when you start adding filters and chromatic aberration to hide your own incompetence, there's a problem.

Look at #10 (my personal favorite)... many artists make their projects too "heavy" -- which unnecessarily makes their renders too large and take way too long. When they realize what they did, they scale back and BAM! ...much faster and a very similar end result!

So there you have it. Rendering doesn't really have to suck! When it comes right down to it, as my friend Gerri Schwartz says, "The images are what your clients see -- it's your "signature" and best advertisements for your talents." So you want to put your best foot forward and present your finest. Whether it's through an in-house system or online using the latest in Cloud Technology, the faster it can be created with the optimum results are what truly matters. And knowing the best solution for your needs and requirements is what it's all about.







  Broadcasting Tutorials   •   Broadcasting Forum
Reply   Like  
Share on Facebook


Related Articles / Tutorials:
Broadcasting
Project DAVID Creates Digital Content Preservation Tech

Project DAVID Creates Digital Content Preservation Tech

While there is a strong movement to preserve and restore old film, preservation of audiovisual digital content has been less of a priority. Project DAVID seeks to change that, by developing technology for prevention of damage, preservation and restoration for the vast libraries of digital content.

Editorial, Feature
Broadcasting
NAB Show Conferences: Can We Talk?

NAB Show Conferences: Can We Talk?

NAB Show is billed as "the largest and most relevant educational program for media and entertainment professionals anywhere." With so much information, you'll want to do your research and find what's the best conference for you. In this condensed guide, Ryan Salazar names a few of the conferences he finds the most "interesting and intriguing" and provides links for your further perusal.

Editorial, Feature, People / Interview
Broadcasting
NOT Your Father's AM

NOT Your Father's AM

At this time, over 2,200 radio stations are broadcasting a hybrid HD Radio signal, with more on the way, and with NAB approaching, Ryan Salazar is considering the future and applications of digital radio. Radio is going to become sexy again, and this is NOT your father's AM broadcast...

Editorial, Feature
Broadcasting
NAB Labs Futures Park: FM & Smartphones - A Good Idea?

NAB Labs Futures Park: FM & Smartphones - A Good Idea?

NAB Labs Futures Park is a showplace designed to display the newest of advanced projects, demonstrations of high-tech media developments in progress, prototypes, and products not yet available for sale. One of the most exciting features in NAB Labs Futures Park will be the exploration of FM radio signals delivered via smartphones. Read up on what's new and be prepared to visit NAB with questions ready.

Editorial, Feature
Broadcasting
Inter BEE keynote: Japan Will Broadcast 8K by 2020 Olympics

Inter BEE keynote: Japan Will Broadcast 8K by 2020 Olympics

It's not news that Japan has announced its intent to broadcast 8K by the 2020 Tokyo Olympics. In today's production environment, the advent of 4K is still news and 8K seems like a futuristic pipe dream. But when Creative COW Contributing Editor Debra Kaufman was in Japan in November, she learned just how serious Japan is in its intent to broadcast 8K -- and to do so sooner than originally announced.

Editorial, Feature, People / Interview
Broadcasting
Will 2014 Be the Year of 4K?

Will 2014 Be the Year of 4K?

UltraHD, or 4K, has been making an appearance at trade shows for the last couple of years. At this year's IBC in Amsterdam, the demonstrations and products pushed forward the idea that 4K is a possibility for TV distribution and general production and post. Creative COW takes a look at the offerings and the opportunities.

Editorial, Feature, People / Interview
Broadcasting
IBC 2013 Wrap Up

IBC 2013 Wrap Up

Broadcast Engineer Ryan Salazar wraps up his perspective on IBC 2013, the premier annual event for professionals engaged in the creation, management and delivery of entertainment and news content worldwide.

Editorial, Feature, People / Interview
Broadcasting
Ten Networking Tips for Video Production Conferences

Ten Networking Tips for Video Production Conferences

Attending Video Production conferences and educational seminars can add to your pool of creative resources, but you're missing out if you don't take the opportunity to meet people and make connections.

Editorial, Feature, People / Interview
Broadcasting
SIGGRAPH 2013: Highlights from a Great Party!

SIGGRAPH 2013: Highlights from a Great Party!

SIGGRAPH member Ryan Salazar highlights animation tech, visual tech featuring powerful LED and DLP projection and ultra-high resolution, provides links for keynote speeches, and first-hand looks at the Canon MREAL Mixed Reality handset. This was a must-see show, and we wrap up with a few of our COW favorites.

Editorial, Feature, People / Interview
Broadcasting
The Cloud - Nowhere To Go But Up

The Cloud - Nowhere To Go But Up

The cloud is here, and it's perfect for television broadcasting. "The broadcast industry is changing, has always been changing and will always be about change," says Michael Rofe, iCTVBA Chairman and Global president. Migrating broadcasting to the cloud is a natural transition, and Ryan Salazar takes a look at that transition, the possibilities for cloud-based broadcasting and embracing the progress of technology.

Editorial, Feature, People / Interview
MORE


FORUMSTUTORIALSFEATURESVIDEOSPODCASTSEVENTSSERVICESNEWSLETTERNEWSBLOGS

Creative COW LinkedIn Group Creative COW Facebook Page Creative COW on Twitter
© 2014 CreativeCOW.net All rights are reserved. - Privacy Policy

[Top]