LIBRARY: Tutorials Reviews Interviews Editorials Features Business Authors RSS Feed

The SciTech Award Goes to... Side Effects' Andrew Clinton and Mark Elendt

COW Library : Cinematography : Debra Kaufman : The SciTech Award Goes to... Side Effects' Andrew Clinton and Mark Elendt
CreativeCOW presents The SciTech Award Goes to... Side Effects' Andrew Clinton and Mark Elendt -- Cinematography Feature


CreativeCOW.net. All rights reserved.


At the 84th Annual Academy Awards for Technical Achievements, Side Effects senior mathematician Mark Elendt and 3D graphics programmer Andrew Clinton will pick up a Technical Achievement Award (an Academy Certificate) for the invention and integration of micro-voxels in the Mantra software. "This work allowed, for the first time, unified and efficient rendering of volumetric effects such as smoke and clouds, together with other computer graphics objects, in a micro-polygon imaging pipeline," says the Academy's citation.

The integration of micro-voxels in Mantra is a leap forward in rendering volumes. Placing this achievement in context highlights its significance. The 3D animation/visual effects software company Side Effects is celebrating its 25th year, and Elendt -- employee #3 -- has been along for most of the ride. He recalls the early days of rendering. "In the early 1990s when I started, a single frame of film or video took 20 minutes to an hour to render," he says. Today? It takes about the same amount of time; although the compute power has exploded exponentially so has the detail and artistry in each much more complicated visual effect. Elendt reports that one frame -- rendering Aslan's fur -- in The Chronicles of Narnia: The Lion, the Witch and the Wardrobe took over 24 hours to render across eight different machines.

"The software is being pushed further and further," he says. "The quality of the animation today is just astounding. We have to try to make sure that customers are able to do things quickly and efficiently without hitting hardware limits."


The A Team
From The A-Team. Rhythm & Hues relied on Mantra's micro-voxel rendering solution for Golden Compass and The A-Team


From the beginning, Side Effects' philosophy was to build software that was both open and flexible. That included Mantra, the company's renderer, which is built into its flagship software Houdini. When he joined Side Effects six years ago, Clinton began working exclusively on Mantra. "Even then, one key thing about Mantra was that it had its own programming language built into it," he says. "Studios create a library of shaders, all of them customizable with different colors and textures. One of the great things about Mantra is the full control over what you can do with it through the shading language."

The technology for rendering volumes, however, wasn't ideal. "There were two techniques for rendering volumes," says Elendt. "Ray-marching and sprite rendering were used not just by Mantra but almost every other renderer in the marketplace." Neither solution was very good, however, when it came to handling the complexities and depth of volumes. "If you had two clouds that overlapped and tried to render it, it was hard to figure out the right transparency and color of the overlapping part," says Clinton. "When you render sprites, you're trying to approximate 3D volumes and project it into 2D space. It's not really 3D, so the shadows can be wrong and it can look not entirely correct."

"We wanted something purely 3D that was programmable so users wouldn't run into limitations with parameters such as overlapping volumes," he adds.

The need was acute. Clinton recalls being asked to put together an example for properly shaded volumes to show to clients...and not being satisfied with the results. "We worked hard to put examples together with what we had," he says. "It took quite a bit of work but it wasn't well integrated with the renderer and didn't do motion blur, so it wasn't very useable." At the same time, Side Effects' dynamics team was working on fluid simulations (puffs of smoke, explosions, and so on) and wanted to find the best way to render them.

Clinton and Elendt took a closer look at another rendering technique, REYES (an acronym for Render Everything You Ever Saw), which was published by Pixar Animation Studios in 1987. This is an algorithm used by many rendering systems that worked by taking a very complicated 3D object -- a sub-division or NURBS surface -- and split it into micro-polygons that would shape and render into pixels.

"Many rendering algorithms rely on a refinement process to render complex surfaces," says Elendt. "A sub-division surface might be split into simpler patches when then get refined to Bezier patches and eventually get converted to polygons for rendering. The most popular of these algorithms -- the REYES algorithm -- refines all surfaces into micro-polygons, which are polygons roughly the size of a pixel."


Amelia
Amelia from Fox Searchlight Pictures. Toronto-based Mr. X used the micro-voxel rendering solution on Amelia, Resident Evil: Afterlife and Hot Tub Time Machine.


The two took this algorithm, which worked only on surfaces, and found a way to apply it to volumes. "We found a parallel for all the different things you'd do with surfaces in the REYES architecture, and found a way to do it with volumes," says Clinton. "In simplest terms, micro-voxels are a divide and conquer strategy to render volumetric objects for computer graphics. We take all these different types of volumes and break them up into micro-voxels, just like surfaces would be broken down into micro-polygons. That way, you can have two different volumes overlapping and it's handled all in the same architecture."

"Micro-voxels are very similar in spirit to micro-polygons," he adds. "A complicated volume primitive such as a cloud or burst of flame is sliced and diced to form simpler volume primitives, which are then turned into micro-voxels. In their final form, micro-voxels run through the same shading pipeline as micro-polygons, which allow them to be displacement shaded and lit like other surfaces."

Fast and the Furious
Fast & Furious '09
Another benefit, notes Elendt, is that their solution was easy for big studios in the industry to use. "Many of them had their own custom way of representing volumes," he explains. "The [VFX/animation] studios were able to make plug-ins to Mantra from their customized solutions, and Mantra was then able to take their data -- without converting it to Houdini's format -- and deal with it natively. They could break their data up into micro-voxels for rendering, and only had to write a plug-in not a full rendering volume."

Several studios have done just that. Rhythm & Hues relied on Mantra's micro-voxel rendering solution for Golden Compass and The A-Team, and Toronto-based Mr. X used it on Amelia, Resident Evil: Afterlife and Hot Tub Time Machine.

The micro-voxel rendering solution for volumes was shipped in beta version in 2006 and launched as a release in 2007. The need was so gaping that some studios began to use it in production when the algorithm was still in beta form.

"The big advantage of micro-voxels is that they allow volume primitives to be integrated into the rendering processes," concludes Clinton. "With micro-voxels, the renderer can apply motion blur, occlusion culling and other techniques and still end up with properly lit and composited volumes."








This story on Mantra Software is one of a series on the winners of the Scientific and Engineering Awards.

The Technical Achievement Award® (Academy Certificate) goes to Andrew Clinton and Mark Elendt for the invention and integration of micro-voxels in the Mantra software.

This work allowed, for the first time, unified and efficient rendering of volumetric effects such as smoke and clouds, together with other computer graphics objects, in a micro-polygon imaging pipeline.




ACADEMY AWARDS® is the registered trademark and service mark of the Academy of Motion Picture Arts and Sciences. ALL RIGHTS ARE RESERVED.



Related Articles / Tutorials:
Cinematography
The Lion King's Virtual Cinematography: Caleb Deschanel, ASC

The Lion King's Virtual Cinematography: Caleb Deschanel, ASC

Caleb Deschanel, cinematographer for Disney’s live-action The Lion King, shares how they used traditional cinematography to create the life-like virtual film. Caleb and Go Creative Show host, Ben Consoli, discuss modeling cameras and lenses for virtual filmmaking, how Caleb was able to move the sun around in virtual space to get the perfect lighting, using a real drone for the Circle of Life sequence, and more!


Ben Consoli
Cinematography
Shooting RED 8K for Danny Boyle's Yesterday

Shooting RED 8K for Danny Boyle's Yesterday

The magical romantic comedy Yesterday reunites cinematographer Christopher Ross BSC with director Danny Boyle to tell the story of a singer-songwriter who wakes up to discover that he's the only one in the world who remembers The Beatles. Christopher selected the RED HELIUM S35 8K sensor (with as many as 17 cameras rolling simultaneously in a single scene!) to capture a variety of looks as the story takes viewers from East Anglia to Los Angeles. With 10-15TB of footage coming in every day, this is also a workflow story, featuring DIT Thomas Patrick and the team at Mission Digital for dailies, and Goldcrest Post for online, VFX, conform, and grade.


Adrian Pennington
Cinematography
Spider-Man Far From Home Cinematographer Matthew Lloyd

Spider-Man Far From Home Cinematographer Matthew Lloyd

Matthew Lloyd, cinematographer for Spider-Man: Far From Home, takes us behind the scenes of the film and shares techniques for lighting and shooting massive visual effects scenes. Matthew and Go Creative Show host Ben Consoli, discuss working in Marvel’s Cinematic Universe, using pre-vis to prep for shots with VFX, creating Spider-Man’s holographic world, plus Matt’s camera and lens choice, his experience with commercial and fashion filmmaking, audience questions and so much more!


Ben Consoli
Cinematography
DJI Osmo Action Camera In-Depth: Taking on GoPro

DJI Osmo Action Camera In-Depth: Taking on GoPro

The DJI Osmo Action is DJI's first GoPro-like action camera. It shoots crisp 4K video at 60 FPS, and super slow motion at 240 FPS at 1080p, also with support for HDR and terrific RockSteady image stabilization. Especially interesting: TWO LCD screens to make it easy to see what you're shooting from every angle. VFX guru and filmmaker, Surfaced Studio's Tobias G puts the Osmo Action through its paces and tells all about what he likes and doesn't, with lots of sample footage for you to judge for yourself!


Tobias G
Cinematography
Stuart Dryburgh: DP for Men In Black International

Stuart Dryburgh: DP for Men In Black International

Stuart Dryburgh, cinematographer for Men In Black International, joins Go Creative Show host, Ben Consoli, to discuss creating the look for the film. Stuart talks about the challenges of working in an established franchise, filming in NYC in the snow, why Stuart prefers Arri Alexa cameras, his lighting and lens choices for the film, shooting action scenes, and more!


Ben Consoli
Cinematography
Capturing ProRes RAW

Capturing ProRes RAW

Apple ProRes RAW has lots of buzz, and can offer some great opportunities in both shooting and post, once you know how to capture it. Director Steve Pierce and DP Igor Kropotov explain why they love it, how to capture it on set, and what tools you can use.


Adorama TV
Cinematography
Small HD FOCUS 7 4K Monitor Hands On

Small HD FOCUS 7 4K Monitor Hands On

Here's a first look at the SmallHD FOCUS 7, a 7-inch, 4K monitor that packs significant production value in a moderate price. The monitor includes Small HD’s OS3 software, which gives users access to features such as pinch-to-zoom, waveform monitors, focus pulling, 3D LUTs, and more, in a build that's lightweight, durable, and retains mobility.

Tutorial
Adorama TV
Cinematography
GoPro HERO7 First Look

GoPro HERO7 First Look

The new GoPro HERO7 can do WHAT? Join Steven John Irby, co-owner and director of Street Dreams Magazine, for a look at the most advanced GoPro yet: HyperSmooth Stabilization, TimeWarp Video, live streaming, voice control, waterproof, and much more.


Adorama TV
Cinematography
Five Cinematic Drone Shots For You To Master

Five Cinematic Drone Shots For You To Master

If you tend to put your drone up in the air and then struggle with what to do next, or if you just randomly shoot around filling up your memory card, then this tutorial is for you. Here are 5 cinematic drone shots that, with a little practice, will take your aerial cinematography to the next level.

Tutorial
Adorama TV
Cinematography
Filming In Small Spaces

Filming In Small Spaces

"Penned" is a narrative series shot on location in New York, which means working in lots of small spaces. The team not only explores how these challenges call upon their highest level of creativity in the shortest amount of time, but also lay out how these challenges give some of the most creative results. The producers, director, and DP all share their tricks and advice including connecting the corners, putting light in Z space, having the lens closer to a foreground element, and utilizing high ceilings.

Tutorial
Adorama TV
MORE
© 2019 CreativeCOW.net All Rights Reserved
[TOP]