Cinesite Creates Effects for Disney's JOHN CARTER
: TV & Movie Appreciation
: Sue Rowe
: Cinesite Creates Effects for Disney's JOHN CARTER
CreativeCOW.net. All rights reserved.
Cinesite Visual Effects Supervisor Sue Rowe approached the mammoth job of creating 831 visual effects for John Carter - which marks the live-action debut of noted animation director Andrew Stanton - with a lot of experience under her belt. A long-time Cinesite employee, she has previously served as that VFX house's visual effects supervisor for Prince of Persia: The Sands of Time, The Golden Compass, Death at a Funeral, X-Men: The Last Stand, Charlie and the Chocolate Factory, The Hitchhiker's Guide to the Galaxy, and Troy, among other feature films and TV programs. Earlier in her career, she was a Digital Compositor.|
At Cinesite, we handled 831 visual effects in John Carter. Along with Double Negative, we were one of the two main VFX vendors on the movie, directed by Andrew Stanton. Since Cinesite is renowned for its photoreal environment work, we handled this part of the film, along with the 2D to 3D stereo conversion. There was a tremendous amount of sharing between Cinesite and D-Neg, who did the character animation, since every shot that has a creature in it also has a Cinesite environment. I'm proud of this. London is a unique place to work in that all our competitors are very close to each other. Although there is healthy competition, we also completely share when we work on the same film. My colleagues at D-Neg and my team had a great relationship. Moving Picture Company was brought on to do the attack of an aggressive horde of half-animals running towards John Carter and a smaller company called Nvizible picked up a few shots but the majority of the work was done at D-Neg and Cinesite.
I had a brilliant team and worked with four main supervisors: Jonathan Neill supervised Cinesite's work on the city of Zodanga, a mile-long rusty metal tanker that crawls like a myriapod across the surface of Mars; Christian Irles supervised work on the beautiful city of Helium, which has a huge glass palace in the middle; Ben Shepherd oversaw the big aerial battle between Zodanga and Helium; Simon Stanley-Clamp directed work on the Thern sanctuary, a huge underground cave that forms around the characters as self-illuminating blue branches as they walk through it; and Artemis Oikonomopoulou was Cinesite's CG Supervisor on the project. We developed a short hand with each other on how we wanted the sequences to go I put my input into the shots they did. There was a filtering system so it was as good as possible to review with Andrew Stanton.
Above left: Ben Shepherd oversaw the big aerial battle between Zodanga and Helium. Middle: Christian Irles supervised work on the beautiful city of Helium. Right: Simon Stanley-Clamp directed work on the Thern sanctuary.
Above left: Artemis Oikonomopoulou was Cinesite's CG Supervisor on the project. Right, Jonathan Neill supervised Cinesite's work on the city of Zodanga.
I have definitely drunk the Andrew Stanton Kool-Aid. He is completely inspiring, so eloquent and artistic. We would do a conference call with him every night, U.K. to the States. Using cineSync, we would load files and both look at the same Quicktime of the movie. Andrew stopped the footage when he wanted and could draw on the image. By talking every night for two years, this sense of trust and familiarity built up. Andrew cared about every single pixel. He had good input daily into small things we could change to make the shot better. He was also pragmatic; he knew the story was the most important thing. He was good at keeping us grounded. I found it very rewarding to work with him.
As a company, one reason that creating environments is a large proportion of the work we do is because it saves productions a lot of money. For John Carter, we went to Utah and shot for about 3 months on location. We took a lot of reference footage and photos in Big Water and Moab. Utah is about a seven-hour drive from Las Vegas. There was such beautiful red rock and you can see way off into the horizon. We Europeans aren't used to this harsh bright light and how powerful the bright areas of the sky can be and how dark the shadows. We're more used to an overcast environment.
The weather for the shoot was quite a challenge. We would start shooting at 9 am, and have 35-degree Celsius heat (95-degrees Fahrenheit). Then in the afternoon there were sand storms. So the shooting environment was harsh. [Director] Andrew [Stanton] had a lot of luck in the morning and, by the afternoon, weather conditions would really affect the shooting.
We used photogrammetry -- high resolution stills projected onto geometry -- that we could join together in Nuke and create vistas for horizons. We took all that back from Utah and used the foreground from the studio and put our hot desert environment in the background. The majority of the movie was shot at studios out in north London where it's generally raining or gray. I spent a lot of time in London, replacing those overcast days with bright Utah vistas.
John Carter was definitely the most challenging work I've done so far in my career, in part due to the fact that there was such a wide difference in the styles of work we were asked to do. The two main locations are Zodanga and Helium, and they had to be very different styles of architecture to tell the story. Then there was the challenge of the massive scale of the movie. By the end, 310 people at Cinesite had created 1,973 individual CGI models.
The opening of the movie is a minute-long completely CG sequence, starting with a view of Mars from space. The camera travels through clouds to the surface of Mars and along a giant trail pitted with mining holes. We shot aerial footage of the Utah desert from a helicopter. The path of the camera was prevised based on GPS maps and Google Earth. We prepped when to shoot to get the best lighting but the speed of the real camera was too slow for the Power of Ten idea. So we re-mapped the live action plate on to geometry and this gave us greater freedom for the camera move. Jon Neill and layout artist Thomas Mueller designed the shot starting in space through CG clouds to the surface of Mars ending with the camera rising up between the city's moving legs.
The camera then pans up to reveal a monstrous, dark city marching along the planet's surface. This is the city state of Zodanga, which is mercilessly consuming the planet's resources. We see the enormous mechanical legs of the marching city, and then the camera pans upward to reveal the airfield deck and palace as a flying machine takes off and whooshes past the camera. The camera pans down to reveal Helium City, perched on a rocky pedestal. This lovely city cultivates its own food and prizes knowledge and culture. The differing architectural styles reveal the character of each nation.
Helium City, perched on a rocky pedestal
The city of Zodanga was based on an overall design concept by Ryan Church in the production's art department. Cinesite had to interpret and build detail into the design to make it work for full-screen backgrounds. But the challenge was that we also had to make it detailed enough to be seen in close-ups.
The production did build a few sets for locations within the city, but even these required considerable digital extension work to place them within the immense scale of the city. It's hard to over-state the immensity of the work. Thousands of pieces of geometry were modeled for the building and we also modeled dozens and dozens of props, from tables to lamps, urns to bottles. To quantify it, we built 291 structural element models and 242 CG props. There were up to 20,000 objects in a single shot and between 1 to 2 billion polygons depending on the camera position and detail required.
Then there are the 674 legs that support Zodanga and move it forward. If you were to animate every one of those legs and render it, the computers would fall over and die. We had to create tactics to pre-cache the simulation and work out animation cycles and switch off the legs not seen by the camera. VFX supervisor Jon Neill worked out a way of pre-caching the ray-tracing that meant that it wasn't so computationally expensive and we could get versions of the shots in a much more expedient way. Variations in movement -- as well as additional animation such as cogs and cabling -- were used to create a more interesting look in the leg movements.
Zodanga final comp...Then there are the 674 legs that support Zodanga and move it forward.
It was similarly impractical to texture all the sections of the city in great detail. After decisions were made as to which sections of the city would be seen in close-up, we used a combination of Photoshop, Mari and Mudbox with bespoke shaders and lighting development to create a dirty, industrial feel to the detailed areas.
Jane Rotolo our Massive TD added to the city and ship, based on motion capture of specific actions such as turning the ship's wheel. Using Maya fluids and Houdini we covered the city in dust. Andrew wanted just a small amount of that dust to drop away from the ship as it takes off. We had to find that subtle balance so it didn't look like it was a propulsion jet
Flyer Chase on Zodanga
This was the first sequence we did on Zodanga. Since the scenes used a huge amount of memory-heavy geometry, the biggest challenge was how to render the props and set pieces in the digital set. We used Cinesite's proprietary geometry format, MeshCache, which support LOD files. Between layout and lighting departments, we built mid-res and low-res models in the distance and high-res models in the foreground, which allowed us to make the shot as complex as possible while still fitting it into memory.
Lighting the hangar deck was a challenge since we had to mimic real world lighting. We did this via global illumination, which calculates how light bounces around in the scene. We normally began with only one light (that is, the sun), and then calculated the global illumination. A lot of shots needed extra lights, and a god-ray pass using a volumetric shader added more atmosphere, all of it to make a believably sunny and dusty desert environment.
We also added CG wings to the practical flyer that John Carter escapes on. Andrew had read about these ships in Edgar Rice Burrough's book, and he wanted them to have an 'antique vessel at sea' feeling. We built these ships based on art references he gave us, and they turned out to be such beautiful assets. The wings are powered by the sun, and we devised a shader that would give reflections to the surface, so the color gamut goes from blue through purple to gold. Andrew described the work we did as being similar to fish scales; whenever the ships turn, it looks iridescent, like fish scales in the sun. The wing shader, which we controlled in real-time, changed the color based on the angle between the wings and the camera.
This is also where we did a number of shots with fully CG digital doubles, for which we used subsurface scattering and our Cinesite skin shader. We did a full high-resolution digi-double of Carter as he jumps from one pillar to another, and we also simulated movement for his clothes and hair.
Creating close-ups of digidoubles was perhaps the most daunting challenge in John Carter. That terrified me at the beginning; I'd never had the camera this close on a digital double. We did a huge amount of digidouble work and it took a lot to pull it off.
Also in this sequence, we reach the city's legs and focus on them during a dramatic chase. In some shots we see hundreds of the legs, and the amount of geometry per leg was again challenging. We also had to layout the impact effects when the legs hit the ground. The effects department provided an impact effect element and a layout that would analyze the movement of the leg and place the particle and fluid effects at the exact position of the ground impact. To give compositing more control, the leg effect was rendered in several layers.
Helium, a grandiose cathedral-like made-of-glass city, had to match exactly the art department concept stills from Ryan Church. To create the matte paintings with the level of detail Andrew required, projections were created for the terrain. The matte paintings were easy but also very time-consuming as well as render-heavy for the full 3D renders.
Helium is a grandiose cathedral-like city made-of-glass.
On Helium, there is a 197-shot Palace of Light sequence, a huge challenge as it established the look of Helium that would be re-used in other sequences. Andrew described this as "the jewel of the city," and we got many art department sketches as well as layouts, blueprints and texture samples. The glass itself was difficult. It needed to look like the frosty glass that was on-set inside the palace, but we also needed to keep the palace looking beautiful. It took a lot of time and tests to get right.
Palace of Light
The palace also contained a large number of digital assets, including a balcony, buttresses, ribs, glass feathers, a floor, mirror, flags, flambeaux and lenses as well as a transporter that crashes through the side of the palace, Carter's sword, and a fully animated CG Zodangan flier. We needed to be able to view the fully CG palace from its exterior and also use it as a set extension for live-action that was shot on an interior set.
The interior was a night scene, lit with moonlight and hundreds of flambeaux. It was a tremendously complex scene already and was then combined with the ship crashing through the glass walls. We built some panels with additional geometry, which worked better for the shattering-in effect. All in all, the city structure was built of 346 models with 74 individual props.
This 82-shot section of the movie contained an amazing amount of work. It started on my first day of shooting on set, where we were faced with a 360-degree greenscreen, and Andrew said, I want this room to be made of nano-technology. In fact, Thern is a living nano-technology matrix. We did a lot of R&D and worked on that environment for a full year.
Covered in Thern
In the crucial scene, when Carter and Dejah land on the surface of the pyramid, Thern begins to grow beneath their feet and then breaks off the flat surface of the pyramid into a Thern wave. The surface breaks into steps that drop down, and Carter and Dejah move to a blank wall that transforms into a Thern tunnel. That's the point where you'll see more of the digidoubles we made; a handful of wide shots required Carter and Dejah digidoubles, which were hand-animated. As they move into the tunnel, the Thern effect builds around them, leading them deep into the pyramid. At the end of the tunnel is the Thern Sanctuary that also builds itself.
These growing Thern shots are some of the most complex we did in the movie. I'm very proud of this environment. From a greenscreen room and a little conversation, we came up with a cathedral of blue ivy that builds itself and deconstructs before your eyes. The entire Thern effect system was designed and built from scratch with a combination of Maya, Houdini and custom in-house software. The final system was a semi-automated way to 'grow' Thern into any environment and geometry.
The entire Thern effect system was designed and built from scratch with a combination of Maya, Houdini and custom in-house software.
Early on, via cineSync from the U.S., Andrew looked at our animation test showing how the floor would grow and he said, 'You guys nailed it -- go to the pub.' You can see the final result in the trailer, when the princess Dejah touches the ground and it comes alive with blue light.
This shot continues in the Sanctuary, as Dejah activates the Ninth Ray sequence. When the Sanctuary is activated, nine fingers of Thern run across the floor -- another example of the very detailed Thern effect. Detailed camera tracks completed in 3DE were used for all the shots in the Sanctuary sequence. We used a LIDAR scan of the set married with our geometry of the Sanctuary layout, which allowed us to determine exactly what part of the Sanctuary would be seen in any camera direction.
Around 26 of the 82 shots in the Thern sequence were rendered as native stereo CG rather than post-converted. These shots lend themselves to being rendered with left and right eyes as they exist as totally computer-generated shots so there's no need to post dimensionalize. Compositing the Thern effect in stereo proved challenging in unexpected ways. Compositing the various Thern tip glows and self-illumination effects were difficult to fuse correctly and we used great care in Nuke to preserve the look of the mono final at the same time we were generating a stereo composite.
What we learned
The cities of Zodanga and Helium and the sequences highlighted above were just part of what Cinesite accomplished. We also did a flyer chase sequence on Zodanga, an airship battle and other Thern effects.
Through the experience of working on John Carter, we learned a lot as a company. Working on 800+ shots of such diversity meant we had to be very clever in how we rendered each shot. At the same time, audiences today expect so much more. They're not impressed by the fact that it's created digitally. It has to look right, and audiences know when something doesn't work.
The scale and size of the assets we had to render were immense. Traditional ray-tracing for the Glass Palace of Light was incredibly computationally expensive. You could set a render and come back two years later. There were a number of similarly large shots we needed to ray-trace and perfect, but once established, the smaller shots could be done in a different way.
I learned to be efficient and focus on the important shots. I also learned that there are some shots worth fighting for; working on them a couple more days make them brilliant. Other shots you can keep playing with until the end of time, and someone needs to say, Stop here! I think that's the artist in us all that wants to keep working on it.
To manage such a huge number of assets, Cinesite had an army of producers and coordinators who were amazing. They're really the unsung heroes. We have our own internal shot manager that has saved us on many occasions. We save and publish the assets so everyone can see where they are, in thumbnails, which is much better than a file name. We pre-planned and had a lot of hardware investment so we had enough disk space for 800 shots and multiple versions.
I so hope this movie gets the recognition it deserves. It's quite the epic, with a lot of humor. And, if I dare say so, the effects are very wonderful.
All images courtesy of Cinesite. Please click on any image to zoom.
New John Carter Trailer introduced by Andrew Stanton | Official Disney 2012 Trailer | HD (YouTube)
|Related Articles / Tutorials:|
TV & Movie Appreciation
Favreau, Technicolor & MPC Make The Jungle Book Come Alive
Todd McCarthy, veteran film critic and historian, in his review of director Jon Favreau's new, stunning adaptation of Rudyard Kipling's The Jungle Book declared, "...the visual effects team led by Robert Legato and (MPC's) Adam Valdez has both created sumptuous settings that look as lifelike as any CGI ever presented in a studio feature and integrated both humans and animal characters in them in seamless ways."
TV & Movie Appreciation
VFX Legion | Hardcore Henry breakdown reel
Remote post-production and visual effects studio VFX Legion has released its breakdown reel for the incendiary Hardcore Henry.
The reel reveals the work that went into the first-person perspective action film, from augmenting violence to stitching shots together into one continuous sequence.
TV & Movie Appreciation
Renaissance Masters Go 3D with Nuke
VFX legend Steve Wright helped Italy's Sky 3D tackle an epic project, as Italian all-3D television station set out to present the city of Florence and the masterpieces of Renaissance art housed in the Uffizi Gallery in a spectacular stereoscopic 3D movie shown in 60 countries around the world. While the majority of the film was shot stereoscopically, Steve's challenge was to use Nuke to present some of the world's most precious artworks fully dimensionalized. Here's how he pulled it off.
TV & Movie Appreciation
The Sisterhood of the X-Files Fandom
As the first show to create a rabid, real-time internet fandom, devotion to "The X-Files" has been growing in intensity with each year since the original series finale, with a fanbase that is clever, thoughtful, and largely female. Not that there's any shortage of male X-Philes, but there's a generation of women who was inspired to technical careers by the Gillian Anderson's Dana Scully. Kylee Peña is among them, and additionally very specifically inspired by the production values of "The X-Files" to build a career in the technology of TV storytelling in particular. Here's Kylee's look at what it has meant to be a female fan of the art, technology, and empowerment of "The X-Files" in the 21st century.
TV & Movie Appreciation
Peter Doyle: Supervising Visual Colourist at Technicolor
Peter Doyle, Supervising Visual Colourist at Technicolor, shares details of his upward spiraling career. His deep technical knowledge allows for a perfect blend of creativity and productivity in equal measure. Here he talks about his career, his aspirations, and his involvement in productions right from the outset.
Feature, People / Interview
TV & Movie Appreciation
Introducing Ultron: Trixter Builds The Avengers' Biggest Bad
At the heart of Marvel's biggest Avengers movie yet lies their greatest threat yet: Ultron, a self-constructing robot intelligence bent on destroying all of humanity. Munich's boutique-scale Trixter Film was given the critical task of introducing this epic-scale character, which they undertook from concept art through design, mocap, animation, compositing, and output.
Editorial, Feature, People / Interview
TV & Movie Appreciation
The Walk: Largest Use of Cloud Computing in Film History
Award-winning VFX Company Joins UPP and Rodeo FX to Recapture the Legendary Walk Between the World Trade Center Towers. Lead VFX vendor Atomic Fiction needed a more efficient way to do the compute-intensive, and traditionally very expensive, processes of rendering. The company used their cloud-based software Conductor, which allows artists to offload the processing from their own computers and send it to the cloud. By the end of the project, Atomic Fiction had completed 9.1 million hours of processing in the cloud, which equates to over a millennium of processing time!
TV & Movie Appreciation
Milk's Epic VFX For Jonathan Strange & Mr Norrell
Jonathan Strange & Mr Norrell, the acclaimed bestselling epic novel of magical realism set 200 years ago, was adapted by the BBC to a 7-episode miniseries that was itself quite epic, with over 1000 effects shots handled by London's Milk VFX. Creative COW's Tim Wilson spoke with Milk CEO Will Cohen about his team's work on the series, starting with his own enthusiasm as a fan of the novel. To use that word once more, it's an epic conversation about adapting novels, carefully managing budgeted creativity, and collaboration. Books, televised cinematic storytelling, VFX, good conversation, and magic: if any of those is your cup of tea, you won't want to miss this.
Editorial, Feature, People / Interview