LIBRARY: Tutorials Reviews Interviews Editorials Features Business Authors RSS Feed

Nosferatu becomes Orlok the Vampire in 3D!

COW Library : Adobe After Effects : Chris Heuer : Nosferatu becomes Orlok the Vampire in 3D!
CreativeCOW presents Nosferatu becomes Orlok the Vampire in 3D! -- Adobe After Effects Feature


Stevensville Maryland United States
CreativeCOW.net. All rights reserved.


When asked what it would take to turn the movie Nosferatu into an anaglyph 3D movie, I thought for a moment and then replied "Seventy thousand dollars, a team of 10 to 15 visual effects artists and 3 months."

Curious, I then asked "What do we actually have to work with?".  Keith Carter, the Director of the project (and a good personal friend) replied "A very small budget... and YOU."

Now to fill in some details.  The reason I was able to quote a price so quickly (which I would now consider way under budget) is because this story begins about a year earlier.

Carol Bidault de L'isle of Media Fusion in Washington, DC had acquired a library of recent independent films. Carol and Media Fusion help independent filmmakers that cannot find access to the marketplace. "Sometimes it is just a matter of repackaging these films, sometimes it's re-editing that can make the difference," she says.

Among these new titles was an odd copy of "Nosferatu," by F.W. Murnau. "Nosferatu" was the first film to be made (although without permission) based on Bram Stoker's "Dracula," and has developed a massive cult following since its release way back in 1922. 

Nosferatu - classic shot of Orlok in the doorway

 

Puzzled with what to do with this film, Carol consulted with local filmmaker, animator and horror film fan, Keith Carter. It was Keith's idea to refresh this classic so a whole new generation of viewers who might not care to watch a silent film would give it a shot. He proposed re-editing the movie for a more modern pace, re-scoring the music as well as adding foley sound effects to give new life to the action and... make it all in 3D.  Carol loved the idea and the process began.

Carol and Keith approached me to see if I could figure out a way to convert this 2D film into a 3D experience. Fortunately, I had already begun playing around with anaglyph 3D.  I was always intrigued with an effect that After Effects has called "3D Glasses."  It seems pretty useless unless you have stereo footage already shot. I had been experimenting with 3D After Effects scenes that contained 2 virtual cameras. Using those cameras outputs with the 3D glasses effect creates perfect CG generated 3D imagery. I had also been working with Chroma Depth glasses which place various colors at different depths.

I knew I had to create a second camera's perspective (which I call the Right Eye View) using only the original footage. Industrial Light & Magic achieved this when they turned "The Nightmare Before Christmas" into a 3D movie by basically recreating the entire film in their 3D animation application. It's brilliant work, but we didn't have the time, money, manpower or 3D animation expertise to pull that off.  I had to find a way that would work for a 2.5D compositor like me!

As I created a one minute 3D trailer for Media Fusion to show around (and to prove I could do this), I was trying out different ideas & techniques.  The one I used to finish the trailer took every second of an ENTIRE weekend... for 1 minute of finished footage!!!  I rotoscoped each element that I wanted to give depth and somehow (I haven't figured out how I did this to this day) duplicated the rotoscoped mask, offset it a few pixels and used the After Effects "Reshape" effect, which basically morphs the pixels from Mask 1 to mask 2.  This worked but some of the shots had strange edge distortions.  It was, however, good enough to start generating interest in the project.

Orlok in his coffin

 

The one thing I learned from that attempt was it would never work for anything longer than a few minutes.

The project continued, slowly at first, until the day Keith came back to ask me what it would take to do a whole movie.  He was about to start editing and wanted to make sure this could still be done.  I told him to give me a few weeks, because the process needed refinement.  With a mild feeling of panic, I got back to testing.  I already knew I had to shift certain elements in each shot different distances to get this "new perspective".  My goal was to find a way to do this that didn't involve hand rotoscoping each element.

Three weeks later.

THE BAD NEWS: There was no other way to isolate the elements other than roto.

THE GOOD NEWS: Mocha, from Imagineer Systems, to the rescue.  Yay technology!

Keith Carter, director of Orlok The Vampire in 3D
Keith Carter

The Nosferatu footage, like any film from 1922, was jumpy, flickered a lot and showed its years with lots of dirt and damage (even after Keith edited out the worst of it.).  Mocha did an amazing job of tracking through the clutter and was the final piece to the puzzle that led me to believe that this can be done in a reasonable amount of time.

Since there are many versions of this film already floating around out there, production began under the new title "Orlok the Vampire." (The word "nosferatu" appears in Stoker's book as the Transylvanian word for vampire. Stoker named his "nosferatu" Count Dracula. Murnau named his "nosferatu" Count Orlok.)

Keith worked tirelessly trying to faithfully update the horror classic.  About a month and a half later, I got the hard drive that contained the first draft of the movie. Time to put my money where my mouth is.

Since time and money were tight, we decided to only rotoscope and fully treat the shots with Orlok the vampire in them.  That sounded reasonable!  I started exporting all of the shots that we agreed I'd roto... 70 shots in all!  My stomach dropped. With budget for only one effects artist (me), I decided not to look at the mountain of work.  Just take it one shot at a time.  I put on my cardboard red/cyan glasses (although you can get a variety of plastic glasses from Amazon), and began using the technique I had developed:

  • First, roto every element that had a different depth. (without glasses on!)

  • Shift these elements to create the new perspective. (with glasses on)

  • Clean up the background plate.

  • Finally, combine this new "right eye view" with the original footage using the 3D Glasses effect.

Here is how a typical comp looked in AE. Click the images to see the full-size versions.

AE comp for Nosferatu 3D

 

And here is a sequence in Mocha:

Mocha splines

The first shots took longer, but eventually, I started to hit a stride.  Even better, some new techniques were coming to mind and others fell into my lap.  I found displacement mapping helped give texture and subtle, articulated depth to the "cutout" images I was creating. I accidentally discovered that stretching a layer in one axis made it look like it was angled toward the viewer. That came in handy later, on shots like this one:

 

Nosferatu, Orlok 3D floor

 

Some shots took only a couple of hours, others took days.  Mocha really sped up the roto, but some shots had to still be done entirely by hand.  This process tapped almost every compositing trick I knew.  It was an intense few months, working 4 to 8 hours a day on top of my "day" job.  I would take every Friday off and try to spend any free time with the family.  Somehow with all the long hours and technical challenges, I always looked forward to seeing the next shot completed.

When you work this long on something, you lose perspective and sometimes have trouble discerning how good your work is.  I knew the process was working, because after working for hours on a few seconds of footage, the results would make me smile like a kid seeing 3D for the first time.  I looked for something in every shot that would add greater depth.  One of my favorite shots is when Hutter (our protagonist) is cutting some bread, just before the knife slips and cuts his thumb.  I was able to give subtle depth between his body, arms, hands and the bread.  If you look, it feels like you can reach through the hole between his arms and his body. 

Hutter cutting bread from Orlok the Vampire in 3D

 

It's a shot many may never notice since you quickly desensitize to the 3D effect after a few minutes of viewing.

 

Got your 3D glasses ready? Here are the clips!

Sample 1: A shot I just completed as part of the "additional shots" requested by the producer.  Having lots of tall, thin, waving plants makes roto FUN!!

Sample 2: Another shot added at the end.  I liked all the layers of depth, with plants in the foreground and behind talent.  Then the cat, slightly in front of the woman and the wall fading into the background.

Sample 3: My favorite shot in the whole movie!  I spent two or three nights on this one.  It has so much depth, and I had fun adjusting the effect back as the actors walked away from lens.  You'll see Hutter start in front of his chair, then end up way behind it.

Sample 4: The castle exterior.  I see tons of flaws in this shot, but most people react positively when they see it.  I stumbled into several tricks (that helped me later) working on this shot.

Sample 5: A great Orlock shot (and a sweet effects shot for its time, nearly 90 years ago).  I liked giving the coffins a depth effect that lays back into the distance.

 

Well.  I've told you about 70 shots in the film... what about the rest of it?

The rest of the film was treated with a much simpler technique.  The "right eye view" has a displacement map effect applied to it.  With subtle tweaks, it can look almost as good as the rotoscoped shots... almost!  With this technique, I was able to treat the rest of the film in a few days.

The opening credits and end graphic were created with Photoshop and After Effects so I had layered files to work with.  This allowed me to use the same techniques used on the roto-ed footage with even better results.  The opening credits really pop!

 

3D credits

Finally, all of the dialog slates were given a subtle treatment.  Too much 3D made them harder to read, so we went with a less is more approach.  Can't let effects get in the way of the story! 

Dialog slate from Nosferatu

 

I didn't get to see the entire film combined until my work was complete.  Keith had been working on the sound while I worked on the 3D.  We had a screening before passing it on to Carol and calling it  finished.  As hard as I worked and as great as I felt the 3D looked when I saw it completed shot by shot, it was nothing compared to seeing it all together.  The pacing, the music and the sound all felt like they were there from the first edit of this film and the 3D seemed to blend in just as subtly which makes the compositor in me happy.  I take pride in finishing a shot in which no one will detect my work.

After about a two week break, the producer called to tell us that our work wasn't finished. "The Orlok scenes are great," she told us, "but we need to add something more to the film." We decided to roto other key scenes in the first part of the film, so that the audience can get a taste of the stronger 3D effects throughout the film.

Orlok dying at sunrise

 

As I finish this article, I have about 15 shots left in the pipeline. This will have been a five-month project, working an average of 5-6 hours per night, roughly five days per week.

In the end, the film is a wild ride with lots of new features, including an introduction by Troma Entertainment's Lloyd Kaufman ("Toxic Avenger," "Class of Nuke 'Em High"). The DVD version will also have a popup trivia version, a Director and Producer commentary version, the "Making Of," two pairs of 3D glasses - and for the die-hard fans, a special edition with a comic book prequel and an action figure, complete with a miniature rat!

Orlok the Vampire in 3D DVD

I had never seen this film in its entirety before this project. I am very impressed with what Murnau was
able to do. It really does hold up all these years later -- Orlok is still the scariest vampire to date! I hope the additions we've made really do draw in a new audience.



What I love about post production is the innovative spirit that makes anything possible.  This is why I started Freefall FX, an animation and effects house located about 30 minutes east of Washington DC on Maryland's Eastern Shore, where things are just a bit more relaxed.  Freefall specializes in animation and visual effects for ad campaigns, independent and feature films.  I enjoy doing the creative work, but not as much as I enjoy watching people react to the work I've produced. 

Without the support of places like the COW, I wouldn't be where I am today. I guess I talk about the Cow a lot. If you look at the photo of my workstation, you'll see the "Creative COW" my kids gave me to put under my monitor so I'll remember where to go if I need help!  You can find me in the After Effects, Imagineer Mocha,  Avid and Fusion forums as well as by searching "skipperjonas" on YouTube to find my channel.

Chris Heuer, Creative COW Magazine

 



 

Creative COW Magazine: The Stereoscopic 3D Issue

This is just one of the great articles in
The Stereoscopic 3D Issue of Creative COW Magazine

Here's a short list of what else you'll find:

  • Perception and the Art of 3D Storytelling
  • Big Pictures from Tiny Cameras
  • 3D DI at FotoKem
  • The 3D Zone
  • IMAX, Dreamworks, and much more!

Read the rest of the issue here!

And be sure to subscribe here!


Comments

3D anaglyph
by Franck fraher
Hi Keith ...
Amazing work on Nosferatu...brilliant..
As a matter of fact, i was planning to do the same thing on my bands Adagio new video :






Do you think it s possible to do it with adobe after effects (and with a lot of work of course)...
If you have any tips , i d be glad...
Thanx a lot...
Tutorial
by Chris Heuer
Sorry, I forgot to post this here. The tutorial (2 actually) are up:

http://imagineersystems.com/support/mocha/tutorials/

I gave all the detail I could (in 30-ish minutes per tut). I will do my best to answer any questions as well.
@Chris Heuer
by zeynep ayguler
@zeynep ayguler
by Chris Heuer
It appears Imagineer took down my tutorials. I am re-posting them on Vimeo. Here are the new links!

http://vimeo.com/18351759

http://vimeo.com/18352889

There are some different 3D conversion techniques that Steve Wright demonstrates on Imagineer Systems tutorials page. His use Mocha to create a Z-depth pass that is used in Nuke.

As with my workflow, there are strengths & weaknesses, but I recommend watching every tutorial on this subject even if you don't own the software. No matter how you do this, it's a LOT of work! Enjoy!

Chris Heuer
Freefall FX, LLC
+1
@Chris Heuer
by zeynep ayguler
Thank you for posting videos again, and for the advice as well..
Waiting for the tutorial...
by vivek mohan
incredible job, as you have done this on top of your "day" job...eagerely waiting for the tutorial....
aspect ratio and stereoscopic formats
by Chris Heuer
Hey Claus,
It will be released in 4x3 for just the reason you gave. We figured going 3D was a big enough change and we don't want to alienate the die hard fans of this film.

It will be anaglyph, that's the only way I know that everyone can see this on a television. Send me any links to this field sequential technique that you have. I am not familiar with it, but we are always looking for ways to make this look better!

Thanks, Chris
!!
by Chris Heuer
"Ridiculously awesome! i wish i had your skill!"

You probably do... It's patience that made this possible. ;-)
aspect ratio and stereoscopic formats
by Abram Kadabram
hi, I really like your achievements in "plastifying" nosferatu.
two questions I'd like to ask:
firstly, will you release the final movie on DVD in 4:3 aspect ratio or in top/bottom cropped 16:9?
I'd prefer 4:3, cause it is soemwhat closer to the original aspect ratio and so the cadrage of DoP F.A. Wagner would not be destroyed.
and secondly, do you consider to render a field-sequential version as well as an anaglyptic one? field-sequential, with proper anti-aliasing, would offer a vastly better 3d-quality compared to anaglyph.

thanks, claus
Nosferatu 3D
by Chris Heuer
No you don't have to have a "center" shot. If this were shot in stereo, there would be 2 shots. One left camera and one right camera. I just decided the original shot would be the "Left Cam" and I created the "Right".
Great job! One thing I don't
by aric mannion
Great job! One thing I don't understand though, is that it sounds like you don't offset the left eye. Do you only offset the right eye? Don't you need the left slightly offset and the right slightly offset while keeping the parallax untouched in the middle?
I wish that after effects could color your layers instantly instead of making you nest 2 comps to apply the 3D effect. It's like doing it blind.
Nosferatu 3D
by Chris Heuer
Sorry it's taken a while to reply. Thanks for the compliments. A tutorial is in the works (first I need a microphone!). Give me a week or two!

Chris
Awesome indeed
by Ian Liuzzi-Fedun
As previously stated, it is incredible what you can do. I am quite impressed that you have taken your seemingly limited knowledge and applied it to this project that might otherwise be outside of your range of skill set. At some pointw would it be possible to create a tutorial on exactly how you do this or even a step-by-step guide?
Bravo
by Jason Milligan
Nice work! It's coming along well.
!!
by Paul Massell
Ridiculously awesome! i wish i had your skill!


Related Articles / Tutorials:
Adobe After Effects
Imagineer mocha Pro 5 Plug-In for Adobe: An In Depth Review

Imagineer mocha Pro 5 Plug-In for Adobe: An In Depth Review

Imagineer mocha Pro 5 Plug-in for Adobe brings all the amazing features of the professional version of the mocha Planar Tracker directly into After Effects and Premiere Pro in the form of a plugin. In this in-depth review, After Effects tutorial guru Tobias Gleissenberger of Surfaced Studio will show you what you can do with this new plug-in, and discuss what he likes and doesn't like about the new update.

Tutorial
Tobias Gleissenberger
Adobe After Effects
After Effects 2015.3 - My Favorite Features

After Effects 2015.3 - My Favorite Features

Learn why you should upgrade to After Effects CC 2015.3 - 13.8.1 - a close and detailed look at the latest release of After Effects (August 2016). Roei Tzoref will be focusing on his favorite features that set this release apart from previous versions: Performance, Queue in AME, Lumetri Color new features, and more.

Tutorial
Roei Tzoref
Adobe After Effects
Advanced Masking in Adobe After Effects

Advanced Masking in Adobe After Effects

Some of the coolest stuff you can do inside of Adobe After Effects is only possible once you unlock the power of masks. Join After Effects whiz Tobias Gleissenberger of Surfaced Studio to learn about mask animation and interpolation, using the variable width feathering tool, managing mask modes and ordering, and more.

Tutorial
Tobias Gleissenberger
Adobe After Effects
Fixing Common After Effects Problems and Mistakes

Fixing Common After Effects Problems and Mistakes

Got problems using Adobe After Effects? Exported files too large, Expressions not working, mixing shapes and makes, modes/switches, selecting previews for layers vs. comps - Surfaced Studio's Tobias Gleissenberger shows you fast fixes for these and more!

Tutorial
Tobias Gleissenberger
Adobe After Effects
mocha AE Planar Tracker for Absolute Beginners

mocha AE Planar Tracker for Absolute Beginners

Want to learn how to create advanced visual effects? Learn how to use mocha AE to track your shot and add advanced visual effects to live action footage inside Adobe After Effects. mocha can help you track shots that would be hard to track using traditional 2D point or feature trackers because it is a PLANAR TRACKER. A planar tracker uses planes and textures to track as opposed to points or groups of pixels. This allows the tracker to stay on track even if your shot contains motion blur or a very shallow depth of field. mocha AE comes included with Adobe After Effects and is available since CS3 and there is no reason for you not to use this awesome tool to make it easier for you to track your shot, replace screens or rotoscope!

Tutorial
Tobias Gleissenberger
Adobe After Effects
How to Make After Effects Faster with Proxies

How to Make After Effects Faster with Proxies

Learn how to make Adobe After Effects faster by using PROXIES! A proxy is a placeholder that stands in place for a very large video file or image sequence in your project. You can easily create proxies for the large source files that you are using and After Effects will automatically link them to the item in your project panel.

Tutorial
Tobias Gleissenberger
Adobe After Effects
Stabilize & Smooth: mocha 5 Plug-in for Adobe & Avid

Stabilize & Smooth: mocha 5 Plug-in for Adobe & Avid

Imagineer Systems and Boris FX product specialist Mary Poplin shows you how to stabilize with the new mocha Pro 5 plug-in inside of Avid Media Composer, Adobe Premiere Pro and After Effects. This tutorial covers artistic stabilization, such as smoothing out camera movements or stabilizing around moving objects, completely locking down shots, and automatically replacing edge fill on planar backgrounds.

Tutorial
Mary Poplin
Adobe After Effects
Adobe After Effects Puppet Tool

Adobe After Effects Puppet Tool

Become a puppet master by learning how to use the Puppet Tool in Adobe After Effects! This intermediate-level tutorial from After Effects guru Tobias will show you how the Puppet Tool allows you to add joints and animations to bring life to any static image!

Tutorial
Tobias Gleissenberger
Adobe After Effects
How to Spawn A Clone in Adobe After Effects

How to Spawn A Clone in Adobe After Effects

Want to learn how to create a cool clone spawn effect in Adobe After Effects? Follow along with After Effects whiz Tobias from Surfaced Studio in this exciting new visual effects tutorial that combines green screen using Keylight, CC Vector Blur, the Liquefy Effect, CC Particle World, and much more, delivered in Tobias' inimitable style!

Tutorial
Tobias Gleissenberger
Adobe After Effects
Creating A Flame on Your Finger with After Effects

Creating A Flame on Your Finger with After Effects

It is easy to do some motion tracking and attach a basic stock footage element of fire onto your hands, but there is a little bit of work involved if you actually want to make it look good. In this intermediate tutorial by After Effects expert Tobias, you'll see how to use a fire stock footage element to set your thumb on fire! There are lots of useful tricks for null objects, expressions, and more in this tutorial that will help you create all sorts of other cool visual effects -- or set even more things on fire!

Tutorial
Tobias Gleissenberger
MORE
© 2016 CreativeCOW.net All Rights Reserved
[TOP]