ADOBE AFTER EFFECTS: Forum Expressions Tutorials Podcasts Creative Cloud

Interlacing Progressive Footage

Interlacing Progressive Footage
A Creative COW Tutorial

 

Interlacing Progressive Footage

Marco Solorio Marco Solorio
OneRiver Media
Walnut Creek, CA, USA

©Marco Solorio and CreativeCOW.net



Article Focus:
We've all heard of de-interlacing footage, but what about re-interlacing? Marco Solorio of OneRiver Media shows us how to create interlaced footage from a progressive source. The results are picture perfect!

So why on Earth would you ever want to purposely interlace footage that was shot in a progressive format? Case in point: you’re working on a project that was shot entirely in interlaced format (60i) and you’ve been given some additional footage, maybe B-roll, or even motion graphics, that were given to you in progressive format (30p). When adding this 30p footage to the editing timeline, you quickly realize the flickering of the 30p footage just looks too out of place against the rest of the 60i footage in your timeline. Rather than keeping the 30p footage as is, this tutorial shows how you can turn your progressive footage (30p) into crystal clear interlaced footage (60i) with results so true that it will completely look as if it was shot on a 60i video camera!

Okay so let’s say you have some progressive footage that you need to apply to an interlaced video project. Typically, this may be a 30p source that needs to be 60i or a 24p source that needs to be 60i. Generally speaking, you can simply add the 30p clip right in the 60i timeline and you’re good to go. Likewise, if you have a 24p clip, you can just as well add 3:2 pulldown and boom, ready for a 60i timeline.

But if the progressive clip still just looks too jittery against the rest of the other 60i footage, something needs to be done. Adding interlaced fields from a progressive source isn’t too far-fetched as one might think. Like the de-interlacing process, "re-interlacing," for lack of a better term, is also done by means of pixel interpolation. Where de-interlacing may cut the vertical resolution in half, re-interlacing does something of the opposite by adding spatial interpolation. More specifically, it doubles the frame count.

In reality (and strictly speaking in terms of image quality), an interpolated re-interlaced clip can actually look better in quality than an interpolated de-interlaced clip. With that in mind, I've created examples you can download from this tutorial and drop in your DV timeline to see for yourself. I think you'll be surprised by the results.

For the sake of simplicity, I'll go over the methods that are relative for the same time-base. In other words, I'll first show you how to convert a 30p clip to 60i. The same method is used for converting a 25p clip to 50i. Later, I'll discuss converting 24p to 60i and 50i.

     

Frame Rate Naming Conventions

60i = 29.97 FPS, interlaced
60p = 59.94 FPS, progressive
50i = 25 FPS, interlaced (PAL)
50p = 50 FPS, progressive (PAL)
30p = 29.97 FPS, progressive
25p = 25 FPS, progressive (PAL)
24p = 24 or 23.976 FPS, progressive

The number represents the amount of images (not frames) to be seen in one second. E.g., in 60i video, there are 2 images for every frame of video (vertical resolution cut in half for each image... one image for even fields and another image for odd fields), thus a total of 59.94 "half" images are viewed every second.

The letter after the number says whether those images are interlaced (half resolution) or progressive (full resolution). Some people refer to "30i" to represent 29.97 interlaced frames, but this technically incorrect. In reality, 30i means 15 FPS, interlaced, which does not exist in any video standard.


The Tiki Test Subject

I've used one of my stock footage clips from my collection at RevoStock.com called, "Brady Bunch Tiki: V2" as a test clip to use as an example for this article. This original clip is 1080p24 (and is also supplied as 720p24, 576p25 PAL and 486p24 NTSC at RevoStock). For this tutorial, I created a master file by conforming it from 24p to 30p and reduced it down to SD letterbox 4x3. It's from this converted SD file on which we'll perform all our tests. I thought this clip would work well for this test since the tiki figure moves from frame-left to frame-right, ideal for interlacing.

Click to download
Figure 1 - A single frame from the 30p source. Click the image to download the clip.


Doubling Your Frame Count

The first step is to double up the literal frame count. This is accomplished in one of two methods.

  1. Double the TRT of the 30p clip so it's twice as long. Or...
  2. Double the frame-rate of the original file from 30p to 60p.

In order to do this properly, the new frames need to be interpolated by means of a vector-based pixel warping or morphing algorithm. This can be accomplished by a variety of different applications, including Motion 3 (by use of the Optical Flow feature), After Effects (by use of Layer > Frame Blending > Pixel Motion), Shake, the Twixtor plugin (which can be used in Final Cut Pro, After Effects and several other host applications), Boris FX, or any other application or plugin that can double the frame rate or frame count by means other than merely frame-blending the frames. You do NOT want to frame-blend this step or the entire process will not work.

The best way to tell if this step is working correctly is to look at the new frames that have been created. If they have an overlapping ghost look to them, then it's frame-blending, which you do not want. If the new frames literally look like new frames with no ghosting or overlapping, then you're on the right track.

Interlacing
Figure 2 - Red circles show that this clip has been frame blended for doubling the TRT. We DON'T want that!


Convert to an Interlaced Format

Once your clip is rendered with twice the frame count, you'll now be ready to interlace it, which can be done in After Effects, Final Cut Pro and pretty much any other video application. I found that After Effects renders out a cleaner interlace (actually, a perfect interlace) than does Final Cut Pro, so you may want to keep that in mind. If your clip is now 30p at twice the TRT, you'll want to turn it into a 60p clip at normal speed. Here's how:

Adobe After Effects
Select the rendered clip in the Project window and right-click it and select Interpret Footage > Main. In the Frame Rate section, conform the frame-rate to 59.94 FPS.

Frame Rate

The clip will now be 60p. Create a new 60i comp in After Effects and place the 60p clip in the timeline. Even though your timeline is only 29.97 FPS and you can't see the extra frames when scrubbing frame by frame, don't fear; when you render the final clip, it will use the extra frames in the 60p clip to create the new fields.

Let's go ahead and render this as a final clip by selecting Composition > Make Movie from the menu bar. This should open up the Render Queue window with a new comp in the queue. You'll need to change the Render Settings either by selecting a pulldown option next to it or by clicking the name next to the pulldown option.

The thing to absolutely keep in mind is to make certain you render this clip with Field Rendering turned on. You'll need to select either Upper Field First (UFF) or Lower Field First (LFF), depending on your editing hardware and format of choice. For the samples provided in this tutorial, I rendered to NTSC DV, so LFF it will be.

Time Sampling

From there you'll want to select your format choice and render location. Click Render and you're done.


Final Cut Pro
Bring your rendered 30p clip (that is now twice the TRT) into your FCP timeline. Right-click and select, "Speed..." Change the Speed setting to exactly 200% and make sure Frame Blending is turned on. This will not interpolate new motion as one may think with the "Frame Blending" nomenclature. Rather it's telling FCP to turn on field-rendering on anything that can accept it. Since we shrunk the TRT of the clip by half, it's essentially a 60p clip now. If the clip you brought to the timeline was 60p, then you're already one step ahead.

Now when we render the clip in the FCP timeline, you have a finished 60i clip with smooth motion.


The Finished Clip

When everything is rendered correctly, you'll have an interlaced clip that's nothing short of amazing. For my testing, I used Twixtor in After Effects to perform the initial frame doubling. I then rendered the final clip using After Effects as described above and below is the result of that render. Place the clip in your DV timeline and compare it to the original 30p clip. It's next to impossible to tell that this clip was once progressive! It's easy to think that the clip was shot using an interlaced video camera (when in reality, the original clip was shot using a Canon 20D DSLR still camera, using a 60mm prime lens with a combination of time-lapse and a motorized motion rig).

Click to download
Figure 3 - A properly rendered clip will employ true interlaced fields and run as smooth as silk in 60i. Click image to download.


Working with 24p

There are a few ways to turn a 24p clip into a 60i (or 50i) format.

  1. Conform 24p to 30p. Then convert to 60p, then 60i as outlined above. Note this will increase the speed of the clip.
  2. Add 3:2 pulldown so the clip works in 60i. No interpolation is required and no speed increases are incurred, but it may look a little jittery as compared to surrounding 60i clips.
  3. Spatially interpolate 24p to 30p (or 60p) using pixel morphing/warping and then convert to 60i as outlined above.
  4. For PAL, conform 24p to 25p. Then convert to 50p, then 50i as outlined above. This will increase the speed but is hardly noticeable.

Conclusion

The key to this entire process lies in the frame-doubling step. The best frame-doubler will give you the best results in the end. The actual interlacing part is easy but it's the frame-doubling part where the real magic happens. Once properly interlaced, the clip will be so clean it's basically impossible to know it came from a progressive source and not an interlaced one. The results can be quite amazing to say the least.

Some plugins will allow you to re-interlace with fewer steps as listed above (e.g., RE:Vision Effects Twixtor). For the best quality, I recommend rendering the final video clip out of After Effects as opposed to your NLE if the choice is between the two.

Feel free to discuss this tutorial in Creative Cow's After Effects forum.


Downloadable Files:

Links:


Marco Solorio began his career in media production at the start of the 1990's and has been accredited with many industry achievements. He's the recipient of numerous creative awards ranging from visual effects to editorial to music composition. He's a published writer for both print and web mediums and has appeared on and off-camera for both creative and technical topics. Marco owns OneRiver Media, a successful post-production facility in the San Francisco Bay Area. He also owns Cinesoft, a software company whose flagship product, Media Batch was developed as proprietary server software but is now available to the entire industry. He's also known for the internationally recognized OneRiver Media Codec Resource Site, a resource that compares various codecs for the benefit of end-users and developers alike.

: : : Page design, layout and images by Marco Solorio
:


 



Comments

Re: Interlacing Progressive Footage BORIS FX
by David I'Anson
Hi there. thank you for your tutorial. Do you know which Boris plugin to use to double the frame rate? thanks, David (Editor in London)
Re: Interlacing Progressive Footage
by Bob Azhar Ismail
Hi Marco,
I am working on a project accidentally shot at 25p but saved as DV PAL lower even. During playback it will only show on the TV monitor I am wondering when you double the TRT, what format did your rendered out before pulling back in the created 50p?

Should I render at lossless or as DVD PAL lower even file?
Re: Interlacing Progressive Footage
by Gabriel Lopez
Hi Marco Solorio, I'm not getting my pass progressive 29.970 fps video to 29.970 with interpolated frames giving smoother motion. I'm using Twixtor in sony vegas pro 11 but the video is faster but what I want is to do exactly as you did in After Effects. Could you help me? Thank you and congratulations for the tutorial
Re: Interlacing Progressive Footage
by Ben Slavens
Hello Marco,

First off, thanks for the insightful (and in my case miracle) tutorial!

Here's the skinny:
I've spent the entire day today shooting a spot for French TV (in WA, USA...I'm American). We used Canon 550d's which (while in PAL mode) output H.264 Quicktime's @ about 50,000Kb/s. I'm in a pinch now because I shot 25p and the client needs 50i...I'm so so glad there is a relatively easy way to interlace this footage, but I have a couple questions:


1.
I'm using After Effects CS6 and the Pixel Motion Plug-in to double the frame rate via the Comp Settings (after dragging the clip onto the new comp button). I am then rendering the video out @ 50fps. Is this right?

I noticed in the "Convert to an Interlaced Format" section you import the just-frame-rate-doubled footage into AE, then interpret it. However, the example clip you are interpreting is still 29.97?? Does this mean I need to double the comp's frame rate, pixel motion, then render at 25fps?? Clearing this up would be Greatly Appreciated!


2.
Since this process requires 2 renders to accomplish the interlacing, my puny H.264 (compressed roughly 40:1) is gonna get crushed. SO, will step 2 ("Convert to an Interlaced Format") still work if I render the first, double frame-rate footage as a TIFF (or PNG) image sequence? Since I need to convert ALL of the footage to 50i, image sequences would make it possible for Multi-Machine Rendering, thus saving my should-of-rented-a-proper-camcorder hide!

Thanks Marco (or anyone who knows the answer), you're the BEST!

Ben
Re: Interlacing Progressive Footage
by Allen Watson
Thank you, thank you, thank you!

I've been trying to do this with FCP and Motion, without success until I read your article. This conversion is one that few people want, but those of us who do, really do.

Cheers!
- Allen
Re: Interlacing Progressive Footage
by Simon Piniel
Very solid tutorial. Thank you!

However, it seems impossible to punch fields into my 1080p25 animation. There are only about 6 colours, no gradients and very fast elements throughout, with strobe effects. The worst footage ever for any time stretch software (full HD res won't make anything any easier). I've tried Twixtor and AE native. Btw. simply rendering the original with fields won't work because there's a lot of frame by frame animation involved.
Re: Interlacing Progressive Footage
by Laurie Gibbs
Thanks very much. A very useful Tut - I had come up with the same solution myself but it wasn;t working.

Finding this tutorial just helped me get a few fundamentals right.
Interlacing Progressive Footage
by David Burch
That doesn't work for me because I am already in a 60p format. In other words, if I did what the article told me to my footage would be playing back at twice normal speed. Everything I've tried in FCP or Compressor has resulted in 30p footage as opposed to true interlaced scanning.
Interlacing Progressive Footage
by David Burch
What about if you're starting with a 60p source? I can't seem to get my 720p60 footage to interlace properly within FCP. Anybody know how to fix this?
Interlacing Progressive Footage
by Marco Solorio
"If you try to double the framerate with your standard software (AE, FCP) then the results will look poor. You will need a application or plugin which generates inbetween frames (like the mentioned Twixtor). Just doubling the frame rate will not do the trick."

This is *thoroughly* explained in the tutorial multiple times.

"When the 30p footage is dropped into the NTSC timeline, the software would sample the first field in frame 1, then sample the second field in frame one. No motion would happen as the two fields are being sampled from one progressive frame. Render the clip and done."

This was described in the tutorial as well; you'll get strobe or flicker type playback since field 1 and 2 are sampling from the same spatial source unless you perform the techniques described relating to appropriately doubling the frame count.
Interlacing Progressive Footage
by Dave Beaty
I've been dealing with the issues of converting 720p30 video to NTSC 29.97i in FCPro.

Logic and knowledge of NTSC interlacing would lead me to belive that adding interlacing to the 30p footage would be a simple matter. When the 30p footage is dropped into the NTSC timeline, the software would sample the first field in frame 1, then sample the second field in frame one. No motion would happen as the two fields are being sampled from one progressive frame. Render the clip and done.

But in FCPro, this is not the case. Aliasing happens in this method when using HDV clips. I think perhaps because of the scaling introduced.

So your method would work better in that case. It's very similar to the way 3D animators used to generate interlaced animations before interlaced output was an option in many 3D apps. Just create a 60p animation and drop it into After Effects.

But, when you have a 90 minute doc with 30p clips that need to be send to an NTSC sequence, it's probably too time consuming.

Dave Beaty


Related Articles / Tutorials:
Adobe After Effects
Imagineer mocha Pro 5 Plug-In for Adobe: An In Depth Review

Imagineer mocha Pro 5 Plug-In for Adobe: An In Depth Review

Imagineer mocha Pro 5 Plug-in for Adobe brings all the amazing features of the professional version of the mocha Planar Tracker directly into After Effects and Premiere Pro in the form of a plugin. In this in-depth review, After Effects tutorial guru Tobias Gleissenberger of Surfaced Studio will show you what you can do with this new plug-in, and discuss what he likes and doesn't like about the new update.

Tutorial
Tobias Gleissenberger
Adobe After Effects
After Effects 2015.3 - My Favorite Features

After Effects 2015.3 - My Favorite Features

Learn why you should upgrade to After Effects CC 2015.3 - 13.8.1 - a close and detailed look at the latest release of After Effects (August 2016). Roei Tzoref will be focusing on his favorite features that set this release apart from previous versions: Performance, Queue in AME, Lumetri Color new features, and more.

Tutorial
Roei Tzoref
Adobe After Effects
Advanced Masking in Adobe After Effects

Advanced Masking in Adobe After Effects

Some of the coolest stuff you can do inside of Adobe After Effects is only possible once you unlock the power of masks. Join After Effects whiz Tobias Gleissenberger of Surfaced Studio to learn about mask animation and interpolation, using the variable width feathering tool, managing mask modes and ordering, and more.

Tutorial
Tobias Gleissenberger
Adobe After Effects
Fixing Common After Effects Problems and Mistakes

Fixing Common After Effects Problems and Mistakes

Got problems using Adobe After Effects? Exported files too large, Expressions not working, mixing shapes and makes, modes/switches, selecting previews for layers vs. comps - Surfaced Studio's Tobias Gleissenberger shows you fast fixes for these and more!

Tutorial
Tobias Gleissenberger
Adobe After Effects
mocha AE Planar Tracker for Absolute Beginners

mocha AE Planar Tracker for Absolute Beginners

Want to learn how to create advanced visual effects? Learn how to use mocha AE to track your shot and add advanced visual effects to live action footage inside Adobe After Effects. mocha can help you track shots that would be hard to track using traditional 2D point or feature trackers because it is a PLANAR TRACKER. A planar tracker uses planes and textures to track as opposed to points or groups of pixels. This allows the tracker to stay on track even if your shot contains motion blur or a very shallow depth of field. mocha AE comes included with Adobe After Effects and is available since CS3 and there is no reason for you not to use this awesome tool to make it easier for you to track your shot, replace screens or rotoscope!

Tutorial
Tobias Gleissenberger
Adobe After Effects
How to Make After Effects Faster with Proxies

How to Make After Effects Faster with Proxies

Learn how to make Adobe After Effects faster by using PROXIES! A proxy is a placeholder that stands in place for a very large video file or image sequence in your project. You can easily create proxies for the large source files that you are using and After Effects will automatically link them to the item in your project panel.

Tutorial
Tobias Gleissenberger
Adobe After Effects
Stabilize & Smooth: mocha 5 Plug-in for Adobe & Avid

Stabilize & Smooth: mocha 5 Plug-in for Adobe & Avid

Imagineer Systems and Boris FX product specialist Mary Poplin shows you how to stabilize with the new mocha Pro 5 plug-in inside of Avid Media Composer, Adobe Premiere Pro and After Effects. This tutorial covers artistic stabilization, such as smoothing out camera movements or stabilizing around moving objects, completely locking down shots, and automatically replacing edge fill on planar backgrounds.

Tutorial
Mary Poplin
Adobe After Effects
Adobe After Effects Puppet Tool

Adobe After Effects Puppet Tool

Become a puppet master by learning how to use the Puppet Tool in Adobe After Effects! This intermediate-level tutorial from After Effects guru Tobias will show you how the Puppet Tool allows you to add joints and animations to bring life to any static image!

Tutorial
Tobias Gleissenberger
Adobe After Effects
How to Spawn A Clone in Adobe After Effects

How to Spawn A Clone in Adobe After Effects

Want to learn how to create a cool clone spawn effect in Adobe After Effects? Follow along with After Effects whiz Tobias from Surfaced Studio in this exciting new visual effects tutorial that combines green screen using Keylight, CC Vector Blur, the Liquefy Effect, CC Particle World, and much more, delivered in Tobias' inimitable style!

Tutorial
Tobias Gleissenberger
Adobe After Effects
Creating A Flame on Your Finger with After Effects

Creating A Flame on Your Finger with After Effects

It is easy to do some motion tracking and attach a basic stock footage element of fire onto your hands, but there is a little bit of work involved if you actually want to make it look good. In this intermediate tutorial by After Effects expert Tobias, you'll see how to use a fire stock footage element to set your thumb on fire! There are lots of useful tricks for null objects, expressions, and more in this tutorial that will help you create all sorts of other cool visual effects -- or set even more things on fire!

Tutorial
Tobias Gleissenberger
MORE
© 2016 CreativeCOW.net All Rights Reserved
[TOP]