LIBRARY: Tutorials Reviews Interviews Editorials Features Business Authors RSS Feed

Feeding Live Video into Adobe After Effects - Frischluft Lensfeed for Windows

COW Library : Adobe After Effects Tutorials : Barend Onneweer : Feeding Live Video into Adobe After Effects - Frischluft Lensfeed for Windows
After Effects Tutorial from The Creative COW Magazine


Creative COW Magazine presents Feeding live video into Adobe After Effects



Barend OnneweerBarend Onneweer
Rotterdam, Netherlands

©2006 Barend Onneweer and CreativeCOW.net. All rights reserved.

Article Focus:

Frischluft Lensfeed for Windows - Rough but ready to do the job, this unique AE plug-in fills a need for After Effects users wanting live video to test and set-up shots for later compositing.



Every now and then when I am on the set of a visual effects shoot, I wish I could load the footage being shot into my laptop and do a quick composite to see if I'm getting what I need. Sometimes I'd like to do a quick chroma-key test to see if the foreground separates nicely from the background. Other times, I'd like to see how the set lighting works against a pre-created background.

In very rare cases, I've had the time to actually grab a frame or two from the camera and load them into a laptop. I might suggest a couple of changes to the blocking of the scene or the lighting, based on the result, but that's about it.

So I've had this secret fantasy of being able to take a live camera feed into my laptop and run the video into my compositing software continuously. I've actually done a couple of quick experiments with VJ software packages like Arkaos and Resolume - and although it works, it didn't allow me to use my preferred keying tools and also took me out of my compositing software.

Fortunately, a short while ago I stumbled upon the Frischluft Lensfeed plug-in for After Effects. Frischluft is Philipp Spoeth's oneman company that is probably best known for Lenscare, a high quality lens blur that has been quite popular in visual effects studios for a couple of years now.


USING LENSFEED

Lensfeed is a download-only application that comes with a PDF manual. The introduction in the manual says: "Lensfeed extends After Effects with the possibility to view live feeds from a camera (or any other video device) directly inside a composition." After going through the functions of the software, the manual concludes with a warning: "Since After Effects was not built with plug-ins like Lensfeed in mind, there are a few side effects and problems that occur when Lensfeed is active." The following review outlines my experience with Lensfeed.

Once the software is installed in the After Effects plug-ins folder, it shows up in the Filters menu. Actually, the Lensfeed folder contains 5 effects, named Lensfeed 1 to 5. This will allow for five separate video signals to be fed into After Effects simultaneously, and apparently if you need more, you can drop an email to Frischluft.

Frischluft Lensfeed

To get the video feed going, you simply apply one of the Lensfeed filters to a Solid layer.

The user interface that shows up in the Effect Controls viewer is very rudimentary. There are four buttons, that are easily mistaken for checkboxes. The first button says: "next cam ->". By clicking this button you can cycle through the video inputs that are available on your system.

Lensfeed recognizes almost any video device, such as Firewire, USB video devices and on my video workstation it even recognized my Decklink HD Pro card.

For this test I only had a DV camera available. After connecting the camera to the Firewire port of my laptop, I clicked the ‘next cam' button and miraculously the video signal from the camera appeared in the composition window.

The video can be paused by clicking the ‘toggle feed on/ off' button. When paused, the current source frame is frozen in the Comp viewer. Unfortunately, there's no feedback about this in the user interface, but in the Comp viewer you get a message that says "lensfeed:paused".

When no other things are going on in the composition except the video feed, the frame rate is around 2fps on my 2GHz P4 laptop. On my dual AMD Opteron workstation, the results seem similar. As Philipp suggests in the manual, Adobe After Effects isn't really designed for this sort of thing, and this may well cause the slow refresh on the video feed.

AE Effects Controls

So once you've applied Lensfeed to a layer and selected the right video input, the Comp viewer automatically updates at roughly 2fps. You don't have to run a RAM preview, the Lensfeed layer automatically forces rendering of the frames.

The most obvious use for Lensfeed is at a chromakey shoot. It allows you to feed the actual video into Adobe After Effects, and apply effects and transformations as you would normally do. This makes it very easy to see if there's enough separation between the background and foreground to pull a good key. If you have an image of the final background available, you can bring that into the composition for a preview of how the final composite might look. Matching lighting and camera angles becomes a lot easier this way.

Another way to use the direct video feed into After Effects is do color correction on-set, to see if the raw footage has everything needed when doing final color correction in post production.


PERFORMANCE & QUIRKS

Although the slow frame rate may rule out some situations, I feel that it's not much of an issue when using Lensfeed for on-set supervising of chroma-key shoots. At roughly 2fps it's still interactive enough to get good feedback while adjusting camera angles or set lighting.

When shooting interlaced video, you get raw interlaced video in the composition. To remove the interlacing before compositing you need to apply a de-interlacing filter. Unfortunately Re:VisionFX's FieldsKit only works when it's the first effect in the stack, which makes it all but useless for this purpose. It works when applied to an adjustment layer on top of the Lensfeed layer, but when I also want to apply a keying filter, this quickly makes my composition more complicated than I really need .

As a quick workaround I used "Reduce Interlace Flicker", which subtly softens up the image. Not perfect, but good enough for previz use. I would have liked to see a very simple de-interlacer built into Lensfeed.

With only Keylight applied, the frame rate stays around 2fps at SD resolution. When I applied ÔReduce Interlace Flicker' and a DV deartifactor, the frame rate dropped to around 1fps.

Another weird quirk is the user interface. Like I mentioned earlier, it consists of four buttons that look like checkboxes. The first button cycles through the available video inputs on your machine. The second toggles "pause". The other two are to increase or reduce resolution, but were only available when I had the Decklink input selected, but I couldn't test whether they worked. This makes Lensfeed feel like it's not quite finished. The manual also mentions some other issues when running Lensfeed, such as the snapshot doesn't work anymore, until you pause the feed.


FINAL VERDICT

On the other hand, when I saw that Lensfeed also recognizes the Decklink HD board in my workstation, I couldn't help thinking of building a small shuttle PC with a Decklink board in it, to bring to the set. By using a laptop I'd be pretty much stuck with a DV signal over Firewire. A Shuttle PC with a Blackmagic Decklink board in it would allow me to take an SDI or even HD-SDI signal directly into After Effects.

The functionality in Lensfeed is unique in the world of Adobe After Effects. There is no other tool or plug-in that will let you feed live video into After Effects. Some of us have been wanting this functionality for a long time. If you do a lot of chroma-key shoots, and use After Effects for compositing, Lensfeed can be extremely helpful in doing quick compositing tests on-set. It is pretty exciting to be able to use After Effects to do a live previz of the composite.

The performance is nothing special, but at the same time it's all I need for this type of use. Lensfeed doesn't make After Effects a live real-time video application, but at around one frame per second for DV footage, it still does the job.

So, do I recommend this plugin? That's a tough question. Lensfeed sells for USD 199, which seems a little steep for an application that looks so rough. The price can probably be explained by the small market for this type of plug-in. But for that price I would expect the user interface to be slightly more polished and user friendly. At the same time, the quirky buttons hardly limit the functionality.

If you are regularly doing chroma-key shoots and run into poorly lit footage, this is a very useful tool. Even at USD 199 you should be able to quickly recoup the investment because it would help reduce the time spent fixing problems in post production.


Lensfeed 1.01 (Windows only): $199 A watermarked demo can be downloaded from the Frischluft website www.frischluft.com


Barend OnneweerBarend Onneweer
Gouda, The Netherlands

Barend Onneweer is an instructor at the Art Academy in Rotterdam, The Netherlands. He has been a leader in Creative Cow since the day it went online and is one of our After Effects leaders. Barend speaks at seminars and is a contributor to books, magazines and other training tools.



Find more great Creative COW Magazine articles by signing up for the complimentary Creative COW Magazine.
Comments

Re: Feeding Live Video into Adobe After Effects - Frischluft Lensfeed for Windows
by Rob Neal
I have used Lensfeed in the past with a Sony Z1 and Firewire (iLink) connection with good results.

However, I urgently needed to use it with my new Sony EX-3, and got nada, either via iLink or the SDI on the internal Decklink card. Really disappointed. Any suggestions?

http://www.robneal.co.uk
Re: Feeding Live Video into Adobe After Effects - Frischluft Lensfeed for Windows
by Solvaij Al shaaily
Dear Barend
I just bought Frischluft Lensfeed after reading your
reviewe because I do lot of greenscreen work
for fun and small projects.
I got canon T2i DSLR camera but the Lensfeed plugin cannot recognize the T2i camera.( dont now why )
The camera was pluged throw the USB cable
and all the T2i Utility is installd but still I am getting ERROR in the Lensfeed plugin
then I connect the camera with my Intensity Pro HDMI card.( nothing heppen still geting the Erorr messege )
But it is working with my intenet Live Cam without any error.
Do you have any sulotion for DSLR users
Please Help

Thanks
Solvaij


Related Articles / Tutorials:
Adobe After Effects
Imagineer mocha Pro 5 Plug-In for Adobe: An In Depth Review

Imagineer mocha Pro 5 Plug-In for Adobe: An In Depth Review

Imagineer mocha Pro 5 Plug-in for Adobe brings all the amazing features of the professional version of the mocha Planar Tracker directly into After Effects and Premiere Pro in the form of a plugin. In this in-depth review, After Effects tutorial guru Tobias Gleissenberger of Surfaced Studio will show you what you can do with this new plug-in, and discuss what he likes and doesn't like about the new update.

Tutorial
Tobias Gleissenberger
Adobe After Effects
After Effects 2015.3 - My Favorite Features

After Effects 2015.3 - My Favorite Features

Learn why you should upgrade to After Effects CC 2015.3 - 13.8.1 - a close and detailed look at the latest release of After Effects (August 2016). Roei Tzoref will be focusing on his favorite features that set this release apart from previous versions: Performance, Queue in AME, Lumetri Color new features, and more.

Tutorial
Roei Tzoref
Adobe After Effects
Advanced Masking in Adobe After Effects

Advanced Masking in Adobe After Effects

Some of the coolest stuff you can do inside of Adobe After Effects is only possible once you unlock the power of masks. Join After Effects whiz Tobias Gleissenberger of Surfaced Studio to learn about mask animation and interpolation, using the variable width feathering tool, managing mask modes and ordering, and more.

Tutorial
Tobias Gleissenberger
Adobe After Effects
Fixing Common After Effects Problems and Mistakes

Fixing Common After Effects Problems and Mistakes

Got problems using Adobe After Effects? Exported files too large, Expressions not working, mixing shapes and makes, modes/switches, selecting previews for layers vs. comps - Surfaced Studio's Tobias Gleissenberger shows you fast fixes for these and more!

Tutorial
Tobias Gleissenberger
Adobe After Effects
mocha AE Planar Tracker for Absolute Beginners

mocha AE Planar Tracker for Absolute Beginners

Want to learn how to create advanced visual effects? Learn how to use mocha AE to track your shot and add advanced visual effects to live action footage inside Adobe After Effects. mocha can help you track shots that would be hard to track using traditional 2D point or feature trackers because it is a PLANAR TRACKER. A planar tracker uses planes and textures to track as opposed to points or groups of pixels. This allows the tracker to stay on track even if your shot contains motion blur or a very shallow depth of field. mocha AE comes included with Adobe After Effects and is available since CS3 and there is no reason for you not to use this awesome tool to make it easier for you to track your shot, replace screens or rotoscope!

Tutorial
Tobias Gleissenberger
Adobe After Effects
How to Make After Effects Faster with Proxies

How to Make After Effects Faster with Proxies

Learn how to make Adobe After Effects faster by using PROXIES! A proxy is a placeholder that stands in place for a very large video file or image sequence in your project. You can easily create proxies for the large source files that you are using and After Effects will automatically link them to the item in your project panel.

Tutorial
Tobias Gleissenberger
Adobe After Effects
Stabilize & Smooth: mocha 5 Plug-in for Adobe & Avid

Stabilize & Smooth: mocha 5 Plug-in for Adobe & Avid

Imagineer Systems and Boris FX product specialist Mary Poplin shows you how to stabilize with the new mocha Pro 5 plug-in inside of Avid Media Composer, Adobe Premiere Pro and After Effects. This tutorial covers artistic stabilization, such as smoothing out camera movements or stabilizing around moving objects, completely locking down shots, and automatically replacing edge fill on planar backgrounds.

Tutorial
Mary Poplin
Adobe After Effects
Adobe After Effects Puppet Tool

Adobe After Effects Puppet Tool

Become a puppet master by learning how to use the Puppet Tool in Adobe After Effects! This intermediate-level tutorial from After Effects guru Tobias will show you how the Puppet Tool allows you to add joints and animations to bring life to any static image!

Tutorial
Tobias Gleissenberger
Adobe After Effects
How to Spawn A Clone in Adobe After Effects

How to Spawn A Clone in Adobe After Effects

Want to learn how to create a cool clone spawn effect in Adobe After Effects? Follow along with After Effects whiz Tobias from Surfaced Studio in this exciting new visual effects tutorial that combines green screen using Keylight, CC Vector Blur, the Liquefy Effect, CC Particle World, and much more, delivered in Tobias' inimitable style!

Tutorial
Tobias Gleissenberger
Adobe After Effects
Creating A Flame on Your Finger with After Effects

Creating A Flame on Your Finger with After Effects

It is easy to do some motion tracking and attach a basic stock footage element of fire onto your hands, but there is a little bit of work involved if you actually want to make it look good. In this intermediate tutorial by After Effects expert Tobias, you'll see how to use a fire stock footage element to set your thumb on fire! There are lots of useful tricks for null objects, expressions, and more in this tutorial that will help you create all sorts of other cool visual effects -- or set even more things on fire!

Tutorial
Tobias Gleissenberger
MORE
© 2016 CreativeCOW.net All Rights Reserved
[TOP]