Serious Magic's Ultra2
Serious Magic's Ultra2
|A CreativeCOW.net Product Review
||Joaquín 'Kino' Gil
kino, Marina del Rey (L.A.), California USA
©2005 by Joaquin Gil and CreativeCow.net. All rights are reserved.
CreativeCOW.net contributing editor Joaquin 'Kino' Gil writes a review on Serious Magic's ULTRA 2 Professional Keying Software with Vector Keying Technology and tells readers, ''[Before ULTRA2] each matte had to be calibrated separately and the values adjusted almost on a frame by frame basis in order to get details like loose strands of hair, bluish shadows and reflections, grains of sand and other minutiae. Yes, it took forever [and] no motion tracking software, either. All of that effort, [and hours of work] very seriously done, is made moot today with this software tool from Serious Magic. ... The key is perfect to the extreme of perfectly keyed fine strands of hair, transparency and translucency.''
Ultra2: The evolution of chromakey
It can be reasonably argued that most of today's effects filmmaking, from TV sitcoms to blockbusters galore, depend on a process through which the actors and basic props shot on a sound stage are inserted onto images or footage of real or computer generated locations, complete with creatures.
The most popular way of doing things is called Chroma-Key (from a TV tradition) or "bluescreen/greenscreen" in the world of film. This has the talent and props standing on a set painted an almost fluorescent shade of green or blue. Helpers, rigs and props that are to be made "invisible" likewise don garments or paint in the key colors to be processed out.
The process originally derives from the luminance key, where a particular level of grey or intensity of light (= "luma" therefore "luminance") in the primary image can be separated and made transparent to a secondary image by using the resulting area as a "cookie cutter" to reveal the secondary image in the selected ranges of the primary image.
The use of the image from a single gun in "color" or RGB TV allows a process known as chroma key, in which the key occurs on the output of a single color. That single color is electronically ignored or "removed", thus becoming, in essence, a "hole" through which another image can be shown. In practice the color chosen is rarely a single frequency (reflectance bead systems with camera-mounted green or blue light source being the notable exception) but rather a small range of the chosen color. The purpose of even lighting and wrinkle avoidance in flexible backdrops is precisely to minimize that range of shades or tones so the keying can be as perfect as possible and fine detail in the keyed subject is preserved.
A quick search in the Wikipedia turns up some juicy facts:
The technique is variously referred to as "color key" ( color = chroma ), colour separation overlay, greenscreen and bluescreen, according with the implementation.
"The principal subject is photographed/filmed against a background having a single color or a relatively narrow range of colors, usually in the blue or green. When the phase of the chroma signal corresponds to the preprogrammed state or states associated with the background color(s) behind the principal subject, the signal from the alternate background is inserted in the composite signal and presented at the output. When the phase of the chroma signal deviates from that associated with the background color(s) behind the principal subject, video associated with the principal subject is presented at the output."
The reason blue is used for weather maps and movie special effects is because it is complimentary to human skin tone and therefore is easier to key out. However, in many instances green has become the favored color mainly because green is easier to key and because green is not found as frequently on clothing.
The colors used are bright, fluorescent versions of blue and green. Again, this is done partially so the person in front of the wall could still wear, for example, a dark blue tie without it keying out.
Though blue and green are the most common colors used, it is technically possible to chroma key using any color background. However, green and blue are the favored. Occasionally one might see a pink background used.
The most difficult part to setup a blue - or greenscreen is the even lighting and the avoidance of shadow, because as narrow as possible range of blue (or green or other) color is made transparent. A shadow would change that to a darker color and it will be opaque.
Don't you just love the Internet?
Again, in practice, very few chroma-keying systems can deal with the finer stuff: transparency, reflections and shadows have been usually effects that belong to the higher end of the equipment rack. The work of Ultimatte comes to mind, as the de-facto standard for the dedicated machines and the very effective homonymous software that works as a plug-in in the major compositing packages.
Up to now, Ultimatte and the superb keyers in Curious gFx, Apple's Shake and Autodesk's Combustion/Flame/Inferno family were the way to go. We used Ultimatte running inside Wavefront's Composer - the first compositing package and one I was proud to help shape - to carefully remove Miss Foster from a blue room for the Beach sequence in Zemeckis' "Contact". Each matte had to be calibrated separately and the values adjusted almost on a frame basis in order to get details like loose strands of hair, bluish shadows and reflections, grains of sand and other minutiae.
Yes, it took forever. No motion tracking software, either.
And all of that effort, very seriously done, is made moot today with this software tool from Serious Magic.
The folks at this company take seriously that old phrase of Arthur C. Clarke's, borrowed from the science fiction domains:
"Any sufficiently advanced technology is indistinguishable from magic".
So the company works at producing a piece of software that performs
ULTRA2, an upgraded version of the original ULTRA, is one of those incredibly smart applications of computers we keep finding in this XXIst Century of ours. The program basically runs a complete set of comparative keys (chrominance, luminance, difference, etc.) on the source images supplied and delivers what can be termed perfect keys. ( Or what a friend of mine calls emphatically "freakin' perfect keys".)
The procedures are really simple to follow, too. Although the tool provides a complete set of controls of all the aspects of the keying ( and related ) processes taking place, the idea is that you don't need to use them. The tool will run all the keyings and comparisons and extract the optimal matte for you without your intervention. Of course, if you are like many of us, you'll tweak. That's fine. The controls are easy to use and effective in result. They are even fun and teach you a thing or two about mattes you thought you knew.
On startup, the program consists of a panel split roughly in three areas: "INPUTS" is on the left side, and a very well thought out interface allows for easy selection of background, input clips and other sources, like Source B, overlay video and graphics. The dedicated overlay channel accepts Flash-type swf files. On the right side of the display the "PREVIEW" panel lets you see and use the composite in progress. Finally, the bottom of the work area is taken by the "CONTROLS" area: a series of tabs that allow access to the different sections of the software like controls for cropping and resizing one or more layers, animation of the virtual camera you see through, tabbed collections of pre-ready media and a media browser.
The rest of the design is just as powerfully self-explanatory. Deceptively simple in appearance, this program packs a lot of ingenuity and knowledge.
ULTRA2 is a standalone program that runs only in Windows boxes. No OSX or Linux versions contemplated for the moment. The program runs on wrapped sequences, that is to say, Quicktimes or AVI files. It is equally comfortable using AVI or QUICKTIME as input files as far as I could check. It does not recognize frame sequences so compilation in a wrapped form is a must, but that is a default format for most digitizing applications. ULTRA2 can work in standard definition, DV and High Def, both 1080 and 720 simply by choosing a new "Session" (Ultra2 parlance for a project) and choosing either 4:3 or 16:9 format.
The quality of the mattes is amazing. This software package of less then US$600 does the kind of job of a piece of traditional hardware of US$250,000.00.
Choice problem spots like (1) transparency , (2) motion blur and (3) wrinkled backdrop are quickly compensated for by the software to obtain the mask below. Additional modes offer very easy to use painting tools to mask out regions, like the rounded edges of the backdrop in the top corners of the clip.
There are two main ways of using the tool, depending on whether or not you avail yourself of all its properties. You can use it as a very quick and easy matte-extraction tool to process a series of green or blue screen shots and ready them for external compositing in another application.
You would accomplish this by reading an input clip, processing it and saving it with a transparent alpha background. (there is such a ready-made file, a DV, i.e. 720 x 480 png frame. Similar transparent frames are possible for any SD or HD resolution.)
The second way entails learning a bit more about the concept of "virtual sets", as is implemented in ULTRA2.
You are always running a virtual set of some kind. That is how you define how many layers you are using and what kinds. It is a matching set of assumptions that activate capabilities of the program as are needed.
In essence also, a Virtual Set is a matched set of backgrounds and channels. It usually includes different views of a pre-rendered (CGI) location that can be used with different standard framings of your on-screen talent such as close-up, full-frame, mid-shot, etc., and also can be used with controlled, programmable moves in all three axis. Your choice of basic SET defines use of background, insertion of a B source in a window, virtual motion and graphic overlays.
The Sets that come pre-animated with ULTRA2 are mostly designed for corporate and commercial work, but they are gorgeous, sure to give a good production value injection to many a humble talking head.
The special thing about these Virtual Sets is that you can have extremely complex camera moves inside your virtual set that will be applied to the image of your talent, so you can effectively look at the horizon, do a fly-by around digital buildings or mountains and swoop right through a window or a crevice in the rock to reach the place where your talent is in that virtual landscape. This makes for exciting intros to spice up many a talking head, but also opens interesting narrative options, specially when applied to high-end imagery and carefully lit plates, because these trajectories are programmable.
Even using the virtual sets supplied - which can give a polished, professional look to a sequence shot in your garage with passable illumination - the sky
seems not to be the limit: The really nice news is that there are "empty" sets that let you hang your own customizations, so a decent CGI program like Maya or XSI and you can Virtualize a whole film. Eat your heart out, Sky Captain, Sin City, Star Wars and all those good yarns done in greenscreen.
There are also two ways for getting a key. The tools are more than adequate for general production work.
The first mode of use is that in which many corporate videographers will find themselves with models or voice talent: You have a green or blue background of limited size in a place where illumination will pose problems and you cannot guarantee wrinkle-free, perfectly even light.
No problem. Point your camera, shoot a few frames of the EMPTY background, then position your talent and record normally. Once you import the clip in ULTRA2 look for a frame with ONLY the background, go to the "KEY" tab in the ULTRA2 display (which is simplicity itself) and hit the "SET KEY" button.
When you play back the material with your talent, the key is perfect to the extreme of perfectly keyed fine strands of hair, transparency and translucency.
The second way to get a key using this tool is for those occasions where you have no footage of the empty background, or when the talent moves along a larger area and the camera follows, losing individual wrinkles and shades that would have permitted the automatic matte extraction in the previous case example.
In these occasions you have the capability of directing the matting engines to the color ranges you want to matte out.
The mechanism for doing this is called "POINT PLACEMENT". In a nutshell, you click on the source footage in the green shades or variations themselves, as they turn up in the image.
This is an NTSC 16:9 image, recorded anamorphic onto normal NTSC DV25. Since I do not have the footage with the screen alone, the points - marked here by small gray squares I have outlined in yellow - were used to select the different green shades I want to eliminate.
Below you can see the test of the mask done by simply double clicking one of the included backgrounds, which automagically puts it in the "background" channel.
Ease of use, minimal price and fantastic delivered power make this tool a must for the eFilm or Video professionals of all sizes and walks of life, from those doing wedding and corporate videos to the indie effect makers, documentarians and feature filmmakers out there, to whom the SD and HD capabilities should appeal as a very desirable and cost-effective combination.
This is a tool that pulls amazing masks from something like DV25 footage. Broadcast SD or HD material looks just unbelievable. This is truly Chroma-key for the rest of us, but with the full quality that computer assisted keying is capable of in the XXIst Century, better quality, in fact, than many dedicated and hardware tools sold for fifty times the price of ULTRA2 or even more. It is also a standalone program, not a plug-in, so you can dedicate a smaller machine, a user and a session to mask pulling without sacrificing an animation or compositing machine and attending software. This means more efficiency and less glut of generalized tools of higher cost, which translates to a must in any administrator's book. ULTRA2's robust coding and multi-format capability allow it to integrate to any kind of production pipeline and also make it also a remarkably trouble-free tool in the digital arsenal. To qualify this level of tool for our readers is a no-brainer:
Five out of five cows.
Go and get one.
Marina del Rey, September 2005
If you found this page from a direct link, please visit our forums or read other articles at CreativeCOW.net
|Recent Articles / Tutorials:|
Art of the Edit
Always Be Editing: Sculptors & Bricklayers Revisited
Do you edit like a sculptor, or like a bricklayer? It seems a simple enough question, but as longtime editor, post house owner, and VFX software developer Simon Ubsdell shows, the implications for how this affects the way you edit can be profound. His advice, regardless of where you land on the spectrum? Always be editing.
Hearing The Handmaid's Tale: Jane Tattersall's Sound Career
With Emmy, BAFTA, Motion Picture Sound Editors Golden Reel, Canadian Screen, and Directors Guild of Canada Awards among many more, Jane Tattersall shares insights into a career in sound editing entering its fourth decade with two young women just beginning their own careers in the field. Their conversation begins with Jane's work on the Hulu hit series, The Handmaid's Tale.
Feature, People / Interview
Art of the Edit
Indie Film Sound Editing: A This Guy Edits Tutorial
ACE Award-nominated picture editor Sven Pape ("This Guy Edits") speaks with Sundance Award-winning sound editor Ugo Derouard on The 5 Five Steps of Audio Post Production: Sound Editing, Spotting, Dialog Editing, Sound Design, and Sound Mixing, paying special attention to the specific needs of, and techniques that can work best for, independent filmmakers.
Adobe After Effects
Stabilize 360 Video with Mocha VR
In this intermediate tutorial, Mocha Product Manager Martin Brennand takes you through smoothing the horizon in a Samsung Gear 360 shot using the Reorient Module in Mocha VR. Jittery 360 video footage can be made more watchable by stabilizing with Mocha’s planar tracking tools. The tutorial is done via the Adobe After Effects plug-in, but the techniques apply to all versions of Mocha VR.
DJI Mavic Pro In Depth Review - The Best 4K Drone?
VFX guru Tobias Gleissenberger was so delighted with the DJI Mavic Pro 4K drone that he bought (yes, bought) that he was inspired to take a break from making tutorials to create an in-depth review of this compact, lightweight, consumer drone offering terrific value. No, it's not a platform for your digital cinema camera, but if you're looking for a fast, fun, integrated 4K camera drone packed with features, the Mavic Pro might be for you. This review is delivered Surfaced Studio-style, with wit, high energy, and details you won't find anywhere else.
The Panasonic EVA1: Questions Answered!
Anticipation that Panasonic began building for their "mystery camera" at April's NAB Show 2017 was paid off at June's Cine Gear Expo 2017 in Hollywood, as Panasonic finally unveiled their AU-EVA1 cinema camera. Compact, lightweight, equipped with a newly designed 5.7K Super 35 sensor, and positioned between the Panasonic Lumix GH5 4K mirrorless camera and the VariCam LT 4K cinema camera, the AU-EVA1 is tailor-made for handheld shooting, but also well suited for documentaries, commercials, and music videos. Panasonic Cinema Product Manager, Mitch Gross has provided some answers to early questions about the EVA1’s target audience, shooting applications, Dual Native ISO, the 5.7K sensor, and more.
Art of the Edit
TV Workflow Supervisor Kylee Peña: The Benefits of Pressure
TV workflow supervisor Kylee Peña (Jane the Virgin, Colony) visits Adobe's "Make It" talk show to chat with host Jason Levine about the evolution of motion picture workflows, from the days of film and tape to our modern digital world of crazy-high shooting ratios and constantly evolving technology. She also expounds on the upside to creative constraints and tight deadlines. And don’t miss the lightning round!!!
Feature, People / Interview
Grading The LEGO Batman Movie: Animal Logic and FilmLight
Following successful collaborations on The Matrix, Legends of the Guardians, and Happy Feet, Sydney's Animal Logic worked with Warner Bros on The LEGO Movie from pitch to proof of concept to post. Animal Logic has gone even further on the latest LEGO animated feature, The LEGO Batman Movie, where they were embedded with the production for over a year. The range of their work pushed every aspect of the Baselight system for editorial, VFX, and HDR not just for post, but for the entire production process.
An Editor's Epic Journey, by Katie Toomey
What do you do when your company folds and there's no local work? Whatever you have to. For Katie Toomey, that meant emptying her savings and heading 2000 miles west to Los Angeles, with no job in hand. The only options were make it or break it. The journey itself was difficult, but the hardest part may have been the only thing that made it all possible: asking for help. This is a truly inspiring story with tons of real-world examples of how to accomplish what feels impossible at the time.
Fairlight + Resolve, Part 1: The DAWn of a Resolved Era
Marco Solorio of OneRiver Media gives an introductory overview to the rebirth of the Fairlight digital audio workstation (DAW) that is now part of Blackmagic Design’s powerful DaVinci Resolve post-production system. Is this finally the solution to break away from the Pro Tools stronghold?
Review, Editorial, Feature