|A Creative COW Feature|
From a two-camera interview to a 26-camera concert special, multicamera production is being used more now than ever before. And with so many camera types, codecs and editing workflows for filmmakers to chose from, it’s hard not to suffer from Multicamera Madness! After being diagnosed recently with “multicamera-personality disorder,” I decided to write a text book and reach out in workshops to others who share the passion and desire to master multicamera production and editing. At NAB this year, I will be sharing my experiences by presenting in-depth workshops and a keynote at Future Media Concepts World Post Production conference.
EDITING EPKs ON-SET: YOUR FIRST CUT IS YOUR LAST CUT
On-set cutting for concert tour kickoff events is some of the most exciting editing I’ve ever done. I’ve worked with bands including The Rolling Stones, Aerosmith, Paul McCartney, and U2, and the basics are the same. We create EPKs (electronic press kits) that combine cut pieces like story packages, interviews with the band, b-roll, three or four songs that are multi-camera edited pieces – and it's super-fast turnaround, usually same day. You don't have any time for errors. You have to be completely organized, the same way you would if you were shooting and editing any feature package in one day. By the time you ingest, prep and edit your first cut, it’s your last cut because of the same-day-satellite feed constantly looming in your deliverable’s future.
Multicamera ENG crews prep for b-roll shooting. Courtesy MHP3.com, Live Nation and U2.com
Setting up gear on location is a big deal. You have to have everything you need, because you can’t rely on an edit suite down the hall, or somebody else jumping in to help out if something goes wrong. You have to have all your tools -- not just your editing equipment, but also software for graphics and sound. Then clients are going to throw things at you like Word files or PDFs or TIFs or files with notes about things that have to be re-conformed, so you really have to have your ducks in a row. I keep a full Adobe Production Premium Package, Microsoft Office and a tool kit of various applications on the road.
"The Claw" Stage from U2 360º Tour EPK. Courtesy MHP3.com, Live Nation and U2.com
Even though they tour in the United States, their entire rig is based on European power -- all of their gear runs at a whopping 220 volts at 50 cycles, twice the voltage of American power systems. In addition to that, they're doing everything in PAL, and we're NTSC. To do something as simple as adding a deck to record a line cut means converting the power AND the signal. In addition, we were doing an HD package, but the band was actually set up for SD, 16x9 anamorphic. So, we had to convert the power, we had to convert the format, and then we had to bump it to HD, just to get a line cut for editing—and have the full package done within hours of the concert!
On this particular U2 project, we shot with 5 Varicams (recording to tape) and combined them with the band's cameras -- U2 travels with 12 cameras with robotics, cranes and dollies, the whole deal. We wound up with a massive amount of footage to organize, catalog, convert and have ready so that everybody could get what they needed immediately.
Tape is a slower format for logging and loading than using a tapeless format like P2. A really fast P2 workflow uses MXF4Mac and ingests to Final Cut Pro without having to rewrap or transcode to QT. AJA KiPro is also cool for going directly to Apple ProRes and Telestream has the Pipeline system that I also use for quick turnaround and ingest-while-editing.
Editor Mitch Jacobson cutting U2 EPK backstage. Courtesy MHP3.com, Live Nation and U2.com
It really is frantic to try to get all this done in the middle of a concert. You can hear the band playing out there, everything is thumping, people are screaming, and everybody has their idea of what to put in the cut – “Try this, let's do that, let's do this, let's do that” -- it really is nuts. A friend of mine once said, "It's like jumping off of cliff and building your wings on the way down."
THE ADVENT OF THE MODERN EPK
Back in the 70s, there was a little band called Journey. You may have heard of them.
They actually developed the system that we know as IMAG, Image Magnification for concerts. They started a company called Nocturne which is still around today-- the largest touring IMAG company in the world. Basicly, they put up big screens at their shows so that people in the back row could experience the concert the same as if they were on the front row. It's all about the close-ups, showing the tight shots of the hands and the head, the singers. That led to having full multi-camera production teams on tour with the bands.
And then along the line, the record companies discovered the need for electronic publicity including all these elements like B-roll, interviews and the music from the shows. They began to hire dedicated production companies to handle that, which is where Mark Haefeli Productions came in. All the legacy-type concert jobs I've done were produced and directed by Mark Haefeli, including the U2 360º Tour. Mark is a television pioneer who helped to develop the modern EPK by combining ENG crews with the touring IMAG productions.
A number of years ago, Mark and his team were asked to shoot performance footage for the Rolling Stones, capturing their stadium concert experience for news organizations and promotional purposes: everything from selling tickets to creating commercials. While Mark knew there were already cameras in place at these shows, he realized there was a problem with the setup.
“Back then, says Haefeli, it was just cameras out there shooting the action as it happened and going directly to the big screens. There weren’t even any recording devices to record the feed. They recorded the audio, but they never recorded the mixed master of all the cameras together, which we now know as the line cut.”
Mark began to record a line cut off the switcher, with occasional ISO decks as well. He also began to supplement that with additional multiple cameras that could divide and conquer to double-team a performance. For instance, 5 cameras shooting ENG style packages during the day could reconfigure at night to compliment angles shot with the band’s IMAG cameras to maximize coverage.
U2 IMAG screen testing colorbars. Courtesy MHP3.com, Live Nation and U2.com
View from the director's chair on the U2 360º Tour. Courtesy MHP3.com, Live Nation and U2.com
Mark Haefeli: “Essentially, we walk out of there with a complete show under our belts. With remixed audio tracks, as well; half an hour after the show was over we were able to go right into post and edit what ultimately looked and felt like a multi-million dollar concert production of tremendous size.”
"WE LIVE AND DIE BY TIMECODE." – Ray Volkema, Editor, HDNet
Time code is the essential, original metadata, and a lot of the time, people get it wrong. Our work in multicam is designed around getting it right. A couple of minutes to do something as simple as jam sync your cameras in the field could save hours of time in editing. High-end cameras all have capabilities for that, so there are no excuses.
Assistant cameraperson preps a pair of Panavision Genesis® cameras on the set of "Law & Order" in Manhattan. Photo courtesy Mitch Jacobson.
But even many lesser-capable cameras are still able to work with timecode, and even when they aren’t, there are many workarounds, add-on boxes, and so on. Some of the workarounds are simple and inexpensive –clapboards, handclaps, or flashlights – but timecode really does work better, and for multi-cam, that usually means time of day, free run.
I should mention that there are a lot of really cool iPhone slates out there. “Movie Slate” by PureBlend Software even lets you jam-synch multiple slates, and generates EDLs, XMLs and ALEs for Final Cut and Media Composer. You can even e-mail them right out of your phone to your editor.
Longitudinal timecode is one way to go for these lower-end cameras that don’t handle timecode on their own. A signal gets sent to cameras' audio tracks, and then picked up in post and converted to auxiliary time code. A company called Ambient makes theLockit Box, a high-quality timecode and sync generator. They also make the LANC Logger for smaller, lower-end cameras. (It actually works on high-end cameras too.) It plugs into the LANC jack, and generates, reads and converts timecode. It also creates XMLs that you can input into your editing software, and start grouping clips right away.
Ambient has a lot of other cool products for timecode with multicam. Sequence Liner takes timecoded clips, and lines them up in your sequence on vertically stacked tracks. This gives you what we call a sync map of your multicamera show, and then make groups from the sync map. And, Video ToolShed has the AuxTCReader for converting LTC to Aux TC in FCP. (Avid does this natively).
Timeline From U2 360º Tour EPK. Courtesy MHP3.com, Live Nation and U2.com
And all of these products work with time of day, free-run timecode, which as I’ve mentioned before, is the best way.
The problem is that not everybody does it this way, and for one reason or another you sometimes get footage that doesn’t have perfect sync. The real challenge is how you deal with the stuff that's not setup properly. That's where something like PluralEyes from Singular Software comes in. It basically analyzes the audio tracks of the cameras and syncs everything to that, to make the sync map making a sync map for grouping your multiclips. If you don't have audio on your cameras, then PluralEyes doesn't work, so if in preproduction you realize that you're not going to be using traditional approaches with free run/time of day, then you need to make sure you at least have audio going to all the cameras -- preferably the same audio.
Because let's say you're using a little camera mic, and the cameras are in different distances from the sound that they're picking up -- 37 feet is approximately the same as one frame of lip-sync error in the United States, so if you have a bunch of cameras that don't have the same sound, syncing by audio could be off a little bit.
So, grab a few cameras and sync ‘em up, It’s a great time to master multicam!