Compositing a 3D documentary: converting 2D to 3D

Even though we’re going to shoot our first 3D documentary entirely in the third dimension, our visual effects will still be generated from stills.

Our compositor, Jakub Kuczynski, has been converting 2D VFX from previous episodes of the explosive demolition series Blowdown as he preps to work with photos from the implosion of the Fonte Nova Stadium in Salvador, Brazil.

He’s working in 3D space in Adobe After Effects. So to convert shots, he:

1) Generates a second camera in the 3D space, so there’s a camera for the left eye and the right eye.

2) Positions the second camera being aware of the same elements as shooting on location: how close objects are to the camera, etc.

3) Goes thorough the shot, key frame convergence depending on where the camera is in relation to objects.

4) Creatively decides where the depth cues will work best.

5) Renders both eyes.

6) Hand over to edit, then check the shot out on our polarized monitor.

Go through the shot, key frame convergence, spit out a left eye and a right eye.

It’s great to see some of the shots of 2D past converted into 3D – prominent, big and impressive.

Here’s the anaglyphic version of one of the shots, a bunker fly-in from Spyship: sinking the Hoyt S. Vandenberg – now the second-largest artificial reef in the world – off the coast of Florida.

VFX compositing for a 3D documentary: compiling a demo

As we prep to shoot our first 3D documentary, our compositor, Jakub Kuczynski, is getting ready to produce 3D VFX for the show.

We use these photo-real visuals in the explosive demolition series Blowdown, which we’ll be filming the next episode of, mostly for:

1) Locators – help orient the audience and show where the crew is working at a particular point.

2) Disaster scenarios – show the audience what will happen if different aspects demolition plan go wrong.

3) Dynamic structure shots – fly-overs, fly-throughs, fly-ins … allows audience to experience the strength, grandeur and engineering prowess of structures that Controlled Demolition Inc. implodes.

Here are two examples from previous shows: Super Stadium and Spyship:

Locator VFX: RCA Dome. Indianapolis, Indiana

Disaster scenario VFX: Hoyt S. Vandenberg. Key West, Florida

As part of this process, Jakub’s generating sample 3D VFX shots so we can assess them and so I can take some on my trip to meet with broadcasters the week after next.

We’ll combine the 3D VFX clips with some of the 3D test footage we’ve shot so I can give the broadcasters a solid visual idea of what we’ve developed so far.

One of Jakub’s shots – a fly-in to pyramids.

Why I’m including this in the 3D demo:

Look forward to the final.

Explosive demolition and 3D filmmaking: why Canon Vixia footage survives epic implosions

As we prep to shoot our first 3D documentary, I’ve focused on nailing down our A, B and C cam systems.

Score is zero for three, so far – the A cam requires lenses that may not exist anywhere on earth, we’re still debating which cameras to use for the B cam system (though the Sony EX1/EX3 duo looks promising), and we’ve shot some time lapse stills with the C cam system, but still need to test this duo Canon 5D system for shooting footage.

So I’m embracing our lukewarm successes by adding another mission to the mix:

3D HD implosion cams …18 of them.

Let’s call them our V cam and M cam systems – lettering inspired by the camera brands, this time.

These cameras will capture POV and perimeter shots of the explosive demolition series, Blowdown, piece de resistance – the implosion.

In this case, the lenses will be locked on various points of a sports stadium in Salvador, Brazil, as Controlled Demolition Inc. takes it down with explosives.

As you can imagine, these cameras will take serious a beating – riding the building down, sitting in the centre of the field as the stadium crashes to the earth, etc.

For these POVs, we’re going with six (three pairs) of Canon Vixia HF 10s – the V cam systems.

These little cameras have survived the ultimate Parallax Film Productions 2D challenge – riding the Hoyt S. Vandenberg, now the second-largest artificial reef in the world, some 30 metres from the surface to the ocean floor when the vessel was sunk off the coast of Florida in May 2009.

I’ve thrown in a few screen grabs of the ride – watch the full episode trailer here.

A POV camera rides the Hoyt S. Vandenberg as it sinks off the coast of Florida

Six Vixia 10s in our custom-built underwater housings went down – six solid-state, high-capacity SDHD cards survived, and we recovered all of the footage.

Because this system is flash-based, its memory is relatively robust.

For our intents and purposes, this means they have a better chance of surviving massive vibrations and debris that come with the massive implosions we cover. No tape heads to fall off, no moving mechanical parts to malfunction.

Water engulfs a POV camera as the Hoyt S. Vandenberg sinks off the coast of Florida.

These three pairs will be mounted on small rails with a 74 mm interaxial distance.

Our M cam systems will also be placed at strategic places throughout the implosion perimeter to capture key demolition engineering story points (and, of course, rocking, gratuitous destruction).

For this, we’ll need 12 (six pairs) of Canon Vixia HF M31s.

And so the great camera recruitment continues … Double trouble, to be sure.

3D documentary filmmaking – the great splitter rig DSLR experiment

I’ve chosen cameras to test with our 3D Film Factory BS Indie Rig, two main parts of the B cam system we’ll need to shoot our first 3D documentary.

We plan to mount two Canon 7D DSLRs on the Indie Rig, a mid-sized model that’s currently being shipped to our production house.

Our stereographer, Sean White, chose the middle-of-the-road rig because he was worried that a small one wouldn’t allow for enough coverage when using a wide-angled lens, that the cameras would “see” the inside of the beam splitter box.

And a large rig was out of the question for the event-based, run-and-gun industrial-worksite shooting that’s required Blowdown, the explosive demolition series we’re going to shoot. Our stomping ground will be a huge, condemned sports stadium in Brazil!

But there’s a huge potential downside to our mid-sized, non-refundable rig – if the Canons don’t work, logistically or qualitatively, we won’t be able to mount larger, higher-calibre video cameras because the rig’s not big enough.

But it’s a gamble we have to take – as far as we can tell, there aren’t any other systems like this … no documentary has been filmed this way, using a hand-held self-contained unit.

(more…)