Editing DSLR video on PC

18 10 2010

Here’re a few links that are useful for us PC users, as most of the online guides are for Mac users.

From Hurlbut Visuals Blog
Here is the much anticipated post-production work flow blog that you have been asking for from Mike McCarthy, our technology guru. Please visit Mike’s site at hd4pc.com for even more in-depth technical information on the post-production work flow process.

Post Work flows for DSLRs

“Here at Bandito Brothers, we have been handling the post aspect of many of Shane’s DSLR based projects, ever since the first “Terminiator Webisodes.” The tools available have developed during the past year from a relative hack job, to a reasonably well supported work flow.

File Format:
The first thing we need to understand about a work flow, is what we are starting with. In the case of Canon DSLR footage, we have full raster HD footage, in YUV 4:2:0, with a full range (0-255) of 8bit color values, at a variety of frame rates. This is saved into Quicktime files, encoded with H.264 compression at about 40Mb/s, with 44.1khz audio. While high bit rate H.264 files preserve a tremendous amount of detail into a relatively small file size, that level of compression makes it difficult to playback the native files in any editing program. In almost all cases it will be easier and more efficient to convert the footage into an intermediate editing format before editorial. This choice of formats will probably be dictated by your NLE options. DNxHD will be the format of choice for Avid, with ProRes for FCP, and a couple other options like Motion-JPEG, MPEG2-IF, or Cineform for Premiere Pro.

Frame Rates:
From a post perspective, the most obvious unique work flow challenge presented by the original Canon 5DMk2, was “30P!?” Since a transcode to an intermediate format was already required by most work flows, we slowed the footage and the audio by .1% to 29.97 for our first few projects. So 29.97 based work flows can be relatively simple, and are even easier now with the true 29.97 support in the 7D and 1D, and recently the 5D as well.

Inter cutting with film on the other hand usually requires editing and finishing in 24p, (by which I always mean 23.976p) which is a lot more complicated challenge with 5D footage. As Shane has mentioned in the past, the simplest way I have found to deal with this requires that you edit in Avid, and online with Twixtor in AE and Premiere Pro CS4. We use Re:Vision Effects’ Twixtor plug-in to convert our 30p clips to 24p, with true motion compensated frame blending. It works quite well for more footage, but it is extremely render intensive and take a long time to process footage. The details of the relinking process for Twixtored footage with Avid edits are fairly complicated, but can be found on my site, (Link to Avid page on my site) for anyone who is interested in going down that path. For footage shot at 24p on a DSLR, the on-lining process should be relatively straightforward by comparison, and have no unique challenges over 29.97p DSLR work flows.

Editorial Options:
While Premiere and FCP are both useful tools that will work well on smaller DSLR based projects, Avid is the most stable and responsive editing program, for large projects that encompass hundreds of hours of footage spread across thousands of individual clips. Most Avid edits of DSLR footage will use DNxHD as their editing codec. Since Canon MOVs have a full 0-255 color range, you have to select the RGB (0-255) color space when importing the files into Avid, in order to maintain the full range of the color space. If you are going to use you Avid output as your master, without a separate online conform, using a 10bit editing codec like DNxHD175x will prevent you from losing bit depth during the Rec709 conversion on the initial import transcode. We use 8bit DNxHD36 offline files in our Avid edits, since this is an offline, because we aren’t editing at the 5D’s native frame rate, and we use simple EDLs to online in CS4 via file name relinking after the frame rate conversion. There are other more expensive options for on lining Avid edits, but I am not as familiar with any of them, since Adobe’s Creative Suite satisfies most of our current needs.

Now as a PC guy, I will still be the first to admit that Macs do have their uses. (Specifically generating Pro Res files and accessing HPFS volumes;) For Final Cut Pro work flows, life is a little simpler in that Pro Res is capable of 10bit color by default, as long as the host application supports it. Batching your DSLR files to Pro Res in Compressor should allow you to maintain the full resolution and color space. Compressor also has the capability to solve the 30p to 24p issue through use of Apple’s Optical Flow technology. Compared to Twixtor, our tests have found this process to be slower and the results aren’t quite as good, but if you can’t afford a dedicated conversion plug-in, this is probably the next best thing.

For Premiere based edits, while DSLR files can be played directly on the time line, using an intermediate format will give you a more responsive and stable editing experience. Adobe Media Encoder will give you the proper processing bit depth to convert your files into a variety of possible third party formats, for editing or on-lining in CS4. At Bandito Brothers, we batch process our Canon 5D footage in After Effects, which allows us to use Twixtor to convert our 30p clips to 24p. If the footage is already in the right frame rate, AME is totally sufficient and will process the conversions much faster. We usually online with Cineform AVI files, to utilize the head room that 10bit color offers, especially since SpeedgradeXR can access native files, which is usually our next step after the conform.

Once you have exported an online conform, preferably in 10bit color, there is one more step that should be added to DSLR work flows. There are a number of cleanup processes that can be undertaken to deal with common imaging issues with DSLRs, similar to a dust-busting pass on film work flows. Dead pixels, usually caused by dust on the sensor, which can happen to any camera, are more frequent on DSLRs due to their large sensors and interchangeable lenses. These artifacts are usually static and can be fixed by overlaying nearby pixels that were unaffected, usually directly above or below. You also may see rolling shutter issues, caused by the top of the frame capturing a slightly different moment in time than the bottom. Certain types of rolling shutter artifacts, especially ones related to camera motion, can be fixed with plug-ins from companies like the foundry. Other rolling shutter artifacts like horizontal bands caused by flashes of light are much harder to fix, unless you manually replace the image data with information from another nearby frame. And if you have run a frame conversion process like Twixtor on your footage, this is when you should replace any frames that interpreted poorly with frames from the original source files. These processes are all very labor intensive and require quite a bit of fiddling and fine tuning to perfect your image. As with any step in the process, consider your available resources and carefully prioritize the issues you want to fix.

Once you are finished fixing any defects in the footage, the resulting files should be similar to any other workflow, and you can proceed to visual effects, color correction, tape lay back, web encoding, or disc authoring the same as you would a project from any other acquisition source. Most of the things that are key to an efficient DSLR based work flow take place at the beginning of the process. Once you are off to a proper start, the later steps should come together the same way as any other tapeless project. Hopefully the tips above will give you a good overview of the potential pitfalls, and things you can do to stay one step ahead of the game. I have much more detailed information available on my site http://www.hd4pc.com/techblog/2010/04/24/editing-dslr-footage-in-avid/, that I will continue to update as new developments are released.”

And here’s another one from Next Wave

First I’m going to assume you have a quad core PC or are at least able to view raw footage from your 5D in Windows Media Player without it skipping. If you can’t do that, your computer may not be able to handle 5D footage very well. Also we’ll assume you’ve already offloaded the footage from your CF card to your computer. And lastly, I use Adobe Premiere Pro so this workflow will revolve around that. If you use Avid, Vegas, or something else try to substitute parts of this guide for your setup.

Now that it’s on your computer, you’ll need to transcode it. Raw 5D footage is encoded in H.264 which is great for capturing, but horrible for editing. Macs can read H.264 and edit it pretty well, but PC editors don’t use the GPU of the computer the same way Macs do so transcoding is a necessary step in PC editing.

I personally use Cineform NEO Scene for my transcoding. Mainly cause it creates an editable, lossless file that is converted from 30 fps (which is the 5D’s only frame rate) to 29.967 (which is the industry standard frame rate).

Now that you’ve transcoded your footage, open your editor. Select a project that is 1080 HD at 29.967 (sometimes shown as 60i). Go ahead and drag in your transcoded footage and try playing it back. You will notice that the raw footage from the 5D will barely play at 1 fps in your editor, but the transcoded footage should play back fairly smoothly. Depending on the power of your PC, you may notice some choppiness in playback, but that has nothing to do with the quality of the footage. It just means your computer has a hard time editing Full HD 1080 footage. HD editing is very resource intensive so the newer and more powerful the computer, the better.

Hopefully that helps. Remember, transcoding is pretty much a requirement of PC editing of 5D footage. If you’re planning on buying a 5D MkII and a PC to edit it on, add Cineform (or something similar) to the cost of your purchase.

Good luck!

I thought I’d share one more thing. Cineform is great for commercial productions when you want the best possible editable copy of your footage. But what if you just want something smaller to edit and archive?

I’ve been using Adobe Media Encoder to convert my 5D footage down to 720p 29.97 which works great. The file sizes are much smaller and it’s a standard format that I can work with.

I usually compress out an MP4 using an H.264 encoding. Here are the typical settings I use. Depending on your sequence settings, you may want to change a few of the settings around until you get something you are happy with.

And here’s a website that might be of interest to you: Hd4pc.




Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s

%d bloggers like this: