The Capture Process

wHere is the process developed by Volum and tested by the Newmark Team. The steps involve capture and prepare 3D footage with the Volum Box workflow. The capture pipeline involves a combination of cameras and software. This workflow emphasizes working as cheaply and portably as possible given the current equipment available. (3D video capture tools are rapidly evolving so capabilities are improving frequently). This is not a fixed process–alternative hardware and software exist for many of these steps. The cornerstone of making this capture process portable is the Volum Box. The Volum Box is not a commercial product, it's a do-it-yourself portable 3D camera and computer in a lunchbox size container. You'll find more info on the Volum Box below.

This is a high-level overview of the process so that you can see how all of the parts of the pipeline fit together. Detailed steps are listed in the tabs below. There are many steps in this process, but once you become familiar you should be able to go through the process from start to finish in two or three hours.

to create a 3D scene you will record 3D video; audio; and photos for a static 3D model.
The capture phase of the process starts with recording 3D video with the RGB+D camera (Volum Box or equivalent). Audio should also be recorded separately to accompany the video (The RGB+D camera's don't record audio.) The next step is to capture photos of the space where the video was recorded. These photos will be used to create a photogrammetry model. The photogrammetry model and 3D video are used together to properly scale and place all of the elements in the scene.

Once the 3D video, audio and photos for the 3D scene have been recorded, those raw recordings need to be processed and converted to be ready to edit and playback as 3D assets. The 3D video from the Volum Box needs to be transferred from the Volum Box hard drive to another PC, then converted into a DepthKit format mp4. Once the 3D video is in the DepthKit mp4 format you can edit it in video editing software like Premiere or Final Cut, sync your audio files, and export.
The photos go into photogrammetry software to create a 3D model of the space.

Putting it all together:
The final step of post-production is to align the photogrammetry model and the 3D video. We're using the Unity software-development engine for this step and also for putting the 3D scene into an augmented reality experience.

Note: the photogrammetry model will add detail to the scene, but is not required to get the 3D video to playback.

Click the triangle toggles for details

Required Equipment

Video Capture

Photogrammetry Capture

Converting Video

Syncing Audio and Video





Jump Back>

Jump Forward>

Want to print your doc?
This is not the way.
Try clicking the ⋯ next to your doc name or using a keyboard shortcut (
) instead.