Recommend Image sequence than mp4 of before importing the footage
Create Motion Tracker layer: Click Motion Tracker button (Bottom L) at Motion Tracker menu
Motion Tracker layer Parameters:
Footage (import the footage):
increase Resampling rate to 100% (higher resolution for motion tracker to work with, Footage scale. brightness, adjust in Navigation Setting and Visibility Setting)
After all setting fixed, Click Create Background Object, to create a Background layer (A 3d model material will be created at the same time)
2D Tracking (Automatic):
Automatic Tracking:
Number of Tracks: How many points made on screen for calculation (recommend 1000); Tick Auto Replace Lost Tracks (track those points in case out of the frame within the duration)
Options:
Boost Default Pattern Size to 25, Default Search Size to100 (make the calculation more precise)
Create mask to hide things that may affect motion tracking:
At bottom column, Create Mask→ use the pin icon create a mask area on the screen
To track the mask: Choose Move tool to adjust the created pin position (keyframe will be created at the same time); at R bottom corner. Mask→ Active from xx to xx (to set when the mask works in timeline)
Before click Create Auto Tracks, go to the middle of timeline of the footage → then Click Auto Track
To deleted unwanted track point, open Motion Tracker Graph View (Above Mode Column), check the red one (green means working) and delete them
3D Solve:
Camera Setting: Choose Unknown but Constant (if no zoom in/out during the shot and we don’t know what camera set to film the shot) →Run 3D Solver (will start calculate, Solved Camera layer is created in the Motion Tracker layer,
the 3D tracking points and cam movement can be seen by deactivating the Solve Camera: In Solved Camera layer, click Camera Object (Solved Camera) icon-a square with a dot in centre
Create Planar Constraint (to create a floor pan for 3d object place on):
In Create Position Constraint Button at Bottom menu: → Click Create Planar Constraint → use Pin tool click 3 tracker points on screen to make a polygon (a new pin icon will add on Motion Tracker layer → Click Create Plane (R bottom Mode menu)
To adjust the created Plane position matching the footage: select the Plane layer, change to M/R/S tool, change to Object Mode from Model Mode icon (L bar below Make Editable Icon)
Reconstruction (Optional but recommended, it’s to create a 3D Point Cloud and Mesh for the scene detail analysis):
Preset: High Quality → Hide the created plane → Generate Point Cloud (start calculation, check if it’s done if the C4D icon on window menu bar stop running)
Scene Point Cloud layer is created under Motion Tracker layer, and The Point Cloud can be seen by deactivating the Solve Camera (I can’t see it) 21:30-22:01
Import 3D object:
Merge project or Open the 3D project, short cut copy and paste in layers. Move the object in the motion tracker camera visible frame, as the pasted object may be out of the frame1
Mask a 3D Object:
Create a plane and a material.
In material editor, only tick Transparency: Refraction Preset: Custom, Refraction: 1 (to make the material fully invisible) → Drag the material to the plane → Place the plane in front of 3D object
On 3D object layer that want to mask out: Render Tag → Compositing → Untick seen by Transparency → Render preview
Now only things in front of the plane transparency is visible. If invert what is visible and hidden, tick Seen by Transparency by untick Seen by Camera in Compositing
Fine Tune in AE:
Remark: Before Render the 3D object on the track as an alpha channel in C4D, turn off the background layer, At render setting → Save → Tick Alpha Channel
In AE, import the C4D PNG sequence/C4D project and the background footage.
Neutralize color and brightness on 3D object : Effect → Tint → use dropper from Map Black and Map White to select darkest and lightness part from the footage
Add adjust and apply Lumetri Color effect
LUT: Arri Universial DCI
Creative → Look → SL Clean Fuji B Soft