Virtual Production

Virtual Production Chromakeying

Plugin: Tick "Composure"→
Window (top bar)→ "Composure Composite"
→ R click on it → Create New Group →Empty Comp Shot (0010_comp is created in World Outliner)
R click on 0010 comp in Composite window → Add Layer Element →
Media Plate → open its Detail under World Outliner →
"Composure" → Input, choose "Media Soruce"
image.png
Select media plate1 in Compositing window, hit P to open preview window

Option 1:


Select"Media Plate" → Detail → Composure → Add 3 "Transfrom Passers", choose all as "Custom Material Pass or Compositing Element Material Pass"
1. Rename as CDK, Material: M_SinglePassDiff/ColorKeyer
Input Element: PrePass
Material Parameters: KeyColor (dropper click green area), Alpha Threshok (Reduce)
2. Rename as Despill, Material: M_DespillGreenByAvg
3. Rename as TransformPass_26, Material: Drag the "M_ColorGradeRange" to the box
(Find it from Content Browser: Composure Content->Materials->ColorGrading)
Material Parameters: ColorGamma (adjust Alpha channel)
3a (Optional, for advance color grading): Create new material as M_Grade, copy ''Color Correction' nodes from "M_ColorDifferenceKey" Material Hierarchy, and paste to M_Grade hierarchy, adjust setting accordingly...Then use it as 3rd Transform Passers
6:13 to 7:50, 8:40 to 9:20
Choose "0010_comp", Add 1 layer on Transform/Compositing Passes, Drag "M_Grade" Material to the added layer, Input as "PrePass". For color grading of Both layers
"CG layer" (used for BG/FG) has built in color grade setting, so just grade it in "Details"

Option 2:


Choose "Media Plate", Add Media Soruce, Set Material "M_VideoPlateDefault", Untick "Intermediate" box
4:10 to 8:00
Add 3 "Transfrom Passers"
1. TransformPasses: Choose "Multi Pass Chroma Keyer", Material: M_SinglePassChromaKeyer,
Add "Key Colors" array, click "+" button to use color picker to click on green area in screen ("A" key shows alpha channel) ,
Material Parameters: DevignetteOuter (rise), ChromaBound, ChromaContrast, AlphaBias/White/BlackClip (optional)
2. TransformPasses: Choose "Multi Pass Despill",
Key Colors, pciker to click spilled green area in screen
3. Erode (Optional): Choose Any layer on TransformPass,
Material: ErodeAlpha, Material Paramaters: ErodeKernalSize (To blur edges and as matte choker)

Choose "0010_comp", set "Transform Passes" at "Composure" in Details, Create and Drag "M_Comp_tutorial" Material there.
Add CG layer as BG (Add Cinecamera Actor, if it shows camera missing, or set it at 0010_comp, Details-> Composure> Target Camera Actor, assign Cinecamera Actor)
8:30 to 9:30, 11:00 to 12:38
Hirerarchy for "M_Comp_tutorial": bottom left corner search bar: 1. Material Domain (Post Process), 2. Output Alpha (Tick box. If dont find such option, go to Project Settings> Type "Alpha" on bar, make sure "Postprocessing" column as "Linear color space only" )

See the keying result
At "0010_Comp", Detail> Output > add array> OutputPass change from "Media Capture" to "Player Viewport"
14:00 to 14:30

Option 3:


Input media Source, choose the image sequence shot → Create New Media player, choose the footage
Create a green screen footage that can be composite in UE:
In Composure page, create Empty Comp Shot
→ Create media plate, go to its Details, assign media source as the imported media player footage;
→ Create CG Layer, add a cine actor camera,
Back to —10 Comp layer, go to Details, assign target camera actor as the created cine actor camera

To composite the footage in UE environment:
Create New Material, open its graph → assign Material Domain as Post Process →
Create Node “Texture Sample Parameter 2D” → Duplicate it → rename each new nodes as Actor and Background respectively →
Create Node “Over” (to let A layer on top of B) → connect the graph as below:
image.png
Go to 0010 Comp Details → Transform /Composting Passes
→ Drag New Material created in Pass 0 box → Input Element will popup: assign actor as media plate, and background as CG element
(If the camera screen is blank, open NewMedia player to reassign the footage, use image sequence has less problem like this than using mp4)
Add Transform Passes 1 and 2 to assign as Multi Pass Chroma Keyer and Multi Pass Despill
In Passes 1, click on “+” in Key Colors → click another “+” in 0 layer (preview screen popup), use color picker to pick green screen color
(If edge still has flashing green, go to Material Parameters in Passes 1, play around Devignette Outter value)
In Passes 2, open the preview screen as same method as Passes 1, use color picker to despill the remained green
→ Fine tune on Erode (function as Matte Choker)

Still in 0010 Comp Detail → Output, change Outpass 0 as Player Viewport

Set Color grade/exposure adjustment for footage to match the BG:
In R bottom of Content Broswer, View Options, make sure tick Show Engine Content and Show Plugin Content
→ Open folder icon in Content, choose Color Grading (M_ColorGrade Range material is found):
image.png
In Media Plate layer, add 4th Transform Passes, drag ColorGrade Range in its box
→ Material Parameters → Color Gamma, adjust its Alpha (A) for brigthness)
Create Blueprint to let UE knows when to play the video:
In Blueprint tab → Open Blueprint → + Variables, name as Media, drag in the graph → Get
→ assign Variable Type (R hand side) as Media Player → Object Reference → Change Variable Type
→ Type “EventBeginPlay” and “Open Source” in graph → In Open Source node, change Media Source to Footage
→ Click on Media node, Default Value (R side) → Media: Assign New Media Player
Connect the graph as follow:
image.png
Now press play in UE, the composite footage starts to play
(The footage usually look darker during play, that’s why exposure in Passes 4 should be used to fix it)

Export the footage:
Drag Comp 0010 layer in Sequencer

Want to print your doc?
This is not the way.
Try clicking the ⋯ next to your doc name or using a keyboard shortcut (
CtrlP
) instead.