Animation & Mesh character

Retarget & synchronize Anim in Real time



Purpose:
Synchoirze followings in real time:
let just 1 main character adapt all different ainms (skip putting different anim in anim BP);
and be able to apply on different skeleton meshes with create simple ik rig.

Import the mixamo skeleton Y Bot T pose to UE
image.png
Create IK Rig, choose the mixamo skeletal mesh, name as IKR_Mixamo (I use Y Bot instead of X BOo)
image.png

Create different Skeleton chains by combing different skeletons


Select Hips, R click, Set Retarget Root
image.png
Select Spine, to Spine 2, Select New Retarget... → click ok (choose no goal if it will ask further)
image.png
Repeat the same steps by grouping different skeletons into different chains:
Head
image.png
Arm
image.png
Thumb
image.png
Index
image.png
Middle
image.png
Ring
image.png
Pinky
image.png
Leg
image.png
Repeat the same on right hand side

All will be shown on IK Retargeting:
image.png

Set the IK Retargeter:


For this case, Retargeter is UE5 mannequin
Check if IK_Mannequin in the project (if using different meshes, recreate that IK retargeter witht the method above):
image.png
Create a IK Retargeter, choose IK Mannequin (i.e. use UE5 mannequin as a base, to copy the anim to mixamo), name as IKRetargeter_Mannequin_To_Mixamo
image.png
Open it, choose the target IK Rig Asset to mixamo
move preview offset to let 2 characters overlapping exactly:
image.png
Check if source and target match in Chain Mapping, if not, correct them (my case, hand index, ring, pinky need to be corrected):
image.png

Edit the Target skeleton to fit source skeleton:
Go to Edit mode/Edit Pose, rotate/adjust the hands and leg positons:
image.png
image.png
Reduce Bone Draw size from 8 to 3 or 2 (to see easier for rotating)

P.S. turn on the following helps to see the mesh from all sides:
image.png

After finish, press Edit Pose/Edit mode button again to quit
image.png

Test animation if they match in Asset Broswer:
image.png

Create Anim BP to use the IK Rig


Create a Anim BP, select mixamo character skeleton
name as ABP_Mixamo
create Retarget Pose from Mesh node to connect,
Choose mannequin to mixamo IK Retargeter,
be sure tick Use Attached Parent
image.png

Go to 3rd person BP viewport
Child a new mesh under current mesh, called Mixamo
Change the mesh and Animation class in the mixamo component
Select the Parent Mesh component,
Untick visibility, and set Tick option at bottom as Always tick Pose and refresh bones:
image.png
third

Some advice to retarget on metahuman:


Want to print your doc?
This is not the way.
Try clicking the ⋯ next to your doc name or using a keyboard shortcut (
CtrlP
) instead.