This blog serves as a guide to users who want to learn about importing Rokoko’s Face Capture data into Blender and attaching it to their characters. We go over how to export face data from Studio, import it directly into Blender and attach it to your custom character. Please follow along below as we break down this process for you!
Please note that the Face Capture feature within Rokoko Studio is only included under the paid Studio subscription plans. If you are only on the Studio Basic plan and want to take advantage of Face Capture, check out our subscription plans here.
It's also important to note that characters that utilize the standard ARKit 52 blendshapes are compatible with Face Capture. Make sure your character is set up with this method before proceeding. If you're looking for a way to rig your characters to take advantage of face capture, check out Polywink’s solution here.
Exporting Face Capture Data from Studio
When you’re ready to export out your Face Capture recording, click the “Exporter” panel to bring up the “Export options” box
Most of the default information should remain untouched however, you have the option to adjust the following settings:
Make sure that ‘Export face data’ is checked
If you have Virtual Production data, make sure “Export VP data” is checked
“Mimic file hierarchy” will export your files in the same hierarchy that they are in Studio
“Export Path” shows where the files will be exported out to
FBX is the only format that currently supports Face Capture
“FBX Settings” allows you to choose between ASCII or Binary types
“Version” allows you to choose which FBX version you’d like to export as
Once you have your settings set, click the “Export” button
Once done exporting, open Blender
Importing Face Capture Data into Blender
Open Blender and import both your character and exported face data
Click File > Import > FBX (.fbx)
Locate each file and click the ‘Import FBX’ button
You can playback the animation by pressing the play button at the bottom of Blender
If it’s playing slower than usual, click ‘Playback’ and toggle on ‘AV-sync’
In order to paste keyframe data from your face data to your character, your character must already have a starting keyframe on each blendshape that data will be transferred to
Click on the mesh that holds the blendshape data for your character
In your ‘Properties’ panel under the Object data tab, navigate to ‘Shape Keys’ and zero out all of the blendshapes
Then insert a keyframe for each blendshape by right-clicking on ‘0.00’ and clicking ‘Insert Keyframe’
Note: Make sure you are on frame “0” of the playback timeline before inserting keyframes
Once a keyframe has been inserted for all of your blendshapes, open a new Graph Editor window
Hover your cursor in the top-right corner of your 3D viewport until it turns into a “+”
Click and drag left to create a new window
At the bottom-left, of this new window, click the button with a cube, and select ‘Graph Editor’
Click on your face data within the 3D viewport so that you can see its’ curve data inside the Graph Editor
Open up the mesh to the left of the Graph Editor so that you can see all of the values of the blendshapes
Select all of the data by clicking ‘Select’ then ‘Select All’
Once it’s all high-lighted copy by press CTRL+C or CMD+C
Note: You have to make sure your cursor is hovered above the Graph Editor window or else it will not copy
Now click on your character mesh that contains the blendshapes
Press CTRL+V or CMD+V on your keyboard to paste the copied face data
All of the keyframes from the face capture data should now have been copied over and you can press the ‘Play’ button to test your face data on your character!
We hope this guide has helped you learn how to forward your Face Capture data from Rokoko Studio directly to your character in Blender. If you run into any issues during this process, feel free to reach out to our support desk or email firstname.lastname@example.org.
To learn more about Face Capture and claim your free month, click here.