Face Capture get started

Key takeaways
How to Live Stream Face Capture data to Unreal
How to Live Stream Face Capture data to Unreal
How to use Face Capture Data in Maya
How to use Face Capture Data in Maya
How to use Face Capture data in Blender (2.79)
How to use Face Capture data in Blender (2.79)
How to use Face Capture data in Cinema4D
How to use Face Capture data in Cinema4D
How to use Face Capture data in Blender (2.80)
How to use Face Capture data in Blender (2.80)
How to Live Stream Face Capture Data in Unity
How to Live Stream Face Capture Data in Unity
Everything you need to know about Rokoko Face Capture
Everything you need to know about Rokoko Face Capture

How to use Face Capture data in Blender (2.80)

This blog serves as a guide to users who want to learn about importing Rokoko’s Face Capture data into Blender and attaching it to their characters. We go over how to export face data from Studio, import it directly into Blender and attach it to your custom character. Please follow along below as we break down this process for you!

If you're using a version of Blender before 2.8 watch this video here.

Please note that the Face Capture feature within Rokoko Studio is only included under the paid Studio subscription plans. If you are only on the Studio Basic plan and want to take advantage of Face Capture, check out our subscription plans here.

It's also important to note that characters that utilize the standard ARKit 52 blendshapes are compatible with Face Capture. Make sure your character is set up with this method before proceeding. If you're looking for a way to rig your characters to take advantage of face capture, check out Polywink’s solution here.

Exporting Face Capture Data from Studio

  • When you’re ready to export out your Face Capture recording, click the “Exporter” panel to bring up the “Export options” box
  • Most of the default information should remain untouched however, you have the option to adjust the following settings:
  • Make sure that ‘Export face data’ is checked
  • If you have Virtual Production data, make sure “Export VP data” is checked
  • “Mimic file hierarchy” will export your files in the same hierarchy that they are in Studio
  • “Export Path” shows where the files will be exported out to
  • FBX is the only format that currently supports Face Capture
  • “FBX Settings” allows you to choose between ASCII or Binary types
  • “Version” allows you to choose which FBX version you’d like to export as
  • Once you have your settings set, click the “Export” button
  • Once done exporting, open Blender

Importing Face Capture Data into Blender

  • Open Blender and import both your character and exported face data
  • Click File > Import > FBX (.fbx)
  • Locate each file and click the ‘Import FBX’ button
  • You can playback the animation by pressing the play button at the bottom of Blender
  • If it’s playing slower than usual, click ‘Playback’ and toggle on ‘AV-sync’
  • In order to paste keyframe data from your face data to your character, your character must already have a starting keyframe on each blendshape that data will be transferred to
  • Click on the mesh that holds the blendshape data for your character
  • In your ‘Properties’ panel under the Object data tab, navigate to ‘Shape Keys’ and zero out all of the blendshapes
  • Then insert a keyframe for each blendshape by right-clicking on ‘0.00’ and clicking ‘Insert Keyframe’
  • Note: Make sure you are on frame “0” of the playback timeline before inserting keyframes
  • Once a keyframe has been inserted for all of your blendshapes, open a new Graph Editor window
  • Hover your cursor in the top-right corner of your 3D viewport until it turns into a “+”
  • Click and drag left to create a new window
  • At the bottom-left, of this new window, click the button with a cube, and select ‘Graph Editor’
  • Click on your face data within the 3D viewport so that you can see its’ curve data inside the Graph Editor
  • Open up the mesh to the left of the Graph Editor so that you can see all of the values of the blendshapes
  • Select all of the data by clicking ‘Select’ then ‘Select All’
  • Once it’s all high-lighted copy by press CTRL+C or CMD+C
  • Note: You have to make sure your cursor is hovered above the Graph Editor window or else it will not copy
  • Now click on your character mesh that contains the blendshapes
  • Press CTRL+V or CMD+V on your keyboard to paste the copied face data
  • All of the keyframes from the face capture data should now have been copied over and you can press the ‘Play’ button to test your face data on your character!

We hope this guide has helped you learn how to forward your Face Capture data from Rokoko Studio directly to your character in Blender. If you run into any issues during this process, feel free to reach out to our support desk or email support@rokoko.com.

To learn more about Face Capture and claim your free month, click here.

Face Capture
Rokoko Studio
Smartsuit Pro
Blender
Key takeaways
How to Live Stream Face Capture data to Unreal
How to Live Stream Face Capture data to Unreal
How to use Face Capture Data in Maya
How to use Face Capture Data in Maya
How to use Face Capture data in Blender (2.79)
How to use Face Capture data in Blender (2.79)
How to use Face Capture data in Cinema4D
How to use Face Capture data in Cinema4D
How to use Face Capture data in Blender (2.80)
How to use Face Capture data in Blender (2.80)
How to Live Stream Face Capture Data in Unity
How to Live Stream Face Capture Data in Unity
Everything you need to know about Rokoko Face Capture
Everything you need to know about Rokoko Face Capture
More courses