Virtual Production get started

Key takeaways
How to use Tracker data in Unity
How to use Tracker data in Unity
How to set up a Virtual Camera in Unreal
How to set up a Virtual Camera in Unreal
How to use Virtual Production Props in Unreal
How to use Virtual Production Props in Unreal
How to use Virtual Production Props in Unity
How to use Virtual Production Props in Unity

How to set up a Virtual Camera in Unreal

Ready to show off your cinematic chops inside of Unreal? Learn how to set up a virtual camera that you can control with an HTC tracker using our Virtual Production.

This blog serves as a guide to teach users how to set up a virtual camera inside of Unreal using our Virtual Production. A virtual camera gives you the ability to control the camera within your Unity project with a Vive tracker. This allows you to walk within a 3D environment and set up specific camera shots that might only be done with a human director. Read on below to learn how easy it is to set up!

Note: Before proceeding below, make sure that you already have the Virtual Production kit setup with at least one Vive tracker online. If you need help setting this up, check out our blog Virtual Production Setup. Also, you must have at least a Studio Plus subscription in order to take advantage of Live Streaming data - see subscription plans here.

Rokoko Studio Setup

  • With the Virtual Production already setup and at least one Vive tracker live, add a camera prop to your scene.
  • Click on the orange camera icon at the bottom of the “Virtual Production” window
  • Assign your tracker to the camera prop
  • Click and drag the grey tracker icon within the “Virtual Production” window directly on top of “Camera-1” inside of the window
  • Note: To unassign a track from a prop, you can drag the tracker icon from below the prop to the grey box titled “Drop here to free tracker”. You may also simply drag and drop it on top of another prop to reassign it
  • Next, click the cogwheel icon at the top left of Studio and hover your cursor over “Data streaming”
  • Click to enable “Stream data”
  • Ensure that your ‘Forward IP’ address is set to the IP address of the computer you will be streaming data to
  • Ensure that your ‘Forward Port’ and ‘Forward VP port’ are different
  • Take note of what your ‘Forward VP port’ number is because it will be needed inside of Unreal

Installing Smartsuit Live & Virtual Camera Plugins

  • Click the Epic Games Launcher and navigate to the Marketplace tab
  • Use the Search bar and type in “Smartsuit Live”
  • Click on the Smartsuit Live asset
  • Navigate down the product page and click the “Install to Engine” button
  • Once finished, click the “Launch” button at the top of the Epic Games Launcher window
  • Open an existing or new Unreal Project (if this is your first time, we recommend opening a new project)
  • Once Unreal is open, click ‘Edit’ then click ‘Plugins’
  • Locate the ‘Smartsuit Live’ plugin by using the search bar
  • Check the ‘Enabled’ check box
  • A prompt will appear asking if you are sure that you want to enable the plugin. Click ‘Yes’
  • A prompt to restart Unreal will appear
  • Restart Unreal and then the Smartsuit Live plugin will be installed
  • Now install the Virtual Camera Plugin
  • Locate the ‘Virtual Camera’ plugin by scrolling through the plugins list and clicking ‘Virtual Production’
  • Check the ‘Enabled’ check box
  • A prompt with appear asking if you are sure that you want to enable the plugin. Click ‘Yes’
  • A prompt to restart Unreal will appear
  • Restart Unreal and then the ‘Virtual Camera’ plugin will be installed
  • Close out of the ‘Plugins’ window

Unreal Setup

  • Now, use the search bar under the ‘Modes’ tab on the left and type “Smartsuit Receiver”
  • Click and drag the “Smartsuit Receiver” inside of the viewport
  • Click the “SmartsuitReceiver” object inside of the World Outliner
  • Make sure that the ‘Streaming Data Port’ is the same number as the “Forward Port” inside of Rokoko Studio
  • Make sure that the ‘VP Listen Port’ is the same number as the ‘Forward VP Port’ inside of Rokoko Studio
  • Next, open Live Link by clicking Window > Live Link
  • Click ‘Add’ and hover your cursor over ‘Rokoko Virtual Production Source’
  • Click ‘Studio’ then click ‘OK’
  • Close the Live Link window
  • Now, in order to view Virtual Camera Content within the Content Browser, click ‘View Options’ at the bottom right of the Content Browser and click ‘Show Engine Content’ and click ‘Show Plugin Content’
  • Make sure you are showing the ‘Sources Panel’ in your Content Browser by clicking the ‘Show or hide the sources panel’ button to the left of ‘Filters’
  • Scroll down the list of folders and click the ‘Virtual Camera Content’ folder
  • Double-click ‘VirtualCameraPlayerController’ within the Content Browser
  • Within the ‘VirtualCameraPlayerController’ window, click on the ‘Class Defaults’ button at the top
  • Within the ‘Details’ panel under ‘Camera Settings’ change ‘Input Source’ to ‘Live Link’
  • Within the Live Link Target Name, type ‘prop:L:Camera-1’
  • Note: This is the name of the prop from Studio. This specific name can be found within the Live Link window under ‘Subject Name’ after Studio has been selected as a Source
  • Click the ‘Compile’ button then close this window
  • Next, change the GameMode by:
  • Clicking the downward facing arrow to the right of the ‘Blueprints’ button at the top of Unreal
  • Hover your cursor over ‘GameMode:...’ under ‘Project Settings’ > ‘Select GameModeBase Class > click ‘VirtualCameraGameMode
  • This makes it so that a virtual camera will spawn within Unreal upon entering ‘Play’ mode
  • Now click the ‘Play’ button and a virtual camera will spawn which is moveable by the real world movement of your HTC Tracker
[optimize output image]

We hope that this guide has helped you learn how to set up a virtual camera within Unreal. If you run into any issues during this process, feel free to reach out to our support desk or email support@rokoko.com.

Virtual Production
Unreal
Key takeaways
How to use Tracker data in Unity
How to use Tracker data in Unity
How to set up a Virtual Camera in Unreal
How to set up a Virtual Camera in Unreal
How to use Virtual Production Props in Unreal
How to use Virtual Production Props in Unreal
How to use Virtual Production Props in Unity
How to use Virtual Production Props in Unity
More courses