Text-to-Motion: create new motion clips with text
A new experimental feature in Studio Preview that turns prompts into 3D character motions.
Create new human motion clips with text-based prompts in Studio Preview.
Prompt it like
it's hot 🔥
Generate unique 3D motions like idles, walks, runs with text-based prompts and add the clips to your project.
Crop it, smooth it, loop it
All generated clips can be cropped, smoothed, looped and added to your mocap project workflow in Studio Preview. Export your clips in custom formats.
Tutorial on how to get started with Text-to-Motion.
Text-to-Motion is part of Studio Preview
We have created Text-to-Motion for our users to have fun with a new way of generating motion clips. It's in an experimental phase, so give it a try and show us what fun stuff you'll create.
.jpg)
Frequently asked questions
Can't find what you're looking for? Shoot us an email at support@rokoko.com
How can I access Text-to-Motion?
Text-to-Motion is accessible in Studio Preview. Studio Preview is currently available for users on trials or paid plans only, but will be opened up to more users at a later point. You can start your free trial today (or request a new free trial if you have already used your trial by writing to support@rokoko.com)
How does Text-to-Motion work?
Text-to-Motion uses Rokoko’s proprietary AI foundation model for human motion to generate novel motion data files that never existed before. The files are based on the world’s largest database of motion assets, but the model will always produce motions that are unique and not replicated directly from an existing asset.
How is the Text-to-Motion model made?
Our Text-to-Motion AI model is trained on millions of unique motion assets, paired with text descriptions. This foundation model learns a deep understanding of human motion, and is capable of transforming text prompts into unique human motions. The generated assets are all unique and different from any assets in the original dataset.
Can I use the generated motion clips commercially?
Yes, the assets you generate are available for commercial use just like assets from Rokoko’s other motion capture tools, following our Terms of Use.
What kind of motions can I create with Text-to-Motion?
In theory there are no limits to what you can ask the Text-to-Motion tool to generate. However, in this initial version, it will give you the best result if you stick with idles (standing, sitting, squatting etc.) or simple locomotion prompts like variations around walking etc. You can also get decent results with running and more dynamic motions, but it might require a few tries. As soon as you have a small part of an asset that looks good (like a few steps in a run), you can crop out that segment in Preview, smooth it if needed, and then turn it into a really cool run cycle with the loopable segments tool.
Book a personal demo
Schedule a free personal Zoom demo with our team, we'll show you how our mocap tools work and answer all your questions.
Product Specialists Francesco and Paulina host Zoom demos from the Copenhagen office
