Rokoko Create: create new motion clips with text

Text-to-Motion is accessible to everyone on a web-based app called Rokoko Create and in Studio Preview. You can get started on Rokoko Create for free and upgrade to a paid plan if you exceed your limit of 5 clips added to Studio.

Studio Preview is currently available for users on trials or paid plans only, but will be opened up to more users at a later point.

Text-to-Motion uses Rokoko’s proprietary AI foundation model for human motion to generate novel motion data files that never existed before. The files are based on the world’s largest database of motion assets, but the model will always produce motions that are unique and not replicated directly from an existing asset.

Our Text-to-Motion AI model is trained on millions of unique motion assets, paired with text descriptions. This foundation model learns a deep understanding of human motion, and is capable of transforming text prompts into unique human motions. The generated assets are all unique and different from any assets in the original dataset.

Yes, the assets you generate are available for commercial use just like assets from Rokoko’s other motion capture tools, following our Terms of Use.

In theory there are no limits to what you can ask the Text-to-Motion tool to generate. However, in this initial version, it will give you the best result if you stick with idles (standing, sitting, squatting etc.) or simple locomotion prompts like variations around walking etc. You can also get decent results with running and more dynamic motions, but it might require a few tries. As soon as you have a small part of an asset that looks good (like a few steps in a run), you can crop out that segment in Preview, smooth it if needed, and then turn it into a really cool run cycle with the loopable segments tool.