Capture Studio
Capture Studio is a suite of tools I’ve been developing for an upcoming project. The goals is to make motion and performance capture easier, make tools that anyone can download and use without requiring specific game engines, networking, marker suits, web service subscriptions, or any of the other headaches that currently stand in the way.
Features
Face / Pose animation processing from ArKit / Google Mediapipe
Debugging and Video Processing in native app
Animation importing tools (currently only in Houdini)
Automatically exports extracted audio, runs Whisper Text-to-Speech and generated Rhubarb animation data
Capture Studio iOS
Capture studio for iOS leverages the front facing depth camera and Apple’s blendshape detection model to estimate the blendshape poses.
Rather than storing raw blendshape value data we encode the blendshape values into the recorded pixel grid so we can edit, retime, and concatenate videos together before exporting the animation data.
