Markerless Mocap
A downloadable tool for Windows and Android
5 FREE TO USE MOCAP PROGRAMS
Program 1
MarkerlessMocapWIN.zip
FEATURES:
- 30/60 FPS BVH export (works great with Blender and Motion Builder)
- Easy to use GUI
- Rig is Unity/Mixamo ready
MINIMUM SPECS:
- NVIDIA GeForce RTX2070 graphics card and above recommended
- Application requires 1 webcam plugged in (internal fine)
USE INSTRUCTIONS:
- Entire body needs to be visible within 15 seconds of application startup
- T-Pose at the beginning of your takes to make retargeting easy in post-production
- Your takes will be saved inside the application folder as BVH motion files
- If it imports like a ball, the scale is wrong, scale it up and scale down the size of the skeleton nodes
Program 2-5
QuestMocap.apk / QuestMocapWin.zip / QuestMocopiMocap.apk / QuestMocopiMocapWin.zip
FEATURES:
- 30/60 FPS BVH export (works great with Blender and Motion Builder)
- Easy to use GUI
- Rig is Unity/Mixamo ready
- Unlimited capture space, capture on the go (just be mindful of the sun not burning your displays through the lenses)
- Sony Mocopi hybrid version for full body tracking of legs and hands.
MINIMUM SPECS:
- Quest 3 HMD or VR Ready PC + Link cable + Quest 3
- Mocopi is optional, but use mocopi version if you're using it.
USE INSTRUCTIONS:
- Snap your right index finger and thumb to begin and end recording
- Tposing will happen automatically (no need to do it yourself), just do your motion
- Your takes will be saved locally on the device in the persistent data path of the app as BVH. You can manually rename and set the options with Bluetooth keyboard, otherwise it's just versioned up.
This PC\Quest 3\Internal shared storage\Android\data\com.StevenHarmonGames.QuestMocap
- If it imports like a ball, the scale is wrong, scale it up and scale down the size of the skeleton nodes
- If using Sony Mocopi version, be sure to set the IP of the quest device into the mocopi app as UDP stream lower body priority mode, IP device address and port will be located in blue text in-app. Must be on same WIFI network (can use mobile hotspot)
LICENSING:
- Commercial use allowed, feel free to use however you'd like.
- If you like it, please donate what you can so I can improve upon it.
PROJECT SHOWCASE:
Please share your work you make with Markerless Mocap!
Digitizing Tacit Knowledge | Hosai Matsubayashi XVI — HAKO - preserving Japanese craft using mocap
Zotto - VR Immersive Theater production, intergenerational folktale of Denver's history of Japanese internment.
CAREGIVR - social end of life VR experience for informed decisions and support
Download
Click download now to get access to the following files:
Comments
Log in with itch.io to leave a comment.
unable to select webcam? i have like 9 plugged in
Huh, that’s odd. I’ve only tested it on computers with one webcam plugged in and it is hard coded to just pick the first primary one. Perhaps try unplugging all but one and restarting your computer.
update:
most were virtual. i wrote a bat file to disable them and another to enable them for future use, but this will come up with other users. there will be a strong overlap of people using this but also using OBS, vseeface, vtubestudio, Snap Camera, Elgato products, animaze, etc
rokoko and plask are embarrassingly predatory considering you supply the same thing for free with unlimited use after one day's work.
if you cant update markerless mocap or release the project files for us to update, can you point us in the right direction to remake it? from what i remember from your talk it was a few github repositories, making them talk to one another, export and some UI, right?
for other people who come across this post, if you don't write BATs and are disabling each virtual camera manually in device manager, you will need to also use registry edit to disable some of them by creating device states. try to leverage gpt for aid with your setup because they're all different.
Yeah, I would recommend exploring https://github.com/digital-standard/ThreeDPoseTracker
and bvh tools (also linked in the git page)
There’s lots of other great free DIY mocap tools like freemocap https://github.com/freemocap/freemocap
If you’re trying to recreate the VR tool I created, I recommend using the meta body SDK and bvh tools.
The linked project CAREGIVR is open source and has a repo