meshonline writes:
Hello Everyone,
I had developed an open source Kinect motion capture toolkit, and put it on GitHub.
If you want to make your own motion capture system, this is your best choice, it is completely free.
You need to compile it yourself, I only use the it on macOS, you can try compiling it for Linux and Windows, it should work.
I have successfully use it in Blender, here are the steps:
- Use the toolkit to generate BVH file.
- Import the BVH file to blender.
- Bind the character to the armature.
If you are using Rigify's metabone, you just need to adjust the armature slightly, here are the steps:
- Select the armature, enter 'Edit' mode, select all bones, press 'Ctrl' + 'N', click 'Recalculate Roll->with Global -Y axis'.
- Select the armature, enter 'Pose' mode, rename some bones, let them match the bone names of the BVH armature, and change the rotation mode from 'Quaternion(WXYX)' to 'ZYX Euler'.
- Bind the character to the armature.
- Use the toolkit to generate BVH file.
- Import the BVH file to blender.
- Delete the BVH armature.
- Select the armature, switch to 'Dope Sheet->Action Editor' interface, attach the motion clip.
37 Comments
This is a great step for the Open Source!
Thank you so much!
Thank you so much for making this open source. It is now 2020, does anyone know the latest update /development with the Kinect V2, Blender and Windows? Thank you
Hi, I'm the author of the article, there is a spelling error:
Recalculate Roll->with Global Y axis
Should be:
Recalculate Roll->with Global -Y axis
Updated, thanks!
This sounds amazing! If anyone successfully compiles a windows version please consider sharing it here - thanks!
Hey could you make video tutorial for this one, thank you so much!
Hi ! Seems pretty awesome ! Been waiting for these king of tools for years. You need to make/link a demo to show some live footage Vs Capture (will allow me to know if i should acquire a Kinect ^^). BTW is it Kinect or Kinect2 ? Does it allow multiple Kinect for sharper/360 capture ?
Thank you for releasing this.
It is Kinect 1, not Kinect2, it only allow one Kinect device, I use some algorithm to recover lost data when turning your body, though it's not perfect, it works.
Here is a generated BVH file: http://www.mesh-online.net/test-bvh.zip
You may import to Blender to see the result.
Here is a generated BVH file: http://www.mesh-online.net/test-bvh.zip
Hallo Sir,
does it still work in 2020 with the new operating systems for Mac like Catalina and Big Sur?
I don't know, for I did not touch the project for a long time.
Hi, I have just recorded a short live footage Vs Capture: https://youtu.be/4x8NyXuXZWI
You may get the BVH file from: https://github.com/meshonline/kinect-openni-bvh-saver
Thank you for the live footage comparison. That's really neat. Though it has the limitations I expected (a bit shaky, some lost movements) I think it's the best you could get from a Kinect 1. This is a really a great tool, I'll definitely need to get a Kinect device (and learn to compile for windows). Thank you again for this. I see you have other really interesting project on your Github ! Yum !
The unit of this BVH is centimeter, while the unit of Blender is meter, if you use Rigify armature, please scale the armature by 100, then apply scale on the armature, then scale the armature by 0.01, otherwise, the animation looks strange.
I'll modify the source code to fit Blender's default unit, compile to Linux and Windows is not easy, you need to install drivers, I'll release the compiled version when finished.
pls need the complied version for windows
Hi, I have just built a windows release:
https://drive.google.com/file/d/0B37dehusTo2MTWJEdkdrd29pLWM/view?usp=sharing
Cheers.
Wow so fast ! thank you.
Yehualashet if you make some test can you share it with us ? or at least mention if you had some difficulty to make it work on windows. If I lay a hand on a kinect I will do so.
I had removed the link from Google Driver, and here is the latest link: http://www.mesh-online.net/mocap-windows.zip
If you have any bugs, please report on:
https://blenderartists.org/forum/showthread.php?439837-Test-Kinect-motion-capture-toolkit-on-Windows
Thanks.
How i start recording/stop recording?
It will automatically start recording when it detected your body, and automatically stop recording when it lost tracking, so you can record multiple animation clips at one time.
Press 'ESC' key on the display window to quit the app.
The Answer to me prayers! I was searching for a method like this!
thanks a lot ! really great work !
You are my god !
when I import into blender the armature is reversed left-right. the right arms and legs are on the left side and the left arms and legs are on the right side, and everything bends backwards, so reversing the armature doesn't fix the issue. any ideas how to address this? I'm using the windows port.
There will be Kinect 2 support?
+1 ! I tested it and the only thing it's lacking is precision !
I also hope for a kinect 2 version but I don't know if the developer has time to do this...
No, I don't have a Kinect v2 sensor, but I have three Kinect v1 sensors.
Only one Kinect v2 sensor can run on one computer, but multiple Kinect v1 sensors can run on one computer, that's why I prefer Kinect v1 sensors.
There is an enhanced version: http://www.mesh-online.net/mocap.html
Which kind of modification would be needed to adapt to kinect v2?
https://stackoverflow.com/questions/27465516/does-openni-2-2-support-kinect-v2
https://stackoverflow.com/questions/37787832/dose-nite-work-with-kinect-v2?noredirect=1&lq=1
It seems that the NiTE SDK does not support Kinect v2, but the project depends on NiTE SDK, so it only supports Kinect v1.
This is a great tool, and I am very happy for this! My mistake probably, but I tried mocap for win. I have Kinect 1 and my laptop is Intel core i5 at 2700 GHz, with 8 GB ram and the operating system is Windows 10. I followed the instructions, but at tiltkinect I had no luck. I gave up after twenty times try. Please advise. Thank you.
The Kinect driver may not work, please check if you have installed the Kinect SDK properly, there are a few utilities in the SDK, can they run correctly?
I downloaded the latest version of Kinect driver and the SDK is perfect also. It works with N-iMate free version, correctly. That's why I think, I made a mistake at mocap for Windows.
It works well, now. The problem was with the Kinect 1.8. This was not removed before I installed the Kinect 2.0 SDK.
Should happen.
Thank you Mr. Wang for the software. Great job, you made if open source.
Thank you so much for making this open source. It is now 2020, does anyone know the latest update /development with the Kinect V2, Blender and Windows? Thank you
Hey,
I'm having trouble working out how to build it for macOS, does anyone have any info which could help?