NRK writes:
In these videos, we will see a super-easy way of doing facial motion capture with the Artificial Intelligence open-source body tracking software OpenPose. In the first video, I will show you how to track a video of your face and generate data files and then import that data into blender onto a rig. In the second video, we take a deep dive into Python scripting for blender so you can modify the process to work on your own rig.
All tools and methods are freely available. The Python script I wrote for blender to import the files can be downloaded here.
I am an engineering generalist combining electrical, mechanical, and software engineering to solve problems and make cool stuff! Ever since I've been bottled up at home recently I've had some time to put some videos together to share with the community that has given so much to me, here's some love back....
Part 1: Facial Mocap
Part 2: Customize the Process to Your Rig with Python!
2 Comments
Very nice job friend. I tried this but is not work as expected, i see movement but its not mathes my input video. I think i’ve matched the bones properly (rig is with riggify) the only think i didnt do and i think thats the problem, is in the part 2 you say to reset the X and Z axes to 0 and also the roll to 0, if i do that the rig structure get ruined, i cant just set all those face bones with x and z to 0. I think there is something that i dont understand, any help please, thank you
This is amazing. Do you think it's possible to track just the mouth?. I'm working on a dental project and I would like to use camera tracking to register the jaw movements. However, with Blender's motion tracking function and a fixed camera, I can only obtain two axis at the time.
Any help would be appreciated.
Best
Juan González
http://www.cursosodonto3d.com