Blender Facial Motion Capture with iphone!
pascalJardin writes:
I created a free app for iphone X and a blender add-on to import facial data into Blender!
Hippie Camp
pascalJardin writes:
I created a free app for iphone X and a blender add-on to import facial data into Blender!
Yesterday i created a new tutorial. For BMC
The next version of BMC will have full body capture!
https://www.youtube.com/watch?v=pAjoJ28ZosM
Any chance you’ll port this to Android? Or make the source available so others can?
the entire thing is open source!
https://github.com/pjardin/Blender-Motion-Capture
https://github.com/pjardin/iphoneCaptureAddon
unfortunately it is PHYSICALLY impossible to make this app work on android.
Hey Pascal, amazing work! However when I tried to motion capture face, after the recording no sending prompt comes up. Am I doing something wrong? Thank you!
Can I import my own model so that the facial animations are applied to it?
This is amazing! Can I use this data on a character with a full body?
wow amazing! You are a genius, Thank you for sharing!
When will the next version with body mocap coming? in Weeks or months?
Probably 2 weeks.
1 week to finish developing body mocap
1 week for apple to accept the updated version…. app store is a pain
Wow! Would be amazed to see that really working!
In your tutorial you use a Mac… But the addon works with an iPhone & Windows PC too?
The add-on works for both pc and windows. To capture the data you need a iPhone X or greater.
Yep! The add-on should work on both Mac and Windows
What about one for Android.
currently is not possible to do one for android
when will it be possible?
Not sure if it will be ever be possible… in order to do CLEAN facial capture you need depth, currently only iPhones have “true depth.” The “true depth” is a custom made camera and uv projector to capture the depth of the face. If android decides to copy apple with the face id, then it will be possible to have this on an android phone, until then it is physically not possible to have it on an android phone.
how about single axis track from android phone … is it possible ?
I would LOVE to see this add on get further developed, it looks seriously promising!
Great work! Do you plan to make it available for 3rd gen ipad pro? That device also has true depth front cameras.
For the second version I will definitely try too! : ) I don’t own a 3rd gen iPad so getting the screen shots will be tricky…. and to publish an app you need screen shots.
If you need a tester to get screenshots, hit me up.
[email protected]
If I have problems with the app store I definitely will! Thank you!
Hi just installed version 1.4 of your app. Great work but can’t get the plugin iphonecapture to work in Blender :( I’ve tried in Preferences to install it but it doesn’t upload. Any ideas?
Did you install it using the zip? if you don’t use the zip it will not upload.
Yes I tried to upload the zip file iphoneCapture.zip but everything I tried didn’t work. It doesn’t register in the preferences Add-on tab and I can’t find it in blender tabs or by pressing N or T. No error messages though which is wierd. I’ve blender 2.80 – should I upgrade my blender version and try again? Currently we are on version 2.82.
That would do it! you should upgrade your blender. Let me know if that does not work
Amazing Pascal! Bravo! Do you think it would be a lot of work to make it work in Maya?
Very good work…just a little idea for the next update.. consider to add extension to generated files (json and wav)… for PC users! :)
Hello friend, this project is great, only that in my country (Chile) it is not available, you know why?