Michael Gschwandtner uses an Android phone to control a Blender camera in real time in this proof of concept.
This video shows a proof of concept implementation of an Android app and a Blender addon that allows you to use your smartphone as a real word substitute for a camera in a Blender scene.
By moving the smartphone in front of the marker with the Blender logo the app estimates the phone pose relative to your screen. This information is sent via Wifi to a server running inside Blender which calculates the phone position and rotation relativ to the laptop and transforms the camera in the Blender scene accordingly.
The Android app uses the Vuforia SDK from Qualcomm which is really fast in tracking the frame markers (the border around the Blender logo).
As you can see from the video the app is far from perfect and the whole Phone to Blender connection is not really userfriendly but it works and there is much room for improvement.
- lots and lots of things ;)
- Kalman filter for the 6DOF pose of the camera
- Different frame markers on all 4 edges of the screen or maybe using an image target instead of the frame marker
- Saving the movement of the camera
Please leave a comment if you like it or if you got any suggestions. The code is too “fragile” to be released just now, but I will continue working on this if the community wants it to be developed further.