You're blocking ads, which pay for BlenderNation. Read about other ways to support us.

Camera Tracking Using the Game Engine


"It's finally here. GameBlender - ARToolKit demo contains camera tracking in GameBlender's virtual scene, as it is shown in Little man video. To get it working, you need to install Texture plug-in and PyARToolKit module. (I've sorted out some bugs in Texture plug-in, so I suggest to download actual version)."

Short about the project: They import a video stream into blender and use some scripts to real-time camera track the streamed content. Then they are able to move the camera in blender with their real camera. Take a look at it:

GameBlender - ARToolKit demo


  1. that's all great and all, but not really usefull for scenes that DONT have that piece of paper in there.
    what we really need is camera tracking that just calculates positions based on camera angles and such.
    something like this:
    (and yeah.. this is realtime also)

  2. Thats impressive, so its all realtime and there's even phyisics based on what the cam sees? That's a feature i'd like to try out myself

  3. Wow, thats pretty sweet! It would be interesting to see some applications for this, never seen anything like it.

    Tesla- i dont think the physics (ie the balls falling off the table) are based on what it 'sees' in realtime, that would be really advanced.

    And its my first post here on Blendernation to. Bout time... :)

  4. Mmmmh. Does it work with the built-in iSight from most moderns mac?

    If yes, that's definitely something I would like to have a look at...

  5. Brilliant!

    But what if I wanted it the other way around: integrate Blender generated movie sets and props with green-screen shot actors? How would I do this? I can't wait to produce my own Star Wars-like movie using Blender.

  6. aws357, yes it works with a mac and her webcam. well, at least this works: it's another use of the ARToolKit 'engine' and one that works just by downloading the setup, printing the three included patterns and starting the app. now ye see a ship, a logo and an animated ship-race-course in 3D on your screen.

    I couldn't get the blender app to work, ye need all these really difficult and technical application to get it to work (maybe I'm just a noob and fool) but I couldn't get it to work

  7. Has anyone got this working yet? I find the install help a little cryptic. I have made a PYTHONPATH variable pointing to the PyARTK files, installed the latest BlendVideoTex scripts into blender but cannot make sense of the demo. Is there a painfully slow step by step for numb-skulls like me to help me get going?


  8. it sucks that i can't get it to work, if someone can make the suggested complete package, that would be wild

    until then, this is what i've made just now using the ARToolKit's 'engine'

    hope to be able to do the same thing, but then with materials (maybe even textures) and using the blender game engine


  9. Yeah I agree about the quality of the camera tracking, although that said it's not that bad, there was a fractional lag through the faster moving images but it soon caught up. When Icarus or pftrack start to go off track that's where they stay without human intervention.

    The first example movie I saw ran for over a minute and looked like it didn't need to stop anytime soon. I got Icarus to successfully track 12 seconds of DV footage once. Also I think this was developed for more real time interactive kinda stuff. I'm amazed by it frankly, and free to boot! It might be a while before programs like Icarus and pf track can do pixel perfect "live" tracking but can you imagine how cool it would be to have near instantaneous cg and live action animatics for our future productions...well, that's what it looks like we have here. Awesome! For now though, like a few others I'll have to wait until someone smarter than myself makes an idiot proof installer...Anyone?

  10. Hi, all,

    thanks for compliments to this video, and for the critics, too. I apologise for problems you had with the demo, but I didn't meant it as complete "one-click" solution. It's purpose was to show possibilies of GameBlender Texture plug-in that I created and published. This plug-in currently works on Windows only (there are users trying to make it work on linux).

    The best way to get working demo is install Texture plug-in first and test, that's it is working (there is demo for it on my site). Then you'll have to install remaining modules: numpy and PyARTK.

    When you'll get into troubles, you can check discussion on - there is a lot of information on plug-in, or you can write a comment on my site with info of your specific error.

  11. I know this page is very old, but just in case someone happens onto this page like I did I feel like I have to say this. The links on this page no longer lead to the plug-in and I'm not sure where someone can find it. However there are other programs and plug-ins that will do the same thing. You just have to be vigilant.

Leave A Reply

To add a profile picture to your message, register your email address with To protect your email address, create an account on BlenderNation and log in when posting a message.