It looks like you're using an ad blocker! I really need the income to keep this site running.
If you enjoy BlenderNation and you think it’s a valuable resource to the Blender community, please take a moment to read how you can support BlenderNation.

Camera Tracking Using the Game Engine

"It's finally here. GameBlender - ARToolKit demo contains camera tracking in GameBlender's virtual scene, as it is shown in Little man video. To get it working, you need to install Texture plug-in and PyARToolKit module. (I've sorted out some bugs in Texture plug-in, so I suggest to download actual version)."

Short about the project: They import a video stream into blender and use some scripts to real-time camera track the streamed content. Then they are able to move the camera in blender with their real camera. Take a look at it:

GameBlender - ARToolKit demo


  • LOL


  • Stephen Danic

    Really impressive!

  • Dread Knight

    Haha so cool!

  • Murphy Randle


  • 3sie 3wiel

    Uh... video anyone? Seems to have gone missing?

    @LOL. Any particular reason for your choice of word?

  • Roger

    realtime? wow

    is it also a precise method for the non-realtime exact need for camera tracking?

  • Roger

    check out this one: even more impressive

  • blaize

    that's all great and all, but not really usefull for scenes that DONT have that piece of paper in there.
    what we really need is camera tracking that just calculates positions based on camera angles and such.
    something like this:
    (and yeah.. this is realtime also)

  • Tesla

    Thats impressive, so its all realtime and there's even phyisics based on what the cam sees? That's a feature i'd like to try out myself

  • AD-Edge

    Wow, thats pretty sweet! It would be interesting to see some applications for this, never seen anything like it.

    Tesla- i dont think the physics (ie the balls falling off the table) are based on what it 'sees' in realtime, that would be really advanced.

    And its my first post here on Blendernation to. Bout time... :)

  • aws357

    Mmmmh. Does it work with the built-in iSight from most moderns mac?

    If yes, that's definitely something I would like to have a look at...

  • Olaf


    But what if I wanted it the other way around: integrate Blender generated movie sets and props with green-screen shot actors? How would I do this? I can't wait to produce my own Star Wars-like movie using Blender.

  • Roger

    aws357, yes it works with a mac and her webcam. well, at least this works: it's another use of the ARToolKit 'engine' and one that works just by downloading the setup, printing the three included patterns and starting the app. now ye see a ship, a logo and an animated ship-race-course in 3D on your screen.

    I couldn't get the blender app to work, ye need all these really difficult and technical application to get it to work (maybe I'm just a noob and fool) but I couldn't get it to work


    Nice to try. Some one willing to make a complete package to download with needed installs?

  • boat

    i guess no one can get it to work.???????????
    any one? do i have to install Microsoft Visual Studio .NET 2003?

  • Glenn

    Has anyone got this working yet? I find the install help a little cryptic. I have made a PYTHONPATH variable pointing to the PyARTK files, installed the latest BlendVideoTex scripts into blender but cannot make sense of the demo. Is there a painfully slow step by step for numb-skulls like me to help me get going?


  • SNovak


  • Roger

    it sucks that i can't get it to work, if someone can make the suggested complete package, that would be wild

    until then, this is what i've made just now using the ARToolKit's 'engine'

    hope to be able to do the same thing, but then with materials (maybe even textures) and using the blender game engine


  • NathanKP

    I don't know about you, but I didn't find the camera tracking in the sample video to be particular impressive.

    NathanKP - Inkweaver Review

  • solhex

    Yeah I agree about the quality of the camera tracking, although that said it's not that bad, there was a fractional lag through the faster moving images but it soon caught up. When Icarus or pftrack start to go off track that's where they stay without human intervention.

    The first example movie I saw ran for over a minute and looked like it didn't need to stop anytime soon. I got Icarus to successfully track 12 seconds of DV footage once. Also I think this was developed for more real time interactive kinda stuff. I'm amazed by it frankly, and free to boot! It might be a while before programs like Icarus and pf track can do pixel perfect "live" tracking but can you imagine how cool it would be to have near instantaneous cg and live action animatics for our future productions...well, that's what it looks like we have here. Awesome! For now though, like a few others I'll have to wait until someone smarter than myself makes an idiot proof installer...Anyone?

  • Ash

    Hi, all,

    thanks for compliments to this video, and for the critics, too. I apologise for problems you had with the demo, but I didn't meant it as complete "one-click" solution. It's purpose was to show possibilies of GameBlender Texture plug-in that I created and published. This plug-in currently works on Windows only (there are users trying to make it work on linux).

    The best way to get working demo is install Texture plug-in first and test, that's it is working (there is demo for it on my site). Then you'll have to install remaining modules: numpy and PyARTK.

    When you'll get into troubles, you can check discussion on - there is a lot of information on plug-in, or you can write a comment on my site with info of your specific error.

  • Gustavo

    where do i put the sources?

  • Gustavo

    where do i put the plug-in?

  • Erik

    The links are dead, anyone knows where to get it now?

  • Matt

    I know this page is very old, but just in case someone happens onto this page like I did I feel like I have to say this. The links on this page no longer lead to the plug-in and I'm not sure where someone can find it. However there are other programs and plug-ins that will do the same thing. You just have to be vigilant.

Share this story: