Camera Tracking Using the Game Engine

Posted on by

“It’s finally here. GameBlender – ARToolKit demo contains camera tracking in GameBlender’s virtual scene, as it is shown in Little man video. To get it working, you need to install Texture plug-in and PyARToolKit module. (I’ve sorted out some bugs in Texture plug-in, so I suggest to download actual version).”

Short about the project: They import a video stream into blender and use some scripts to real-time camera track the streamed content. Then they are able to move the camera in blender with their real camera. Take a look at it:

GameBlender – ARToolKit demo


Be Sociable, Share!

    Twitter



    Please support us

    • LOL

      Bullshit.

    • http://mdm.gnwc.ca/?q=blog Stephen Danic

      Really impressive!

    • http://www.freezingmoon.org Dread Knight

      Haha so cool!

    • http://murphyrandle.com Murphy Randle

      wow

    • 3sie 3wiel

      Uh… video anyone? Seems to have gone missing?

      @LOL. Any particular reason for your choice of word?

    • Roger

      realtime? wow

      is it also a precise method for the non-realtime exact need for camera tracking?

    • Roger

      check out this one: http://www.youtube.com/watch?v=tpZI1Z-k88Y even more impressive

    • blaize

      that’s all great and all, but not really usefull for scenes that DONT have that piece of paper in there.
      what we really need is camera tracking that just calculates positions based on camera angles and such.
      something like this: http://www.doc.ic.ac.uk/~ajd/Scene/
      (and yeah.. this is realtime also)

    • Tesla

      Thats impressive, so its all realtime and there’s even phyisics based on what the cam sees? That’s a feature i’d like to try out myself

    • AD-Edge

      Wow, thats pretty sweet! It would be interesting to see some applications for this, never seen anything like it.

      Tesla- i dont think the physics (ie the balls falling off the table) are based on what it ‘sees’ in realtime, that would be really advanced.

      And its my first post here on Blendernation to. Bout time… :)

    • aws357

      Mmmmh. Does it work with the built-in iSight from most moderns mac?

      If yes, that’s definitely something I would like to have a look at…

    • Olaf

      Brilliant!

      But what if I wanted it the other way around: integrate Blender generated movie sets and props with green-screen shot actors? How would I do this? I can’t wait to produce my own Star Wars-like movie using Blender.

    • Roger

      aws357, yes it works with a mac and her webcam. well, at least this works: http://www.hitlabnz.org/wiki/Black_Magic_Book it’s another use of the ARToolKit ‘engine’ and one that works just by downloading the setup, printing the three included patterns and starting the app. now ye see a ship, a logo and an animated ship-race-course in 3D on your screen.

      I couldn’t get the blender app to work, ye need all these really difficult and technical application to get it to work (maybe I’m just a noob and fool) but I couldn’t get it to work

    • LOGAN

      Nice to try. Some one willing to make a complete package to download with needed installs?

    • boat

      i guess no one can get it to work.???????????
      any one? do i have to install Microsoft Visual Studio .NET 2003?

    • Glenn

      Has anyone got this working yet? I find the install help a little cryptic. I have made a PYTHONPATH variable pointing to the PyARTK files, installed the latest BlendVideoTex scripts into blender but cannot make sense of the demo. Is there a painfully slow step by step for numb-skulls like me to help me get going?

      Glenn

    • http://www.snovak.com SNovak

      Awesome!!

    • Roger

      it sucks that i can’t get it to work, if someone can make the suggested complete package, that would be wild

      until then, this is what i’ve made just now using the ARToolKit’s ‘engine’

      http://www.youtube.com/watch?v=WmWRokiwux4

      hope to be able to do the same thing, but then with materials (maybe even textures) and using the blender game engine

      cheers

    • http://inkweaver-review.blogspot.com NathanKP

      I don’t know about you, but I didn’t find the camera tracking in the sample video to be particular impressive.

      NathanKP – Inkweaver Review

    • solhex

      Yeah I agree about the quality of the camera tracking, although that said it’s not that bad, there was a fractional lag through the faster moving images but it soon caught up. When Icarus or pftrack start to go off track that’s where they stay without human intervention.

      The first example movie I saw ran for over a minute and looked like it didn’t need to stop anytime soon. I got Icarus to successfully track 12 seconds of DV footage once. Also I think this was developed for more real time interactive kinda stuff. I’m amazed by it frankly, and free to boot! It might be a while before programs like Icarus and pf track can do pixel perfect “live” tracking but can you imagine how cool it would be to have near instantaneous cg and live action animatics for our future productions…well, that’s what it looks like we have here. Awesome! For now though, like a few others I’ll have to wait until someone smarter than myself makes an idiot proof installer…Anyone?

    • http://www.ash.webstranka.info Ash

      Hi, all,

      thanks for compliments to this video, and for the critics, too. I apologise for problems you had with the demo, but I didn’t meant it as complete “one-click” solution. It’s purpose was to show possibilies of GameBlender Texture plug-in that I created and published. This plug-in currently works on Windows only (there are users trying to make it work on linux).

      The best way to get working demo is install Texture plug-in first and test, that’s it is working (there is demo for it on my site). Then you’ll have to install remaining modules: numpy and PyARTK.

      When you’ll get into troubles, you can check discussion on http://blenderartists.org/forum/showthread.php?t=65107 – there is a lot of information on plug-in, or you can write a comment on my site with info of your specific error.

    • Gustavo

      where do i put the sources?

    • Gustavo

      where do i put the plug-in?

    • Erik

      The links are dead, anyone knows where to get it now?