It looks like you're using an ad blocker! I really need the income to keep this site running.
If you enjoy BlenderNation and you think it’s a valuable resource to the Blender community, please take a moment to read how you can support BlenderNation.

Turn your webcam into a 3D scanner

49

Turn your webcam into a 3D scanner toolbox Several people reported this: Cambridge University Qi Pan is developing software that will reconstruct textured 3D models from webcam video. A Linux and later a Windows downloadable demo should be available in a couple of months. The results are already quite amazing - check out the video inside.

Links

Share.
  • Iconoclast

    This looks awesome, keep up the good works.

  • http://www.amyto.com Robin

    Wow

  • Vince

    I`m just speachless.... wow!

  • tmr232

    This is really cool!
    I wonder how would something like that can handle holes, though. But I guess this will be done in the future...

    It reminds me of this - http://www.robots.ox.ac.uk/~gk/youtube.html .

  • Sergio Frias

    THIS IS AMAZING!!!! ,just imagine how easy it will be to digitalize your face/head or the entire body...i think it will be better that DAVID 3d scanner,wich require to have a laser .
    hope it will be free as well ;)

  • Nik

    VERY Impressive! The applications for this are endless, especially for markerless augmented reality systems! I take my hat off to the person who made it.

  • Jonathan

    ...I need... a webcam... XD

  • tntermini

    that's revolutionary!

  • lile

    amazing !!

    the fun is that google ads are for 'affordable 3d scanners' on this page :)

    can't wait to see the followings of this story

  • http://www.byronsdesigns.com ByronK

    That is truley amazing!

  • nemesis

    Now, this is something I need.

    Thanks for the article.

  • kenny_lex

    Woow. I did ask in a Blender forum if it was possible to convert a point cloud to a 3D mesh, and here is the answer. With better calculations algorithms it will soon be possible to film a real house (or landscape) and get a rough 3D mesh of it.

    Cool with the reel time functionality, this make the 3D future interesting.

  • MeshWeaver

    one word: AMAZING!!!

    ooh, can't wait until the demo!!!!!!!!!!!!

    and it even adds the TEXTURES!!! wow

  • http://www.blendercross.org madturtle

    Cool !!!!
    ....in the movie tron the need a installation large then a building - now you need a web-cam and an impressive
    piece of software !! ;)

  • _L_

    Wow :)

  • http://www.eibriel.com.ar Eibriel

    Wow! :O

  • pildanovak

    actually look at papers from Polyfeys from the 90's. Similar algorithms are around for years, just that nobody took the effort to make them realtime & opensource.
    great news.

  • http://smokin.homeip.net smokin juan

    You can sign up for notification of the proforma demo release here: http://mi.eng.cam.ac.uk/~qp202/
    In the meantime, you can generate point clouds with voodoo camera tracker: http://www.digilab.uni-hannover.de/docs/manual.html
    Good luck making a mesh from the output, but it could be a usefull reference tool.

  • Jordan Harris

    Holy cow...

    That's pretty insane. I mean, the results aren't perfect or anything, but it's a huge step.

    ~ J

  • txrx

    That's awesome, great work and the way of the future etc! :D

  • http://www.villablender.blogspot.com Santiago

    Thats just amazing, i actually have been working with blender for a short time, not very good at modelindo, but im great with textures and riggings/animation. This would solve my modling problems, and i could just make real life models and then get them into the pc with this software.

    Hopefully it would be free... because if it is comercial, im sure it would cost a lot of money.

  • http://kubuntulover.blogspot.com Blendiac

    How does it know not to include his hand?!

  • ggFEL

    How does this affect the jobs of modelers in the near future?

    Of course is amazing, it just worries me how automatized is everything. The mesh is not perfect but a Re-mesh algorithm can solve that.

    I hope is not something to worry about.

  • http://www.das-fussballcamp.de Cyrr

    Segmentation Blendiac. It takes the point cloud and tries to find points that create a face. The face has to be plane. Then it tries to find faces that have the same edge and with these edges it is possible to add the next face. I assume the algorithm uses some coplanarity issues.
    We develop at our company the same stuff. We take LIDAR data from airial planes flying over cities and trying to reconstruct complete cities.
    the problem is that houses are not as simple as shown in this demo. Many cities have very complex roof shapes and of course you have gables, chimneys, antennas and all that stuff.
    Therefore we only reconstruct LOD2 models (Level of Detail). These are generalized buildings.
    As pildanovak already mentioned - the algorithms are old.
    We work together with the University of Vienna
    http://www.ipf.tuwien.ac.at/cd-labor/31.0.html

  • txrx

    I'm wondering how complicated the mesh can get using this method (and how it didn't pick out his hand, I suspect that there's some form of straight edge tolerance on this/mixed into the motion tracking)

    Where abouts were the webcam and laser scripts I saw a while back? I've gotta google that again since I've got a single beam laser (for aligning my astronomy telescopes) but need to make some form of relflective mirror on a small motor to throw the laser up and down onto the turntable and the subject matter.

  • Wasa

    While it is pretty neat, it seems it still has a way to go developement wise.
    The model used is very simple, yet the mesh seems quite messy, and a
    bit inaccurate when it comes to concave surfaces.
    I'm sure this is something that will see some improvement in the future,
    but concerns me that they are showing it off either this early in
    development, or that it's still this poor at handling it at this late in
    development.

  • japrogramer

    now imagine having a computer controlled 3-axis turntable in a dark room with laser to light the model wherever the computer detects inconsistencies and to further map the object with greater precision ... also multiple cameras oriented towards the model from multiple angles ,
    and all available for order-in a small kit
    that would result in a market for this product and with a market there's sure to be some competition - with this competition the product will become better and smaller (more implementable in any location )
    with a broader market we could all soon have this at our disposal ,in our arsenal of open source tools ,
    new comers to the 3d industry would be able to create stunning work with little effort
    and the world will become a better open source world , with less arguments that lead to global disputes
    resulting in a more peaceful world - creating an environment where human beings can grow to accept each others differences

    for brighter future,
    keep up the great work !!!

  • namekuseijin

    Great, but I'm much better with the usual polygonal editing than with any manual crafts... :)

  • Woutervd

    What, no mac! I might want to look at linux once again in the near future...

  • rubicon

    Quite impressive in that small scale.
    I'm not too much in the textures, but a robust reconstruction of a bigger model (a milling machine for example)
    in a not-so-well-lighted environment (a factory building) with changing lighting. Where you can't move the model, but have to move the camera...... and you get out a (relative) good mesh, that would kick all 3D-Laserscanners out off business. Be careful, they will offer you lot's of money ;)

  • http://www.volny.cz/milos.zajic/ 4museman

    WOW! This looks really interesting!

    But I also wonder, that it doesn't track the hand even in initialisation stage, when point cloud is created by tracking moving portions of the image. No single point placed on the hand. Ok, the magic is probably the "...motion estimation followed by bundle adjustment" part, which I dont fully understand. :)

    I think it would be very funny to take the camera and move it through the room. I'd love to see the result of this! :-D :-D

    Can't wait to check this software out!

  • Mpu.Bater

    Great stuff!
    I hope it won't make me jobless in the future ;p

  • Charon

    Not prefect but pretty amazing! Make things affordable and fast!!

  • wysiwyg

    wow! will this be open source or at least freeware?

  • ralmon

    Wow awesome. Had to be developed further though to be usable, but still, it rocks for experiments.

  • ibkanat

    Meshlab(open source) can create meshes from point clouds. You can try it out using radio heads free point cloud data off google. This is a interesting blog about similar tech http://binarymillenium.com/
    This was impressivre to me as well http://www.youtube.com/watch?v=TuHJUS2olyc

  • amonymous

    It does include his hand (and the background) in the texture after 1:30, but then removes most of it

  • Tim, LA

    Sorry guys, but u could use this only for scanning boxes and cans!!
    This because feature tracking und probabilistic algorithms are used!!
    For all the other objects take the David Scanner or more professional (expensive!!) systems!

  • gvrixtel

    Wonder if in the near future video files can be turned into 3d environments by using tools based on this software. This would enable you to get more accurate models of buildings and people long gone or even give you the opertunity to have a look around inside movies.

  • http://nitro912gr.deviantart.com Nikolas Karampelas

    Amazing, but will there be a MacOS version? :)

  • memals

    Tim, LA: its pretty obvious that at this point the software is limited to very basic shapes, but all things can be created from basic shapes/faces. Wait for USB 3.0 to bring some serious resolution into the mix and then the fun can begin

  • Tim, LA

    @memals: I think you better take this one!
    http://www.youtube.com/watch?v=XSrW-wAWZe4

  • sqgsgds

    Nobody thinking about how this could transform robots abilities to see and interact with the world around them.

  • djallalnamri

    no comment...if this really can be done!

  • http://advanced-lemon.blogspot.com epat

    That's pretty cool. I came across a program a number of years ago that could do this but you had to take seperate images and manually load them into it. When I saw it I thought, 'wouldn't it be nice to have a program that could do this from a video instead', and here it is... :)

    I hope they decide to open source it! That would be really nice.

  • Anders Otte

    This is a very nice progress on 3D model recognition.
    it reminds me of the presentation by Thomas Vetter and Volker Blanz in Siggraph 1999:
    A Morphable Model for the Synthesis of 3D Faces
    Can't we work towards a similar 3D recognition from a single 2D image combined with a reference model database? It's probably an extremely enormous task !!!
    Some links:
    Video on ChaosComputerClub (PLEASE LOOK AT THIS VIDEO):
    chaosradio.ccc.de/ctv088.html
    Some Volker Blanz pages
    http://www.mpi-inf.mpg.de/~blanz/
    http://www.informatik.uni-trier.de/~ley/db/indices/a-tree/b/Blanz:Volker.html
    Some Thomas Vetter pages:
    http://www.informatik.uni-trier.de/~ley/db/indices/a-tree/v/Vetter:Thomas.html
    en.scientificcommons.org/thomas_vetter

    Best regards, Anders Otte

  • http://www.vi3dim.com dima

    We have better mesh from web camera with http://www.top4download.com/vi3dim-demo/zojzbxui.html

  • PagineIngrosso.com

    Amazing

  • Favela

    Cool, when the software comes out to the public?

Share.
7ads6x98y