By Daniel Franke & Cedric Kiefer. See the making of below.
Daniel and Cedric write:
The basic idea of the project is built upon the consideration of creating a moving sculpture from the recorded motion data of a real person. For our work we asked a dancer to visualize a musical piece (Kreukeltape by Machinenfabriek) as closely as possible by movements of her body. She was recorded by three depth cameras (Kinect), in which the intersection of the images was later put together to a three-dimensional volume (3d point cloud), so we were able to use the collected data throughout the further process. The three-dimensional image allowed us a completely free handling of the digital camera, without limitations of the perspective. The camera also reacts to the sound and supports the physical imitation of the musical piece by the performer. She moves to a noise field, where a simple modification of the random seed can consistently create new versions of the video, each offering a different composition of the recorded performance. The multi-dimensionality of the sound sculpture is already contained in every movement of the dancer, as the camera footage allows any imaginable perspective.
17 Comments
looks like the sandman from spiderman 3, or the ghost/reaper from the frighteners :D
Got to admit, it was pretty interesting for about the first minute and a half.
Yes, perhaps a shorter time or some added energy towards the end would have made this otherwise amazing video perfect.
Long time no heard about the Kinect.
I am even thinking about selling it.
The Microsoft SDK worked, but not the Blender kangoroo.
I don't mean to be a dick, but for all the gorgeous 3D imagery and the amazing process, I still think the most compelling piece of footage is that of the actual dancer, and not just because she's beautiful. Still an impressive piece.
It looks like falling particles emitted from the volume. Right ?
lovely idea , I do like the performance , music dance the girl and all ,It would be bit more interesting if there was a background of some other process . Thank you .
Can this be done with Blender?? If not, will it be? lets say when the Particle Node system be implemented !!
Cool idea, boring implementation, no script! It can be a very interesting movie with couple of scenes at least... Some tunnel and rooms maybe. After 30 seconds I started to think "how much is to the end?"
Technically clever, but the relentless camera movement made me seasick. I couldn't watch the whole thing, so I don't know if it had something to say or not. For some reason I kept thinking of "The Mummy" - the stuff of nightmares.
The most interesting CG thing I've seen in quite a while. The technical interpretation of her interpretation is wonderful, and the lighting variations fit the rendering well.
I'm not so fond of the camera movement though... I don't think it adds much to the abstract idea-concept package, I don't think it does a good job of highlighting the dance interpretation, and it feels slightly (especially together with the light flahes) like erratic edgyness for the sake of it.
But it feels bad to be negative... I'm very happy to see this sort of technique used for the inherent expressive qualities, without stupid padding.
A great concept and fantastic results. I hope that you've had the opportunity to display this in a large, dark room. Many thanks for sharing such a comprehensive breakdown of your workflow- some great ideas in there.
*Deleting my grumble about the quality and candour of many of the other comments here. Not a space for trolling, and I imagine many readers already feel the same.*
Interesting for about the first 2½ minutes, then it got monotonous. Maybe if they’d introduced a second dancer, or varied the effect, or something, it could have maintained the interest.
And made the difference between a technical tour de force and a work of art.
Very talented people. A really creative use of new technologies.
And @6a14c353b4458e287bdce00404f96bf9:disqus , I share your unexpressed regret about some comments. Maybe we have to keep doing archviz and strive for photorealism to earn a living, but looking at something different from time to time does not hurt, really. Due respect to people strolling along unexplored alleys.
Thank you bart for posting.
I get the feeling from this piece that it isn't the final version? Changing the camera angles /zoom and focus, lighting and then picking music that gas more "room" ie, volume and dynamics changes would really help, but as I mentioned I think this is more of a proof of concept at this point? I'm really interested in how this was done as well as finding a way to apply the motion from multiple cameras to a rig.
Great technical setup and superb creative idea!
I thought it was rather an imaginative use of the technology and appreciate it being posted here despite being non-blender. :D
Nice one.