May 24

For a list of all the ways technology has failed to improve the quality of life, please press three.

-- Alice Kahn

 
 

Featured chapter

Read the fascinating history of Wearable Computing, told by its father, Steve Mann

Read Steve's chapter !

 
 

Help us help you!

 
 

Robert Held

Add description
Add publication

Publications by Robert Held (bibliography)

 what's this?
2012
 
Edit | Del

Held, Robert, Gupta, Ankit, Curless, Brian and Agrawala, Maneesh (2012): 3D puppetry: a Kinect-based interface for 3D animation. In: Proceedings of the 2012 ACM Symposium on User Interface Software and Technology 2012. pp. 423-434.

We present a system for producing 3D animations using physical objects (i.e., puppets) as input. Puppeteers can load 3D models of familiar rigid objects, including toys, into our system and use them as puppets for an animation. During a performance, the puppeteer physically manipulates these puppets in front of a Kinect depth sensor. Our system uses a combination of image-feature matching and 3D shape matching to identify and track the physical puppets. It then renders the corresponding 3D models into a virtual set. Our system operates in real time so that the puppeteer can immediately see the resulting animation and make adjustments on the fly. It also provides 6D virtual camera \rev{and lighting} controls, which the puppeteer can adjust before, during, or after a performance. Finally our system supports layered animations to help puppeteers produce animations in which several characters move at the same time. We demonstrate the accessibility of our system with a variety of animations created by puppeteers with no prior animation experience.

© All rights reserved Held et al. and/or ACM Press

 
Add publication
Show this list on your homepage
 
 

Join the technology elite and advance:

 
1.

Your career

 
2.

Your network

 
 3.

Your skills

 
 
 
 
 
 

Changes to this page (author)

23 Nov 2012: Added

Page Information

Page maintainer: The Editorial Team
URL: http://www.interaction-design.org/references/authors/robert_held.html
May 24

For a list of all the ways technology has failed to improve the quality of life, please press three.

-- Alice Kahn

 
 

Featured chapter

Read the fascinating history of Wearable Computing, told by its father, Steve Mann

Read Steve's chapter !

 
 

Help us help you!