Trevor Darrell
About the author:
No description available of Trevor Darrell...
Publications by Trevor Darrell (bibliography)
» 2009 «
Darrell, Trevor (2009): Invited talk: image recognition for intelligent interfaces. In: Proceedings of the 2009 International Conference on Intelligent User Interfaces 2009. pp. 1-2. Available online
When interaction concerns the physical world, interfaces should do their best to search for information using direct observation. Image-based interfaces have been tried in the past, but generally required artificial barcode tags to be affixed to each viewed object or surface. Recent advances in computer vision and content-based image retrieval have enabled fast and robust indexing from images of individual objects -- CD covers, book jackets, magazine advertisements, etc. -- even on relatively low-power platforms such as camera-equipped mobile phones. I'll review the relevant algorithms and design of such systems, and discuss what types of image recognition interfaces are feasible in the near term. I'll describe very recent work on multimodal question answering interfaces, which combine image and text query matching with human-in-the-loop interaction. I'll close with a discussion of the anticipated future progress on category-level visual recognition, and what classes of interfaces it may enable.
Copyrights may apply
» 2008 «
Yeh, Tom and Darrell, Trevor (2008): Multimodal question answering for mobile devices. In: Proceedings of the 2008 International Conference on Intelligent User Interfaces 2008. pp. 405-408. Available online
This paper introduces multimodal question answering, a new interface for community-based question answering services. By offering users an extra modality -- photos -- in addition to the text modality to formulate queries, multimodal question answering overcomes the limitations of text-only input methods when the users ask questions regarding visually distinctive objects. Such interface is especially useful when users become curious about an interesting object in the environment and want to know about it -- simply by taking a photo and asking a question in a situated (from a mobile device) and intuitive (without describing the object in words) manner. We propose a system architecture for multimodal question answering, describe an algorithm for searching the database, and report on the findings of two prototype studies.
Copyrights may apply
Yeh, Tom, Lee, John J. and Darrell, Trevor (2008): Photo-based question answering. In: El-Saddik, Abdulmotaleb, Vuong, Son, Griwodz, Carsten, Bimbo, Alberto Del, Candan, K. Selcuk and Jaimes, Alejandro (eds.) Proceedings of the 16th International Conference on Multimedia 2008 October 26-31, 2008, Vancouver, British Columbia, Canada. pp. 389-398. Available online
» 2007 «
Wang, Sy Bor, Demirdjian, David and Darrell, Trevor (2007): Detecting communication errors from visual cues during the system's conversational turn. In: Massaro, Dominic W., Takeda, Kazuya, Roy, Deb and Potamianos, Alexandros (eds.) Proceedings of the 9th International Conference on Multimodal Interfaces - ICMI 2007 November 12-15, 2007, Nagoya, Aichi, Japan. pp. 323-326. Available online
» 2006 «
Morency, Louis-Philippe and Darrell, Trevor (2006): Head gesture recognition in intelligent interfaces: the role of context in improving recognition. In: Proceedings of the 2006 International Conference on Intelligent User Interfaces 2006. pp. 32-38. Available online
Acknowledging an interruption with a nod of the head is a natural and intuitive communication gesture which can be performed without significantly disturbing a primary interface activity. In this paper we describe vision-based head gesture recognition techniques and their use for common user interface commands. We explore two prototype perceptual interface components which use detected head gestures for dialog box confirmation and document browsing, respectively. Tracking is performed using stereo-based alignment, and recognition proceeds using a trained discriminative classifier. An additional context learning component is described, which exploits interface context to obtain robust performance. User studies with prototype recognition components indicate quantitative and qualitative benefits of gesture-based confirmation over conventional alternatives.
Copyrights may apply
Morency, Louis-Philippe, Christoudias, Chris Mario and Darrell, Trevor (2006): Recognizing gaze aversion gestures in embodied conversational discourse. In: Quek, Francis K. H., Yang, Jie, Massaro, Dominic W., Alwan, Abeer A. and Hazen, Timothy J. (eds.) Proceedings of the 8th International Conference on Multimodal Interfaces - ICMI 2006 November 2-4, 2006, Banff, Alberta, Canada. pp. 287-294. Available online
Christoudias, Chris Mario, Saenko, Kate, Morency, Louis-Philippe and Darrell, Trevor (2006): Co-Adaptation of audio-visual speech and gesture classifiers. In: Quek, Francis K. H., Yang, Jie, Massaro, Dominic W., Alwan, Abeer A. and Hazen, Timothy J. (eds.) Proceedings of the 8th International Conference on Multimodal Interfaces - ICMI 2006 November 2-4, 2006, Banff, Alberta, Canada. pp. 84-91. Available online
» 2005 «
Yeh, Tom, Grauman, Kristen, Tollmar, Konrad and Darrell, Trevor (2005): A picture is worth a thousand keywords: image-based object search on a mobile platform. In: Proceedings of ACM CHI 2005 Conference on Human Factors in Computing Systems 2005. pp. 2025-2028. Available online
Finding information based on an object's visual appearance is useful when specific keywords for the object are not known. We have developed a mobile image-based search system that takes images of objects as queries and finds relevant web pages by matching them to similar images on the web. Image-based search works well when matching full scenes, such as images of buildings or landmarks, and for matching objects when the boundary of the object in the image is available. We demonstrate the effectiveness of a simple interactive paradigm for obtaining a segmented object boundary, and show how a shape-based image matching algorithm can use the object outline to find similar images on the web.
Copyrights may apply
Morency, Louis-Philippe, Sidner, Candace L., Lee, Christopher and Darrell, Trevor (2005): Contextual recognition of head gestures. In: Lazzari, Gianni, Pianesi, Fabio, Crowley, James L., Mase, Kenji and Oviatt, Sharon L. (eds.) Proceedings of the 7th International Conference on Multimodal Interfaces - ICMI 2005 October 4-6, 2005, Trento, Italy. pp. 18-24. Available online
» 2004 «
Tollmar, Konrad, Demirdjian, David and Darrell, Trevor (2004): Navigating in virtual environments using a vision-based interface. In: Proceedings of the Third Nordic Conference on Human-Computer Interaction October 23-27, 2004, Tampere, Finland. pp. 113-120. Available online
Interacting and navigating virtual environments usually requires a wired interface, game console, or keyboard. The advent of perceptual interface techniques allows a new option: the passive and untethered sensing of users' pose and gesture to allow them to maneuver through and manipulate virtual worlds. We describe new algorithms for interacting with 3-D environments using real-time articulated body tracking with standard cameras and personal computers. Our method is based on rigid stereo-motion estimation algorithms and can accurately track upper body pose in real-time. With our tracking system users can navigate virtual environments using 3-D gesture and body poses. We analyze the space of possible perceptual interface abstractions for full-body navigation, and present a prototype system based on these results. We finally describe an initial evaluation of our prototype system with users guiding avatars through a series of 3-D virtual game worlds.
Copyrights may apply
Tollmar, Konrad, Yeh, Tom and Darrell, Trevor (2004): IDeixis - Searching the Web with Mobile Images for Location-Based Information. In: Brewster, Stephen A. and Dunlop, Mark D. (eds.) Mobile Human-Computer Interaction - Mobile HCI 2004 - 6th International Symposium September 13-16, 2004, Glasgow, UK. pp. 288-299. Available online
Sharma, Rajeev, Darrell, Trevor, Harper, Mary P., Lazzari, Gianni and Turk, Matthew (eds.) Proceedings of the 6th International Conference on Multimodal Interfaces - ICMI 2004 October 13-15, 2004, State College, PA, USA.
Demirdjian, David, Wilson, Kevin, Siracusa, Michael and Darrell, Trevor (2004): Real-time audio-visual tracking for meeting analysis. In: Sharma, Rajeev, Darrell, Trevor, Harper, Mary P., Lazzari, Gianni and Turk, Matthew (eds.) Proceedings of the 6th International Conference on Multimodal Interfaces - ICMI 2004 October 13-15, 2004, State College, PA, USA. pp. 331-332. Available online
Saenko, Kate, Darrell, Trevor and Glass, James R. (2004): Articulatory features for robust visual speech recognition. In: Sharma, Rajeev, Darrell, Trevor, Harper, Mary P., Lazzari, Gianni and Turk, Matthew (eds.) Proceedings of the 6th International Conference on Multimodal Interfaces - ICMI 2004 October 13-15, 2004, State College, PA, USA. pp. 152-158. Available online
Morency, Louis-Philippe and Darrell, Trevor (2004): From conversational tooltips to grounded discourse: head poseTracking in interactive dialog systems. In: Sharma, Rajeev, Darrell, Trevor, Harper, Mary P., Lazzari, Gianni and Turk, Matthew (eds.) Proceedings of the 6th International Conference on Multimodal Interfaces - ICMI 2004 October 13-15, 2004, State College, PA, USA. pp. 32-37. Available online
Sharma, Rajeev, Darrell, Trevor, Harper, Mary P., Lazzari, Gianni and Turk, Matthew (eds.) Proceedings of the 6th international conference on Multimodal interfaces October 13-15, 2004, State College, PA, USA.
Oviatt, Sharon L., Darrell, Trevor and Flickner, Myron (2004): Introduction. In Communications of the ACM, 47 (1) pp. 30-33
» 2003 «
Oviatt, Sharon L., Darrell, Trevor, Maybury, Mark T. and Wahlster, Wolfgang (eds.) Proceedings of the 5th International Conference on Multimodal Interfaces - ICMI 2003 November 5-7, 2003, Vancouver, British Columbia, Canada.
Ko, Teresa, Demirdjian, David and Darrell, Trevor (2003): Untethered gesture acquisition and recognition for a multimodal conversational system. In: Oviatt, Sharon L., Darrell, Trevor, Maybury, Mark T. and Wahlster, Wolfgang (eds.) Proceedings of the 5th International Conference on Multimodal Interfaces - ICMI 2003 November 5-7, 2003, Vancouver, British Columbia, Canada. pp. 147-150. Available online
Siracusa, Michael, Morency, Louis-Philippe, Wilson, Kevin, III, John W. Fisher and Darrell, Trevor (2003): A multi-modal approach for determining speaker location and focus. In: Oviatt, Sharon L., Darrell, Trevor, Maybury, Mark T. and Wahlster, Wolfgang (eds.) Proceedings of the 5th International Conference on Multimodal Interfaces - ICMI 2003 November 5-7, 2003, Vancouver, British Columbia, Canada. pp. 77-80. Available online
Koile, Kimberle, Tollmar, Konrad, Demirdjian, David, Shrobe, Howard E. and Darrell, Trevor (2003): Activity Zones for Context-Aware Computing. In: Dey, Anind K., Schmidt, Albrecht and McCarthy, Joseph F. (eds.) UbiComp 2003 Ubiquitous Computing - 5th International Conference October 12-15, 2003, Seattle, WA, USA. pp. 90-106. Available online
» 2002 «
Demirdjian, David and Darrell, Trevor (2002): 3-D Articulated Pose Tracking for Untethered Diectic Reference. In: 4th IEEE International Conference on Multimodal Interfaces - ICMI 2002 14-16 October, 2002, Pittsburgh, PA, USA. pp. 267-272. Available online
Wilson, Kevin, Rangarajan, Vibhav, Checka, Neal and Darrell, Trevor (2002): Audiovisual Arrays for Untethered Spoken Interfaces. In: 4th IEEE International Conference on Multimodal Interfaces - ICMI 2002 14-16 October, 2002, Pittsburgh, PA, USA. pp. 389-394. Available online
Darrell, Trevor, Tollmar, Konrad, Bentley, Frank, Checka, Neal, Morency, Louis-Philippe, Rahimi, Ali and Oh, Alice (2002): Face-Responsive Interfaces: From Direct Manipulation to Perceptive Presence. In: Borriello, Gaetano and Holmquist, Lars Erik (eds.) UbiComp 2002 Ubiquitous Computing - 4th International Conference September 29 - October 1, 2002, Göteborg, Sweden. pp. 135-151. Available online
» 2001 «
Ackerman, Mark S., Darrell, Trevor and Weitzner, Daniel J. (2001): Privacy in Context. In Human-Computer Interaction, 16 (2) pp. 167-176
Context-aware computing offers the promise of significant user gains-the ability for systems to adapt more readily to user needs, models, and goals. Dey, Abowd, and Salber (2001 [this special issue]) present a masterful step toward understanding context-aware applications. We examine Dey et al. in the light of privacy issues-that is, individuals' control over their personal data-to highlight some of the thorny issues in context-aware computing that will be upon us soon. We argue that privacy in context-aware computing, especially those with perceptually aware environments, will be quite complex. Indeed, privacy forms a co-design space between the social, the technical, and the regulatory. We recognize that Dey et al. is a necessary first step in examining important software engineering concerns, but future research will need to consider how regulatory and technical solutions might be co-designed to form a public good.
Copyrights may apply
» 2000 «
Darrell, Trevor, III, John W. Fisher, Viola, Paul A. and Freeman, William T. (2000): Ausio-visual Segmentation and "The Cocktail Party Effect. In: Tan, Tieniu, Shi, Yuanchun and Gao, Wen (eds.) Advances in Multimodal Interfaces - ICMI 2000 - Third International Conference October 14-16, 2000, Beijing, China. pp. 32-40. Available online
SHOW THIS LIST ON YOUR HOMEPAGE
What do YOU think?
Give us your opinion! Do you have any comments/additions
that you would like other visitors to see?
You say:
Mar 18th, 2010
Changes to this page (author)
26 Feb 2010: Enabled abstracts to be shown on Trevor Darrell's author page.17 Aug 2009: Author was edited 29 Jul 2009: Author was added to the bibliography (approved by an editor)
17 Jun 2009: Author was edited
02 Jun 2009: Author was edited
02 Jun 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
29 May 2009: Author was edited
08 Apr 2009: Author was edited
24 Jul 2007: Author was edited
29 Jun 2007: Author was edited
22 Jun 2007: Author was edited
28 Apr 2003: Added the author to the bibliography