About Contact Help us

HCI, User Experience, Information Architecture, Usability, and more

“Interaction-Design.org has given me a lot of help, now it is the time for return”

---William P. Steen

Last 3 Donors

1. Stephen J. Kidd

2. Maria Hull

3. Rosemary J. Bennett

...more generous donors

Support us

Funding progress for 2010:

References

Authors

Deb Roy

Printer-friendly

How to cite

Deb Roy

About the author:
No description available of Deb Roy...

ADD DESCRIPTION

← Button will not work: You have not enabled Javascript. How do I enable it?

ADD PUBLICATION

← Button will not work: You have not enabled Javascript. How do I enable it?

SHARE YOUR RESEARCH

← Button will not work: You have not enabled Javascript. How do I enable it?

Publications by Deb Roy (bibliography)

» 2008 «

Edit | Del

Hsiao, Kai-yuh, Vosoughi, Soroush, Tellex, Stefanie, Kubat, Rony and Roy, Deb (2008): Object schemas for responsive robotic language use. In: Proceedings of the 3rd ACM/IEEE International Conference on Human Robot Interaction 2008. pp. 233-240. Available online

“The use of natural language should be added to a robot system without sacrificing responsiveness to the environment. In this paper, we present a robot that manipulates objects on a tabletop in response to verbal interaction. Reactivity is maintained by using concurrent interaction processes, such as visual trackers and collision detection processes. The interaction processes and their associated data are organized into object schemas, each representing a physical object in the environment, based on the target of each process. The object schemas then serve as discrete structures of coordination between reactivity, planning, and language use, permitting rapid integration of information from multiple sources.”

Copyrights may apply

» 2007 «

Edit | Del

Massaro, Dominic W., Takeda, Kazuya, Roy, Deb and Potamianos, Alexandros (eds.) Proceedings of the 9th International Conference on Multimodal Interfaces - ICMI 2007 November 12-15, 2007, Nagoya, Aichi, Japan.

Edit | Del

Fleischman, Michael, Evans, Humberto and Roy, Deb (2007): Unsupervised content-based indexing for sports video retrieval. In: Lienhart, Rainer, Prasad, Anand R., Hanjalic, Alan, Choi, Sunghyun, Bailey, Brian P. and Sebe, Nicu (eds.) Proceedings of the 15th International Conference on Multimedia 2007 September 24-29, 2007, Augsburg, Germany. pp. 473-474. Available online

Edit | Del

Fleischman, Michael, Roy, Brandon and Roy, Deb (2007): Temporal feature induction for baseball highlight classification. In: Lienhart, Rainer, Prasad, Anand R., Hanjalic, Alan, Choi, Sunghyun, Bailey, Brian P. and Sebe, Nicu (eds.) Proceedings of the 15th International Conference on Multimedia 2007 September 24-29, 2007, Augsburg, Germany. pp. 333-336. Available online

» 2006 «

Edit | Del

Tellex, Stefanie and Roy, Deb (2006): Spatial routines for a simulated speech-controlled vehicle. In: Proceedings of the 1st ACM SIGCHI/SIGART Conference on Human-Robot Interaction 2006. pp. 156-163. Available online

“We have defined a lexicon of words in terms of spatial routines, and used that lexicon to build a speech controlled vehicle in a simulator. A spatial routine is a script composed from a set of primitive operations on occupancy grids, analogous to Ullman's visual routines. The vehicle understands the meaning of context-dependent natural language commands such as "Go across the room." When the system receives a command, it combines definitions from the lexicon according to the parse structure of the command, creating a script that selects a goal for the vehicle. Spatial routines may provide the basis for interpreting spatial language in a broad range of physically situated language understanding systems.”

Copyrights may apply

» 2005 «

Edit | Del

Gorniak, Peter and Roy, Deb (2005): Probabilistic grounding of situated speech using plan recognition and reference resolution. In: Lazzari, Gianni, Pianesi, Fabio, Crowley, James L., Mase, Kenji and Oviatt, Sharon L. (eds.) Proceedings of the 7th International Conference on Multimodal Interfaces - ICMI 2005 October 4-6, 2005, Trento, Italy. pp. 138-143. Available online

» 2004 «

Edit | Del

Juster, Joshua and Roy, Deb (2004): Elvis: situated speech and gesture understanding for a robotic chandelier. In: Sharma, Rajeev, Darrell, Trevor, Harper, Mary P., Lazzari, Gianni and Turk, Matthew (eds.) Proceedings of the 6th International Conference on Multimodal Interfaces - ICMI 2004 October 13-15, 2004, State College, PA, USA. pp. 90-96. Available online

» 2003 «

Edit | Del

Gorniak, Peter and Roy, Deb (2003): Augmenting user interfaces with adaptive speech commands. In: Oviatt, Sharon L., Darrell, Trevor, Maybury, Mark T. and Wahlster, Wolfgang (eds.) Proceedings of the 5th International Conference on Multimodal Interfaces - ICMI 2003 November 5-7, 2003, Vancouver, British Columbia, Canada. pp. 176-179. Available online

Edit | Del

Gorniak, Peter and Roy, Deb (2003): A visually grounded natural language interface for reference to spatial scenes. In: Oviatt, Sharon L., Darrell, Trevor, Maybury, Mark T. and Wahlster, Wolfgang (eds.) Proceedings of the 5th International Conference on Multimodal Interfaces - ICMI 2003 November 5-7, 2003, Vancouver, British Columbia, Canada. pp. 219-226. Available online

» 2002 «

Edit | Del

Roy, Deb (2002): Towards Visually-Grounded Spoken Language Acquisition. In: 4th IEEE International Conference on Multimodal Interfaces - ICMI 2002 14-16 October, 2002, Pittsburgh, PA, USA. pp. 105-110. Available online

Edit | Del

Roy, Deb and Pentland, Alex (2002): Learning words from sights and sounds: a computational model. In Cognitive Science, 26 (1) pp. 113-146

» 1999 «

Edit | Del

Pentland, Alex, Roy, Deb and Wren, Christopher Richard (1999): Perceptual Intelligence: learning gestures and words for individualized, adaptive interfaces. In: Bullinger, Hans-Jörg (ed.) HCI International 1999 - Proceedings of the 8th International Conference on Human-Computer Interaction August 22-26, 1999, Munich, Germany. pp. 286-290.

» 1998 «

Edit | Del

Roy, Deb and Pentland, Alex (1998): A Phoneme Probability Display for Individuals with Hearing Disabilities. In: Third Annual ACM Conference on Assistive Technologies 1998. pp. 165-168. Available online

“We are building an aid for individuals with hearing impairments which converts continuous speech into an animated visual display. A speech analysis system continuously estimates phoneme probabilities from the input acoustic stream. Phoneme symbols are displayed graphically with brightness in proportion to estimated phoneme probabilities. We use an automated layout algorithm to design the display to group acoustically confusable phonemes together in the graphical display.”

Copyrights may apply

ADD PUBLICATION

← Button will not work: You have not enabled Javascript. How do I enable it?

SHOW THIS LIST ON YOUR HOMEPAGE

What do YOU think?

Give us your opinion! Do you have any comments/additions
that you would like other visitors to see?

You say: Mar 18th, 2010

Be the first to add a thoughtful note to this page !

Changes to this page (author)

12 Feb 2010: Enabled abstracts to be shown on Deb Roy's author page.
09 Jul 2009: Author was edited

09 Jul 2009: Author was edited
17 Jun 2009: Author was edited
17 Jun 2009: Author was edited
05 Jun 2009: Author was edited
01 Jun 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
30 May 2009: Author was edited
22 Jun 2007: Author was added to the bibliography

Publication statistics

Publication period:1998-2008
Publication count:13
Number of co-authors:14

Productive colleagues

Deb Roy's 3 most productive colleagues in number of publications:

Alex Pentland:34
Dominic W. Massaro:11
Alexandros Potamianos:5

Collaboration count

Number of publications with 3 favourite co-authors:

Alex Pentland:3
Peter Gorniak:3
Stefanie Tellex:2

Other options

Learn more about Deb Roy:
- Google Scholar
- ACM
- CSB

Conference Calendar

Mar 21

WritersUA Conf. for Software User Assistance

Mar 22

UX People

Mar 22

ETRA '10 - Eye Tracking Research & Applications Symp.

Mar 18

“ The theory gives the answers, not the theorist. ”

-- Allen Newell ”

Share this quote on...
Get more quotes

Eva Hornecker on Tangible Interaction

Eva Hornecker explains the evolving concept of Tangible Interaction.

Read Eva's insightful entry here..

Help us help you!

Spread the word:
Donate
Other ways to help

Last 3 Donors

Support us

Deb Roy

Publications by Deb Roy (bibliography)

» 2008 «

» 2007 «

» 2006 «

» 2005 «

» 2004 «

» 2003 «

» 2002 «

» 1999 «

» 1998 «

What do YOU think?

Changes to this page (author)

Publication statistics

Productive colleagues

Collaboration count

Other options

Conference Calendar

Eva Hornecker on Tangible Interaction

Help us help you!

Page information