Deb Roy

Soroush Vosoughi, Matthew S. Goodwin, Bill Washabaugh, Deb Roy: A portable audio/video recorder for longitudinal study of child development. ICMI 2012: 193-200

Soroush Vosoughi, Deb Roy: An Automatic Child-Directed Speech Detector for the Study of Child Language Development. INTERSPEECH 2012

George Shaw, Deb Roy: An Interface for Visualization and Exploration of Spatial Distributions. Scalable Integration of Analytics and Visualization 2011

Peter Gorniak, Deb Roy: Grounded Semantic Composition for Visual Scenes. CoRR abs/1107.0031 (2011)

Thomas Kollar, Stefanie Tellex, Deb Roy, Nicholas Roy: Toward understanding natural language directions. HRI 2010: 259-266

Philipp Robbel, Deb Roy: Exploiting feature dynamics for active object recognition. ICARCV 2010: 2102-2108

Stefanie Tellex, Thomas Kollar, George Shaw, Nicholas Roy, Deb Roy: Grounding spatial language for video search. ICMI-MLMI 2010: 31

Brandon Roy, Soroush Vosoughi, Deb Roy: Automatic estimation of transcription accuracy and difficulty. INTERSPEECH 2010: 1902-1905

Albert S. Huang, Stefanie Tellex, Abraham Bachrach, Thomas Kollar, Deb Roy, Nicholas Roy: Natural language command of an autonomous micro-air vehicle. IROS 2010: 2663-2669

Philip DeCamp, George Shaw, Rony Kubat, Deb Roy: An immersive system for browsing and visualizing surveillance video. ACM Multimedia 2010: 371-380

Philip DeCamp, Deb Roy: A human-machine collaborative approach to tracking human movement in multi-camera video. CIVR 2009

Stefanie Tellex, Deb Roy: Towards surveillance video search by natural language query. CIVR 2009

Stefanie Tellex, Deb Roy: Grounding spatial prepositions for video search. ICMI 2009: 253-260

Deb Roy: New horizons in the study of child language acquisition. INTERSPEECH 2009: 13-20

Brandon Roy, Deb Roy: Fast transcription of unstructured audio recordings. INTERSPEECH 2009: 1647-1650

Kai-yuh Hsiao, Stefanie Tellex, Soroush Vosoughi, Rony Kubat, Deb Roy: Object schemas for grounding language in a responsive robot. Connect. Sci. 20(4): 253-276 (2008)

Michael Fleischman, Deb Roy: Grounded Language Modeling for Automatic Speech Recognition of Sports Video. ACL 2008: 121-129

Kai-yuh Hsiao, Soroush Vosoughi, Stefanie Tellex, Rony Kubat, Deb Roy: Object schemas for responsive robotic language use. HRI 2008: 233-240

Peter Gorniak, Deb Roy: Situated Language Understanding as Filtering Perceived Affordances. Cognitive Science 31(2): 197-231 (2007)

Michael Fleischman, Deb Roy: Representing Intentions in a Cognitive Model of Language Acquisition: Effects of Phrase Structure on Situated Verb Learning. AAAI Spring Symposium: Intentions in Intelligent Systems 2007: 7-12

Stefanie Tellex, Deb Roy: Grounding Language in Spatial Routines. AAAI Spring Symposium: Control Mechanisms for Spatial Knowledge Processing in Cognitive / Intelligent Systems 2007: 53-58

Michael Fleischman, Deb Roy: Unsupervised content-based indexing of sports video. Multimedia Information Retrieval 2007: 87-94

Michael Fleischman, Brandon Roy, Deb Roy: Temporal feature induction for baseball highlight classification. ACM Multimedia 2007: 333-336

Michael Fleischman, Humberto Evans, Deb Roy: Unsupervised content-based indexing for sports video retrieval. ACM Multimedia 2007: 473-474

Michael Fleischman, Deb Roy: Situated Models of Meaning for Sports Video Retrieval. HLT-NAACL (Short Papers) 2007: 37-40

Dominic W. Massaro, Kazuya Takeda, Deb Roy, Alexandros Potamianos (Eds.): Proceedings of the 9th International Conference on Multimodal Interfaces, ICMI 2007, Nagoya, Aichi, Japan, November 12-15, 2007. ACM 2007, isbn 978-1-59593-817-6

Deb Roy, Rupal Patel, Philip DeCamp, Rony Kubat, Michael Fleischman, Brandon Roy, Nikolaos Mavridis, Stefanie Tellex, Alexia Salata, Jethran Guinness, Michael Levit, Peter Gorniak: The Human Speechome Project. EELC 2006: 192-196

Stefanie Tellex, Deb Roy: Spatial routines for a simulated speech-controlled vehicle. HRI 2006: 156-163

Dong Zhang, Daniel Gatica-Perez, Deb Roy, Samy Bengio: Modeling Interactions from Email Communication. ICME 2006: 2037-2040

Nikolaos Mavridis, Deb Roy: Grounded Situation Models: Where Words and Percepts Meet. IROS 2006

Nikolaos Mavridis, Deb Roy: Grounded Situation Models for Robots: Where words and percepts meet. IROS 2006: 4690-4697

Michael Fleischman, Philip DeCamp, Deb Roy: Mining temporal patterns of movement for video content classification. Multimedia Information Retrieval 2006: 183-192

Deb Roy, Ehud Reiter: Connecting language to the world. Artif. Intell. 167(1-2): 1-12 (2005)

Deb Roy: Semiotic schemas: A framework for grounding language in action and perception. Artif. Intell. 167(1-2): 170-205 (2005)

Deb Roy, Niloy Mukherjee: Towards situated speech understanding: visual context priming of language models. Computer Speech & Language 19(2): 227-248 (2005)

Peter Gorniak, Deb Roy: Speaking with your Sidekick: Understanding Situated Speech in Computer Role Playing Games. AIIDE 2005: 57-62

Peter Gorniak, Deb Roy: Probabilistic grounding of situated speech using plan recognition and reference resolution. ICMI 2005: 138-143

Dong Zhang, Daniel Gatica-Perez, Samy Bengio, Deb Roy: Learning Influence among Interacting Markov Chains. NIPS 2005

Peter Gorniak, Deb Roy: Grounded Semantic Composition for Visual Scenes. J. Artif. Intell. Res. (JAIR) 21: 429-470 (2004)

Deb Roy, Kai-yuh Hsiao, Nikolaos Mavridis: Mental imagery for a conversational robot. IEEE Transactions on Systems, Man, and Cybernetics, Part B 34(3): 1374-1383 (2004)

Joshua Juster, Deb Roy: Elvis: situated speech and gesture understanding for a robotic chandelier. ICMI 2004: 90-96

Deb Roy, Yair Ghitza, Jeff Bartelma, Charlie Kehoe: Visual Memory Augmentation: Using Eye Gaze as an Attention Filter. ISWC 2004: 128-131

Deb Roy: Grounded spoken language acquisition: experiments in word learning. IEEE Transactions on Multimedia 5(2): 197-209 (2003)

Peter Gorniak, Deb Roy: Augmenting user interfaces with adaptive speech commands. ICMI 2003: 176-179

Peter Gorniak, Deb Roy: A visually grounded natural language interface for reference to spatial scenes. ICMI 2003: 219-226

Niloy Mukherjee, Deb Roy: A visual context-aware multimodal system for spoken language processing. INTERSPEECH 2003

Kai-yuh Hsiao, Nikolaos Mavridis, Deb Roy: Coupling perception and simulation: steps towards conversational robotics. IROS 2003: 928-933

Deb Roy, Alex Pentland: Learning words from sights and sounds: a computational model. Cognitive Science 26(1): 113-146 (2002)

Deb Roy: Towards Visually-Grounded Spoken Language Acquisition. ICMI 2002: 105-110

Deb Roy: A system that learns to describe objects in visual scenes. INTERSPEECH 2002

Deb Roy, Peter Gorniak, Niloy Mukherjee, Joshua Juster: A trainable spoken language understanding system for visual object selection. INTERSPEECH 2002

Deb Roy: Learning from Multimodal Observations. IEEE International Conference on Multimedia and Expo (I) 2000: 579-582

Deb Roy: Grounded speech communication. INTERSPEECH 2000: 69-72

Alex Pentland, Deb Roy, Christopher Richard Wren: Perceptual Intelligence: learning gestures and words for individualized, adaptive interfaces. HCI (1) 1999: 286-290

Deb Roy, Alex Pentland: A Phoneme Probability Display for Individuals with Hearing Disabilities. International ACM Conference on Assistive Technologies 1998: 165-168

Deb Roy, Alex Pentland: Learning words from natural audio-visual input. ICSLP 1998

Chris Schmandt, Deb Roy: Using Acoustic Structure in a Hand-Held Audio Playback Device. IBM Systems Journal 35(3/4): 453-472 (1996)

Deb Roy, Alex Pentland: Automatic Spoken Affect Classification and Analysis. FG 1996: 363-367