Dr Nick Hawes

Reader in Autonomous Intelligent Robotics

School of Computer Science
University of Birmingham
Edgbaston, Birmingham, B15 2TT
United Kingdom

Email: n.a.hawes@cs.bham.ac.uk
Twitter: @hawesie
Phone: +44 (0) 121 41 43739
Office: 133 (first floor, back right)
Office Hours: Mon 12:00, Tues 11:00 (term-time only)
Availability: Doodle MeetMe
[kruijffetal06pit] Geert-Jan Kruijff, John Kelleher and Nick Hawes. Information Fusion For Visual Reference Resolution In Dynamic Situated Dialogue. In Elisabeth Andre, Laila Dybkjaer,Wolfgang Minker, Heiko Neumann and Michael Weber (editors) Perception and Interactive Technologies (PIT 2006), volume 4021 of Lecture Notes in Computer Science, pages 117--128, Springer. June 2006. [pdf] [bib]
Abstract. Human-Robot Interaction (HRI) invariably involves dialogue about objects in the environment in which the agents are situated. The paper focuses on the issue of resolving discourse references to such visual objects. The paper addresses the problem using strategies for intra-modal fusion (identifying that different occurrences concern the same object), and inter-modal fusion, (relating object references across different modalities). Core to these strategies are sensorimotoric coordination, and ontology-based mediation between content in differentmodalities. The approach has been fully implemented, and is illustrated with several working examples.
Download:  pdf pdf (572 KB)  bib bib

Note: The original publication is available at www.springerlink.com
Links: [Google Scholar] [CiteSeer]
DOI: 10.1007/11768029_12