Dr Nick Hawes

[vreckoetal09iros] Alen Vrecko, Danijel Skovcaj, Nick Hawes, and Ales Leonardis. A Computer Vision Integration Model for a Multi-modal Cognitive System. In IEEE/RSJ International Conference on Intelligent Robots and Systems, pages 3140-3147. October 2009. [pdf] [bib]
Abstract. We present a general method for integrating visual components into a multi-modal cognitive system. The integration is very generic and can combine an arbitrary set of modalities. We illustrate our integration approach with a specific instantiation of the architecture schema that focuses on integration of vision and language: a cognitive system able to collaborate with a human, learn and display some understanding of its surroundings. As examples of cross-modal interaction we describe mechanisms for clarification and visual learning.
Download:  pdf pdf (1.15 MB)  bib bib
Links: [Google Scholar] [CiteSeer]