{"pk":28149,"title":"Coupling Dynamical and Connectionist Models: Representation of SpatialAttention via Learned Deictic Gestures in Human-Robot Interaction","subtitle":null,"abstract":"A proper representation of space and a joint attention mecha-nism are indispensable for an effective deictic communicationwith embodied agents. Taking inspiration from developmen-tal psychology may help us to tackle computational challengesfor robots. Although some developmental joint attention mod-els for robots have already been proposed, to the best of ourknowledge, there is no such model that can stand for the ef-fects of pointing gestures on covert attention in infants. Thuswe have designed and implemented a developmental roboticsmodel for joint spatial attention combining connectionist anddynamical approaches. The hybrid architecture was struc-tured over two existing computational models: a connectionistmodel of gesture comprehension and a Dynamic Field (DF)model of spatial attention in infants. These models were ex-tended with various perceptual modules and dynamical neu-ral fields, and implemented on the state-of-art iCub humanoidrobot. In this paper, the computational architecture is intro-duced with some preliminary results that show the model’s ca-pability of representing deixis and perceived objects, and theireffects on attention over space and time.","language":"eng","license":{"name":"","short_name":"","text":null,"url":""},"keywords":[{"word":"cognitive modelling; cognitive robotics; artificialneural networks; dynamic field theory; joint attention; pointinggestures; spatial attention; deixis; grounded cognition"}],"section":"Publication-based-Talks","is_remote":true,"remote_url":"https://escholarship.org/uc/item/5413h4zr","frozenauthors":[{"first_name":"Baris","middle_name":"","last_name":"Serhan","name_suffix":"","institution":"Plymouth University","department":""},{"first_name":"John","middle_name":"","last_name":"Spencer","name_suffix":"","institution":"University of East Anglia","department":""},{"first_name":"Angelo","middle_name":"","last_name":"Cangelosi","name_suffix":"","institution":"Plymouth University","department":""}],"date_submitted":null,"date_accepted":null,"date_published":"2018-01-01T18:00:00Z","render_galley":null,"galleys":[{"label":"PDF","type":"pdf","path":"https://journalpub.escholarship.org/cognitivesciencesociety/article/28149/galley/17808/download/"}]}