{"pk":29493,"title":"Simulating Early Word Learning in Situated Connectionist Agents","subtitle":null,"abstract":"Recent advances in Deep Learning (DL) and ReinforcementLearning (RL) make it possible to train neural network agentswith raw, first-person visual perception to execute language-like instructions in 3D simulated worlds. Here, we inves-tigate the application of such deep RL agents as cognitivemodels, specifically as models of infant word learning. Wefirst develop a simple neural network-based language learningagent, trained via policy-gradient methods, which can inter-pret single-word instructions in a simulated 3D world. Tak-ing inspiration from experimental paradigms in developmentalpsychology, we run various controlled simulations with the ar-tificial agent, exploring the conditions in which established hu-man biases and learning effects emerge, and propose a novelmethod for visualising and interpreting semantic representa-tions in the agent. The results highlight the potential util-ity, and some limitations, of applying state-of-the-art learningagents and simulated environments to model human cognition.","language":"eng","license":{"name":"","short_name":"","text":null,"url":""},"keywords":[{"word":"early word learning; neural networks; situated ar-tificial agents; 3D environments; word learning biases"}],"section":"Agend-based Models","is_remote":true,"remote_url":"https://escholarship.org/uc/item/24z9k0vd","frozenauthors":[{"first_name":"Felix","middle_name":"","last_name":"Hill","name_suffix":"","institution":"DeepMind","department":""},{"first_name":"Stephen","middle_name":"","last_name":"Clark","name_suffix":"","institution":"DeepMind","department":""},{"first_name":"Karl","middle_name":"Moritz","last_name":"Hermann","name_suffix":"","institution":"DeepMind","department":""},{"first_name":"Phil","middle_name":"","last_name":"Blunsom","name_suffix":"","institution":"DeepMind","department":""}],"date_submitted":null,"date_accepted":null,"date_published":"2020-01-01T13:00:00-05:00","render_galley":null,"galleys":[{"label":"PDF","type":"pdf","path":"https://journalpub.escholarship.org/cognitivesciencesociety/article/29493/galley/19353/download/"}]}