{"pk":28020,"title":"Relational inductive bias for physical construction in humans and machines","subtitle":null,"abstract":"While current deep learning systems excel at tasks such asobject classification, language processing, and gameplay, fewcan construct or modify a complex system such as a tower ofblocks. We hypothesize that what these systems lack is a “re-lational inductive bias”: a capacity for reasoning about inter-object relations and making choices over a structured descrip-tion of a scene. To test this hypothesis, we focus on a task thatinvolves gluing pairs of blocks together to stabilize a tower,and quantify how well humans perform. We then introducea deep reinforcement learning agent which uses object- andrelation-centric scene and policy representations and apply itto the task. Our results show that these structured represen-tations allow the agent to outperform both humans and morena ̈ıve approaches, suggesting that relational inductive bias isan important component in solving structured reasoning prob-lems and for building more intelligent, flexible machines.","language":"eng","license":{"name":"","short_name":"","text":null,"url":""},"keywords":[{"word":"physical construction; reinforcement learning;deep learning; relational reasoning; object-based reasoning"}],"section":"Publication-based-Talks","is_remote":true,"remote_url":"https://escholarship.org/uc/item/0p02k1qw","frozenauthors":[{"first_name":"Jessica","middle_name":"B","last_name":"Hamrick","name_suffix":"","institution":"Deepmind","department":""},{"first_name":"Kelsey","middle_name":"R","last_name":"Allen","name_suffix":"","institution":"MIT","department":""},{"first_name":"Victor","middle_name":"","last_name":"Bapst","name_suffix":"","institution":"Deepmind","department":""},{"first_name":"Tina","middle_name":"","last_name":"Zhu","name_suffix":"","institution":"Deepmind","department":""},{"first_name":"Kevin","middle_name":"R","last_name":"McKee","name_suffix":"","institution":"Deepmind","department":""},{"first_name":"Joshua","middle_name":"B","last_name":"Tenenbaum","name_suffix":"","institution":"MIT","department":""},{"first_name":"Peter","middle_name":"W","last_name":"Battaglia","name_suffix":"","institution":"Deepmind","department":""}],"date_submitted":null,"date_accepted":null,"date_published":"2018-01-01T18:00:00Z","render_galley":null,"galleys":[{"label":"PDF","type":"pdf","path":"https://journalpub.escholarship.org/cognitivesciencesociety/article/28020/galley/17659/download/"}]}