{"pk":28776,"title":"Active physical inference via reinforcement learning","subtitle":null,"abstract":"When encountering unfamiliar physical objects, children andadults often perform structured interrogatory actions such asgrasping and prodding, so revealing latent physical propertiessuch as masses and textures. However, the processes drivingand supporting these curious behaviors are still largely mys-terious. In this paper, we develop and train an agent able toactively uncover latent physical properties such as the massand force of objects in a simulated physical “micro-world’.Concretely, we used a simulation-based-inference frameworkto quantify the physical information produced by observationand interaction with the evolving dynamic environment. Weused model-free reinforcement learning algorithm to train anagent to implement general strategies for revealing latent phys-ical properties. We compare the behaviors of this agent to thehuman behaviors observed in a similar task.","language":"eng","license":{"name":"","short_name":"","text":null,"url":""},"keywords":[{"word":"physical simulation; active learning; probabilisticinference; reinforcement learning"}],"section":"Papers with Poster Presentations","is_remote":true,"remote_url":"https://escholarship.org/uc/item/0x3167r6","frozenauthors":[{"first_name":"Shuaiji","middle_name":"","last_name":"Li","name_suffix":"","institution":"New York University","department":""},{"first_name":"Yu","middle_name":"","last_name":"Sun","name_suffix":"","institution":"New York University","department":""},{"first_name":"Sijia","middle_name":"","last_name":"Liu","name_suffix":"","institution":"New York University","department":""},{"first_name":"Tianyu","middle_name":"","last_name":"Wang","name_suffix":"","institution":"New York University","department":""},{"first_name":"Todd","middle_name":"M.","last_name":"Gureckis","name_suffix":"","institution":"New York University","department":""},{"first_name":"Neil","middle_name":"R.","last_name":"Bramley","name_suffix":"","institution":"University of Edinburgh","department":""}],"date_submitted":null,"date_accepted":null,"date_published":"2019-01-01T18:00:00Z","render_galley":null,"galleys":[{"label":"PDF","type":"pdf","path":"https://journalpub.escholarship.org/cognitivesciencesociety/article/28776/galley/18647/download/"}]}