{"pk":29907,"title":"Leveraging Machine Learning to Automatically Derive Robust Planning Strategiesfrom Biased Models of the Environment","subtitle":null,"abstract":"Teaching clever heuristics is a promising approach to improvedecision-making. We can leverage machine learning to dis-cover clever strategies automatically. Current methods requirean accurate model of the decision problems people face inreal life. But most models are misspecified because of lim-ited information and cognitive biases. To address this prob-lem we develop strategy discovery methods that are robustto model misspecification. Robustness is achieved by model-ing model-misspecification and handling uncertainty about thereal-world according to Bayesian inference. We translate ourmethods into an intelligent tutor that automatically discoversand teaches robust planning strategies. Our robust cognitivetutor significantly improved human decision-making when themodel was so biased that conventional cognitive tutors were nolonger effective. These findings highlight that our robust strat-egy discovery methods are a significant step towards leverag-ing artificial intelligence to improve human decision-makingin the real world.","language":"eng","license":{"name":"","short_name":"","text":null,"url":""},"keywords":[{"word":"automatic strategy discovery; cognitive tutors; ro-bust reinforcement learning; decision-making"}],"section":"Poster Session 2","is_remote":true,"remote_url":"https://escholarship.org/uc/item/91q6r08m","frozenauthors":[{"first_name":"Anirudha","middle_name":"","last_name":"Kemtur","name_suffix":"","institution":"Max Planck Institute for Intelligent Systems","department":""},{"first_name":"Yash","middle_name":"Raj","last_name":"Jain","name_suffix":"","institution":"Max Planck Institute for Intelligent Systems","department":""},{"first_name":"Aashay","middle_name":"","last_name":"Mehta","name_suffix":"","institution":"Max Planck Institute for Intelligent Systems","department":""},{"first_name":"Frederick","middle_name":"","last_name":"Callaway","name_suffix":"","institution":"Princeton University","department":""},{"first_name":"Saksham","middle_name":"","last_name":"Consul","name_suffix":"","institution":"Max Planck Institute for Intelligent Systems","department":""},{"first_name":"Jugoslav","middle_name":"","last_name":"Stojcheski","name_suffix":"","institution":"Max Planck Institute for Intelligent Systems","department":""},{"first_name":"Falk","middle_name":"","last_name":"Lieder","name_suffix":"","institution":"Max Planck Institute for Intelligent Systems","department":""}],"date_submitted":null,"date_accepted":null,"date_published":"2020-01-01T18:00:00Z","render_galley":null,"galleys":[{"label":"PDF","type":"pdf","path":"https://journalpub.escholarship.org/cognitivesciencesociety/article/29907/galley/19761/download/"}]}