{"pk":24049,"title":"Developing Object Permanence from Videos","subtitle":null,"abstract":"Humans learn that temporarily occluded objects continue to exist within the first months of their lives. Deep learning mod- els, on the other hand, struggle to generalize such concepts from observations, due to missing proper inductive biases. Here, we introduce the first self-supervised interpretable ma- chine learning model that learns about object permanence di- rectly from video data without supervision. We augment a slot- based autoregressive deep learning system with the ability to adaptively and selectively fuse latent imaginations with pixel- based observations into consistent object-specific ‚Äòwhat' and ‚Äòwhere' encodings over time. We show that (i) Loci-Looped tracks objects through occlusions and anticipates their reap- pearance while outperforming state-of-the-art baseline models, (ii) Loci-Looped shows signs of surprise when the principle of object permanence is violated, and (iii) Loci-Looped's internal latent loop is key for learning object permanence.","language":"eng","license":{"name":"","short_name":"","text":null,"url":""},"keywords":[{"word":"Artificial Intelligence; Computer Science; Psychology; Development; Machine learning; Perception; Neural Networks"}],"section":"Papers with Poster Presentation","is_remote":true,"remote_url":"https://escholarship.org/uc/item/8s43261r","frozenauthors":[{"first_name":"Frederic","middle_name":"","last_name":"Becker","name_suffix":"","institution":"University of Tübingen","department":""},{"first_name":"Manuel","middle_name":"","last_name":"Traub","name_suffix":"","institution":"Eberhard Karls University of Tübingen","department":""},{"first_name":"Sebastian","middle_name":"","last_name":"Otte","name_suffix":"","institution":"University of Lübeck","department":""},{"first_name":"Martin","middle_name":"V.","last_name":"Butz","name_suffix":"","institution":"University of Tuebingen","department":""}],"date_submitted":null,"date_accepted":null,"date_published":"2024-01-01T18:00:00Z","render_galley":null,"galleys":[{"label":"PDF","type":"pdf","path":"https://journalpub.escholarship.org/cognitivesciencesociety/article/24049/galley/13643/download/"},{"label":"PDF","type":"pdf","path":"https://journalpub.escholarship.org/cognitivesciencesociety/article/24049/galley/21069/download/"}]}