{"pk":28837,"title":"A proverb is worth a thousand words:Learning to associate images with proverbs","subtitle":null,"abstract":"We describe a system that can associate images with Englishproverbs. We start from a corpus of proverbs, harvest relatedimages from the web and use this data to train two variants ofa convolutional neural network. We then collect a small set ofannotations, and use these to combine the outputs of the twonetworks into a single prediction for each input image. Wecarry out feature selection experiments on a set of features de-rived from the images and from the predicted proverbs, anddemonstrate that the metaphoricity of the proverbs plays a sig-nificant role in classification accuracy. An empirical evalua-tion with human raters confirms the system’s ability to abstractfrom the raw bits in the images and to learn meaningful, non-trivial associations.","language":"eng","license":{"name":"","short_name":"","text":null,"url":""},"keywords":[],"section":"Papers with Poster Presentations","is_remote":true,"remote_url":"https://escholarship.org/uc/item/5wj9v5f3","frozenauthors":[{"first_name":"G ̈ozde","middle_name":"","last_name":"Ozbal","name_suffix":"","institution":"FBK-Irst - Trento","department":""},{"first_name":"Daniele","middle_name":"","last_name":"Pighin","name_suffix":"","institution":"Google Zurich","department":""},{"first_name":"Carlo","middle_name":"","last_name":"Strapparava","name_suffix":"","institution":"FBK-Irst - Trento","department":""}],"date_submitted":null,"date_accepted":null,"date_published":"2019-01-01T18:00:00Z","render_galley":null,"galleys":[{"label":"PDF","type":"pdf","path":"https://journalpub.escholarship.org/cognitivesciencesociety/article/28837/galley/18708/download/"}]}