{"pk":27785,"title":"Human Decision on Targeted and Non-Targeted Adversarial Samples","subtitle":null,"abstract":"In a world that relies increasingly on large amounts of data\nand on powerful Machine Learning (ML) models, the veracity\nof decisions made by these systems is essential. Adversarial\nsamples are inputs that have been perturbed to mislead the in-\nterpretation of the ML and are a dangerous vulnerability. Our\nresearch takes a first step into what can be an important innova-\ntion in cognitive science: we analyzed human’s judgments and\ndecisions when confronted with targeted (inputs constructed\nto make a ML model purposely misclassify an input as some-\nthing else) and non-targeted (a noisy perturbed input that tries\nto trick the ML model) adversarial samples. Our findings sug-\ngest that although ML models that produce non-targeted adver-\nsarial samples can be more efficient than targeted samples they\nresult in more incorrect human classifications than those of tar-\ngeted samples. In other words, non-targeted samples interfered\nmore with human perception and categorization decisions than\ntargeted samples.","language":"eng","license":{"name":"","short_name":"","text":null,"url":""},"keywords":[{"word":"Adversarial machine learning"},{"word":"Human decision making"},{"word":"Adversarial samples"}],"section":"Publication-based-Talks","is_remote":true,"remote_url":"https://escholarship.org/uc/item/0gn9p0ts","frozenauthors":[{"first_name":"Samuel","middle_name":"M","last_name":"Harding","name_suffix":"","institution":"Indiana","department":""},{"first_name":"Prashanth","middle_name":"","last_name":"Rajivan","name_suffix":"","institution":"Carnegie Mellon","department":""},{"first_name":"Bennett","middle_name":"I","last_name":"Bertenthal","name_suffix":"","institution":"Indiana","department":""},{"first_name":"Cleotide","middle_name":"","last_name":"Gonzalez","name_suffix":"","institution":"Carnegie Mellon","department":""}],"date_submitted":null,"date_accepted":null,"date_published":"2018-01-01T18:00:00Z","render_galley":null,"galleys":[{"label":"PDF","type":"pdf","path":"https://journalpub.escholarship.org/cognitivesciencesociety/article/27785/galley/17425/download/"}]}