{"pk":24822,"title":"Voice markers of neuropsychiatric disorders: assessing the generalizability performance of machine learning models","subtitle":null,"abstract":"This research explores the potential of machine learning (ML) in identifying vocal markers for schizophrenia. While previous research showed that voice-based ML models can accurately predict schizophrenia diagnosis and symptoms, it is unclear to what extent such ML markers generalize to different clinical subpopulations and languages: the assessment of generalization performance is however crucial for testing their clinical applicability.\nWe systematically examined voice-based ML model performance on a large cross-linguistic dataset (3 languages: Danish, German, Chinese). Employing a rigorous pipeline to minimize overfitting, including cross-validated training sets and multilingual models, we assessed generalization on participants with schizophrenia and controls speaking the same or different languages. Model performance was comparable to state-of-the art findings (F1-score ~ 0.75) within the same language; however, models did not generalize well - showing a substantial decrease - when tested on new languages, and the performance of multilingual models was also generally low (F1-score ~ 0.50).","language":"eng","license":{"name":"","short_name":"","text":null,"url":""},"keywords":[{"word":"Linguistics; Psychology; Machine learning; Natural Language Processing; Speech recognition"}],"section":"Abstracts","is_remote":true,"remote_url":"https://escholarship.org/uc/item/19c9b42w","frozenauthors":[{"first_name":"Alberto","middle_name":"","last_name":"Parola","name_suffix":"","institution":"Copenhagen University","department":""},{"first_name":"Astrid","middle_name":"","last_name":"Rybner","name_suffix":"","institution":"Aarhus University","department":""},{"first_name":"Emil Trenckner","middle_name":"","last_name":"Jessen","name_suffix":"","institution":"Aarhus University","department":""},{"first_name":"Stine Nyhus","middle_name":"","last_name":"Larsen","name_suffix":"","institution":"Aarhus University","department":""},{"first_name":"Marie Damsgaard","middle_name":"","last_name":"Mortensen","name_suffix":"","institution":"Aarhus University","department":""},{"first_name":"Arndis","middle_name":"","last_name":"Simonsen","name_suffix":"","institution":"Aarhus University","department":""},{"first_name":"Yuan","middle_name":"","last_name":"Zhou","name_suffix":"","institution":"Chinese Academy of Sciences","department":""},{"first_name":"Katja","middle_name":"","last_name":"Koelkebeck","name_suffix":"","institution":"Hospital and Institute of the University of Duisburg-Essen","department":""},{"first_name":"Vibeke","middle_name":"","last_name":"Bliksted","name_suffix":"","institution":"Aarhus University","department":""},{"first_name":"Riccardo","middle_name":"","last_name":"Fusaroli","name_suffix":"","institution":"Aarhus University","department":""}],"date_submitted":null,"date_accepted":null,"date_published":"2024-01-01T15:00:00-03:00","render_galley":{"label":"PDF","type":"pdf","path":"https://journalpub.escholarship.org/cognitivesciencesociety/article/24822/galley/21729/download/"},"galleys":[{"label":"PDF","type":"pdf","path":"https://journalpub.escholarship.org/cognitivesciencesociety/article/24822/galley/14420/download/"},{"label":"PDF","type":"pdf","path":"https://journalpub.escholarship.org/cognitivesciencesociety/article/24822/galley/21729/download/"}]}