{"pk":24397,"title":"PersonalityScanner: Exploring the Validity of Personality Assessment Based on Multimodal Signals in Virtual Reality","subtitle":null,"abstract":"Human cognition significantly influences expressed behavior and is intrinsically tied to authentic personality traits. Personality assessment plays a pivotal role in various fields, including psychology, education, social media, etc. However, traditional self-report questionnaires can only provide data based on what individuals are willing and able to disclose, thereby lacking objective. Moreover, automated measurements and peer assessments demand significant human effort and resources. In this paper, given the advantages of the Virtual Reality (VR) technique, we develop a VR simulator --- PersonalityScanner, to stimulate cognitive processes and simulate daily behaviors based on an immersive and interactive simulation environment, in which participants carry out a battery of engaging tasks that formulate a natural story of first-day at work. Through this simulator, we collect a synchronous multi-modal dataset with ten modalities, including first/third-person video, audio, text, eye tracking, facial microexpression, pose, depth data, log, and inertial measurement unit. By systematically examining the contributions of different modalities on revealing personality, we demonstrate the superior performance and effectiveness of PersonalityScanner.","language":"eng","license":{"name":"","short_name":"","text":null,"url":""},"keywords":[{"word":"Artificial Intelligence; Computer Science; Psychology; Behavioral Science; Human-computer interaction; Other; Computational Modeling"}],"section":"Papers with Poster Presentation","is_remote":true,"remote_url":"https://escholarship.org/uc/item/4p8191z5","frozenauthors":[{"first_name":"Xintong","middle_name":"","last_name":"Zhang","name_suffix":"","institution":"Beijing Key Lab of Traffic Data Analysis and Mining, Beijing Jiaotong University","department":""},{"first_name":"Di","middle_name":"","last_name":"Lu","name_suffix":"","institution":"Peking University","department":""},{"first_name":"Huiqi","middle_name":"","last_name":"Hu","name_suffix":"","institution":"Beijing Key Lab of Traffic Data Analysis and Mining, Beijing Jiaotong University","department":""},{"first_name":"Nan","middle_name":"","last_name":"Jiang","name_suffix":"","institution":"Peking University","department":""},{"first_name":"Xianhao","middle_name":"","last_name":"Yu","name_suffix":"","institution":"Beijing Key Lab of Traffic Data Analysis and Mining, Beijing Jiaotong University","department":""},{"first_name":"Jinan","middle_name":"","last_name":"Xu","name_suffix":"","institution":"Beijing Key Lab of Traffic Data Analysis and Mining, Beijing Jiaotong University","department":""},{"first_name":"Yujia","middle_name":"","last_name":"Peng","name_suffix":"","institution":"Peking University","department":""},{"first_name":"Qing","middle_name":"","last_name":"Li","name_suffix":"","institution":"National Key Laboratory of Beijing Institute for General Artificial Intelligence","department":""},{"first_name":"Wenjuan","middle_name":"","last_name":"Han","name_suffix":"","institution":"Beijing Key Lab of Traffic Data Analysis and Mining, Beijing Jiaotong University","department":""}],"date_submitted":null,"date_accepted":null,"date_published":"2024-01-01T12:00:00-06:00","render_galley":null,"galleys":[{"label":"PDF","type":"pdf","path":"https://journalpub.escholarship.org/cognitivesciencesociety/article/24397/galley/13994/download/"},{"label":"PDF","type":"pdf","path":"https://journalpub.escholarship.org/cognitivesciencesociety/article/24397/galley/21451/download/"}]}