Abstract

Hypomimia and voice changes are soft signs preceding classical motor disability in patients with Parkinson’s disease (PD). We aim to investigate whether an analysis of acoustic and facial expressions with machine-learning algorithms assist early identification of patients with PD. We recruited 371 participants, including a training cohort (112 PD patients during “on” phase, 111 controls) and a validation cohort (74 PD patients during “off” phase, 74 controls). All participants underwent a smartphone-based, simultaneous recording of voice and facial expressions, while reading an article. Nine different machine learning classifiers were applied. We observed that integrated facial and voice features could discriminate early-stage PD patients from controls with an area under the receiver operating characteristic (AUROC) diagnostic value of 0.85. In the validation cohort, the optimal diagnostic value (0.90) maintained. We concluded that integrated biometric features of voice and facial expressions could assist the identification of early-stage PD patients from aged controls.

Details

Title
An integrated biometric voice and facial features for early detection of Parkinson’s disease
Author
Lim, Wee Shin 1 ; Chiu, Shu-I 2 ; Wu, Meng-Ciao 3 ; Tsai, Shu-Fen 1 ; Wang, Pu-He 1 ; Lin, Kun-Pei 4 ; Chen, Yung-Ming 5 ; Peng, Pei-Ling 6 ; Chen, Yung-Yaw 3 ; Jang, Jyh-Shing Roger 1 ; Lin, Chin-Hsien 6 

 National Taiwan University, Department of Computer Science and Information Engineering, Taipei, Taiwan (GRID:grid.19188.39) (ISNI:0000 0004 0546 0241) 
 National Chengchi University, Department of Computer Science, Taipei, Taiwan (GRID:grid.412042.1) (ISNI:0000 0001 2106 6277) 
 National Taiwan University, Department of Electronic Engineering, Taipei, Taiwan (GRID:grid.19188.39) (ISNI:0000 0004 0546 0241) 
 National Taiwan University, Department of Geriatrics, National Taiwan University Hospital, College of Medicine, Taipei, Taiwan (GRID:grid.19188.39) (ISNI:0000 0004 0546 0241) 
 National Taiwan University, Department of Internal Medicine, National Taiwan University Hospital, College of Medicine, Taipei, Taiwan (GRID:grid.19188.39) (ISNI:0000 0004 0546 0241) 
 National Taiwan University, Department of Neurology, National Taiwan University Hospital, College of Medicine, Taipei, Taiwan (GRID:grid.19188.39) (ISNI:0000 0004 0546 0241) 
Publication year
2022
Publication date
2022
Publisher
Nature Publishing Group
e-ISSN
23738057
Source type
Scholarly Journal
Language of publication
English
ProQuest document ID
2729999471
Copyright
© The Author(s) 2022. This work is published under http://creativecommons.org/licenses/by/4.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.