1
|
Yang YC, Cheng WH, Lin ET, Liu AS, Ko CH, Huang CH, Tsai CL, Fu LC. Deep Learning-Based Instance Appraisable Model (EDi Pain) for Pain Estimation via Facial Videos: A Retrospective Analysis and a Prospective Emergency Department Study. JOURNAL OF IMAGING INFORMATICS IN MEDICINE 2025:10.1007/s10278-025-01534-2. [PMID: 40355693 DOI: 10.1007/s10278-025-01534-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/15/2025] [Revised: 04/28/2025] [Accepted: 04/29/2025] [Indexed: 05/14/2025]
Abstract
Pain assessment is a critical aspect of medical care, yet automated systems for clinical pain estimation remain rare. Tools such as the visual analog scale (VAS) are commonly used in emergency departments (EDs) but rely on subjective self-reporting, with pain intensity often fluctuating during triage. An effective automated system should utilize objective labels from healthcare professionals and identify key frames from video sequences for accurate inference. In this study, short video clips were treated as instance segments for the model, with ground truth (physician-rated VAS) provided at the video level. To address the weak label problem, we proposed flexible multiple instance learning approaches. Using a specialized loss function and sampling strategy, our instance-appraisable model, EDi Pain, was trained to estimate pain intensity while evaluating the significance of each instance segment. During inference, the VAS pain score for the entire video is derived from instance-level predictions. In retrospective analysis using the public UNBC-McMaster dataset, the EDi Pain model demonstrated competitive performance relative to prior studies, achieving strong performance in video-level pain intensity estimation, with a mean absolute error (MAE) of 1.85 and a Pearson correlation coefficient (PCC) of 0.63. Additionally, our model was validated on a prospectively collected dataset of 931 patients from National Taiwan University Hospital, yielding an MAE of 1.48 and a PCC of 0.22. In summary, we developed and validated a novel deep learning-based, instance-appraisable model for pain intensity estimation using facial videos. The EDi Pain model shows promise for real-time application in clinical settings, offering a more objective and dynamic approach to pain assessment.
Collapse
Affiliation(s)
- Yi-Cheng Yang
- Department of Computer Science and Information Engineering, National Taiwan University, CSIE Der Tian Hall No. 1, Sec. 4, Roosevelt Road, Taipei, 106319, Taiwan
| | - Wen-Hsiang Cheng
- Department of Computer Science and Information Engineering, National Taiwan University, CSIE Der Tian Hall No. 1, Sec. 4, Roosevelt Road, Taipei, 106319, Taiwan
| | - En-Ting Lin
- Department of Computer Science and Information Engineering, National Taiwan University, CSIE Der Tian Hall No. 1, Sec. 4, Roosevelt Road, Taipei, 106319, Taiwan
| | - An-Sheng Liu
- Department of Computer Science and Information Engineering, National Taiwan University, CSIE Der Tian Hall No. 1, Sec. 4, Roosevelt Road, Taipei, 106319, Taiwan
| | - Chia-Hsin Ko
- Department of Emergency Medicine, National Taiwan University Hospital and National Taiwan University College of Medicine, 7 Zhongshan S. Rd, Taipei, 100, Taiwan
| | - Chien-Hua Huang
- Department of Emergency Medicine, National Taiwan University Hospital and National Taiwan University College of Medicine, 7 Zhongshan S. Rd, Taipei, 100, Taiwan
| | - Chu-Lin Tsai
- Department of Emergency Medicine, National Taiwan University Hospital and National Taiwan University College of Medicine, 7 Zhongshan S. Rd, Taipei, 100, Taiwan.
| | - Li-Chen Fu
- Department of Computer Science and Information Engineering, National Taiwan University, CSIE Der Tian Hall No. 1, Sec. 4, Roosevelt Road, Taipei, 106319, Taiwan.
| |
Collapse
|
2
|
Chen YK, Wen WL, Hsu HP, Tsai CL. Impact of discordant pain assessment between patients and physicians on patient outcomes: a prospective emergency department study. Eur J Emerg Med 2024; 31:220-222. [PMID: 38661504 DOI: 10.1097/mej.0000000000001107] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/26/2024]
Affiliation(s)
- Yen-Kai Chen
- Department of Medicine, College of Medicine, National Taiwan University, Taipei
| | - Wei-Lun Wen
- Department of Medicine, College of Medicine, National Taiwan University, Taipei
| | - Hao-Ping Hsu
- Department of General Medicine, Chi Mei Medical Center, Tainan
| | - Chu-Lin Tsai
- Department of Emergency Medicine, National Taiwan University Hospital
- Department of Emergency Medicine, College of Medicine, National Taiwan University, Taipei, Taiwan
| |
Collapse
|
3
|
Hsu TM, Chang HW, Chen AL, Wei JCC. Comment on serum urate-lowering efficacy and safety of Tigulixostat in gout patients with hyperuricemia: A randomized, double-blind, placebo-controlled, dose-finding trial. Int J Rheum Dis 2024; 27:e15024. [PMID: 38287554 DOI: 10.1111/1756-185x.15024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/22/2023] [Accepted: 12/23/2023] [Indexed: 01/31/2024]
Affiliation(s)
- Tai-Ming Hsu
- School of Medicine, Chung Shan Medical University, Taichung, Taiwan
| | - Hui Wen Chang
- School of Medicine, Chung Shan Medical University, Taichung, Taiwan
| | - Ai-Lin Chen
- School of Medical Science and Technology, Chung Shan Medical University, Taichung, Taiwan
| | - James Cheng-Chung Wei
- Institute of Medicine, Chung Shan Medical University, Taichung, Taiwan
- Department of Allergy, Immunology, and Rheumatology, Chung Shan Medical University Hospital, Taichung, Taiwan
- Graduate Institute of Integrated Medicine, China Medical University, Taichung, Taiwan
| |
Collapse
|
4
|
Ku NW, Cheng MT, Liew CQ, Chen YC, Sung CW, Ko CH, Lu TC, Huang CH, Tsai CL. Prospective study of pain and patient outcomes in the emergency department: a tale of two pain assessment methods. Scand J Trauma Resusc Emerg Med 2023; 31:56. [PMID: 37872561 PMCID: PMC10594810 DOI: 10.1186/s13049-023-01130-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/13/2023] [Accepted: 10/12/2023] [Indexed: 10/25/2023] Open
Abstract
BACKGROUND Accurate pain assessment is essential in the emergency department (ED) triage process. Overestimation of pain intensity, however, can lead to unnecessary overtriage. The study aimed to investigate the influence of pain on patient outcomes and how pain intensity modulates the triage's predictive capabilities on these outcomes. METHODS A prospective observational cohort study was conducted at a tertiary care hospital, enrolling adult patients in the triage station. The entire triage process was captured on video. Two pain assessment methods were employed: (1) Self-reported pain score in the Taiwan Triage and Acuity Scale, referred to as the system-based method; (2) Five physicians independently assigned triage levels and assessed pain scores from video footage, termed the physician-based method. The primary outcome was hospitalization, and secondary outcomes included ED length of stay (EDLOS) and ED charges. RESULTS Of the 656 patients evaluated, the median self-reported pain score was 4 (interquartile range, 0-7), while the median physician-rated pain score was 1.5 (interquartile range, 0-3). Increased self-reported pain severity was not associated with prolonged EDLOS and increased ED charges, but a positive association was identified with physician-rated pain scores. Using the system-based method, the predictive efficacy of triage scales was lower in the pain groups than in the pain-free group (area under the receiver operating curve, [AUROC]: 0.615 vs. 0.637). However, with the physician-based method, triage scales were more effective in predicting hospitalization among patients with pain than those without (AUROC: 0.650 vs. 0.636). CONCLUSIONS Self-reported pain seemed to diminish the predictive accuracy of triage for hospitalization. In contrast, physician-rated pain scores were positively associated with longer EDLOS, increased ED charges, and enhanced triage predictive capability for hospitalization. Pain, therefore, appears to modulate the relationship between triage and patient outcomes, highlighting the need for careful pain evaluation in the ED.
Collapse
Affiliation(s)
- Nai-Wen Ku
- Lawrence S. Bloomberg Faculty of Nursing, University of Toronto, Toronto, ON, Canada
| | - Ming-Tai Cheng
- Department of Emergency Medicine, National Taiwan University Hospital, 7 Zhongshan S. Rd., Taipei, 100, Taiwan
- Department of Emergency Medicine, College of Medicine, National Taiwan University, Taipei, Taiwan
- Department of Emergency Medicine, National Taiwan University Hospital Yun-Lin Branch, Hsinchu, Taiwan
| | - Chiat Qiao Liew
- Department of Emergency Medicine, National Taiwan University Hospital, 7 Zhongshan S. Rd., Taipei, 100, Taiwan
| | - Yun Chang Chen
- Department of Emergency Medicine, National Taiwan University Hospital Yun-Lin Branch, Hsinchu, Taiwan
| | - Chih-Wei Sung
- Department of Emergency Medicine, College of Medicine, National Taiwan University, Taipei, Taiwan
- Department of Emergency Medicine, National Taiwan University Hospital Hsin-Chu Branch, Hsinchu, Taiwan
| | - Chia-Hsin Ko
- Department of Emergency Medicine, National Taiwan University Hospital, 7 Zhongshan S. Rd., Taipei, 100, Taiwan
| | - Tsung-Chien Lu
- Department of Emergency Medicine, National Taiwan University Hospital, 7 Zhongshan S. Rd., Taipei, 100, Taiwan
- Department of Emergency Medicine, College of Medicine, National Taiwan University, Taipei, Taiwan
| | - Chien-Hua Huang
- Department of Emergency Medicine, National Taiwan University Hospital, 7 Zhongshan S. Rd., Taipei, 100, Taiwan
- Department of Emergency Medicine, College of Medicine, National Taiwan University, Taipei, Taiwan
| | - Chu-Lin Tsai
- Department of Emergency Medicine, National Taiwan University Hospital, 7 Zhongshan S. Rd., Taipei, 100, Taiwan.
- Department of Emergency Medicine, College of Medicine, National Taiwan University, Taipei, Taiwan.
| |
Collapse
|