1
|
He T, Yang KF, Song GC, Liu H, Xu G, Wan J, Zhao H, Wang Q, Liu C, Zhao CK, Zhang YF, Guo LH, Sun LP, Xu HX. Diagnostic Performance of Different Examination Types and Learning Curves of Radiologists for 5G-Based Robot-Assisted Tele-Ultrasonography: A Prospective and Large-Scale Study. JOURNAL OF ULTRASOUND IN MEDICINE : OFFICIAL JOURNAL OF THE AMERICAN INSTITUTE OF ULTRASOUND IN MEDICINE 2025; 44:747-758. [PMID: 39838951 DOI: 10.1002/jum.16638] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/16/2024] [Revised: 11/25/2024] [Accepted: 12/13/2024] [Indexed: 01/23/2025]
Abstract
OBJECTIVE To investigate the feasibility of remotely providing routine ultrasound (US) examinations to patients using a fifth-generation-based robot-assisted tele-ultrasonography (RATU) system in a real-world setting. METHODS Between September 2020 and May 2021, we conducted a prospective and large-scale study using the RATU system to provide US examinations for patients on a limited-source island locate. An on-site radiologist on the island performed US examinations, which served as the reference diagnosis. Five tele-radiologists then remotely conducted RATU examinations from Central Shanghai. We compared the diagnostic performance of the RATU examinations to that of the on-site US examinations. Additionally, we assessed the learning curves of the various tele-radiologists. We also distributed 2 questionnaires to evaluate the usefulness of the clinical application. RESULTS In total, 770 patients were enrolled in the study with a mean age of 55.46 ± 15.02 years (ranging from 19 to 80 years). Out of the total, 501 patients were men, and 269 were women. Across all examination types, the diagnosis in 84.3% (649/770) of RATU examinations was consistent with the on-site US examination. The learning curve was not significantly different between tele-radiologists of different seniority. Furthermore, 86.6% (667/770) of participants accepted the RATU examination, and 97.5% (751/770) of patients were willing to pay a fair price. CONCLUSION RATU's diagnostic performance is still helpful for patients in remote areas, even though it may be slightly inferior to on-site US examination.
Collapse
Affiliation(s)
- Tian He
- Department of Medical Ultrasound, Shanghai Tenth People's Hospital, School of Medicine, Tongji University, Shanghai, China
- Shanghai Engineering Research Center of Ultrasound Diagnosis and Treatment, Shanghai, China
| | - Kai-Feng Yang
- Department of Medical Ultrasound, Shanghai Tenth People's Hospital Chongming Branch, Shanghai, China
| | - Guo-Chao Song
- Department of Medical Ultrasound, Shanghai Tenth People's Hospital Chongming Branch, Shanghai, China
| | - Hui Liu
- Department of Medical Ultrasound, Shanghai Tenth People's Hospital, School of Medicine, Tongji University, Shanghai, China
- Shanghai Engineering Research Center of Ultrasound Diagnosis and Treatment, Shanghai, China
| | - Guang Xu
- Department of Medical Ultrasound, Shanghai Tenth People's Hospital, School of Medicine, Tongji University, Shanghai, China
- Shanghai Engineering Research Center of Ultrasound Diagnosis and Treatment, Shanghai, China
| | - Jing Wan
- Department of Medical Ultrasound, Shanghai Tenth People's Hospital, School of Medicine, Tongji University, Shanghai, China
- Shanghai Engineering Research Center of Ultrasound Diagnosis and Treatment, Shanghai, China
| | - Hui Zhao
- Department of Medical Ultrasound, Shanghai Tenth People's Hospital, School of Medicine, Tongji University, Shanghai, China
- Shanghai Engineering Research Center of Ultrasound Diagnosis and Treatment, Shanghai, China
| | - Qiao Wang
- Department of Medical Ultrasound, Shanghai Tenth People's Hospital, School of Medicine, Tongji University, Shanghai, China
- Shanghai Engineering Research Center of Ultrasound Diagnosis and Treatment, Shanghai, China
| | - Chang Liu
- Department of Medical Ultrasound, Shanghai Tenth People's Hospital, School of Medicine, Tongji University, Shanghai, China
- Shanghai Engineering Research Center of Ultrasound Diagnosis and Treatment, Shanghai, China
| | - Chong-Ke Zhao
- Department of Ultrasound, Zhongshan Hospital, Fudan University, Shanghai, China
| | - Yi-Feng Zhang
- Department of Medical Ultrasound, Shanghai Tenth People's Hospital, School of Medicine, Tongji University, Shanghai, China
- Shanghai Engineering Research Center of Ultrasound Diagnosis and Treatment, Shanghai, China
| | - Le-Hang Guo
- Department of Medical Ultrasound, Shanghai Tenth People's Hospital, School of Medicine, Tongji University, Shanghai, China
- Shanghai Engineering Research Center of Ultrasound Diagnosis and Treatment, Shanghai, China
| | - Li-Ping Sun
- Department of Medical Ultrasound, Shanghai Tenth People's Hospital, School of Medicine, Tongji University, Shanghai, China
- Shanghai Engineering Research Center of Ultrasound Diagnosis and Treatment, Shanghai, China
| | - Hui-Xiong Xu
- Department of Ultrasound, Zhongshan Hospital, Fudan University, Shanghai, China
| |
Collapse
|
2
|
Han ZL, Lei YM, Yu J, Lei BS, Ye HR, Zhang G. Satisfaction analysis of 5G remote ultrasound robot for diagnostics based on a structural equation model. Front Robot AI 2024; 11:1413065. [PMID: 39445153 PMCID: PMC11496036 DOI: 10.3389/frobt.2024.1413065] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/10/2024] [Accepted: 09/26/2024] [Indexed: 10/25/2024] Open
Abstract
Objectives With the increasing application of 5G remote ultrasound robots in healthcare, robust methods are in critical demand to assess participant satisfaction and identify its influencing factors. At present, there is limited empirical research on multi-parametric and multidimensional satisfaction evaluation of participants with 5G remote ultrasound robot examination. Previous studies have demonstrated that structural equation modeling (SEM) effectively integrates various statistical techniques to examine the relationships among multiple variables. Therefore, this study aimed to evaluate the satisfaction of participants with 5G remote ultrasound robot examination and its influencing factors using SEM. Methods Between April and June 2022, 213 participants from Wuhan Automobile Manufacturing Company underwent remote ultrasound examinations using the MGIUS-R3 remote ultrasound robot system. After these examinations, the participants evaluated the performance of the 5G remote ultrasound robot based on their personal experiences and emotional responses. They completed a satisfaction survey using a self-developed questionnaire, which included 19 items across five dimensions: examination efficiency, examination perception, communication perception, value perception, and examination willingness. A SEM was established to assess the satisfaction of participants with the 5G remote ultrasound robot examinations and the influencing factors. Results A total of 201 valid questionnaires were collected. The overall satisfaction of participants with the 5G remote ultrasound robot examination was 45.43 ± 11.60, with 169 participants (84%) expressing satisfaction. In the path hypothesis relationship test, the dimensions of examination efficiency, examination perception, communication perception, and value perception had positive effects on satisfaction, with standardized path coefficients of 0.168, 0.170, 0.175, and 0.191. Satisfaction had a direct positive effect on examination willingness, with a standardized path coefficient of 0.260. Significant differences were observed across different educational levels in the dimensions of examination perception, communication perception, value perception, and examination willingness. Participants with different body mass indices also showed significant differences in examination perception; all p-values were less than 0.05. Conclusion In this study, value perception was identified as the most significant factor influencing satisfaction. It could be improved by enhancing participants' understanding of the accuracy and safety of 5G remote ultrasound robot examinations. This enhances satisfaction and the willingness to undergo examinations. Such improvements not only facilitate the widespread adoption of this technology but also promote the development of telemedicine services.
Collapse
Affiliation(s)
- Zhi-Li Han
- Department of Medical Ultrasound, China Resources and Wisco General Hospital, Wuhan University of Science and Technology, Wuhan, China
- Medical College, Wuhan University of Science and Technology, Wuhan, China
| | - Yu-Meng Lei
- Department of Medical Ultrasound, China Resources and Wisco General Hospital, Wuhan University of Science and Technology, Wuhan, China
| | - Jing Yu
- Department of Medical Ultrasound, China Resources and Wisco General Hospital, Wuhan University of Science and Technology, Wuhan, China
| | - Bing-Song Lei
- Department of Medical Ultrasound, China Resources and Wisco General Hospital, Wuhan University of Science and Technology, Wuhan, China
| | - Hua-Rong Ye
- Department of Medical Ultrasound, China Resources and Wisco General Hospital, Wuhan University of Science and Technology, Wuhan, China
| | - Ge Zhang
- Department of Medical Ultrasound, China Resources and Wisco General Hospital, Wuhan University of Science and Technology, Wuhan, China
| |
Collapse
|
3
|
Zhang YQ, Sun LP, He T, Guo LH, Liu H, Xu G, Zhao H, Wang Q, Wang J, Yang KF, Song GC, Zhou BY, Xu HX, Zhao CK. A 5G-based telerobotic ultrasound system provides qualified abdominal ultrasound services for patients on a rural island: a prospective and comparative study of 401 patients. Abdom Radiol (NY) 2024; 49:942-957. [PMID: 38102443 DOI: 10.1007/s00261-023-04123-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/20/2023] [Revised: 11/01/2023] [Accepted: 11/03/2023] [Indexed: 12/17/2023]
Abstract
PURPOSE To explore the feasibility of a 5G-based telerobotic ultrasound (US) system for providing qualified abdominal US services on a rural island. METHODS This prospective study involved two medical centers (the tele-radiologist site's hospital and the patient site's hospital) separated by 72 km. Patients underwent 5G-based telerobotic US by tele-radiologists and conventional US by on-site radiologists from September 2020 to March 2021. The clinical feasibility and diagnostic performance of the 5G-based telerobotic abdominal US examination were assessed based on safety, duration, image quality, diagnostic findings, and questionnaires. RESULTS A total of 401 patients (217 women and 184 men; mean age, 54.96 ± 15.43 years) were enrolled. A total of 90.1% of patients indicated no discomfort with the telerobotic US examination. For the examination duration, telerobotic US took longer than conventional US (12.54 ± 3.20 min vs. 7.23 ± 2.10 min, p = 0.001). For image quality scores, the results of the two methods were similar (4.54 ± 0.63 vs. 4.57 ± 0.61, p = 0.112). No significant differences were found between the two methods in measurements for the aorta, portal vein, gallbladder, kidney (longitudinal diameter), prostate, and uterus; however, telerobotic US underestimated the transverse diameter of the kidney (p < 0.05). A total of 504 positive results, including 31 different diseases, were detected. Among them, 455 cases were identified by the two methods; 17 cases were identified by telerobotic US only; and 32 cases were identified by conventional US only. There was good consistency in the diagnosis of 29 types of disease between the two methods (κ = 0.773-1.000). Furthermore, more than 90% of patients accepted the telerobotic US examination and agreed to pay additional fees in future. CONCLUSION The 5G-based telerobotic US system can expand access to abdominal US services for patients in rural areas, thereby reducing health care disparities.
Collapse
Affiliation(s)
- Ya-Qin Zhang
- Department of Medical Ultrasound, Center of Minimally Invasive Treatment for Tumor, Shanghai Tenth People's Hospital, School of Medicine, Tongji University, Shanghai, 200072, China
- Shanghai Engineering Research Center of Ultrasound Diagnosis and Treatment, Shanghai, 200072, China
- Department of Ultrasound, Zhongshan Hospital, Institute of Ultrasound in Medicine and Engineering, Fudan University, Shanghai, 200032, China
| | - Li-Ping Sun
- Department of Medical Ultrasound, Center of Minimally Invasive Treatment for Tumor, Shanghai Tenth People's Hospital, School of Medicine, Tongji University, Shanghai, 200072, China
- Shanghai Engineering Research Center of Ultrasound Diagnosis and Treatment, Shanghai, 200072, China
| | - Tian He
- Department of Medical Ultrasound, Center of Minimally Invasive Treatment for Tumor, Shanghai Tenth People's Hospital, School of Medicine, Tongji University, Shanghai, 200072, China
- Shanghai Engineering Research Center of Ultrasound Diagnosis and Treatment, Shanghai, 200072, China
| | - Le-Hang Guo
- Department of Medical Ultrasound, Center of Minimally Invasive Treatment for Tumor, Shanghai Tenth People's Hospital, School of Medicine, Tongji University, Shanghai, 200072, China
- Shanghai Engineering Research Center of Ultrasound Diagnosis and Treatment, Shanghai, 200072, China
| | - Hui Liu
- Department of Medical Ultrasound, Center of Minimally Invasive Treatment for Tumor, Shanghai Tenth People's Hospital, School of Medicine, Tongji University, Shanghai, 200072, China
- Shanghai Engineering Research Center of Ultrasound Diagnosis and Treatment, Shanghai, 200072, China
| | - Guang Xu
- Department of Medical Ultrasound, Center of Minimally Invasive Treatment for Tumor, Shanghai Tenth People's Hospital, School of Medicine, Tongji University, Shanghai, 200072, China
- Shanghai Engineering Research Center of Ultrasound Diagnosis and Treatment, Shanghai, 200072, China
| | - Hui Zhao
- Department of Medical Ultrasound, Center of Minimally Invasive Treatment for Tumor, Shanghai Tenth People's Hospital, School of Medicine, Tongji University, Shanghai, 200072, China
- Shanghai Engineering Research Center of Ultrasound Diagnosis and Treatment, Shanghai, 200072, China
| | - Qiao Wang
- Department of Medical Ultrasound, Center of Minimally Invasive Treatment for Tumor, Shanghai Tenth People's Hospital, School of Medicine, Tongji University, Shanghai, 200072, China
- Shanghai Engineering Research Center of Ultrasound Diagnosis and Treatment, Shanghai, 200072, China
| | - Jing Wang
- Department of Medical Ultrasound, Center of Minimally Invasive Treatment for Tumor, Shanghai Tenth People's Hospital, School of Medicine, Tongji University, Shanghai, 200072, China
- Shanghai Engineering Research Center of Ultrasound Diagnosis and Treatment, Shanghai, 200072, China
| | - Kai-Feng Yang
- Department of Medical Ultrasound, Shanghai Tenth People's Hospital Chongming Branch, Shanghai, 200072, China
| | - Guo-Chao Song
- Department of Medical Ultrasound, Shanghai Tenth People's Hospital Chongming Branch, Shanghai, 200072, China
| | - Bo-Yang Zhou
- Department of Ultrasound, Zhongshan Hospital, Institute of Ultrasound in Medicine and Engineering, Fudan University, Shanghai, 200032, China
| | - Hui-Xiong Xu
- Department of Ultrasound, Zhongshan Hospital, Institute of Ultrasound in Medicine and Engineering, Fudan University, Shanghai, 200032, China.
| | - Chong-Ke Zhao
- Department of Ultrasound, Zhongshan Hospital, Institute of Ultrasound in Medicine and Engineering, Fudan University, Shanghai, 200032, China.
| |
Collapse
|
4
|
Zhou YJ, Guo LH, Bo XW, Sun LP, Zhang YF, Chai HH, Ye RZ, Peng CZ, Qin C, Xu HX. Tele-Mentored Handheld Ultrasound System for General Practitioners: A Prospective, Descriptive Study in Remote and Rural Communities. Diagnostics (Basel) 2023; 13:2932. [PMID: 37761299 PMCID: PMC10530153 DOI: 10.3390/diagnostics13182932] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/01/2023] [Revised: 09/04/2023] [Accepted: 09/07/2023] [Indexed: 09/29/2023] Open
Abstract
BACKGROUND Rural general practitioners (GPs) have insufficient diagnostic information to deal with complex clinical scenarios due to the inequality in medical imaging resources in rural and remote communities. The objective of this study is to explore the value of a tele-mentored handheld ultrasound (tele-HHUS) system, allowing GPs to provide ultrasound (US) services in rural and remote communities. METHODS Overall, 708 patients underwent tele-HHUS examination between March and October 2021 and March and April 2022 across thirteen primary hospitals and two tertiary-care general hospitals. All US examinations were guided and supervised remotely in real time by US experts more than 300 km away using the tele-HHUS system. The following details were recorded: location of tele-HHUS scanning, primary complaints, clinical diagnosis, and US findings. The recommendations (referral or follow-up) based on clinical experience alone were compared with those based on clinical experience with tele-HHUS information. RESULTS Tele-HHUS examinations were performed both in hospital settings (90.6%, 642/708) and out of hospital settings (9.4%, 66/708). Leaving aside routine physical examinations, flank pain (14.2%, 91/642) was the most common complaint in inpatients, while chest distress (12.1%, 8/66) and flank discomfort (12.1%, 8/66) were the most common complaints in out-of-hospital settings. Additionally, the referral rate increased from 5.9% to 8.3% (kappa = 0.202; p = 0.000). CONCLUSIONS The tele-HHUS system can help rural GPs perform HHUS successfully in remote and rural communities. This novel mobile telemedicine model is valuable in resource-limited areas.
Collapse
Affiliation(s)
- Yu-Jing Zhou
- Department of Medical Ultrasound, Jinshan Hospital, Fudan University, Shanghai 201508, China;
| | - Le-Hang Guo
- Department of Medical Ultrasound, Shanghai Tenth People’s Hospital, Tongji University, Shanghai 200072, China; (L.-H.G.); (X.-W.B.); (L.-P.S.); (Y.-F.Z.); (H.-H.C.)
- Shanghai Engineering Research Center of Ultrasound Diagnosis and Treatment, Shanghai 200072, China
| | - Xiao-Wan Bo
- Department of Medical Ultrasound, Shanghai Tenth People’s Hospital, Tongji University, Shanghai 200072, China; (L.-H.G.); (X.-W.B.); (L.-P.S.); (Y.-F.Z.); (H.-H.C.)
- Shanghai Engineering Research Center of Ultrasound Diagnosis and Treatment, Shanghai 200072, China
| | - Li-Ping Sun
- Department of Medical Ultrasound, Shanghai Tenth People’s Hospital, Tongji University, Shanghai 200072, China; (L.-H.G.); (X.-W.B.); (L.-P.S.); (Y.-F.Z.); (H.-H.C.)
- Shanghai Engineering Research Center of Ultrasound Diagnosis and Treatment, Shanghai 200072, China
| | - Yi-Feng Zhang
- Department of Medical Ultrasound, Shanghai Tenth People’s Hospital, Tongji University, Shanghai 200072, China; (L.-H.G.); (X.-W.B.); (L.-P.S.); (Y.-F.Z.); (H.-H.C.)
- Shanghai Engineering Research Center of Ultrasound Diagnosis and Treatment, Shanghai 200072, China
| | - Hui-Hui Chai
- Department of Medical Ultrasound, Shanghai Tenth People’s Hospital, Tongji University, Shanghai 200072, China; (L.-H.G.); (X.-W.B.); (L.-P.S.); (Y.-F.Z.); (H.-H.C.)
- Shanghai Engineering Research Center of Ultrasound Diagnosis and Treatment, Shanghai 200072, China
| | - Rui-Zhong Ye
- Department of Ultrasound Medicine, Zhejiang Provincial People’s Hospital (Affiliated People’s Hospital, Hangzhou Medical College), Hangzhou 310014, China;
| | - Cheng-Zhong Peng
- Department of Medical Ultrasound, Shanghai Tenth People’s Hospital, Tongji University, Shanghai 200072, China; (L.-H.G.); (X.-W.B.); (L.-P.S.); (Y.-F.Z.); (H.-H.C.)
- Shanghai Engineering Research Center of Ultrasound Diagnosis and Treatment, Shanghai 200072, China
| | - Chuan Qin
- Department of Medical Ultrasound, Jinshan Hospital, Fudan University, Shanghai 201508, China;
- Department of Ultrasound, Karamay Central Hospital, Karamay 834000, China
| | - Hui-Xiong Xu
- Department of Ultrasound, Zhongshan Hospital, Fudan University, Shanghai 200032, China;
| |
Collapse
|
5
|
Wu M, Zhang M, Cao J, Wu S, Chen Y, Luo L, Lin X, Su M, Zhang X. Predictive accuracy and reproducibility of the O-RADS US scoring system among sonologists with different training levels. Arch Gynecol Obstet 2023; 308:631-637. [PMID: 35994107 DOI: 10.1007/s00404-022-06752-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/26/2022] [Accepted: 08/12/2022] [Indexed: 11/02/2022]
Abstract
PURPOSE To investigate the predictive performance and reproducibility of Ovarian-Adnexal Reporting and Data System (O-RADS) ultrasound (US) system in evaluating adnexal masses between sonologists with varying levels of expertise. METHODS This was a single-center retrospective study conducted between May 2019 and May 2020, which included 147 adnexal mases with pathological results. Four sonologists with varying experiences independently assigned an O-RADS US category to each adnexal mass twice. The intra- and inter-observer agreement was assessed using weighted kappa values. The area under the curve (AUC), sensitivity, specificity, positive and negative predictive value (PPV and NPV) were assessed for each sonologist. RESULTS Of the 147 adnexal mases, 115 (78.2%) lesions were benign and 32 (21.8%) lesions were malignant. Considering O-RADS > 3 as a predictor for adnexal malignancy, the predictive accuracies of the four sonologists were excellent, with AUCs ranging from 0.831 to 0.926. The predictive accuracies of O-RADS US by experienced sonologists were significantly higher compared to inexperienced sonologists (all P values < 0.005). The O-RADS US presented high sensitivity and NPV value for each sonologist. With regard to the reproducibility of O-RADS, the intra- and inter-observer agreement among experienced sonologists performed better than inexperienced sonologists. CONCLUSION O-RADS showed difference in the predictive accuracy and reproducibility in the evaluation of adnexal masses among sonologists with different levels of expertise. Training is required for inexperienced sonologists before the generalization of O-RADS classification system in clinical practice.
Collapse
Affiliation(s)
- Manli Wu
- Department of Ultrasound, Third Affiliated Hospital of Sun Yat-Sen University, 600 Tianhe Road, Guangzhou, 510630, Guangdong Province, People's Republic of China
| | - Man Zhang
- Department of Ultrasound, Third Affiliated Hospital of Sun Yat-Sen University, 600 Tianhe Road, Guangzhou, 510630, Guangdong Province, People's Republic of China
| | - Junyan Cao
- Department of Ultrasound, Third Affiliated Hospital of Sun Yat-Sen University, 600 Tianhe Road, Guangzhou, 510630, Guangdong Province, People's Republic of China
| | - Shuangyu Wu
- Department of Ultrasound, Third Affiliated Hospital of Sun Yat-Sen University, 600 Tianhe Road, Guangzhou, 510630, Guangdong Province, People's Republic of China
| | - Ying Chen
- Department of Ultrasound, Third Affiliated Hospital of Sun Yat-Sen University, 600 Tianhe Road, Guangzhou, 510630, Guangdong Province, People's Republic of China
| | - Liping Luo
- Department of Ultrasound, Third Affiliated Hospital of Sun Yat-Sen University, 600 Tianhe Road, Guangzhou, 510630, Guangdong Province, People's Republic of China
| | - Xin Lin
- Department of Ultrasound, Third Affiliated Hospital of Sun Yat-Sen University, 600 Tianhe Road, Guangzhou, 510630, Guangdong Province, People's Republic of China
| | - Manting Su
- Department of Ultrasound, Third Affiliated Hospital of Sun Yat-Sen University, 600 Tianhe Road, Guangzhou, 510630, Guangdong Province, People's Republic of China
| | - Xinling Zhang
- Department of Ultrasound, Third Affiliated Hospital of Sun Yat-Sen University, 600 Tianhe Road, Guangzhou, 510630, Guangdong Province, People's Republic of China.
| |
Collapse
|