1
|
Wang Y, Liu F, Zhang H, Wang Q, Yu P, Wang J, Zhang Z, Wang G, Zhang Y, Yang Y, Mou Y, Mao N, Song X. Deep Learning Model for the Differential Diagnosis of Nasal Polyps and Inverted Papilloma by CT Images: A Multicenter Study. Acad Radiol 2025; 32:2900-2909. [PMID: 39730250 DOI: 10.1016/j.acra.2024.12.011] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/18/2024] [Revised: 12/05/2024] [Accepted: 12/07/2024] [Indexed: 12/29/2024]
Abstract
RATIONALE AND OBJECTIVES Nasal polyps (NP) and inverted papilloma (IP) are benign tumors within the nasal cavity, each necessitating distinct treatment approaches. Herein, we investigate the utility of a deep learning (DL) model for distinguishing between NP and IP. MATERIALS AND METHODS A total of 1791 patients with nasal benign tumors from two hospitals were retrospectively enrolled. Patients were divided into training, internal test, and external test sets. DL models (3D ResNet, 3D Xception, and HRNet) were employed to identify NP from IP using computed tomography images. Model performance was evaluated via receiver operating characteristic curve analysis, accuracy, sensitivity, and specificity. The best-performing model was compared with radiologists' interpretations. The potential enhancement of radiologists' diagnostic performance using the optimal DL model was investigated. Additionally, proteomics analysis in 70 patients was conducted to elucidate the biological underpinnings of the DL model. RESULTS The 3D Xception model emerged as the best-performing DL model, achieving the highest area under the receiver operating characteristic curve of 0.999 (95% confidence interval [CI]: 0.950-1.000) in the training set, 0.981 (95% CI: 0.950-1.000) in the internal test set, and 0.933 (95% CI: 0.9099-0.9557) in the external test set. The sensitivity and specificity of the optimal DL model surpassed those of the four radiologists. Furthermore, the DL model improved average radiologist sensitivity from 0.845 to 0.884 and specificity from 0.670 to 0.840. Proteomic analysis revealed an association between the model predictions and epithelial cell differentiation. CONCLUSION DL based on CT images holds promise for distinguishing between NP and IP lesions, thereby augmenting clinicians' interpretation capabilities.
Collapse
Affiliation(s)
- Yaqi Wang
- Department of Otorhinolaryngology, Head and Neck Surgery, Yantai Yuhuangding Hospital, Qingdao University, Yantai, China (Y.W., P.Y., J.W., Z.Z., G.W., Y.Z., Y.Y., Y.M., X.S.); Shandong Provincial Clinical Research Center for Otorhinolaryngologic Diseases, Yantai Yuhuangding Hospital, Yantai, China (Y.W., P.Y., J.W., Z.Z., G.W., Y.Z., Y.Y., Y.M., X.S.); Yantai Key Laboratory of Otorhinolaryngologic Diseases, Yantai Yuhuangding Hospital, Yantai, China (Y.W., P.Y., J.W., Y.Z., Y.Y., Y.M., X.S.)
| | - Fengjie Liu
- Department of Radiology, Yantai Yuhuangding Hospital, Qingdao University, Yantai, China (F.L., H.Z., Q.W., N.M.)
| | - Haicheng Zhang
- Big data and Artificial Intelligence Laboratory, Yantai Yuhuangding Hospital, Qingdao University, Yantai, China (H.Z., Q.W., N.M.); Department of Radiology, Yantai Yuhuangding Hospital, Qingdao University, Yantai, China (F.L., H.Z., Q.W., N.M.); Shandong Provincial Key Medical and Health Laboratory of Intelligent Diagnosis and Treatment for Women's Diseases, Yantai Yuhuangding Hospital, Yantai, China (H.Z., Q.W., N.M.)
| | - Qi Wang
- Big data and Artificial Intelligence Laboratory, Yantai Yuhuangding Hospital, Qingdao University, Yantai, China (H.Z., Q.W., N.M.); Department of Radiology, Yantai Yuhuangding Hospital, Qingdao University, Yantai, China (F.L., H.Z., Q.W., N.M.); Shandong Provincial Key Medical and Health Laboratory of Intelligent Diagnosis and Treatment for Women's Diseases, Yantai Yuhuangding Hospital, Yantai, China (H.Z., Q.W., N.M.)
| | - Pengyi Yu
- Department of Otorhinolaryngology, Head and Neck Surgery, Yantai Yuhuangding Hospital, Qingdao University, Yantai, China (Y.W., P.Y., J.W., Z.Z., G.W., Y.Z., Y.Y., Y.M., X.S.); Shandong Provincial Clinical Research Center for Otorhinolaryngologic Diseases, Yantai Yuhuangding Hospital, Yantai, China (Y.W., P.Y., J.W., Z.Z., G.W., Y.Z., Y.Y., Y.M., X.S.); Yantai Key Laboratory of Otorhinolaryngologic Diseases, Yantai Yuhuangding Hospital, Yantai, China (Y.W., P.Y., J.W., Y.Z., Y.Y., Y.M., X.S.)
| | - Jianwei Wang
- Department of Otorhinolaryngology, Head and Neck Surgery, Yantai Yuhuangding Hospital, Qingdao University, Yantai, China (Y.W., P.Y., J.W., Z.Z., G.W., Y.Z., Y.Y., Y.M., X.S.); Shandong Provincial Clinical Research Center for Otorhinolaryngologic Diseases, Yantai Yuhuangding Hospital, Yantai, China (Y.W., P.Y., J.W., Z.Z., G.W., Y.Z., Y.Y., Y.M., X.S.); Yantai Key Laboratory of Otorhinolaryngologic Diseases, Yantai Yuhuangding Hospital, Yantai, China (Y.W., P.Y., J.W., Y.Z., Y.Y., Y.M., X.S.)
| | - Zheng Zhang
- Department of Otorhinolaryngology, Head and Neck Surgery, Yantai Yuhuangding Hospital, Qingdao University, Yantai, China (Y.W., P.Y., J.W., Z.Z., G.W., Y.Z., Y.Y., Y.M., X.S.); Shandong Provincial Clinical Research Center for Otorhinolaryngologic Diseases, Yantai Yuhuangding Hospital, Yantai, China (Y.W., P.Y., J.W., Z.Z., G.W., Y.Z., Y.Y., Y.M., X.S.)
| | - Guangkuo Wang
- Department of Otorhinolaryngology, Head and Neck Surgery, Yantai Yuhuangding Hospital, Qingdao University, Yantai, China (Y.W., P.Y., J.W., Z.Z., G.W., Y.Z., Y.Y., Y.M., X.S.); Shandong Provincial Clinical Research Center for Otorhinolaryngologic Diseases, Yantai Yuhuangding Hospital, Yantai, China (Y.W., P.Y., J.W., Z.Z., G.W., Y.Z., Y.Y., Y.M., X.S.)
| | - Yu Zhang
- Department of Otorhinolaryngology, Head and Neck Surgery, Yantai Yuhuangding Hospital, Qingdao University, Yantai, China (Y.W., P.Y., J.W., Z.Z., G.W., Y.Z., Y.Y., Y.M., X.S.); Shandong Provincial Clinical Research Center for Otorhinolaryngologic Diseases, Yantai Yuhuangding Hospital, Yantai, China (Y.W., P.Y., J.W., Z.Z., G.W., Y.Z., Y.Y., Y.M., X.S.); Yantai Key Laboratory of Otorhinolaryngologic Diseases, Yantai Yuhuangding Hospital, Yantai, China (Y.W., P.Y., J.W., Y.Z., Y.Y., Y.M., X.S.)
| | - Yujuan Yang
- Department of Otorhinolaryngology, Head and Neck Surgery, Yantai Yuhuangding Hospital, Qingdao University, Yantai, China (Y.W., P.Y., J.W., Z.Z., G.W., Y.Z., Y.Y., Y.M., X.S.); Shandong Provincial Clinical Research Center for Otorhinolaryngologic Diseases, Yantai Yuhuangding Hospital, Yantai, China (Y.W., P.Y., J.W., Z.Z., G.W., Y.Z., Y.Y., Y.M., X.S.); Yantai Key Laboratory of Otorhinolaryngologic Diseases, Yantai Yuhuangding Hospital, Yantai, China (Y.W., P.Y., J.W., Y.Z., Y.Y., Y.M., X.S.)
| | - Yakui Mou
- Department of Otorhinolaryngology, Head and Neck Surgery, Yantai Yuhuangding Hospital, Qingdao University, Yantai, China (Y.W., P.Y., J.W., Z.Z., G.W., Y.Z., Y.Y., Y.M., X.S.); Shandong Provincial Clinical Research Center for Otorhinolaryngologic Diseases, Yantai Yuhuangding Hospital, Yantai, China (Y.W., P.Y., J.W., Z.Z., G.W., Y.Z., Y.Y., Y.M., X.S.); Yantai Key Laboratory of Otorhinolaryngologic Diseases, Yantai Yuhuangding Hospital, Yantai, China (Y.W., P.Y., J.W., Y.Z., Y.Y., Y.M., X.S.)
| | - Ning Mao
- Big data and Artificial Intelligence Laboratory, Yantai Yuhuangding Hospital, Qingdao University, Yantai, China (H.Z., Q.W., N.M.); Department of Radiology, Yantai Yuhuangding Hospital, Qingdao University, Yantai, China (F.L., H.Z., Q.W., N.M.); Shandong Provincial Key Medical and Health Laboratory of Intelligent Diagnosis and Treatment for Women's Diseases, Yantai Yuhuangding Hospital, Yantai, China (H.Z., Q.W., N.M.)
| | - Xicheng Song
- Department of Otorhinolaryngology, Head and Neck Surgery, Yantai Yuhuangding Hospital, Qingdao University, Yantai, China (Y.W., P.Y., J.W., Z.Z., G.W., Y.Z., Y.Y., Y.M., X.S.); Shandong Provincial Clinical Research Center for Otorhinolaryngologic Diseases, Yantai Yuhuangding Hospital, Yantai, China (Y.W., P.Y., J.W., Z.Z., G.W., Y.Z., Y.Y., Y.M., X.S.); Yantai Key Laboratory of Otorhinolaryngologic Diseases, Yantai Yuhuangding Hospital, Yantai, China (Y.W., P.Y., J.W., Y.Z., Y.Y., Y.M., X.S.).
| |
Collapse
|
2
|
Ayoub NF, Rameau A, Brenner MJ, Bur AM, Ator GA, Briggs SE, Takashima M, Stankovic KM. American Academy of Otolaryngology-Head and Neck Surgery (AAO-HNS) Report on Artificial Intelligence. Otolaryngol Head Neck Surg 2025; 172:734-743. [PMID: 39666770 DOI: 10.1002/ohn.1080] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2024] [Revised: 10/31/2024] [Accepted: 11/22/2024] [Indexed: 12/14/2024]
Abstract
This report synthesizes the American Academy of Otolaryngology-Head and Neck Surgery (AAO-HNS) Task Force's guidance on the integration of artificial intelligence (AI) in otolaryngology-head and neck surgery (OHNS). A comprehensive literature review was conducted, focusing on the applications, benefits, and challenges of AI in OHNS, alongside ethical, legal, and social implications. The Task Force, formulated by otolaryngologist experts in AI, used an iterative approach, adapted from the Delphi method, to prioritize topics for inclusion and to reach a consensus on guiding principles. The Task Force's findings highlight AI's transformative potential for OHNS, offering potential advancements in precision medicine, clinical decision support, operational efficiency, research, and education. However, challenges such as data quality, health equity, privacy concerns, transparency, regulatory gaps, and ethical dilemmas necessitate careful navigation. Incorporating AI into otolaryngology practice in a safe, equitable, and patient-centered manner requires clinician judgment, transparent AI systems, and adherence to ethical and legal standards. The Task Force principles underscore the importance of otolaryngologists' involvement in AI's ethical development, implementation, and regulation to harness benefits while mitigating risks. The proposed principles inform the integration of AI in otolaryngology, aiming to enhance patient outcomes, clinician well-being, and efficiency of health care delivery.
Collapse
Affiliation(s)
- Noel F Ayoub
- Department of Otolaryngology-Head and Neck Surgery, Mass Eye & Ear, Boston, Massachusetts, USA
- Department of Otolaryngology-Head and Neck Surgery, Stanford University, Palo Alto, California, USA
| | - Anaïs Rameau
- Department of Otolaryngology-Head and Neck Surgery, Weill Cornell Medical College, Ithaca, New York, USA
| | - Michael J Brenner
- Department of Otolaryngology-Head and Neck Surgery, University of Michigan Medical School, Ann Arbor, Michigan, USA
| | - Andrés M Bur
- Department of Otolaryngology-Head and Neck Surgery, University of Kansas Medical Center, Kansas City, Kansas, USA
| | - Gregory A Ator
- Department of Otolaryngology-Head and Neck Surgery, University of Kansas Medical Center, Kansas City, Kansas, USA
| | - Selena E Briggs
- Department of Otolaryngology-Head and Neck Surgery, MedStar Georgetown University Hospital, Washington, District of Columbia, USA
| | - Masayoshi Takashima
- Department Otolaryngology-Head and Neck Surgery, Houston Methodist, Houston, Texas, USA
| | - Konstantina M Stankovic
- Department of Otolaryngology-Head and Neck Surgery, Stanford University, Palo Alto, California, USA
| |
Collapse
|
3
|
Craig JR, Tataryn RW, Saibene AM. The Future of Odontogenic Sinusitis. Otolaryngol Clin North Am 2024; 57:1173-1181. [PMID: 39428207 DOI: 10.1016/j.otc.2024.06.008] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/22/2024]
Abstract
This article discusses the exciting future of odontogenic sinusitis (ODS) in the context of recent advancements in ODS understanding. It emphasizes the importance of integrating ODS into the broader framework of sinonasal diseases and highlights the need for multidisciplinary collaboration among otolaryngologists and dental specialists to optimize clinical outcomes, research, and education. Key challenges include refining dental and sinus pathophysiologic understandings, establishing widely accepted diagnostic criteria, and optimizing multidisciplinary treatment pathways. The article provides also some tips for how to develop interdisciplinary networks both to improve clinical care and research endeavors.
Collapse
Affiliation(s)
- John R Craig
- Department of Otolaryngology-Head and Neck Surgery, Henry Ford Health, Henry Ford Hospital, 2799 West Grand Boulevard, Detroit, MI 48202, USA.
| | - Rod W Tataryn
- Private Practice Endodontics, Spokane, WA, USA; Department of Endodontics, Loma Linda University, Loma Linda, CA, USA
| | - Alberto M Saibene
- Otolaryngology Unit, Department of Health Sciences, Santi Paolo and Carlo Hospital, Università degli Studi di Milano, Milan, Italy. https://twitter.com/ent_ams
| |
Collapse
|
4
|
Sukswai P, Hnoohom N, Hoang MP, Aeumjaturapat S, Chusakul S, Kanjanaumporn J, Seresirikachorn K, Snidvongs K. The accuracy of deep learning models for diagnosing maxillary fungal ball rhinosinusitis. Eur Arch Otorhinolaryngol 2024; 281:6485-6492. [PMID: 39230611 DOI: 10.1007/s00405-024-08948-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/27/2024] [Accepted: 08/22/2024] [Indexed: 09/05/2024]
Abstract
PURPOSE To assess the accuracy of deep learning models for the diagnosis of maxillary fungal ball rhinosinusitis (MFB) and to compare the accuracy, sensitivity, specificity, precision, and F1-score with a rhinologist. METHODS Data from 1539 adult chronic rhinosinusitis (CRS) patients who underwent paranasal sinus computed tomography (CT) were collected. The overall dataset consisted of 254 MFB cases and 1285 non-MFB cases. The CT images were constructed and labeled to form the deep learning models. Seventy percent of the images were used for training the deep-learning models, and 30% were used for testing. Whole image analysis and instance segmentation analysis were performed using three different architectures: MobileNetv3, ResNet50, and ResNet101 for whole image analysis, and YOLOv5X-SEG, YOLOv8X-SEG, and YOLOv9-C-SEG for instance segmentation analysis. The ROC curve was assessed. Accuracy, sensitivity (recall), specificity, precision, and F1-score were compared between the models and a rhinologist. Kappa agreement was evaluated. RESULTS Whole image analysis showed lower precision, recall, and F1-score compared to instance segmentation. The models exhibited an area under the ROC curve of 0.86 for whole image analysis and 0.88 for instance segmentation. In the testing dataset for whole images, the MobileNet V3 model showed 81.00% accuracy, 47.40% sensitivity, 87.90% specificity, 66.80% precision, and a 67.20% F1 score. Instance segmentation yielded the best evaluation with YOLOv8X-SEG showing 94.10% accuracy, 85.90% sensitivity, 95.80% specificity, 88.90% precision, and an 89.80% F1-score. The rhinologist achieved 93.5% accuracy, 84.6% sensitivity, 95.3% specificity, 78.6% precision, and an 81.5% F1-score. CONCLUSION Utilizing paranasal sinus CT imaging with enhanced localization and constructive instance segmentation in deep learning models can be the practical promising deep learning system in assisting physicians for diagnosing maxillary fungal ball.
Collapse
Affiliation(s)
- Pakapoom Sukswai
- Department of Otolaryngology, Faculty of Medicine, Chulalongkorn University, Bangkok, Thailand
| | - Narit Hnoohom
- Department of Computer Engineering, Faculty of Engineering, Mahidol University, Nakhon Pathom, Thailand
| | - Minh Phuoc Hoang
- Department of Otolaryngology, Hue University of Medicine and Pharmacy, Hue University, Hue, Vietnam
| | - Songklot Aeumjaturapat
- Endoscopic Nasal and Sinus Surgery Excellence Center, Department of Otolaryngology, King Chulalongkorn Memorial Hospital, Bangkok, Thailand
- Department of Otolaryngology, Faculty of Medicine, Chulalongkorn University, Bangkok, Thailand
| | - Supinda Chusakul
- Endoscopic Nasal and Sinus Surgery Excellence Center, Department of Otolaryngology, King Chulalongkorn Memorial Hospital, Bangkok, Thailand
- Department of Otolaryngology, Faculty of Medicine, Chulalongkorn University, Bangkok, Thailand
| | - Jesada Kanjanaumporn
- Endoscopic Nasal and Sinus Surgery Excellence Center, Department of Otolaryngology, King Chulalongkorn Memorial Hospital, Bangkok, Thailand
- Department of Otolaryngology, Faculty of Medicine, Chulalongkorn University, Bangkok, Thailand
| | - Kachorn Seresirikachorn
- Endoscopic Nasal and Sinus Surgery Excellence Center, Department of Otolaryngology, King Chulalongkorn Memorial Hospital, Bangkok, Thailand
- Department of Otolaryngology, Faculty of Medicine, Chulalongkorn University, Bangkok, Thailand
| | - Kornkiat Snidvongs
- Endoscopic Nasal and Sinus Surgery Excellence Center, Department of Otolaryngology, King Chulalongkorn Memorial Hospital, Bangkok, Thailand.
- Department of Otolaryngology, Faculty of Medicine, Chulalongkorn University, Bangkok, Thailand.
| |
Collapse
|
5
|
Novarria GA, Vultaggio F, Saginario V, Felisati G, Saibene AM. Efficacy and safety of middle turbinate surgery: a systematic review. Eur Arch Otorhinolaryngol 2024; 281:6187-6199. [PMID: 38992192 DOI: 10.1007/s00405-024-08825-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/16/2024] [Accepted: 07/02/2024] [Indexed: 07/13/2024]
Abstract
PURPOSE Middle turbinate (MT) surgery is extremely common during endoscopic sinus surgery procedures, though no agreement exists on which techniques provide the best outcomes. This PRISMA-compliant systematic review aims to assess which MT surgery technique yields the least postoperative adverse effects and the best objective and subjective outcomes. METHODS A comprehensive search criteria was conducted in multiple databases up to July 3, 2023, to identify studies reporting surgical treatments of the MT. After screening and quality assessment, 14 articles were included for analysis. Data on patients demographics, surgical approaches, postoperative treatment and follow-up, objective and subjective outcomes were extracted and reviewed. RESULTS Out of 173 unique papers identified, 14 articles met the inclusion criteria, predominantly randomized controlled trials (n = 9). Antero-inferior middle turbinectomy was the predominant surgical approach. Most studies evaluated results with postoperative endoscopy, a superior outcome was documented in the intervention group (ten out of eleven cases). In four out five studies using the SNOT-22, the treatment group was associated with a statistically significant improvement. Olfactory questionnaires highlighted superior olfactory outcome in two out of three studies. The UPSIT score revealed no significant difference between groups. Objective olfactory assessments favored treatment groups in both studies utilizing olfactometry. CONCLUSIONS It seems that a partial MT surgical approach consistently yields subjective and objective improvements compared to conservative measures, also suggesting a positive impact on smell function. Despite it appears that better outcomes with fewer complications are consistently achieved with partial techniques, it remains challenging identifying which partial technique surpasses the others, due to significant heterogeneity among the studies.
Collapse
Affiliation(s)
- Gabriele Alessandro Novarria
- Department of Otolaryngology and Head and Neck Surgery, Istituto Clinico Città Studi, Via Jommelli 17, Milano, 20131, Italy.
| | - Federica Vultaggio
- Department of Clinical Sciences and Community Health, San Giuseppe Hospital, Università Degli Studi di Milano, Milan, Italy
| | - Vittorio Saginario
- Department of Otolaryngology and Head and Neck Surgery, Istituto Clinico Città Studi, Via Jommelli 17, Milano, 20131, Italy
| | - Giovanni Felisati
- Department of Health Sciences, Otorhinolaryngology Unit, Santi Paolo e Carlo Hospital, University of Milan, Milan, Italy
| | - Alberto Maria Saibene
- Department of Health Sciences, Otorhinolaryngology Unit, Santi Paolo e Carlo Hospital, University of Milan, Milan, Italy
| |
Collapse
|
6
|
Miao S, Cheng Y, Li Y, Chen X, Chen F, Zha D, Xue T. Prediction of recurrence-free survival and risk factors of sinonasal inverted papilloma after surgery by machine learning models. Eur J Med Res 2024; 29:528. [PMID: 39497172 PMCID: PMC11533278 DOI: 10.1186/s40001-024-02099-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/27/2024] [Accepted: 10/08/2024] [Indexed: 11/06/2024] Open
Abstract
OBJECTIVES Our research aims to construct machine learning prediction models to identify patients proned to recurrence after inverted papilloma (IP) surgery and guide their follow-up treatment. METHODS This study collected 210 patients underwent IP resection surgery at a university hospital from January 2010 to December 2023. Six machine learning algorithms including ExtraSurvivalTrees (EST), GradientBoostingSurvivalAnalysis (GBSA), RandomSurvivalForest (RSF), SurvivalSVM, Coxnet and Coxph, were used to construct the prediction models. Shapley Additive Explanations (SHAP) values were used to explain the importance of various features in predicting IP recurrence. RESULTS We found that the recurrence rate of IP patients is 20.00%, with a median recurrence time of 35.5 months. Multivariate Cox regression analysis identified mild or moderate dysplasia as an independent risk factor for recurrence. The EST model performs the best in predicting postoperative recurrence of IP, with C-index of 0.968 and 0.878 in the training and testing sets. SHAP emphasizes five important predictive factors for recurrence, including bone defects, orbital involvement, smoking, no processing of tumor attachment sites and drinking. CONCLUSIONS To our knowledge, this is the first study to use multiple ML models to predict postoperative recurrence of IP. The EST model has the best predictive performance, with SHAP emphasizing several key predictive factors for IP recurrence. This study emphasizes the practicality of machine learning algorithms in predicting IP clinical outcomes, providing valuable insights into the potential for improving clinical decision-making.
Collapse
Affiliation(s)
- Siyu Miao
- Department of Otolaryngology Head and Neck Surgery, Xijing Hospital, The Air Force Medical University, 127 Changle West Road, Xi'an, 710032, China
- The Outpatient Department, Lintong Rehabilitation and Convalescent Centre, Xi'an, 710600, China
| | - Yang Cheng
- Department of Endocrinology, Xijing Hospital, The Air Force Medical University, Xi'an, 710032, China
| | - Yaqi Li
- Department of Otolaryngology Head and Neck Surgery, Xijing Hospital, The Air Force Medical University, 127 Changle West Road, Xi'an, 710032, China
| | - Xiaodong Chen
- Department of Otolaryngology Head and Neck Surgery, Xijing Hospital, The Air Force Medical University, 127 Changle West Road, Xi'an, 710032, China
| | - Fuquan Chen
- Department of Otolaryngology Head and Neck Surgery, Xijing Hospital, The Air Force Medical University, 127 Changle West Road, Xi'an, 710032, China
| | - Dingjun Zha
- Department of Otolaryngology Head and Neck Surgery, Xijing Hospital, The Air Force Medical University, 127 Changle West Road, Xi'an, 710032, China.
| | - Tao Xue
- Department of Otolaryngology Head and Neck Surgery, Xijing Hospital, The Air Force Medical University, 127 Changle West Road, Xi'an, 710032, China.
| |
Collapse
|
7
|
Rampinelli V, Paderno A, Conti C, Testa G, Modesti CL, Agosti E, Dohin I, Saccardo T, Vinciguerra A, Ferrari M, Schreiber A, Mattavelli D, Nicolai P, Holsinger C, Piazza C. Artificial intelligence for automatic detection and segmentation of nasal polyposis: a pilot study. Eur Arch Otorhinolaryngol 2024; 281:5815-5821. [PMID: 39001915 DOI: 10.1007/s00405-024-08809-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/18/2024] [Accepted: 06/23/2024] [Indexed: 07/15/2024]
Abstract
PURPOSE Accurate diagnosis and quantification of polyps and symptoms are pivotal for planning the therapeutic strategy of Chronic rhinosinusitis with nasal polyposis (CRSwNP). This pilot study aimed to develop an artificial intelligence (AI)-based image analysis system capable of segmenting nasal polyps from nasal endoscopy videos. METHODS Recorded nasal videoendoscopies from 52 patients diagnosed with CRSwNP between 2019 and 2022 were retrospectively analyzed. Images extracted were manually segmented on the web application Roboflow. A dataset of 342 images was generated and divided into training (80%), validation (10%), and testing (10%) sets. The Ultralytics YOLOv8.0.28 model was employed for automated segmentation. RESULTS The YOLOv8s-seg model consisted of 195 layers and required 42.4 GFLOPs for operation. When tested against the validation set, the algorithm achieved a precision of 0.91, recall of 0.839, and mean average precision at 50% IoU (mAP50) of 0.949. For the segmentation task, similar metrics were observed, including a mAP ranging from 0.675 to 0.679 for IoUs between 50% and 95%. CONCLUSIONS The study shows that a carefully trained AI algorithm can effectively identify and delineate nasal polyps in patients with CRSwNP. Despite certain limitations like the focus on CRSwNP-specific samples, the algorithm presents a promising complementary tool to existing diagnostic methods.
Collapse
Affiliation(s)
- Vittorio Rampinelli
- Unit of Otorhinolaryngology - Head and Neck Surgery, Department of Surgical and Medical Specialties, Radiological Sciences, and Public Health, School of Medicine, ASST Spedali Civili, University of Brescia, Brescia, Italy.
| | - Alberto Paderno
- Otorhinolaryngology Unit, IRCCS Humanitas Research Hospital, Milano, Italy
| | - Carlo Conti
- Unit of Otorhinolaryngology - Head and Neck Surgery, Department of Surgical and Medical Specialties, Radiological Sciences, and Public Health, School of Medicine, ASST Spedali Civili, University of Brescia, Brescia, Italy
| | - Gabriele Testa
- Unit of Otorhinolaryngology - Head and Neck Surgery, Department of Surgical and Medical Specialties, Radiological Sciences, and Public Health, School of Medicine, ASST Spedali Civili, University of Brescia, Brescia, Italy
| | - Claudia Lodovica Modesti
- Unit of Otorhinolaryngology - Head and Neck Surgery, Department of Surgical and Medical Specialties, Radiological Sciences, and Public Health, School of Medicine, ASST Spedali Civili, University of Brescia, Brescia, Italy
| | - Edoardo Agosti
- Division of Neurosurgery, Department of Surgical and Medical Specialties, Radiological Sciences, and Public Health, School of Medicine, ASST Spedali Civili, University of Brescia, Brescia, Italy
| | - Isabelle Dohin
- Unit of Otorhinolaryngology - Head and Neck Surgery, Department of Surgical and Medical Specialties, Radiological Sciences, and Public Health, School of Medicine, ASST Spedali Civili, University of Brescia, Brescia, Italy
| | - Tommaso Saccardo
- Section of Otorhinolaryngology - Head and Neck Surgery, Department of Neurosciences, University of Padova, Padova, PD, Italy
| | | | - Marco Ferrari
- Section of Otorhinolaryngology - Head and Neck Surgery, Department of Neurosciences, University of Padova, Padova, PD, Italy
| | - Alberto Schreiber
- Unit of Otorhinolaryngology - Head and Neck Surgery, Department of Surgical and Medical Specialties, Radiological Sciences, and Public Health, School of Medicine, ASST Spedali Civili, University of Brescia, Brescia, Italy
| | - Davide Mattavelli
- Unit of Otorhinolaryngology - Head and Neck Surgery, Department of Surgical and Medical Specialties, Radiological Sciences, and Public Health, School of Medicine, ASST Spedali Civili, University of Brescia, Brescia, Italy
| | - Piero Nicolai
- Section of Otorhinolaryngology - Head and Neck Surgery, Department of Neurosciences, University of Padova, Padova, PD, Italy
| | - Chris Holsinger
- Division of Head and Neck Surgery, Department of Otolaryngology, Stanford University, Palo Alto, CA, USA
| | - Cesare Piazza
- Unit of Otorhinolaryngology - Head and Neck Surgery, Department of Surgical and Medical Specialties, Radiological Sciences, and Public Health, School of Medicine, ASST Spedali Civili, University of Brescia, Brescia, Italy
| |
Collapse
|
8
|
Gata A, Raduly L, Budișan L, Bajcsi A, Ursu TM, Chira C, Dioșan L, Berindan-Neagoe I, Albu S. Machine Learning Model Predicts Postoperative Outcomes in Chronic Rhinosinusitis With Nasal Polyps. Clin Otolaryngol 2024; 49:776-784. [PMID: 39109612 DOI: 10.1111/coa.14208] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/08/2023] [Revised: 05/28/2024] [Accepted: 07/20/2024] [Indexed: 10/05/2024]
Abstract
OBJECTIVE Evaluating the possibility of predicting chronic rhinosinusitis with nasal polyps (CRSwNP) disease course using Artificial Intelligence. METHODS We prospectively included patients undergoing first endoscopic sinus surgery (ESS) for nasal polyposis. Preoperative (demographic data, blood eosinophiles, endoscopy, Lund-Mackay, SNOT-22 and depression PHQ scores) and follow-up data was standardly collected. Outcome measures included SNOT-22, PHQ-9 and endoscopy perioperative sinus endoscopy (POSE) scores and two different microRNAs (miR-125b, miR-203a-3p) from polyp tissue. Based on POSE score, three labels were created (controlled: 0-7; partial control: 8-15; or relapse: 16-32). Patients were divided into train and test groups and using Random Forest, we developed algorithms for predicting ESS related outcomes. RESULTS Based on data collected from 85 patients, the proposed Machine Learning-approach predicted whether the patient would present control, partial control or relapse of nasal polyposis at 18 months following ESS. The algorithm predicted ESS outcomes with an accuracy between 69.23% (for non-invasive input parameters) and 84.62% (when microRNAs were also included). Additionally, miR-125b significantly improved the algorithm's accuracy and ranked as one of the most important algorithm variables. CONCLUSION We propose a Machine Learning algorithm which could change the prediction of disease course in CRSwNP.
Collapse
Affiliation(s)
- Anda Gata
- Department of Otorhinolaryngology, University of Medicine and Pharmacy "Iuliu Hatieganu", Cluj Napoca, Romania
| | - Lajos Raduly
- Research Center for Functional Genomics, Biomedicine and Translational Medicine, "Iuliu Hatieganu" University of Medicine and Pharmacy, Cluj-Napoca, Romania
| | - Liviuța Budișan
- Research Center for Functional Genomics, Biomedicine and Translational Medicine, "Iuliu Hatieganu" University of Medicine and Pharmacy, Cluj-Napoca, Romania
| | - Adél Bajcsi
- Faculty of Mathematics and Computer Science, Department of Computer Science, Babes-Bolyai University, Cluj-Napoca, Romania
| | - Teodora-Maria Ursu
- Faculty of Mathematics and Computer Science, Department of Computer Science, Babes-Bolyai University, Cluj-Napoca, Romania
| | - Camelia Chira
- Faculty of Mathematics and Computer Science, Department of Computer Science, Babes-Bolyai University, Cluj-Napoca, Romania
| | - Laura Dioșan
- Faculty of Mathematics and Computer Science, Department of Computer Science, Babes-Bolyai University, Cluj-Napoca, Romania
| | - Ioana Berindan-Neagoe
- Research Center for Functional Genomics, Biomedicine and Translational Medicine, "Iuliu Hatieganu" University of Medicine and Pharmacy, Cluj-Napoca, Romania
| | - Silviu Albu
- Department of Otorhinolaryngology, University of Medicine and Pharmacy "Iuliu Hatieganu", Cluj Napoca, Romania
| |
Collapse
|
9
|
Pandey A, Kaur J, Kaushal D. Transforming ENT Healthcare: Advancements and Implications of Artificial Intelligence. Indian J Otolaryngol Head Neck Surg 2024; 76:4986-4996. [PMID: 39376323 PMCID: PMC11456104 DOI: 10.1007/s12070-024-04885-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/03/2024] [Accepted: 07/01/2024] [Indexed: 10/09/2024] Open
Abstract
This systematic literature review aims to study the role and impact of artificial intelligence (AI) in transforming Ear, Nose, and Throat (ENT) healthcare. It aims to compare and analyse literature that applied AI algorithms for ENT disease prediction and detection based on their effectiveness, methods, dataset, and performance. We have also discussed ENT specialists' challenges and AI's role in solving them. This review also discusses the challenges faced by AI researchers. This systematic review was completed using PRISMA guidelines. Data was extracted from several reputable digital databases, including PubMed, Medline, SpringerLink, Elsevier, Google Scholar, ScienceDirect, and IEEExplore. The search criteria included studies recently published between 2018 and 2024 related to the application of AI for ENT healthcare. After removing duplicate studies and quality assessments, we reviewed eligible articles and responded to the research questions. This review aims to provide a comprehensive overview of the current state of AI applications in ENT healthcare. Among the 3257 unique studies, 27 were selected as primary studies. About 62.5% of the included studies were effective in providing disease predictions. We found that Pretrained DL models are more in application than CNN algorithms when employed for ENT disease predictions. The accuracy of models ranged between 75 and 97%. We also observed the effectiveness of conversational AI models such as ChatGPT in the ENT discipline. The research in AI for ENT is advancing rapidly. Most of the models have achieved accuracy above 90%. However, the lack of good-quality data and data variability limits the overall ability of AI models to perform better for ENT disease prediction. Further research needs to be conducted while considering factors such as external validation and the issue of class imbalance.
Collapse
Affiliation(s)
- Ayushmaan Pandey
- Department of Computer Science and Engineering, Dr B R Ambedkar National Institute of Technology, G. T. Road, Jalandhar, Punjab 144008 India
| | - Jagdeep Kaur
- Department of Computer Science and Engineering, Dr B R Ambedkar National Institute of Technology, G. T. Road, Jalandhar, Punjab 144008 India
| | - Darwin Kaushal
- Department of Otorhinolaryngology and Head Neck Surgery, All India Institute of Medical Sciences, Vijaypur, Jammu, Jammu and Kashmir 180001 India
| |
Collapse
|
10
|
Hsu YC, Lin KT, Lee MS, Shen LS, Yeh TH, Lin YT. Multiple instance learning for eosinophil quantification of sinonasal histopathology images: A hierarchical determination on whole slide images. Int Forum Allergy Rhinol 2024; 14:1513-1516. [PMID: 38767581 DOI: 10.1002/alr.23365] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/28/2023] [Revised: 04/26/2024] [Accepted: 05/04/2024] [Indexed: 05/22/2024]
Abstract
KEY POINTS We proposed a hierarchical framework including an unsupervised candidate image selection and a weakly supervised patch image detection based on multiple instance learning (MIL) to effectively estimate eosinophil quantities in tissue samples from whole slide images. MIL is an innovative approach that can help deal with the variability in cell distribution detection and enable automated eosinophil quantification from sinonasal histopathological images with a high degree of accuracy. The study lays the foundation for further research and development in the field of automated histopathological image analysis, and validation on more extensive and diverse datasets will contribute to real-world application.
Collapse
Affiliation(s)
- Yen-Chi Hsu
- Department of Computer Science and Information Engineering, National Taiwan University, Taipei, Taiwan
| | - Kao-Tsung Lin
- Department of Otolaryngology, National Taiwan University Hospital, Taipei, Taiwan
| | - Ming-Sui Lee
- Department of Computer Science and Information Engineering, National Taiwan University, Taipei, Taiwan
| | - Li-Sung Shen
- Department of Computer Science and Information Engineering, National Taiwan University, Taipei, Taiwan
| | - Te-Huei Yeh
- Department of Otolaryngology, National Taiwan University Hospital, Taipei, Taiwan
| | - Yi-Tsen Lin
- Department of Otolaryngology, National Taiwan University Hospital, Taipei, Taiwan
| |
Collapse
|
11
|
Lorenzi A, Pugliese G, Maniaci A, Lechien JR, Allevi F, Boscolo-Rizzo P, Vaira LA, Saibene AM. Reliability of large language models for advanced head and neck malignancies management: a comparison between ChatGPT 4 and Gemini Advanced. Eur Arch Otorhinolaryngol 2024; 281:5001-5006. [PMID: 38795148 PMCID: PMC11392976 DOI: 10.1007/s00405-024-08746-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/16/2024] [Accepted: 05/17/2024] [Indexed: 05/27/2024]
Abstract
PURPOSE This study evaluates the efficacy of two advanced Large Language Models (LLMs), OpenAI's ChatGPT 4 and Google's Gemini Advanced, in providing treatment recommendations for head and neck oncology cases. The aim is to assess their utility in supporting multidisciplinary oncological evaluations and decision-making processes. METHODS This comparative analysis examined the responses of ChatGPT 4 and Gemini Advanced to five hypothetical cases of head and neck cancer, each representing a different anatomical subsite. The responses were evaluated against the latest National Comprehensive Cancer Network (NCCN) guidelines by two blinded panels using the total disagreement score (TDS) and the artificial intelligence performance instrument (AIPI). Statistical assessments were performed using the Wilcoxon signed-rank test and the Friedman test. RESULTS Both LLMs produced relevant treatment recommendations with ChatGPT 4 generally outperforming Gemini Advanced regarding adherence to guidelines and comprehensive treatment planning. ChatGPT 4 showed higher AIPI scores (median 3 [2-4]) compared to Gemini Advanced (median 2 [2-3]), indicating better overall performance. Notably, inconsistencies were observed in the management of induction chemotherapy and surgical decisions, such as neck dissection. CONCLUSIONS While both LLMs demonstrated the potential to aid in the multidisciplinary management of head and neck oncology, discrepancies in certain critical areas highlight the need for further refinement. The study supports the growing role of AI in enhancing clinical decision-making but also emphasizes the necessity for continuous updates and validation against current clinical standards to integrate AI into healthcare practices fully.
Collapse
Affiliation(s)
- Andrea Lorenzi
- Division of Otolaryngology, Department of Surgical Sciences, Università degli Studi di Torino, Turin, Italy
| | - Giorgia Pugliese
- Otolaryngology Unit, Santi Paolo e Carlo Hospital, Department of Health Sciences, Università degli Studi di Milano, Milan, Italy.
| | - Antonino Maniaci
- Faculty of Medicine and Surgery, "Kore" University of Enna, Enna, Italy
- International Federation of Otorhinolaryngological Societies (YO-IFOS) Head and Neck Research Group, Paris, France
| | - Jerome R Lechien
- International Federation of Otorhinolaryngological Societies (YO-IFOS) Head and Neck Research Group, Paris, France
- Department of Otolaryngology-Head and Neck Surgery, Foch Hospital, School of Medicine, University Paris Saclay, Paris, France
| | - Fabiana Allevi
- International Federation of Otorhinolaryngological Societies (YO-IFOS) Head and Neck Research Group, Paris, France
- Maxillofacial Surgery Unit, Santi Paolo e Carlo Hospital, Department of Health Sciences, Università degli Studi di Milano, Milan, Italy
| | - Paolo Boscolo-Rizzo
- Department of Medical, Surgical and Health Sciences, Section of Otolaryngology, University of Trieste, Trieste, Italy
| | - Luigi Angelo Vaira
- International Federation of Otorhinolaryngological Societies (YO-IFOS) Head and Neck Research Group, Paris, France
- Maxillofacial Surgery Operative Unit, Department of Medicine, Surgery and Pharmacy, University of Sassari, Sassari, Italy
- Biomedical Science PhD School, Biomedical Science Department, University of Sassari, Sassari, Italy
| | - Alberto Maria Saibene
- Otolaryngology Unit, Santi Paolo e Carlo Hospital, Department of Health Sciences, Università degli Studi di Milano, Milan, Italy
- International Federation of Otorhinolaryngological Societies (YO-IFOS) Head and Neck Research Group, Paris, France
| |
Collapse
|
12
|
He S, Zhao Y, Shi L, Yang X, Wang X, Luo Y, Wang M, Zhang X, Li X, Yu D, Feng X. Utilizing radiomics for differential diagnosis of inverted papilloma and chronic rhinosinusitis with polyps based on unenhanced CT scans. Sci Rep 2024; 14:19299. [PMID: 39164351 PMCID: PMC11336076 DOI: 10.1038/s41598-024-70134-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/30/2024] [Accepted: 08/13/2024] [Indexed: 08/22/2024] Open
Abstract
To evaluate whether radiomics models based on unenhanced paranasal sinuses CT images could be a useful tool for differentiating inverted papilloma (IP) from chronic rhinosinusitis with polyps (CRSwNP). This retrospective study recruited 240 patients with CRSwNP and 106 patients with IP from three centers. 253 patients from Qilu Hospital were randomly divided into the training set (n = 151) and the internal validation set (n = 102) with a ratio of 6:4. 93 patients from the other two centers were used as the external validation set. The patients with the unilateral disease (n = 115) from Qilu Hospital were selected to further develop a subgroup analysis. Lesion segmentation was manually delineated in CT images. Least absolute shrinkage and selection operator algorithm was performed for feature reduction and selection. Decision tree, support vector machine, random forest, and adaptive boosting regressor were employed to establish the differential diagnosis models. 43 radiomic features were selected for modeling. Among the models, RF achieved the best results, with an AUC of 0.998, 0.943, and 0.934 in the training set, the internal validation set, and the external validation set, respectively. In the subgroup analysis, RF achieved an AUC of 0.999 in the training set and 0.963 in the internal validation set. The proposed radiomics models offered a non-invasion and accurate differential approach between IP and CRSwNP and has some significance in guiding clinicians determining the best treatment plans, as well as predicting the prognosis.
Collapse
Affiliation(s)
- Shaojuan He
- Department of Otorhinolaryngology, Qilu Hospital of Shandong University, NHC Key Laboratory of Otorhinolaryngology (Shandong University), Jinan, China
- Department of Radiology, Qilu Hospital, Cheeloo College of Medicine, Shandong University, Jinan, China
| | - Yuxuan Zhao
- Department of Radiology, Qilu Hospital, Cheeloo College of Medicine, Shandong University, Jinan, China
| | - Lei Shi
- Department of Otorhinolaryngology, Shandong Provincial Hospital Affiliated to Shandong First Medical University, Jinan, China
| | - Xiaorong Yang
- Clinical Epidemiology Unit, Qilu Hospital of Shandong University, Jinan, China
| | - Xuehai Wang
- Department of Otorhinolaryngology, Weihai Municipal Hospital, Weihai, China
| | - Yang Luo
- Department of Otorhinolaryngology, Qilu Hospital of Shandong University, NHC Key Laboratory of Otorhinolaryngology (Shandong University), Jinan, China
| | - Mingming Wang
- Department of Otorhinolaryngology, Qilu Hospital of Shandong University, NHC Key Laboratory of Otorhinolaryngology (Shandong University), Jinan, China
| | - Xianxing Zhang
- Department of Otorhinolaryngology, Qilu Hospital of Shandong University, NHC Key Laboratory of Otorhinolaryngology (Shandong University), Jinan, China
| | - Xuezhong Li
- Department of Otorhinolaryngology, Qilu Hospital of Shandong University, NHC Key Laboratory of Otorhinolaryngology (Shandong University), Jinan, China
| | - Dexin Yu
- Department of Radiology, Qilu Hospital, Cheeloo College of Medicine, Shandong University, Jinan, China
| | - Xin Feng
- Department of Otorhinolaryngology, Qilu Hospital of Shandong University, NHC Key Laboratory of Otorhinolaryngology (Shandong University), Jinan, China.
| |
Collapse
|
13
|
Patil N, Jain S. Rhinomanometry: A Comprehensive Review of Its Applications and Advancements in Rhinology Practice. Cureus 2024; 16:e61370. [PMID: 38947630 PMCID: PMC11214531 DOI: 10.7759/cureus.61370] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/22/2024] [Accepted: 05/30/2024] [Indexed: 07/02/2024] Open
Abstract
Rhinomanometry is a pivotal diagnostic technique in rhinology, providing a quantitative assessment of nasal airflow and resistance. This review comprehensively examines the historical development, principles and clinical applications of rhinomanometry, emphasising its role in diagnosing nasal obstructions, preoperative evaluations and monitoring therapeutic outcomes. Recent advancements, including the integration with imaging technologies and the application of artificial intelligence (AI), have significantly enhanced the accuracy and utility of rhinomanometry. Despite facing challenges such as technical limitations and the need for standardisation, rhinomanometry remains an invaluable tool in both clinical and research settings. The review also explores future directions, highlighting the potential for device miniaturisation, telemedicine integration, personalised protocols and collaborative research efforts. These advancements will likely expand the accessibility, accuracy and clinical relevance of rhinomanometry, solidifying its importance in the ongoing evolution of rhinology practice.
Collapse
Affiliation(s)
- Nimisha Patil
- Otolaryngology-Head and Neck Surgery, Jawaharlal Nehru Medical College, Datta Meghe Institute of Higher Education and Research, Wardha, IND
| | - Shraddha Jain
- Otolaryngology-Head and Neck Surgery, Jawaharlal Nehru Medical College, Datta Meghe Institute of Higher Education and Research, Wardha, IND
| |
Collapse
|
14
|
Alter IL, Chan K, Lechien J, Rameau A. An introduction to machine learning and generative artificial intelligence for otolaryngologists-head and neck surgeons: a narrative review. Eur Arch Otorhinolaryngol 2024; 281:2723-2731. [PMID: 38393353 DOI: 10.1007/s00405-024-08512-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/22/2023] [Accepted: 01/25/2024] [Indexed: 02/25/2024]
Abstract
PURPOSE Despite the robust expansion of research surrounding artificial intelligence (AI) and machine learning (ML) and their applications to medicine, these methodologies often remain opaque and inaccessible to many otolaryngologists. Especially, with the increasing ubiquity of large-language models (LLMs), such as ChatGPT and their potential implementation in clinical practice, clinicians may benefit from a baseline understanding of some aspects of AI. In this narrative review, we seek to clarify underlying concepts, illustrate applications to otolaryngology, and highlight future directions and limitations of these tools. METHODS Recent literature regarding AI principles and otolaryngologic applications of ML and LLMs was reviewed via search in PubMed and Google Scholar. RESULTS Significant recent strides have been made in otolaryngology research utilizing AI and ML, across all subspecialties, including neurotology, head and neck oncology, laryngology, rhinology, and sleep surgery. Potential applications suggested by recent publications include screening and diagnosis, predictive tools, clinical decision support, and clinical workflow improvement via LLMs. Ongoing concerns regarding AI in medicine include ethical concerns around bias and data sharing, as well as the "black box" problem and limitations in explainability. CONCLUSIONS Potential implementations of AI in otolaryngology are rapidly expanding. While implementation in clinical practice remains theoretical for most of these tools, their potential power to influence the practice of otolaryngology is substantial. LEVEL OF EVIDENCE: 4
Collapse
Affiliation(s)
- Isaac L Alter
- Department of Otolaryngology-Head and Neck Surgery, Sean Parker Institute for the Voice, Weill Cornell Medical College, 240 E 59 St, New York, NY, 10022, USA
| | - Karly Chan
- Department of Otolaryngology-Head and Neck Surgery, Sean Parker Institute for the Voice, Weill Cornell Medical College, 240 E 59 St, New York, NY, 10022, USA
| | - Jérome Lechien
- Department of Otorhinolaryngology, Head and Neck Surgery, Hôpital Foch, School of Medicine, UFR Simone Veil, Université Versailles Saint-Quentin-en-Yvelines (Paris Saclay University), Paris, France
- Department of Human Anatomy and Experimental Oncology, Faculty of Medicine, UMONS Research Institute for Health and Sciences Technology, University of Mons (UMons), Mons, Belgium
| | - Anaïs Rameau
- Department of Otolaryngology-Head and Neck Surgery, Sean Parker Institute for the Voice, Weill Cornell Medical College, 240 E 59 St, New York, NY, 10022, USA.
| |
Collapse
|
15
|
Saibene AM, Allevi F, Calvo-Henriquez C, Maniaci A, Mayo-Yáñez M, Paderno A, Vaira LA, Felisati G, Craig JR. Reliability of large language models in managing odontogenic sinusitis clinical scenarios: a preliminary multidisciplinary evaluation. Eur Arch Otorhinolaryngol 2024; 281:1835-1841. [PMID: 38189967 PMCID: PMC10943141 DOI: 10.1007/s00405-023-08372-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2023] [Accepted: 11/22/2023] [Indexed: 01/09/2024]
Abstract
PURPOSE This study aimed to evaluate the utility of large language model (LLM) artificial intelligence tools, Chat Generative Pre-Trained Transformer (ChatGPT) versions 3.5 and 4, in managing complex otolaryngological clinical scenarios, specifically for the multidisciplinary management of odontogenic sinusitis (ODS). METHODS A prospective, structured multidisciplinary specialist evaluation was conducted using five ad hoc designed ODS-related clinical scenarios. LLM responses to these scenarios were critically reviewed by a multidisciplinary panel of eight specialist evaluators (2 ODS experts, 2 rhinologists, 2 general otolaryngologists, and 2 maxillofacial surgeons). Based on the level of disagreement from panel members, a Total Disagreement Score (TDS) was calculated for each LLM response, and TDS comparisons were made between ChatGPT3.5 and ChatGPT4, as well as between different evaluators. RESULTS While disagreement to some degree was demonstrated in 73/80 evaluator reviews of LLMs' responses, TDSs were significantly lower for ChatGPT4 compared to ChatGPT3.5. Highest TDSs were found in the case of complicated ODS with orbital abscess, presumably due to increased case complexity with dental, rhinologic, and orbital factors affecting diagnostic and therapeutic options. There were no statistically significant differences in TDSs between evaluators' specialties, though ODS experts and maxillofacial surgeons tended to assign higher TDSs. CONCLUSIONS LLMs like ChatGPT, especially newer versions, showed potential for complimenting evidence-based clinical decision-making, but substantial disagreement was still demonstrated between LLMs and clinical specialists across most case examples, suggesting they are not yet optimal in aiding clinical management decisions. Future studies will be important to analyze LLMs' performance as they evolve over time.
Collapse
Affiliation(s)
- Alberto Maria Saibene
- Otolaryngology Unit, Santi Paolo E Carlo Hospital, Department of Health Sciences, Università Degli Studi Di Milano, Milan, Italy.
| | - Fabiana Allevi
- Maxillofacial Surgery Unit, Santi Paolo E Carlo Hospital, Department of Health Sciences, Università Degli Studi Di Milano, Milan, Italy
| | - Christian Calvo-Henriquez
- Service of Otolaryngology, Rhinology Unit, Hospital Complex at the University of Santiago de Compostela, Santiago de Compostela, A Coruña, Spain
| | - Antonino Maniaci
- Department of Medical, Surgical Sciences and Advanced Technologies G.F. Ingrassia, University of Catania, Catania, Italy
| | - Miguel Mayo-Yáñez
- Otorhinolaryngology, Head and Neck Surgery Department, Complexo Hospitalario Universitario A Coruña (CHUAC), A Coruña, Galicia, Spain
| | - Alberto Paderno
- Department of Otorhinolaryngology, Head and Neck Surgery, University of Brescia, Brescia, Italy
| | - Luigi Angelo Vaira
- Maxillofacial Surgery Operative Unit, Department of Medicine, Surgery and Pharmacy, University of Sassari, Sassari, Italy
- Biomedical Science PhD School, Biomedical Science Department, University of Sassari, Sassari, Italy
| | - Giovanni Felisati
- Otolaryngology Unit, Santi Paolo E Carlo Hospital, Department of Health Sciences, Università Degli Studi Di Milano, Milan, Italy
| | - John R Craig
- Department of Otolaryngology-Head and Neck Surgery, Henry Ford Health, Detroit, MI, USA
| |
Collapse
|
16
|
Tsilivigkos C, Athanasopoulos M, Micco RD, Giotakis A, Mastronikolis NS, Mulita F, Verras GI, Maroulis I, Giotakis E. Deep Learning Techniques and Imaging in Otorhinolaryngology-A State-of-the-Art Review. J Clin Med 2023; 12:6973. [PMID: 38002588 PMCID: PMC10672270 DOI: 10.3390/jcm12226973] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/14/2023] [Revised: 11/02/2023] [Accepted: 11/06/2023] [Indexed: 11/26/2023] Open
Abstract
Over the last decades, the field of medicine has witnessed significant progress in artificial intelligence (AI), the Internet of Medical Things (IoMT), and deep learning (DL) systems. Otorhinolaryngology, and imaging in its various subspecialties, has not remained untouched by this transformative trend. As the medical landscape evolves, the integration of these technologies becomes imperative in augmenting patient care, fostering innovation, and actively participating in the ever-evolving synergy between computer vision techniques in otorhinolaryngology and AI. To that end, we conducted a thorough search on MEDLINE for papers published until June 2023, utilizing the keywords 'otorhinolaryngology', 'imaging', 'computer vision', 'artificial intelligence', and 'deep learning', and at the same time conducted manual searching in the references section of the articles included in our manuscript. Our search culminated in the retrieval of 121 related articles, which were subsequently subdivided into the following categories: imaging in head and neck, otology, and rhinology. Our objective is to provide a comprehensive introduction to this burgeoning field, tailored for both experienced specialists and aspiring residents in the domain of deep learning algorithms in imaging techniques in otorhinolaryngology.
Collapse
Affiliation(s)
- Christos Tsilivigkos
- 1st Department of Otolaryngology, National and Kapodistrian University of Athens, Hippocrateion Hospital, 115 27 Athens, Greece; (A.G.); (E.G.)
| | - Michail Athanasopoulos
- Department of Otolaryngology, University Hospital of Patras, 265 04 Patras, Greece; (M.A.); (N.S.M.)
| | - Riccardo di Micco
- Department of Otolaryngology and Head and Neck Surgery, Medical School of Hannover, 30625 Hannover, Germany;
| | - Aris Giotakis
- 1st Department of Otolaryngology, National and Kapodistrian University of Athens, Hippocrateion Hospital, 115 27 Athens, Greece; (A.G.); (E.G.)
| | - Nicholas S. Mastronikolis
- Department of Otolaryngology, University Hospital of Patras, 265 04 Patras, Greece; (M.A.); (N.S.M.)
| | - Francesk Mulita
- Department of Surgery, University Hospital of Patras, 265 04 Patras, Greece; (G.-I.V.); (I.M.)
| | - Georgios-Ioannis Verras
- Department of Surgery, University Hospital of Patras, 265 04 Patras, Greece; (G.-I.V.); (I.M.)
| | - Ioannis Maroulis
- Department of Surgery, University Hospital of Patras, 265 04 Patras, Greece; (G.-I.V.); (I.M.)
| | - Evangelos Giotakis
- 1st Department of Otolaryngology, National and Kapodistrian University of Athens, Hippocrateion Hospital, 115 27 Athens, Greece; (A.G.); (E.G.)
| |
Collapse
|
17
|
Wu Q, Wang X, Liang G, Luo X, Zhou M, Deng H, Zhang Y, Huang X, Yang Q. Advances in Image-Based Artificial Intelligence in Otorhinolaryngology-Head and Neck Surgery: A Systematic Review. Otolaryngol Head Neck Surg 2023; 169:1132-1142. [PMID: 37288505 DOI: 10.1002/ohn.391] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/13/2023] [Revised: 04/27/2023] [Accepted: 05/13/2023] [Indexed: 06/09/2023]
Abstract
OBJECTIVE To update the literature and provide a systematic review of image-based artificial intelligence (AI) applications in otolaryngology, highlight its advances, and propose future challenges. DATA SOURCES Web of Science, Embase, PubMed, and Cochrane Library. REVIEW METHODS Studies written in English, published between January 2020 and December 2022. Two independent authors screened the search results, extracted data, and assessed studies. RESULTS Overall, 686 studies were identified. After screening titles and abstracts, 325 full-text studies were assessed for eligibility, and 78 studies were included in this systematic review. The studies originated from 16 countries. Among these countries, the top 3 were China (n = 29), Korea (n = 8), the United States, and Japan (n = 7 each). The most common area was otology (n = 35), followed by rhinology (n = 20), pharyngology (n = 18), and head and neck surgery (n = 5). Most applications of AI in otology, rhinology, pharyngology, and head and neck surgery mainly included chronic otitis media (n = 9), nasal polyps (n = 4), laryngeal cancer (n = 12), and head and neck squamous cell carcinoma (n = 3), respectively. The overall performance of AI in accuracy, the area under the curve, sensitivity, and specificity were 88.39 ± 9.78%, 91.91 ± 6.70%, 86.93 ± 11.59%, and 88.62 ± 14.03%, respectively. CONCLUSION This state-of-the-art review aimed to highlight the increasing applications of image-based AI in otorhinolaryngology head and neck surgery. The following steps will entail multicentre collaboration to ensure data reliability, ongoing optimization of AI algorithms, and integration into real-world clinical practice. Future studies should consider 3-dimensional (3D)-based AI, such as 3D surgical AI.
Collapse
Affiliation(s)
- Qingwu Wu
- Department of Otorhinolaryngology-Head and Neck Surgery, The Third Affiliated Hospital of Sun Yat-sen University, Guangzhou, China
- Department of Allergy, The Third Affiliated Hospital of Sun Yat-sen University, Guangzhou, China
| | - Xinyue Wang
- Department of Otorhinolaryngology-Head and Neck Surgery, The Third Affiliated Hospital of Sun Yat-sen University, Guangzhou, China
| | - Guixian Liang
- Department of Otorhinolaryngology-Head and Neck Surgery, The Third Affiliated Hospital of Sun Yat-sen University, Guangzhou, China
| | - Xin Luo
- Department of Otorhinolaryngology-Head and Neck Surgery, The Third Affiliated Hospital of Sun Yat-sen University, Guangzhou, China
| | - Min Zhou
- Department of Otorhinolaryngology-Head and Neck Surgery, The Third Affiliated Hospital of Sun Yat-sen University, Guangzhou, China
- Department of Allergy, The Third Affiliated Hospital of Sun Yat-sen University, Guangzhou, China
| | - Huiyi Deng
- Department of Otorhinolaryngology-Head and Neck Surgery, The Third Affiliated Hospital of Sun Yat-sen University, Guangzhou, China
| | - Yana Zhang
- Department of Otorhinolaryngology-Head and Neck Surgery, The Third Affiliated Hospital of Sun Yat-sen University, Guangzhou, China
| | - Xuekun Huang
- Department of Otorhinolaryngology-Head and Neck Surgery, The Third Affiliated Hospital of Sun Yat-sen University, Guangzhou, China
| | - Qintai Yang
- Department of Otorhinolaryngology-Head and Neck Surgery, The Third Affiliated Hospital of Sun Yat-sen University, Guangzhou, China
- Department of Allergy, The Third Affiliated Hospital of Sun Yat-sen University, Guangzhou, China
| |
Collapse
|
18
|
Pugliese G, Maccari A, Felisati E, Felisati G, Giudici L, Rapolla C, Pisani A, Saibene AM. Are artificial intelligence large language models a reliable tool for difficult differential diagnosis? An a posteriori analysis of a peculiar case of necrotizing otitis externa. Clin Case Rep 2023; 11:e7933. [PMID: 37736475 PMCID: PMC10509342 DOI: 10.1002/ccr3.7933] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/22/2023] [Revised: 08/30/2023] [Accepted: 09/12/2023] [Indexed: 09/23/2023] Open
Abstract
Key Clinical Message Large language models have made artificial intelligence readily available to the general public and potentially have a role in healthcare; however, their use in difficult differential diagnosis is still limited, as demonstrated by a case of necrotizing otitis externa. Abstract This case report presents a peculiar case of necrotizing otitis externa (NOE) with skull base involvement which proved diagnostically challenging. The initial patient presentation and the imaging performed on the 78-year-old patient suggested a neoplastic rhinopharyngeal lesion and only after several unsuccessful biopsies the patient was transferred to our unit. Upon re-evaluation of the clinical picture, a clinical hypothesis of NOE with skull base erosion was made and confirmed by identifying Pseudomonas aeruginosa in biopsy specimens of skull base bone and external auditory canal skin. Upon diagnosis confirmation, the patient was treated with culture-oriented long-term antibiotics with complete resolution of the disease. Given the complex clinical presentation, we chose to submit a posteriori this NOE case to two large language models (LLM) to test their ability to handle difficult differential diagnoses. LLMs are easily approachable artificial intelligence tools that enable human-like interaction with the user relying upon large information databases for analyzing queries. The LLMs of choice were ChatGPT-3 and ChatGPT-4 and they were requested to analyze the case being provided with only objective clinical and imaging data.
Collapse
Affiliation(s)
- Giorgia Pugliese
- Otolaryngology UnitSanti Paolo e Carlo HospitalMilanItaly
- Department of Health SciencesUniversità degli Studi di MilanoMilanItaly
| | - Alberto Maccari
- Otolaryngology UnitSanti Paolo e Carlo HospitalMilanItaly
- Department of Health SciencesUniversità degli Studi di MilanoMilanItaly
| | - Elena Felisati
- Otolaryngology UnitSanti Paolo e Carlo HospitalMilanItaly
- Department of Health SciencesUniversità degli Studi di MilanoMilanItaly
| | - Giovanni Felisati
- Otolaryngology UnitSanti Paolo e Carlo HospitalMilanItaly
- Department of Health SciencesUniversità degli Studi di MilanoMilanItaly
| | - Leonardo Giudici
- Otolaryngology UnitSanti Paolo e Carlo HospitalMilanItaly
- Department of Health SciencesUniversità degli Studi di MilanoMilanItaly
| | - Chiara Rapolla
- Otolaryngology UnitSanti Paolo e Carlo HospitalMilanItaly
- Department of Health SciencesUniversità degli Studi di MilanoMilanItaly
| | - Antonia Pisani
- Otolaryngology UnitSanti Paolo e Carlo HospitalMilanItaly
- Department of Health SciencesUniversità degli Studi di MilanoMilanItaly
| | - Alberto Maria Saibene
- Otolaryngology UnitSanti Paolo e Carlo HospitalMilanItaly
- Department of Health SciencesUniversità degli Studi di MilanoMilanItaly
| |
Collapse
|
19
|
Massey CJ, Asokan A, Tietbohl C, Morris M, Ramakrishnan VR. Otolaryngologist perceptions of AI-based sinus CT interpretation. Am J Otolaryngol 2023; 44:103932. [PMID: 37245324 DOI: 10.1016/j.amjoto.2023.103932] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/01/2023] [Accepted: 05/13/2023] [Indexed: 05/30/2023]
Abstract
BACKGROUND Overcoming non-standardization, vagueness, and subjectivity in sinus CT radiology reports is an ongoing need, particularly in keeping with data-driven healthcare initiatives. Our aim was to explore otolaryngologists' perceptions of quantitative objective disease measures as enabled by AI-based analysis, and determine preferences for sinus CT interpretation. METHODS A multi-methods design was used. We administered a survey to American Rhinologic Society members and conducted semi-structured interviews with a purposeful sample of otolaryngologists and rhinologists from varying backgrounds, practice settings and locations during 2020-2021. Interview topics included sinus CT reports, familiarity with AI-based analysis, and potential requisites for its future implementation. Interviews were then coded for content analysis. Differences in survey responses were calculated using Chi-squared test. RESULTS 120 of 955 surveys were returned, and 19 otolaryngologists (8 rhinologists) were interviewed. Survey data revealed more trust in conventional radiologist reports, but that AI-based reports would be more systematic and comprehensive. Interviews expanded on these results. Interviewees believed that conventional sinus CT reports had limited utility due to inconsistent content. However, they described relying on them for reporting incidental extra-sinus findings. Reporting could be improved with standardization and more detailed anatomical analysis. Interviewees expressed interest in AI-derived analysis given potential for standardization, although they desired evidence of accuracy and reproducibility to gain trust in AI-based reports. CONCLUSIONS Sinus CT interpretation has shortcomings in its current state. Standardization and objectivity could be aided with deep learning-enabled quantitative analysis, although clinicians desire thorough validation to gain trust in the technology prior to its implementation.
Collapse
Affiliation(s)
- Conner J Massey
- Department of Otolaryngology - Head & Neck Surgery, University of Colorado School of Medicine, Aurora, CO, United States of America.
| | - Annapoorani Asokan
- University of Texas Southwestern Medical School, Dallas, TX, United States of America
| | - Caroline Tietbohl
- Department of Family Medicine, University of Colorado School of Medicine, Aurora, CO, United States of America; Qualitative and Mixed Methods Research Core, Adult and Child Center for Outcomes Research Delivery Science (ACCORDS), University of Colorado School of Medicine, Aurora, CO, United States of America
| | - Megan Morris
- Qualitative and Mixed Methods Research Core, Adult and Child Center for Outcomes Research Delivery Science (ACCORDS), University of Colorado School of Medicine, Aurora, CO, United States of America; Department of Internal Medicine, University of Colorado School of Medicine, Aurora, CO, United States of America
| | - Vijay R Ramakrishnan
- Department of Otolaryngology - Head & Neck Surgery, Indiana University School of Medicine, Indianapolis, IN, United States of America
| |
Collapse
|
20
|
Ma T, Wu Q, Jiang L, Zeng X, Wang Y, Yuan Y, Wang B, Zhang T. Artificial Intelligence and Machine (Deep) Learning in Otorhinolaryngology: A Bibliometric Analysis Based on VOSviewer and CiteSpace. EAR, NOSE & THROAT JOURNAL 2023:1455613231185074. [PMID: 37515527 DOI: 10.1177/01455613231185074] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/31/2023] Open
Abstract
BACKGROUND Otorhinolaryngology diseases are well suited for artificial intelligence (AI)-based interpretation. The use of AI, particularly AI based on deep learning (DL), in the treatment of human diseases is becoming more and more popular. However, there are few bibliometric analyses that have systematically studied this field. OBJECTIVE The objective of this study was to visualize the research hot spots and trends of AI and DL in ENT diseases through bibliometric analysis to help researchers understand the future development of basic and clinical research. METHODS In all, 232 articles and reviews were retrieved from The Web of Science Core Collection. Using CiteSpace and VOSviewer software, countries, institutions, authors, references, and keywords in the field were visualized and examined. RESULTS The majority of these papers came from 44 nations and 498 institutions, with China and the United States leading the way. Common diseases used by AI in ENT include otosclerosis, otitis media, nasal polyps, sinusitis, and so on. In the early years, research focused on the analysis of hearing and articulation disorders, and in recent years mainly on the diagnosis, localization, and grading of diseases. CONCLUSIONS The analysis shows the periodical hot spots and development direction of AI and DL application in ENT diseases from the time dimension. The diagnosis and prognosis of otolaryngology diseases and the analysis of otolaryngology endoscopic images have been the focus of current research and the development trend of future.
Collapse
Affiliation(s)
- Tianyu Ma
- Department of Otorhinolaryngology Head and Neck Surgery, The First Affiliated Hospital of Harbin Medical University, Harbin, China
| | - Qilong Wu
- Department of Otorhinolaryngology Head and Neck Surgery, The First Affiliated Hospital of Harbin Medical University, Harbin, China
| | - Li Jiang
- Department of Otorhinolaryngology Head and Neck Surgery, The First Affiliated Hospital of Harbin Medical University, Harbin, China
| | - Xiaoyun Zeng
- Department of Otorhinolaryngology Head and Neck Surgery, The First Affiliated Hospital of Harbin Medical University, Harbin, China
| | - Yuyao Wang
- Department of Otorhinolaryngology Head and Neck Surgery, The First Affiliated Hospital of Harbin Medical University, Harbin, China
| | - Yi Yuan
- Department of Otorhinolaryngology Head and Neck Surgery, The First Affiliated Hospital of Harbin Medical University, Harbin, China
| | - Bingxuan Wang
- Department of Otorhinolaryngology Head and Neck Surgery, The First Affiliated Hospital of Harbin Medical University, Harbin, China
| | - Tianhong Zhang
- Department of Otorhinolaryngology Head and Neck Surgery, The First Affiliated Hospital of Harbin Medical University, Harbin, China
| |
Collapse
|