1
|
Knoedler L, Hoch CC, Schaschinger T, Niederegger T, Knoedler S, Festbaum C, Ghanad I, Pooth R, Wollenberg B, Koerdt S, Doll C, Heiland M, Kehrer A. Objective and automated facial palsy grading and outcome assessment after facial palsy reanimation surgery - A prospective observational study. JOURNAL OF STOMATOLOGY, ORAL AND MAXILLOFACIAL SURGERY 2025; 126:102211. [PMID: 39732200 DOI: 10.1016/j.jormas.2024.102211] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/20/2024] [Revised: 12/22/2024] [Accepted: 12/23/2024] [Indexed: 12/30/2024]
Abstract
BACKGROUND Facial palsy (FP) is a widespread condition affecting over 3 million people annually, with a complex etiology requiring tailored, multidisciplinary management. Despite advancements, there remains a lack of reliable, automated tools for objective pre- and postoperative assessment, limiting progress in treatment optimization. This study introduces the AI Research Metrics Model (CAARISMA ® ARMM) to evaluate FP severity and outcomes following microsurgical gracilis muscle transfer. METHODS We analyzed pre- and postoperative images of 20 FP patients using CAARISMA ® ARMM, which identifies 17 facial landmarks and evaluates 1,030 parameters. CAARISMA ® ARMM calculates three indices: Facial Youthfulness Index (FYI), Facial Aesthetic Index (FAI), and Skin Quality Index (SQI). All surgical procedures were performed by the senior author. Statistical analysis compared preoperative and postoperative scores using independent t-tests and Wilcoxon-Mann-Whitney tests, with significance set at p < 0.05. RESULTS Significant improvements were observed in the FAI scores post-surgery (p < 0.001). In contrast, FYI and SQI scores did not show significant postoperative changes (p = 0.39 and p = 0.60, respectively). Significant gender differences emerged: females showed increased FYI scores postoperatively, while males exhibited a decline (p = 0.0065). Age-related variations were also significant, with younger patients showing improved SQI and older patients experiencing declines (p = 0.040). CONCLUSION The CAARISMA ® ARMM effectively captures aesthetic improvements post-reanimation. Gender and age significantly influence outcomes, underscoring the key role of personalized and adaptable assessment tools. Future studies should integrate dynamic assessments and validate the CAARISMA ® ARMM across additional patient populations. CAARISMA ® ARMM holds promise as a standardized tool in FP outcome evaluation.
Collapse
Affiliation(s)
- Leonard Knoedler
- Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin, Humboldt-Universität zu Berlin, and Berlin Institute of Health, Department of Oral and Maxillofacial Surgery, Berlin, Germany.
| | - Cosima C Hoch
- Department of Otolaryngology, Head and Neck Surgery, TUM School of Medicine and Health, Technical University of Munich, Munich, Germany
| | - Thomas Schaschinger
- Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin, Humboldt-Universität zu Berlin, and Berlin Institute of Health, Department of Oral and Maxillofacial Surgery, Berlin, Germany
| | - Tobias Niederegger
- Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin, Humboldt-Universität zu Berlin, and Berlin Institute of Health, Department of Oral and Maxillofacial Surgery, Berlin, Germany
| | - Samuel Knoedler
- Department of Plastic, Hand, and Reconstructive Surgery, University Hospital Regensburg, Regensburg, Germany
| | - Christian Festbaum
- Department of Plastic, Hand, and Reconstructive Surgery, University Hospital Regensburg, Regensburg, Germany
| | - Iman Ghanad
- Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin, Humboldt-Universität zu Berlin, and Berlin Institute of Health, Department of Oral and Maxillofacial Surgery, Berlin, Germany
| | - Rainer Pooth
- Clinical Research and Development, ICA Aesthetic Navigation, Frankfurt am Main, Germany
| | - Barbara Wollenberg
- Department of Otolaryngology, Head and Neck Surgery, TUM School of Medicine and Health, Technical University of Munich, Munich, Germany
| | - Steffen Koerdt
- Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin, Humboldt-Universität zu Berlin, and Berlin Institute of Health, Department of Oral and Maxillofacial Surgery, Berlin, Germany
| | - Christian Doll
- Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin, Humboldt-Universität zu Berlin, and Berlin Institute of Health, Department of Oral and Maxillofacial Surgery, Berlin, Germany
| | - Max Heiland
- Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin, Humboldt-Universität zu Berlin, and Berlin Institute of Health, Department of Oral and Maxillofacial Surgery, Berlin, Germany
| | - Andreas Kehrer
- Department of Plastic, Hand, and Reconstructive Surgery, University Hospital Regensburg, Regensburg, Germany
| |
Collapse
|
2
|
Guo X, Chen J, Lin P, Lu Q, Kou T, Li K, Yang S, Shen W. Development and validation of a collaborative framework for assessment of peripheral facial paralysis using facial image regions of interest. Acta Otolaryngol 2025:1-11. [PMID: 40338664 DOI: 10.1080/00016489.2025.2502562] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/26/2025] [Revised: 04/29/2025] [Accepted: 05/01/2025] [Indexed: 05/10/2025]
Abstract
BACKGROUND While accurate evaluation of PFP is crucial for determining optimal treatment strategies, current clinical assessments rely heavily on subjective evaluations, leading to considerable variability between inter- and intra-observer ratings. OBJECTIVE This study aimed to develop and validate a collaborative framework for evaluating PFP based on regions of interest in facial images. METHODS We developed and tested two approaches: (1) a collaborative framework integrating image interpretation techniques (representation learning via CNN) with predefined handcrafted features based on regions of interest in facial images, and (2) a convolutional neural network (CNN) model trained exclusively on full-face patient images. The diagnostic accuracy of both systems was evaluated using a test set and compared with otologists' assessments. RESULTS The collaborative framework achieved a mean Area Under the Curve (AUC) of 0.92 for PFP prediction in the test set, surpassing the 0.76 AUC achieved by the CNN trained on full-face images. The framework's performance matched that of experienced otologists (accuracy: 80.0% vs. 77.2%; sensitivity: 85.3% vs. 77.7%). Moreover, system assistance improved primary clinicians' mean accuracy by 17.7 percentage points. CONCLUSIONS These findings demonstrate that our collaborative framework-based automated diagnosis system can effectively assist clinicians in PFP diagnosis.
Collapse
Affiliation(s)
- Xiaoyan Guo
- Senior Department of Otolaryngology Head and Neck Surgery, the 6th Medical Center of Chinese PLA General Hospital & Chinese PLA Medical School National Clinical Research Center for Otolaryngologic Diseases, State Key Laboratory of Hearing and Balance Science, Beijing, China
| | - Jiyue Chen
- Senior Department of Otolaryngology Head and Neck Surgery, the 6th Medical Center of Chinese PLA General Hospital & Chinese PLA Medical School National Clinical Research Center for Otolaryngologic Diseases, State Key Laboratory of Hearing and Balance Science, Beijing, China
| | - Pingju Lin
- Institute of Interdisciplinary Medicine and Engineering, University of Southern California, Keck School of Medicine, Los Angeles, California, America
| | - Qi Lu
- Senior Department of Otolaryngology Head and Neck Surgery, the 6th Medical Center of Chinese PLA General Hospital & Chinese PLA Medical School National Clinical Research Center for Otolaryngologic Diseases, State Key Laboratory of Hearing and Balance Science, Beijing, China
| | - Ting Kou
- Department of Otolaryngology Head and Neck Surgery, General Hospital of Central Theater Command, Wuhan, China
| | - Kun Li
- Senior Department of Otolaryngology Head and Neck Surgery, the 6th Medical Center of Chinese PLA General Hospital & Chinese PLA Medical School National Clinical Research Center for Otolaryngologic Diseases, State Key Laboratory of Hearing and Balance Science, Beijing, China
| | - Shiming Yang
- Senior Department of Otolaryngology Head and Neck Surgery, the 6th Medical Center of Chinese PLA General Hospital & Chinese PLA Medical School National Clinical Research Center for Otolaryngologic Diseases, State Key Laboratory of Hearing and Balance Science, Beijing, China
| | - Weidong Shen
- Senior Department of Otolaryngology Head and Neck Surgery, the 6th Medical Center of Chinese PLA General Hospital & Chinese PLA Medical School National Clinical Research Center for Otolaryngologic Diseases, State Key Laboratory of Hearing and Balance Science, Beijing, China
| |
Collapse
|
3
|
Knoedler S, Alfertshofer M, Simon S, Panayi AC, Saadoun R, Palackic A, Falkner F, Hundeshagen G, Kauke-Navarro M, Vollbach FH, Bigdeli AK, Knoedler L. Turn Your Vision into Reality-AI-Powered Pre-operative Outcome Simulation in Rhinoplasty Surgery. Aesthetic Plast Surg 2024; 48:4833-4838. [PMID: 38777929 PMCID: PMC11739225 DOI: 10.1007/s00266-024-04043-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/06/2024] [Accepted: 03/28/2024] [Indexed: 05/25/2024]
Abstract
BACKGROUND The increasing demand and changing trends in rhinoplasty surgery emphasize the need for effective doctor-patient communication, for which Artificial Intelligence (AI) could be a valuable tool in managing patient expectations during pre-operative consultations. OBJECTIVE To develop an AI-based model to simulate realistic postoperative rhinoplasty outcomes. METHODS We trained a Generative Adversarial Network (GAN) using 3,030 rhinoplasty patients' pre- and postoperative images. One-hundred-one study participants were presented with 30 pre-rhinoplasty patient photographs followed by an image set consisting of the real postoperative versus the GAN-generated image and asked to identify the GAN-generated image. RESULTS The study sample (48 males, 53 females, mean age of 31.6 ± 9.0 years) correctly identified the GAN-generated images with an accuracy of 52.5 ± 14.3%. Male study participants were more likely to identify the AI-generated images compared with female study participants (55.4% versus 49.6%; p = 0.042). CONCLUSION We presented a GAN-based simulator for rhinoplasty outcomes which used pre-operative patient images to predict accurate representations that were not perceived as different from real postoperative outcomes. LEVEL OF EVIDENCE III This journal requires that authors assign a level of evidence to each article. For a full description of these Evidence-Based Medicine ratings, please refer to the Table of Contents or the online Instructions to Authors www.springer.com/00266 .
Collapse
Affiliation(s)
- Samuel Knoedler
- Division of Plastic Surgery, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, USA
- Department of Plastic and Hand Surgery, Klinikum Rechts der Isar, Technical University of Munich, Munich, Germany
| | - Michael Alfertshofer
- Department of Plastic and Hand Surgery, Klinikum Rechts der Isar, Technical University of Munich, Munich, Germany
- Department of Oromaxillofacial Surgery, Ludwig-Maximilians University Munich, Munich, Germany
| | - Siddharth Simon
- Department of Oromaxillofacial Surgery, Ludwig-Maximilians University Munich, Munich, Germany
| | - Adriana C Panayi
- Department of Hand-, Plastic and Reconstructive Surgery, Microsurgery, Burn Center, BG Center Ludwigshafen, University of Heidelberg, Ludwigshafen, Germany
- Department of Hand and Plastic Surgery, University of Heidelberg, Heidelberg, Germany
| | - Rakan Saadoun
- Department of Plastic Surgery, University of Pittsburgh, Pittsburgh, PA, USA
| | - Alen Palackic
- Department of Hand-, Plastic and Reconstructive Surgery, Microsurgery, Burn Center, BG Center Ludwigshafen, University of Heidelberg, Ludwigshafen, Germany
- Department of Hand and Plastic Surgery, University of Heidelberg, Heidelberg, Germany
| | - Florian Falkner
- Department of Hand-, Plastic and Reconstructive Surgery, Microsurgery, Burn Center, BG Center Ludwigshafen, University of Heidelberg, Ludwigshafen, Germany
- Department of Hand and Plastic Surgery, University of Heidelberg, Heidelberg, Germany
| | - Gabriel Hundeshagen
- Department of Hand-, Plastic and Reconstructive Surgery, Microsurgery, Burn Center, BG Center Ludwigshafen, University of Heidelberg, Ludwigshafen, Germany
- Department of Hand and Plastic Surgery, University of Heidelberg, Heidelberg, Germany
| | - Martin Kauke-Navarro
- Department of Surgery, Division of Plastic Surgery, Yale School of Medicine, New Haven, CT, USA
| | - Felix H Vollbach
- Department of Hand-, Plastic and Reconstructive Surgery, Microsurgery, Burn Center, BG Center Ludwigshafen, University of Heidelberg, Ludwigshafen, Germany
- Department of Hand and Plastic Surgery, University of Heidelberg, Heidelberg, Germany
| | - Amir K Bigdeli
- Department of Hand-, Plastic and Reconstructive Surgery, Microsurgery, Burn Center, BG Center Ludwigshafen, University of Heidelberg, Ludwigshafen, Germany
- Department of Hand and Plastic Surgery, University of Heidelberg, Heidelberg, Germany
| | - Leonard Knoedler
- Department of Surgery, Division of Plastic Surgery, Yale School of Medicine, New Haven, CT, USA.
- Department of Plastic, Hand and Reconstructive Surgery, University Hospital Regensburg, Regensburg, Germany.
| |
Collapse
|
4
|
Kiwan O, Al-Kalbani M, Rafie A, Hijazi Y. Artificial intelligence in plastic surgery, where do we stand? JPRAS Open 2024; 42:234-243. [PMID: 39435018 PMCID: PMC11491964 DOI: 10.1016/j.jpra.2024.09.003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/22/2024] [Accepted: 09/05/2024] [Indexed: 10/23/2024] Open
Abstract
Since the pandemic, artificial intelligence (AI) has been integrated into several fields and everyday life as well. Healthcare is not an exception. Plastic surgery is a key focus area of this technological revolution, with hundreds of studies and reviews already published on the use of AI in plastics. This review summarizes the entirety of the available literature from 2020 to provide a comprehensive overview on AI innovation in plastic surgery. A systematic literature review (following the PRISMA guidelines) of all studies and papers that examined the application of AI in plastic surgery was carried out using Medline, Cochrane, Embase, and Google Scholar. Outcomes of interest included the growing role of AI in clinical consultations, diagnosing potentials, surgical planning, intraoperative, and post-operative uses. Ninety-six studies were included in this review; six examined the role of AI in consultations, fifteen used AI in diagnoses and assessments, seventeen involved AI in surgical planning, fifteen reported on AI use in post-operative predictions and management, and nine involved administrations and documentation. This comprehensive review of available literature found AI to be capable of transforming care throughout the entire patient journey. Certain challenges and concerns persist, but a collaborative effort can solve these issues to bring about a new era of medicine, where AI aids doctors in the pursuit of optimal patient care.
Collapse
Affiliation(s)
- Omar Kiwan
- Faculty of Biology, Medicine and Health, University of Manchester, United Kingdom
| | - Mohammed Al-Kalbani
- Faculty of Biology, Medicine and Health, University of Manchester, United Kingdom
| | - Arash Rafie
- Plastic and Reconstructive Department, Lancashire Teaching Hospitals NHS Foundation, United Kingdom
| | - Yasser Hijazi
- Plastic and Reconstructive Department, Lancashire Teaching Hospitals NHS Foundation, United Kingdom
| |
Collapse
|
5
|
Stephanian B, Karki S, Debnath K, Saltychev M, Rossi-Meyer M, Kandathil CK, Most SP. Role of Artificial Intelligence and Machine Learning in Facial Aesthetic Surgery: A Systematic Review. Facial Plast Surg Aesthet Med 2024; 26:679-705. [PMID: 39591584 DOI: 10.1089/fpsam.2024.0204] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2024] Open
Abstract
Objective: To analyze the quality of artificial intelligence (AI) and machine learning (ML) tools developed for facial aesthetic surgery. Data Sources: Medline, Embase, CINAHL, Central, Scopus, and Web of Science databases were searched in February 2024. Study Selection: All original research in adults undergoing facial aesthetic surgery was included. Pilot reports, case reports, case series (n < 5), conference proceedings, letters (except research letters and brief reports), and editorials were excluded. Main Outcomes and Measures: Facial aesthetic surgery procedures employing AI and ML tools to measure improvements in diagnostic accuracy, predictive outcomes, precision patient counseling, and the scope of facial aesthetic surgery procedures where these tools have been implemented. Results: Out of 494 initial studies, 66 were included in the qualitative analysis. Of these, 42 (63.6%) were of "good" quality, 20 (30.3%) were of "fair" quality, and 4 (6.1%) were of "poor" quality. Conclusion: AI improves diagnostic accuracy, predictive capabilities, patient counseling, and facial aesthetic surgery treatment planning.
Collapse
Affiliation(s)
| | - Sabin Karki
- Indiana University School of Medicine, Indianapolis Indiana, USA
| | | | - Mikhail Saltychev
- Department of Physical and Rehabilitation Medicine, Turku University Hospital and University of Turku, Turku, Finland
| | - Monica Rossi-Meyer
- Division of Facial Plastic and Reconstructive Surgery, Stanford University School of Medicine, Stanford, California, USA
| | - Cherian Kurian Kandathil
- Division of Facial Plastic and Reconstructive Surgery, Stanford University School of Medicine, Stanford, California, USA
| | - Sam P Most
- Division of Facial Plastic and Reconstructive Surgery, Stanford University School of Medicine, Stanford, California, USA
| |
Collapse
|
6
|
Knoedler L, Alfertshofer M, Geldner B, Sherwani K, Knoedler S, Kauke-Navarro M, Safi AF. Truth Lies in the Depths: Novel Insights into Facial Aesthetic Measurements from a U.S. Survey Panel. Aesthetic Plast Surg 2024; 48:3711-3717. [PMID: 38772944 DOI: 10.1007/s00266-024-04022-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/12/2024] [Accepted: 03/11/2024] [Indexed: 05/23/2024]
Abstract
BACKGROUND Aesthetic facial bone surgery and facial implantology expand the boundaries of conventional facial surgery that focus on facial soft tissue. This study aimed to reveal novel aesthetic facial measurements to provide tailored treatment concepts and advance patient care. METHODS A total of n=101 study participants (46 females and 55 males) were presented with 120 patient portraits (frontal images in natural head posture; 60 females and 60 males) and asked to assess the facial attractiveness (scale 0-10; "How attractive do you find the person in the image?") and the model capability score (MCS; scale 0-10; "How likely do you think the person in the image could pursue a modelling career?"). For each frontal photograph, defined facial measurements and ratios were taken to analyse their relationship with the perception of facial attractiveness and MCS. RESULTS The overall attractiveness rating was 4.3 ± 1.1, while the mean MCS was 3.4 ± 1.1. In young males, there was a significant correlation between attractiveness and the zygoma-mandible angle (ZMA)2 (r= - 0.553; p= 0.011). In young and middle-aged females, MCS was significantly correlated with facial width (FW)1-FW2 ratio (r= 0.475; p= 0.034). For all male individuals, a ZMA1 value of 171.79 degrees (Y= 0.313; p= 0.024) was the most robust cut-off to determine facial attractiveness. The majority of human evaluators (n=62; 51.7%) considered facial implants a potential treatment to improve the patient's facial attractiveness. CONCLUSION This study introduced novel metrics of facial attractiveness, focusing on the facial skeleton. Our findings emphasized the significance of zygomatic measurements and mandibular projections for facial aesthetics, with FI representing a promising surgical approach to optimize facial aesthetics. LEVEL OF EVIDENCE IV This journal requires that authors assign a level of evidence to each article. For a full description of these Evidence-Based Medicine ratings, please refer to the Table of Contents or the online Instructions to Authors www.springer.com/00266 .
Collapse
Affiliation(s)
- Leonard Knoedler
- Department of Surgery, Division of Plastic and Reconstructive Surgery, Yale School of Medicine, New Haven, CT, USA
| | - Michael Alfertshofer
- Division of Hand, Plastic and Aesthetic Surgery, Ludwig-Maximilians-University Munich, Munich, Germany
| | - Benedikt Geldner
- Department of Hand-, Plastic and Reconstructive Surgery, Microsurgery, Burn Center, BG Center Ludwigshafen, University of Heidelberg, Ludwigshafen, Germany
| | - Khalil Sherwani
- Department of Hand-, Plastic and Reconstructive Surgery, Microsurgery, Burn Center, BG Center Ludwigshafen, University of Heidelberg, Ludwigshafen, Germany
| | - Samuel Knoedler
- Department of Surgery, Division of Plastic and Reconstructive Surgery, Yale School of Medicine, New Haven, CT, USA
| | - Martin Kauke-Navarro
- Department of Surgery, Division of Plastic and Reconstructive Surgery, Yale School of Medicine, New Haven, CT, USA.
| | - Ali-Farid Safi
- Faculty of Medicine, University of Bern, Bern, Switzerland.
- Center for Cranio-Maxillo-Facial Surgery, Bern, Switzerland.
| |
Collapse
|
7
|
Zhang Y, Gao W, Yu H, Dong J, Xia Y. Artificial Intelligence-Based Facial Palsy Evaluation: A Survey. IEEE Trans Neural Syst Rehabil Eng 2024; 32:3116-3134. [PMID: 39172615 DOI: 10.1109/tnsre.2024.3447881] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 08/24/2024]
Abstract
Facial palsy evaluation (FPE) aims to assess facial palsy severity of patients, which plays a vital role in facial functional treatment and rehabilitation. The traditional manners of FPE are based on subjective judgment by clinicians, which may ultimately depend on individual experience. Compared with subjective and manual evaluation, objective and automated evaluation using artificial intelligence (AI) has shown great promise in improving traditional manners and recently received significant attention. The motivation of this survey paper is mainly to provide a systemic review that would guide researchers in conducting their future research work and thus make automatic FPE applicable in real-life situations. In this survey, we comprehensively review the state-of-the-art development of AI-based FPE. First, we summarize the general pipeline of FPE systems with the related background introduction. Following this pipeline, we introduce the existing public databases and give the widely used objective evaluation metrics of FPE. In addition, the preprocessing methods in FPE are described. Then, we provide an overview of selected key publications from 2008 and summarize the state-of-the-art methods of FPE that are designed based on AI techniques. Finally, we extensively discuss the current research challenges faced by FPE and provide insights about potential future directions for advancing state-of-the-art research in this field.
Collapse
|
8
|
Souza S, Bhethanabotla RM, Mohan S. Applications of artificial intelligence in facial plastic and reconstructive surgery: a systematic review. Curr Opin Otolaryngol Head Neck Surg 2024; 32:222-233. [PMID: 38695544 DOI: 10.1097/moo.0000000000000975] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/06/2024]
Abstract
PURPOSE OF REVIEW Arguably one of the most disruptive innovations in medicine of the past decade, artificial intelligence is dramatically changing how healthcare is practiced today. A systematic review of the most recent artificial intelligence advances in facial plastic surgery is presented for surgeons to stay abreast of the latest in our field. RECENT FINDINGS Artificial intelligence applications developed for use in perioperative patient evaluation and management, education, and research in facial plastic surgery are highlighted. Selected themes include automated facial analysis with landmark detection, automated facial palsy grading and emotional assessment, generation of artificial facial profiles for testing and model training, automated postoperative patient communications, and improving ethnicity-sensitive facial morphometry norms. Inherent bias can exist in artificial intelligence models, and care must be taken to utilize algorithms trained with diverse datasets. SUMMARY Artificial intelligence tools are helping clinicians provide more standardized, objective, and efficient care to their patients. Increasing surgeon awareness of available tools, and their widespread implementation into clinical workflows are the next frontier. Ethical considerations must also shape the adoption of any artificial intelligence functionality. As artificial intelligence applications become a fixture in medicine, surgeons must employ them effectively to stay at the vanguard of modern medicine.
Collapse
Affiliation(s)
- Spenser Souza
- Department of Otolaryngology-Head and Neck Surgery, University of California, San Francisco, San Francisco, California
| | - Rohith M Bhethanabotla
- Department of Otolaryngology-Head and Neck Surgery, University of California, San Francisco, San Francisco, California
| | - Suresh Mohan
- Division of Otolaryngology, Yale School of Medicine, New Haven, Connecticut, USA
| |
Collapse
|
9
|
Knoedler L, Vogt A, Alfertshofer M, Camacho JM, Najafali D, Kehrer A, Prantl L, Iske J, Dean J, Hoefer S, Knoedler C, Knoedler S. The law code of ChatGPT and artificial intelligence-how to shield plastic surgeons and reconstructive surgeons against Justitia's sword. Front Surg 2024; 11:1390684. [PMID: 39132668 PMCID: PMC11312379 DOI: 10.3389/fsurg.2024.1390684] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/23/2024] [Accepted: 07/02/2024] [Indexed: 08/13/2024] Open
Abstract
Large Language Models (LLMs) like ChatGPT 4 (OpenAI), Claude 2 (Anthropic), and Llama 2 (Meta AI) have emerged as novel technologies to integrate artificial intelligence (AI) into everyday work. LLMs in particular, and AI in general, carry infinite potential to streamline clinical workflows, outsource resource-intensive tasks, and disburden the healthcare system. While a plethora of trials is elucidating the untapped capabilities of this technology, the sheer pace of scientific progress also takes its toll. Legal guidelines hold a key role in regulating upcoming technologies, safeguarding patients, and determining individual and institutional liabilities. To date, there is a paucity of research work delineating the legal regulations of Language Models and AI for clinical scenarios in plastic and reconstructive surgery. This knowledge gap poses the risk of lawsuits and penalties against plastic surgeons. Thus, we aim to provide the first overview of legal guidelines and pitfalls of LLMs and AI for plastic surgeons. Our analysis encompasses models like ChatGPT, Claude 2, and Llama 2, among others, regardless of their closed or open-source nature. Ultimately, this line of research may help clarify the legal responsibilities of plastic surgeons and seamlessly integrate such cutting-edge technologies into the field of PRS.
Collapse
Affiliation(s)
- Leonard Knoedler
- Department of Plastic, Hand, and Reconstructive Surgery, University Hospital Regensburg, Regensburg, Germany
| | - Alexander Vogt
- Corporate/M&A Department, Dentons Europe (Germany) GmbH & Co. KG, Munich, Germany
- UC Law San Francisco (Formerly UC Hastings), San Francisco, CA, United States
| | - Michael Alfertshofer
- Division of Hand, Plastic and Aesthetic Surgery, Ludwig-Maximilians-University Munich, Munich, Germany
| | - Justin M. Camacho
- College of Medicine, Drexel University, Philadelphia, PA, United States
| | - Daniel Najafali
- Carle Illinois College of Medicine, University of Illinois Urbana-Champaign, Urbana, IL, United States
| | - Andreas Kehrer
- Department of Plastic, Hand, and Reconstructive Surgery, University Hospital Regensburg, Regensburg, Germany
| | - Lukas Prantl
- Department of Plastic, Hand, and Reconstructive Surgery, University Hospital Regensburg, Regensburg, Germany
| | - Jasper Iske
- Department of Cardiothoracic and Vascular Surgery, Deutsches Herzzentrum der Charité (DHZC), Berlin, Germany
| | - Jillian Dean
- School of Medicine, University of Pittsburgh, Pittsburgh, PA, United States
| | | | - Christoph Knoedler
- Faculty of Applied Social and Health Sciences, Regensburg University of Applied Sciences, Regensburg, Germany
| | - Samuel Knoedler
- Department of Plastic, Hand, and Reconstructive Surgery, University Hospital Regensburg, Regensburg, Germany
| |
Collapse
|
10
|
Karimov Z, Allahverdiyev I, Agayarov OY, Demir D, Almuradova E. ChatGPT vs UpToDate: comparative study of usefulness and reliability of Chatbot in common clinical presentations of otorhinolaryngology-head and neck surgery. Eur Arch Otorhinolaryngol 2024; 281:2145-2151. [PMID: 38217726 PMCID: PMC10942922 DOI: 10.1007/s00405-023-08423-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/02/2023] [Accepted: 12/18/2023] [Indexed: 01/15/2024]
Abstract
PURPOSE The usage of Chatbots as a kind of Artificial Intelligence in medicine is getting to increase in recent years. UpToDate® is another well-known search tool established on evidence-based knowledge and is used daily by doctors worldwide. In this study, we aimed to investigate the usefulness and reliability of ChatGPT compared to UpToDate in Otorhinolaryngology and Head and Neck Surgery (ORL-HNS). MATERIALS AND METHODS ChatGPT-3.5 and UpToDate were interrogated for the management of 25 common clinical case scenarios (13 males/12 females) recruited from literature considering the daily observation at the Department of Otorhinolaryngology of Ege University Faculty of Medicine. Scientific references for the management were requested for each clinical case. The accuracy of the references in the ChatGPT answers was assessed on a 0-2 scale and the usefulness of the ChatGPT and UpToDate answers was assessed with 1-3 scores by reviewers. UpToDate and ChatGPT 3.5 responses were compared. RESULTS ChatGPT did not give references in some questions in contrast to UpToDate. Information on the ChatGPT was limited to 2021. UpToDate supported the paper with subheadings, tables, figures, and algorithms. The mean accuracy score of references in ChatGPT answers was 0.25-weak/unrelated. The median (Q1-Q3) was 1.00 (1.25-2.00) for ChatGPT and 2.63 (2.75-3.00) for UpToDate, the difference was statistically significant (p < 0.001). UpToDate was observed more useful and reliable than ChatGPT. CONCLUSIONS ChatGPT has the potential to support the physicians to find out the information but our results suggest that ChatGPT needs to be improved to increase the usefulness and reliability of medical evidence-based knowledge.
Collapse
Affiliation(s)
- Ziya Karimov
- Medicine Program, Ege University Faculty of Medicine, 35100, Izmir, Türkiye.
| | - Irshad Allahverdiyev
- Medicine Program, Istanbul University, Istanbul Faculty of Medicine, Istanbul, Türkiye
| | - Ozlem Yagiz Agayarov
- Department of Otolaryngology-Head and Neck Surgery, Izmir Tepecik Education and Research Hospital, Health Sciences University, Izmir, Türkiye
| | - Dogukan Demir
- Department of Otolaryngology-Head and Neck Surgery, Izmir Tepecik Education and Research Hospital, Health Sciences University, Izmir, Türkiye
| | - Elvina Almuradova
- Department of Medical Oncology, Ege University Faculty of Medicine, Izmir, Türkiye
- Department of Oncology, Medicana International Hospital, Izmir, Türkiye
| |
Collapse
|
11
|
Knoedler L, Alfertshofer M, Knoedler S, Hoch CC, Funk PF, Cotofana S, Maheta B, Frank K, Brébant V, Prantl L, Lamby P. Pure Wisdom or Potemkin Villages? A Comparison of ChatGPT 3.5 and ChatGPT 4 on USMLE Step 3 Style Questions: Quantitative Analysis. JMIR MEDICAL EDUCATION 2024; 10:e51148. [PMID: 38180782 PMCID: PMC10799278 DOI: 10.2196/51148] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/22/2023] [Revised: 09/30/2023] [Accepted: 10/20/2023] [Indexed: 01/06/2024]
Abstract
BACKGROUND The United States Medical Licensing Examination (USMLE) has been critical in medical education since 1992, testing various aspects of a medical student's knowledge and skills through different steps, based on their training level. Artificial intelligence (AI) tools, including chatbots like ChatGPT, are emerging technologies with potential applications in medicine. However, comprehensive studies analyzing ChatGPT's performance on USMLE Step 3 in large-scale scenarios and comparing different versions of ChatGPT are limited. OBJECTIVE This paper aimed to analyze ChatGPT's performance on USMLE Step 3 practice test questions to better elucidate the strengths and weaknesses of AI use in medical education and deduce evidence-based strategies to counteract AI cheating. METHODS A total of 2069 USMLE Step 3 practice questions were extracted from the AMBOSS study platform. After including 229 image-based questions, a total of 1840 text-based questions were further categorized and entered into ChatGPT 3.5, while a subset of 229 questions were entered into ChatGPT 4. Responses were recorded, and the accuracy of ChatGPT answers as well as its performance in different test question categories and for different difficulty levels were compared between both versions. RESULTS Overall, ChatGPT 4 demonstrated a statistically significant superior performance compared to ChatGPT 3.5, achieving an accuracy of 84.7% (194/229) and 56.9% (1047/1840), respectively. A noteworthy correlation was observed between the length of test questions and the performance of ChatGPT 3.5 (ρ=-0.069; P=.003), which was absent in ChatGPT 4 (P=.87). Additionally, the difficulty of test questions, as categorized by AMBOSS hammer ratings, showed a statistically significant correlation with performance for both ChatGPT versions, with ρ=-0.289 for ChatGPT 3.5 and ρ=-0.344 for ChatGPT 4. ChatGPT 4 surpassed ChatGPT 3.5 in all levels of test question difficulty, except for the 2 highest difficulty tiers (4 and 5 hammers), where statistical significance was not reached. CONCLUSIONS In this study, ChatGPT 4 demonstrated remarkable proficiency in taking the USMLE Step 3, with an accuracy rate of 84.7% (194/229), outshining ChatGPT 3.5 with an accuracy rate of 56.9% (1047/1840). Although ChatGPT 4 performed exceptionally, it encountered difficulties in questions requiring the application of theoretical concepts, particularly in cardiology and neurology. These insights are pivotal for the development of examination strategies that are resilient to AI and underline the promising role of AI in the realm of medical education and diagnostics.
Collapse
Affiliation(s)
- Leonard Knoedler
- Department of Plastic, Hand and Reconstructive Surgery, University Hospital Regensburg, Regensburg, Germany
| | - Michael Alfertshofer
- Division of Hand, Plastic and Aesthetic Surgery, Ludwig-Maximilians University Munich, Munich, Germany
| | - Samuel Knoedler
- Department of Plastic, Hand and Reconstructive Surgery, University Hospital Regensburg, Regensburg, Germany
- Division of Plastic Surgery, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, United States
| | - Cosima C Hoch
- Department of Otolaryngology, Head and Neck Surgery, School of Medicine, Technical University of Munich, Munich, Germany
| | - Paul F Funk
- Department of Otolaryngology, Head and Neck Surgery, University Hospital Jena, Friedrich Schiller University Jena, Jena, Germany
| | - Sebastian Cotofana
- Department of Dermatology, Erasmus Hospital, Rotterdam, Netherlands
- Centre for Cutaneous Research, Blizard Institute, Queen Mary University of London, London, United Kingdom
| | - Bhagvat Maheta
- College of Medicine, California Northstate University, Elk Grove, CA, United States
| | | | - Vanessa Brébant
- Department of Plastic, Hand and Reconstructive Surgery, University Hospital Regensburg, Regensburg, Germany
| | - Lukas Prantl
- Department of Plastic, Hand and Reconstructive Surgery, University Hospital Regensburg, Regensburg, Germany
| | - Philipp Lamby
- Department of Plastic, Hand and Reconstructive Surgery, University Hospital Regensburg, Regensburg, Germany
| |
Collapse
|
12
|
Knoedler S, Knoedler L, Hoch CC, Kauke-Navarro M, Kehrer A, Friedman L, Prantl L, Machens HG, Orgill DP, Panayi AC. An ACS-NSQIP Data Analysis of 30-Day Outcomes Following Surgery for Bell's Palsy. J Craniofac Surg 2024; 35:23-28. [PMID: 37695075 PMCID: PMC10841222 DOI: 10.1097/scs.0000000000009739] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/22/2023] [Accepted: 07/31/2023] [Indexed: 09/12/2023] Open
Abstract
BACKGROUND There exists a paucity of large-scale, multi-institutional studies that investigate the outcomes of surgery for Bell's palsy (BP). Here, we utilize a large, multi-institutional database to study the risk factors and early-stage outcomes following surgical procedures in BP. METHODS We reviewed the American College of Surgeons National Surgical Quality Improvement Program database (2008-2019) to identify patients who underwent surgery for the diagnosis of BP. We extracted data on comorbidities and preoperative blood values, and 30-day postoperative outcomes. RESULTS Two hundred fifty-seven patients who underwent surgery for BP symptoms over the 12-year review period were identified. Muscle grafts (n=50; 19%) and fascial grafts (n=48; 19%) accounted for the majority of procedures. The most common comorbidities were hypertension (n=89; 35%) and obesity (n=79; 31%). Complications occurred in 26 (10.1%) cases. Additionally, length of hospital stay was significantly associated with both surgical and medical complications (3.9±4.7 versus 1.5±2.0; P <0.01) and (3.2±3.8 versus 1.4±2.0; P <0.01), respectively. Preoperative creatinine, blood urea nitrogen, and alkaline phosphatase were identified as potential predictors of poor postoperative outcomes. CONCLUSION Based on multi-institutional analysis, complication rates following surgery for BP were found to be overall low and seen to correlate with length of hospital stay. Reoperations and readmissions were the most frequent complications after surgery for BP. The preoperative evaluation of routine laboratory values may help refine patient eligibility and risk stratification. In addition, our findings call for future large-scale prospective studies in the field of facial palsy surgery to further improve the quality of care and optimize perioperative protocols.
Collapse
Affiliation(s)
- Samuel Knoedler
- Division of Plastic Surgery, Department of Surgery, Brigham and Women’s Hospital, Harvard Medical School, Boston, MA, USA
- Department of Plastic and Hand Surgery, Klinikum Rechts der Isar, Technical University of Munich, Munich, Germany
| | - Leonard Knoedler
- Department of Plastic, Hand and Reconstructive Surgery, University Hospital Regensburg, Regensburg, Germany
| | - Cosima C. Hoch
- Department of Otolaryngology, Head and Neck Surgery, Klinikum Rechts der Isar, Technical University of Munich, Munich, Germany
| | - Martin Kauke-Navarro
- Department of Surgery, Division of Plastic Surgery, Yale School of Medicine, New Haven, CT, USA
| | - Andreas Kehrer
- Department of Plastic, Hand and Reconstructive Surgery, University Hospital Regensburg, Regensburg, Germany
| | - Leigh Friedman
- Division of Plastic Surgery, Department of Surgery, Brigham and Women’s Hospital, Harvard Medical School, Boston, MA, USA
| | - Lukas Prantl
- Department of Plastic, Hand and Reconstructive Surgery, University Hospital Regensburg, Regensburg, Germany
| | - Hans-Guenther Machens
- Department of Plastic and Hand Surgery, Klinikum Rechts der Isar, Technical University of Munich, Munich, Germany
| | - Dennis P. Orgill
- Division of Plastic Surgery, Department of Surgery, Brigham and Women’s Hospital, Harvard Medical School, Boston, MA, USA
| | - Adriana C. Panayi
- Division of Plastic Surgery, Department of Surgery, Brigham and Women’s Hospital, Harvard Medical School, Boston, MA, USA
| |
Collapse
|
13
|
Knoedler L, Alfertshofer M, Simon S, Prantl L, Kehrer A, Hoch CC, Knoedler S, Lamby P. Diagnosing lagophthalmos using artificial intelligence. Sci Rep 2023; 13:21657. [PMID: 38066112 PMCID: PMC10709577 DOI: 10.1038/s41598-023-49006-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2023] [Accepted: 12/02/2023] [Indexed: 12/18/2023] Open
Abstract
Lagophthalmos is the incomplete closure of the eyelids posing the risk of corneal ulceration and blindness. Lagophthalmos is a common symptom of various pathologies. We aimed to program a convolutional neural network to automatize lagophthalmos diagnosis. From June 2019 to May 2021, prospective data acquisition was performed on 30 patients seen at the Department of Plastic, Hand, and Reconstructive Surgery at the University Hospital Regensburg, Germany (IRB reference number: 20-2081-101). In addition, comparative data were gathered from 10 healthy patients as the control group. The training set comprised 826 images, while the validation and testing sets consisted of 91 patient images each. Validation accuracy was 97.8% over the span of 64 epochs. The model was trained for 17.3 min. For training and validation, an average loss of 0.304 and 0.358 and a final loss of 0.276 and 0.157 were noted. The testing accuracy was observed to be 93.41% with a loss of 0.221. This study proposes a novel application for rapid and reliable lagophthalmos diagnosis. Our CNN-based approach combines effective anti-overfitting strategies, short training times, and high accuracy levels. Ultimately, this tool carries high translational potential to facilitate the physician's workflow and improve overall lagophthalmos patient care.
Collapse
Affiliation(s)
- Leonard Knoedler
- Department of Plastic, Hand and Reconstructive Surgery, University Hospital Regensburg, Franz-Josef-Strauss-Allee 11, 93053, Regensburg, Germany.
| | - Michael Alfertshofer
- Division of Hand, Plastic and Aesthetic Surgery, Ludwig-Maximilians-University Munich, Munich, Germany
| | | | - Lukas Prantl
- Department of Plastic, Hand and Reconstructive Surgery, University Hospital Regensburg, Franz-Josef-Strauss-Allee 11, 93053, Regensburg, Germany
| | - Andreas Kehrer
- Department of Plastic, Hand and Reconstructive Surgery, University Hospital Regensburg, Franz-Josef-Strauss-Allee 11, 93053, Regensburg, Germany
| | - Cosima C Hoch
- Department of Otolaryngology, Head and Neck Surgery, School of Medicine, Technical University of Munich (TUM), 81675, Munich, Germany
| | - Samuel Knoedler
- Department of Plastic, Hand and Reconstructive Surgery, University Hospital Regensburg, Franz-Josef-Strauss-Allee 11, 93053, Regensburg, Germany
| | - Philipp Lamby
- Department of Plastic, Hand and Reconstructive Surgery, University Hospital Regensburg, Franz-Josef-Strauss-Allee 11, 93053, Regensburg, Germany
| |
Collapse
|
14
|
Atiyeh B, Emsieh S, Hakim C, Chalhoub R. A Narrative Review of Artificial Intelligence (AI) for Objective Assessment of Aesthetic Endpoints in Plastic Surgery. Aesthetic Plast Surg 2023; 47:2862-2873. [PMID: 37000298 DOI: 10.1007/s00266-023-03328-9] [Citation(s) in RCA: 11] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/22/2022] [Accepted: 03/19/2023] [Indexed: 04/01/2023]
Abstract
Notoriously characterized by subjectivity and lack of solid scientific validation, reporting aesthetic outcome in plastic surgery is usually based on ill-defined end points and subjective measures very often from the patients' and/or providers' perspective. With the tremendous increase in demand for all types of aesthetic procedures, there is an urgent need for better understanding of aesthetics and beauty in addition to reliable and objective outcome measures to quantitate what is perceived as beautiful and attractive. In an era of evidence-based medicine, recognition of the importance of science with evidence-based approach to aesthetic surgery is long overdue. View the many limitations of conventional outcome evaluation tools of aesthetic interventions, objective outcome analysis provided by tools described to be reliable is being investigated such as advanced artificial intelligence (AI). The current review is intended to analyze available evidence regarding advantages as well as limitations of this technology in objectively documenting outcome of aesthetic interventions. It has shown that some AI applications such as facial emotions recognition systems are capable of objectively measuring and quantitating patients' reported outcomes and defining aesthetic interventions success from the patients' perspective. Though not reported yet, observers' satisfaction with the results and their appreciation of aesthetic attributes may also be measured in the same manner.Level of Evidence III This journal requires that authors assign a level of evidence to each article. For a full description of these Evidence-Based Medicine ratings, please refer to the Table of Contents or the online Instructions to Authors www.springer.com/00266 .
Collapse
Affiliation(s)
- Bishara Atiyeh
- American University of Beirut Medical Center, Beirut, Lebanon
| | - Saif Emsieh
- American University of Beirut Medical Center, Beirut, Lebanon.
| | | | - Rawad Chalhoub
- American University of Beirut Medical Center, Beirut, Lebanon
| |
Collapse
|
15
|
Miragall MF, Knoedler S, Kauke-Navarro M, Saadoun R, Grabenhorst A, Grill FD, Ritschl LM, Fichter AM, Safi AF, Knoedler L. Face the Future-Artificial Intelligence in Oral and Maxillofacial Surgery. J Clin Med 2023; 12:6843. [PMID: 37959310 PMCID: PMC10649053 DOI: 10.3390/jcm12216843] [Citation(s) in RCA: 19] [Impact Index Per Article: 9.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/06/2023] [Revised: 10/24/2023] [Accepted: 10/28/2023] [Indexed: 11/15/2023] Open
Abstract
Artificial intelligence (AI) has emerged as a versatile health-technology tool revolutionizing medical services through the implementation of predictive, preventative, individualized, and participatory approaches. AI encompasses different computational concepts such as machine learning, deep learning techniques, and neural networks. AI also presents a broad platform for improving preoperative planning, intraoperative workflow, and postoperative patient outcomes in the field of oral and maxillofacial surgery (OMFS). The purpose of this review is to present a comprehensive summary of the existing scientific knowledge. The authors thoroughly reviewed English-language PubMed/MEDLINE and Embase papers from their establishment to 1 December 2022. The search terms were (1) "OMFS" OR "oral and maxillofacial" OR "oral and maxillofacial surgery" OR "oral surgery" AND (2) "AI" OR "artificial intelligence". The search format was tailored to each database's syntax. To find pertinent material, each retrieved article and systematic review's reference list was thoroughly examined. According to the literature, AI is already being used in certain areas of OMFS, such as radiographic image quality improvement, diagnosis of cysts and tumors, and localization of cephalometric landmarks. Through additional research, it may be possible to provide practitioners in numerous disciplines with additional assistance to enhance preoperative planning, intraoperative screening, and postoperative monitoring. Overall, AI carries promising potential to advance the field of OMFS and generate novel solution possibilities for persisting clinical challenges. Herein, this review provides a comprehensive summary of AI in OMFS and sheds light on future research efforts. Further, the advanced analysis of complex medical imaging data can support surgeons in preoperative assessments, virtual surgical simulations, and individualized treatment strategies. AI also assists surgeons during intraoperative decision-making by offering immediate feedback and guidance to enhance surgical accuracy and reduce complication rates, for instance by predicting the risk of bleeding.
Collapse
Affiliation(s)
- Maximilian F. Miragall
- Department of Oral and Maxillofacial Surgery, University Hospital Regensburg, 93053 Regensburg, Germany
- Department of Oral and Maxillofacial Surgery, School of Medicine, Technical University of Munich, 81675 Munich, Germany
| | - Samuel Knoedler
- Division of Plastic Surgery, Department of Surgery, Yale New Haven Hospital, Yale School of Medicine, New Haven, CT 06510, USA
| | - Martin Kauke-Navarro
- Division of Plastic Surgery, Department of Surgery, Yale New Haven Hospital, Yale School of Medicine, New Haven, CT 06510, USA
| | - Rakan Saadoun
- Department of Plastic Surgery, University of Pittsburgh, Pittsburgh, PA 15261, USA
| | - Alex Grabenhorst
- Department of Oral and Maxillofacial Surgery, School of Medicine, Technical University of Munich, 81675 Munich, Germany
| | - Florian D. Grill
- Department of Oral and Maxillofacial Surgery, School of Medicine, Technical University of Munich, 81675 Munich, Germany
| | - Lucas M. Ritschl
- Department of Oral and Maxillofacial Surgery, School of Medicine, Technical University of Munich, 81675 Munich, Germany
| | - Andreas M. Fichter
- Department of Oral and Maxillofacial Surgery, School of Medicine, Technical University of Munich, 81675 Munich, Germany
| | - Ali-Farid Safi
- Craniologicum, Center for Cranio-Maxillo-Facial Surgery, 3011 Bern, Switzerland;
- Faculty of Medicine, University of Bern, 3010 Bern, Switzerland
| | - Leonard Knoedler
- Division of Plastic Surgery, Department of Surgery, Yale New Haven Hospital, Yale School of Medicine, New Haven, CT 06510, USA
- Department of Plastic, Hand and Reconstructive Surgery, University Hospital Regensburg, 93053 Regensburg, Germany
| |
Collapse
|
16
|
Boochoon K, Mottaghi A, Aziz A, Pepper JP. Deep Learning for the Assessment of Facial Nerve Palsy: Opportunities and Challenges. Facial Plast Surg 2023; 39:508-511. [PMID: 37290452 DOI: 10.1055/s-0043-1769805] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/10/2023] Open
Abstract
Automated evaluation of facial palsy using machine learning offers a promising solution to the limitations of current assessment methods, which can be time-consuming, labor-intensive, and subject to clinician bias. Deep learning-driven systems have the potential to rapidly triage patients with varying levels of palsy severity and accurately track recovery over time. However, developing a clinically usable tool faces several challenges, such as data quality, inherent biases in machine learning algorithms, and explainability of decision-making processes. The development of the eFACE scale and its associated software has improved clinician scoring of facial palsy. Additionally, Emotrics is a semiautomated tool that provides quantitative data of facial landmarks on patient photographs. The ideal artificial intelligence (AI)-enabled system would analyze patient videos in real time, extracting anatomic landmark data to quantify symmetry and movement, and estimate clinical eFACE scores. This would not replace clinician eFACE scoring but would offer a rapid automated estimate of both anatomic data, similar to Emotrics, and clinical severity, similar to the eFACE. This review explores the current state of facial palsy assessment, recent advancements in AI, and the opportunities and challenges in developing an AI-driven solution.
Collapse
Affiliation(s)
- Kieran Boochoon
- Department of Otolaryngology - Head and Neck Surgery, University of Nebraska Medical Center, Omaha, Nebraska
| | - Ali Mottaghi
- Department of Electrical Engineering, Stanford University, Stanford, California
| | - Aya Aziz
- Department of Human Biology, Stanford University, Stanford, California
| | - Jon-Paul Pepper
- Department of Otolaryngology - Head and Neck Surgery, Stanford University School of Medicine, Stanford, California
| |
Collapse
|
17
|
Hoch CC, Wollenberg B, Lüers JC, Knoedler S, Knoedler L, Frank K, Cotofana S, Alfertshofer M. ChatGPT's quiz skills in different otolaryngology subspecialties: an analysis of 2576 single-choice and multiple-choice board certification preparation questions. Eur Arch Otorhinolaryngol 2023; 280:4271-4278. [PMID: 37285018 PMCID: PMC10382366 DOI: 10.1007/s00405-023-08051-4] [Citation(s) in RCA: 91] [Impact Index Per Article: 45.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/23/2023] [Accepted: 05/26/2023] [Indexed: 06/08/2023]
Abstract
PURPOSE With the increasing adoption of artificial intelligence (AI) in various domains, including healthcare, there is growing acceptance and interest in consulting AI models to provide medical information and advice. This study aimed to evaluate the accuracy of ChatGPT's responses to practice quiz questions designed for otolaryngology board certification and decipher potential performance disparities across different otolaryngology subspecialties. METHODS A dataset covering 15 otolaryngology subspecialties was collected from an online learning platform funded by the German Society of Oto-Rhino-Laryngology, Head and Neck Surgery, designed for board certification examination preparation. These questions were entered into ChatGPT, with its responses being analyzed for accuracy and variance in performance. RESULTS The dataset included 2576 questions (479 multiple-choice and 2097 single-choice), of which 57% (n = 1475) were answered correctly by ChatGPT. An in-depth analysis of question style revealed that single-choice questions were associated with a significantly higher rate (p < 0.001) of correct responses (n = 1313; 63%) compared to multiple-choice questions (n = 162; 34%). Stratified by question categories, ChatGPT yielded the highest rate of correct responses (n = 151; 72%) in the field of allergology, whereas 7 out of 10 questions (n = 65; 71%) on legal otolaryngology aspects were answered incorrectly. CONCLUSION The study reveals ChatGPT's potential as a supplementary tool for otolaryngology board certification preparation. However, its propensity for errors in certain otolaryngology areas calls for further refinement. Future research should address these limitations to improve ChatGPT's educational use. An approach, with expert collaboration, is recommended for the reliable and accurate integration of such AI models.
Collapse
Affiliation(s)
- Cosima C Hoch
- Department of Otolaryngology, Head and Neck Surgery, School of Medicine, Technical University of Munich (TUM), Ismaningerstrasse 22, 81675, Munich, Germany.
| | - Barbara Wollenberg
- Department of Otolaryngology, Head and Neck Surgery, School of Medicine, Technical University of Munich (TUM), Ismaningerstrasse 22, 81675, Munich, Germany
| | - Jan-Christoffer Lüers
- Department of Otorhinolaryngology, Head and Neck Surgery, Medical Faculty, University of Cologne, 50937, Cologne, Germany
| | - Samuel Knoedler
- Division of Plastic Surgery, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, 02152, USA
- Department of Plastic Surgery and Hand Surgery, Klinikum Rechts Der Isar, Technical University of Munich, Munich, Germany
| | - Leonard Knoedler
- Division of Plastic and Reconstructive Surgery, Massachusetts General Hospital, Harvard Medical School, Boston, MA, 02115, USA
| | | | - Sebastian Cotofana
- Department of Dermatology, Erasmus Hospital, Rotterdam, The Netherlands
- Centre for Cutaneous Research, Blizard Institute, Queen Mary University of London, London, UK
| | - Michael Alfertshofer
- Division of Hand, Plastic and Aesthetic Surgery, Ludwig-Maximilians-University Munich, Munich, Germany
| |
Collapse
|
18
|
Kehrer A, Hollmann KS, Klein SM, Anker AM, Tamm ER, Prantl L, Engelmann S, Knoedler S, Knoedler L, Ruewe M. Histomorphometry of the Sural Nerve for Use as a CFNG in Facial Reanimation Procedures. J Clin Med 2023; 12:4627. [PMID: 37510742 PMCID: PMC10380239 DOI: 10.3390/jcm12144627] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/09/2023] [Revised: 07/06/2023] [Accepted: 07/08/2023] [Indexed: 07/30/2023] Open
Abstract
Facial palsy (FP) is a debilitating nerve pathology. Cross Face Nerve Grafting (CFNG) describes a surgical technique that uses nerve grafts to reanimate the paralyzed face. The sural nerve has been shown to be a reliable nerve graft with little donor side morbidity. Therefore, we aimed to investigate the microanatomy of the sural nerve. Biopsies were obtained from 15 FP patients who underwent CFNG using sural nerve grafts. Histological cross-sections were fixated, stained with PPD, and digitized. Histomorphometry and a validated software-based axon quantification were conducted. The median age of the operated patients was 37 years (5-62 years). There was a significant difference in axonal capacity decrease towards the periphery when comparing proximal vs. distal biopsies (p = 0.047), while the side of nerve harvest showed no significant differences in nerve caliber (proximal p = 0.253, distal p = 0.506) and axonal capacity for proximal and distal biopsies (proximal p = 0.414, distal p = 0.922). Age did not correlate with axonal capacity (proximal: R = -0.201, p = 0.603; distal: R = 0.317, p = 0.292). These novel insights into the microanatomy of the sural nerve may help refine CFNG techniques and individualize FP patient treatment plans, ultimately improving overall patient outcomes.
Collapse
Affiliation(s)
- Andreas Kehrer
- Department of Plastic, Hand, and Reconstructive Surgery, University Hospital Regensburg, 93053 Regensburg, Germany
- Division of Plastic and Facial Palsy Surgery, Hospital Ingolstadt, 85049 Ingolstadt, Germany
| | - Katharina S Hollmann
- Department of Molecular Pathology, Massachusetts General Hospital, Harvard Medical School, Boston, MA 02115, USA
| | - Silvan M Klein
- Department of Plastic, Hand, and Reconstructive Surgery, University Hospital Regensburg, 93053 Regensburg, Germany
| | - Alexandra M Anker
- Department of Plastic, Hand, and Reconstructive Surgery, University Hospital Regensburg, 93053 Regensburg, Germany
| | - Ernst R Tamm
- Department of Human Anatomy and Embryology, University of Regensburg, 93053 Regensburg, Germany
| | - Lukas Prantl
- Department of Plastic, Hand, and Reconstructive Surgery, University Hospital Regensburg, 93053 Regensburg, Germany
| | - Simon Engelmann
- Department of Plastic, Hand, and Reconstructive Surgery, University Hospital Regensburg, 93053 Regensburg, Germany
| | - Samuel Knoedler
- Department of Plastic, Hand, and Reconstructive Surgery, University Hospital Regensburg, 93053 Regensburg, Germany
- Department of Plastic Surgery and Hand Surgery, Klinikum Rechts der Isar, Technical University of Munich, 81675 Munich, Germany
| | - Leonard Knoedler
- Department of Plastic, Hand, and Reconstructive Surgery, University Hospital Regensburg, 93053 Regensburg, Germany
| | - Marc Ruewe
- Department of Plastic, Hand, and Reconstructive Surgery, University Hospital Regensburg, 93053 Regensburg, Germany
| |
Collapse
|
19
|
Rodríguez Martínez EA, Polezhaeva O, Marcellin F, Colin É, Boyaval L, Sarhan FR, Dakpé S. DeepSmile: Anomaly Detection Software for Facial Movement Assessment. Diagnostics (Basel) 2023; 13:diagnostics13020254. [PMID: 36673064 PMCID: PMC9858579 DOI: 10.3390/diagnostics13020254] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/13/2022] [Revised: 01/03/2023] [Accepted: 01/05/2023] [Indexed: 01/11/2023] Open
Abstract
Facial movements are crucial for human interaction because they provide relevant information on verbal and non-verbal communication and social interactions. From a clinical point of view, the analysis of facial movements is important for diagnosis, follow-up, drug therapy, and surgical treatment. Current methods of assessing facial palsy are either (i) objective but inaccurate, (ii) subjective and, thus, depending on the clinician's level of experience, or (iii) based on static data. To address the aforementioned problems, we implemented a deep learning algorithm to assess facial movements during smiling. Such a model was trained on a dataset that contains healthy smiles only following an anomaly detection strategy. Generally speaking, the degree of anomaly is computed by comparing the model's suggested healthy smile with the person's actual smile. The experimentation showed that the model successfully computed a high degree of anomaly when assessing the patients' smiles. Furthermore, a graphical user interface was developed to test its practical usage in a clinical routine. In conclusion, we present a deep learning model, implemented on open-source software, designed to help clinicians to assess facial movements.
Collapse
Affiliation(s)
- Eder A. Rodríguez Martínez
- UR 7516 Laboratory CHIMERE, University of Picardie Jules Verne, 80039 Amiens, France
- Institut Faire Faces, 80000 Amiens, France
- Correspondence: (E.A.R.M.); (S.D.); Tel.: +33-(0)-22-08-90-48 (E.A.R.M.)
| | - Olga Polezhaeva
- UR 7516 Laboratory CHIMERE, University of Picardie Jules Verne, 80039 Amiens, France
- Faculty of Odontology, University of Reims Champagne-Ardenne, 51097 Reims, France
| | - Félix Marcellin
- UR 7516 Laboratory CHIMERE, University of Picardie Jules Verne, 80039 Amiens, France
- Institut Faire Faces, 80000 Amiens, France
| | - Émilien Colin
- UR 7516 Laboratory CHIMERE, University of Picardie Jules Verne, 80039 Amiens, France
- Institut Faire Faces, 80000 Amiens, France
- Maxillofacial Surgery, CHU Amiens-Picardie, 80000 Amiens, France
| | - Lisa Boyaval
- UR 7516 Laboratory CHIMERE, University of Picardie Jules Verne, 80039 Amiens, France
- Faculty of Odontology, University of Reims Champagne-Ardenne, 51097 Reims, France
| | - François-Régis Sarhan
- UR 7516 Laboratory CHIMERE, University of Picardie Jules Verne, 80039 Amiens, France
- Institut Faire Faces, 80000 Amiens, France
- Physiotherapy School, CHU Amiens-Picardie, 80000 Amiens, France
| | - Stéphanie Dakpé
- UR 7516 Laboratory CHIMERE, University of Picardie Jules Verne, 80039 Amiens, France
- Institut Faire Faces, 80000 Amiens, France
- Maxillofacial Surgery, CHU Amiens-Picardie, 80000 Amiens, France
- Correspondence: (E.A.R.M.); (S.D.); Tel.: +33-(0)-22-08-90-48 (E.A.R.M.)
| |
Collapse
|