1
|
Panthier F, Crawford-Smith H, Alvarez E, Melchionna A, Velinova D, Mohamed I, Price S, Choong S, Arumuham V, Allen S, Traxer O, Smith D. Artificial intelligence versus human touch: can artificial intelligence accurately generate a literature review on laser technologies? World J Urol 2024; 42:598. [PMID: 39466443 DOI: 10.1007/s00345-024-05311-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/10/2024] [Accepted: 10/04/2024] [Indexed: 10/30/2024] Open
Abstract
PURPOSE To compare the accuracy of open-source Artificial Intelligence (AI) Large Language Models (LLM) against human authors to generate a systematic review (SR) on the new pulsed-Thulium:YAG (p-Tm:YAG) laser. METHODS Five manuscripts were compared. The Human-SR on p-Tm:YAG (considered to be the "ground truth") was written by independent certified endourologists with expertise in lasers, accepted in a peer-review pubmed-indexed journal (but not yet available online, and therefore not accessible to the LLMs). The query to the AI LLMs was: "write a systematic review on pulsed-Thulium:YAG laser for lithotripsy" which was submitted to four LLMs (ChatGPT3.5/Vercel/Claude/Mistral-7b). The LLM-SR were uniformed and Human-SR reformatted to fit the general output appearance, to ensure blindness. Nine participants with various levels of endourological expertise (three Clinical Nurse Specialist nurses, Urology Trainees and Consultants) objectively assessed the accuracy of the five SRs using a bespoke 10 "checkpoint" proforma. A subjective assessment was recorded using a composite score including quality (0-10), clarity (0-10) and overall manuscript rank (1-5). RESULTS The Human-SR was objectively and subjectively more accurate than LLM-SRs (96 ± 7% and 86.8 ± 8.2% respectively; p < 0.001). The LLM-SRs did not significantly differ but ChatGPT3.5 presented greater subjective and objective accuracy scores (62.4 ± 15% and 29 ± 28% respectively; p > 0.05). Quality and clarity assessments were significantly impacted by SR type but not the expertise level (p < 0.001 and > 0.05, respectively). CONCLUSIONS LLM generated data on highly technical topics present a lower accuracy than Key Opinion Leaders. LLMs, especially ChatGPT3.5, with human supervision could improve our practice.
Collapse
Affiliation(s)
- Frédéric Panthier
- Department of Urology, Westmoreland Street Hospital, UCLH NHS Foundation Trust, 16-18 Westmoreland Street, Marylebone, London, W1G 8PH, UK.
- Sorbonne University GRC Urolithiasis No. 20 Tenon Hospital, 75020, Paris, France.
- Progressive Endourological Association for Research and Leading Solutions (PEARLS), Paris, France.
- PIMM, UMR 8006 CNRS-Arts et Métiers ParisTech, 151 Bd de L'Hôpital, 75013, Paris, France.
| | - Hugh Crawford-Smith
- Department of Urology, Westmoreland Street Hospital, UCLH NHS Foundation Trust, 16-18 Westmoreland Street, Marylebone, London, W1G 8PH, UK
| | - Eduarda Alvarez
- Department of Urology, Westmoreland Street Hospital, UCLH NHS Foundation Trust, 16-18 Westmoreland Street, Marylebone, London, W1G 8PH, UK
- Escola Bahiana de Medicina e Saúde Pública, Av. Dom João VI, 275, Salvador, BA, Brazil
| | - Alberto Melchionna
- Department of Urology, Westmoreland Street Hospital, UCLH NHS Foundation Trust, 16-18 Westmoreland Street, Marylebone, London, W1G 8PH, UK
| | - Daniela Velinova
- Department of Urology, Westmoreland Street Hospital, UCLH NHS Foundation Trust, 16-18 Westmoreland Street, Marylebone, London, W1G 8PH, UK
| | - Ikran Mohamed
- Department of Urology, Westmoreland Street Hospital, UCLH NHS Foundation Trust, 16-18 Westmoreland Street, Marylebone, London, W1G 8PH, UK
| | - Siobhan Price
- Department of Urology, Westmoreland Street Hospital, UCLH NHS Foundation Trust, 16-18 Westmoreland Street, Marylebone, London, W1G 8PH, UK
| | - Simon Choong
- Department of Urology, Westmoreland Street Hospital, UCLH NHS Foundation Trust, 16-18 Westmoreland Street, Marylebone, London, W1G 8PH, UK
| | - Vimoshan Arumuham
- Department of Urology, Westmoreland Street Hospital, UCLH NHS Foundation Trust, 16-18 Westmoreland Street, Marylebone, London, W1G 8PH, UK
| | - Sian Allen
- Department of Urology, Westmoreland Street Hospital, UCLH NHS Foundation Trust, 16-18 Westmoreland Street, Marylebone, London, W1G 8PH, UK
| | - Olivier Traxer
- Sorbonne University GRC Urolithiasis No. 20 Tenon Hospital, 75020, Paris, France
- Progressive Endourological Association for Research and Leading Solutions (PEARLS), Paris, France
- PIMM, UMR 8006 CNRS-Arts et Métiers ParisTech, 151 Bd de L'Hôpital, 75013, Paris, France
| | - Daron Smith
- Department of Urology, Westmoreland Street Hospital, UCLH NHS Foundation Trust, 16-18 Westmoreland Street, Marylebone, London, W1G 8PH, UK
- Endourology Academy, London, UK
- Social Media Committee, Endourological Society, New York, USA
| |
Collapse
|
2
|
Ma L, Luo K, Liu Z, Ji M. Stain-Free Histopathology with Stimulated Raman Scattering Microscopy. Anal Chem 2024; 96:7907-7925. [PMID: 38713830 DOI: 10.1021/acs.analchem.4c02061] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/09/2024]
Affiliation(s)
- Liyang Ma
- State Key Laboratory of Surface Physics and Department of Physics, Academy for Engineering and Technology, Key Laboratory of Micro and Nano Photonic Structures (Ministry of Education), Shanghai Key Laboratory of Metasurfaces for Light Manipulation, Fudan University, Shanghai 200433, China
| | - Kuan Luo
- State Key Laboratory of Surface Physics and Department of Physics, Academy for Engineering and Technology, Key Laboratory of Micro and Nano Photonic Structures (Ministry of Education), Shanghai Key Laboratory of Metasurfaces for Light Manipulation, Fudan University, Shanghai 200433, China
| | - Zhijie Liu
- State Key Laboratory of Surface Physics and Department of Physics, Academy for Engineering and Technology, Key Laboratory of Micro and Nano Photonic Structures (Ministry of Education), Shanghai Key Laboratory of Metasurfaces for Light Manipulation, Fudan University, Shanghai 200433, China
| | - Minbiao Ji
- State Key Laboratory of Surface Physics and Department of Physics, Academy for Engineering and Technology, Key Laboratory of Micro and Nano Photonic Structures (Ministry of Education), Shanghai Key Laboratory of Metasurfaces for Light Manipulation, Fudan University, Shanghai 200433, China
| |
Collapse
|
3
|
Salirrosas O, Kawahara W, Vega EA, Bhargava R, Salehi O, Conrad C. ASO Author Reflections: Lymph Node Station 16 Status-Becoming a Student of Your Patients' Cancer. Ann Surg Oncol 2024; 31:3031-3032. [PMID: 38424261 PMCID: PMC11048733 DOI: 10.1245/s10434-024-15099-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/07/2024] [Accepted: 02/08/2024] [Indexed: 03/02/2024]
Affiliation(s)
- Oscar Salirrosas
- Department of Surgery, St. Elizabeth's Medical Center, Boston University School of Medicine, Boston, MA, USA
| | | | - Eduardo A Vega
- Department of Surgery, St. Elizabeth's Medical Center, Boston University School of Medicine, Boston, MA, USA
| | - Rohit Bhargava
- Department of Bioengineering, Electrical and Computer Engineering, Mechanical Science and Engineering, Chemical and Biomolecular Engineering, and Chemistry, Beckman Institute for Advanced Science and Technology, Cancer Center at Illinois, University of Illinois Urbana-Champaign, Urbana, IL, USA
| | - Omid Salehi
- Department of Surgery, St. Elizabeth's Medical Center, Boston University School of Medicine, Boston, MA, USA
| | - Claudius Conrad
- Department of Surgery, St. Elizabeth's Medical Center, Boston University School of Medicine, Boston, MA, USA.
| |
Collapse
|
4
|
Pillar N, Li Y, Zhang Y, Ozcan A. Virtual Staining of Nonfixed Tissue Histology. Mod Pathol 2024; 37:100444. [PMID: 38325706 PMCID: PMC11918264 DOI: 10.1016/j.modpat.2024.100444] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/02/2023] [Revised: 01/19/2024] [Accepted: 01/29/2024] [Indexed: 02/09/2024]
Abstract
Surgical pathology workflow involves multiple labor-intensive steps, such as tissue removal, fixation, embedding, sectioning, staining, and microscopic examination. This process is time-consuming and costly and requires skilled technicians. In certain clinical scenarios, such as intraoperative consultations, there is a need for faster histologic evaluation to provide real-time surgical guidance. Currently, frozen section techniques involving hematoxylin and eosin (H&E) staining are used for intraoperative pathology consultations. However, these techniques have limitations, including a turnaround time of 20 to 30 minutes, staining artifacts, and potential tissue loss, negatively impacting accurate diagnosis. To address these challenges, researchers are exploring alternative optical imaging modalities for rapid microscopic tissue imaging. These modalities differ in optical characteristics, tissue preparation requirements, imaging equipment, and output image quality and format. Some of these imaging methods have been combined with computational algorithms to generate H&E-like images, which could greatly facilitate their adoption by pathologists. Here, we provide a comprehensive, organ-specific review of the latest advancements in emerging imaging modalities applied to nonfixed human tissue. We focused on studies that generated H&E-like images evaluated by pathologists. By presenting up-to-date research progress and clinical utility, this review serves as a valuable resource for scholars and clinicians, covering some of the major technical developments in this rapidly evolving field. It also offers insights into the potential benefits and drawbacks of alternative imaging modalities and their implications for improving patient care.
Collapse
Affiliation(s)
- Nir Pillar
- Electrical and Computer Engineering Department, University of California, Los Angeles, California; Bioengineering Department, University of California, Los Angeles, California; California NanoSystems Institute (CNSI), University of California, Los Angeles, California
| | - Yuzhu Li
- Electrical and Computer Engineering Department, University of California, Los Angeles, California; Bioengineering Department, University of California, Los Angeles, California; California NanoSystems Institute (CNSI), University of California, Los Angeles, California
| | - Yijie Zhang
- Electrical and Computer Engineering Department, University of California, Los Angeles, California; Bioengineering Department, University of California, Los Angeles, California; California NanoSystems Institute (CNSI), University of California, Los Angeles, California
| | - Aydogan Ozcan
- Electrical and Computer Engineering Department, University of California, Los Angeles, California; Bioengineering Department, University of California, Los Angeles, California; California NanoSystems Institute (CNSI), University of California, Los Angeles, California.
| |
Collapse
|