1
|
O'Malley GR, Sarwar SA, Cassimatis ND, Kumar RP, Munier S, Shill S, Maggio W, Ahmad G, Hundal JS, Danish SF, Patel NV. Can Publicly Available Artificial Intelligence Successfully Identify Current Procedural Terminology Codes for Common Procedures in Neurosurgery? World Neurosurg 2024; 183:e860-e870. [PMID: 38219799 DOI: 10.1016/j.wneu.2024.01.043] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/18/2023] [Revised: 01/07/2024] [Accepted: 01/08/2024] [Indexed: 01/16/2024]
Abstract
OBJECTIVE Coding for neurosurgical procedures is a complex process that is dynamically changing year to year, through the annual introduction and removal of codes and modifiers. The authors hoped to elucidate if publicly available artificial intelligence (AI) could offer solutions for neurosurgeons with regard to coding. METHODS Multiple publicly available AI platforms were asked to provide Current Procedural Terminology (CPT) codes and Revenue Value Units (RVU) values for common neurosurgical procedures of the brain and spine with a given indication for the procedure. The responses of platforms were recorded and compared to the currently valid CPT codes used for the procedure and the amount of RVUs that would be gained. RESULTS Six platforms and Google were asked for the appropriate CPT codes for 10 endovascular, spinal, and cranial procedures each. The highest performing platforms were as follows: Perplexity.AI identified 70% of endovascular, BingAI identified 55% of spinal, and ChatGPT 4.0 with Bing identified 75% of cranial CPT codes. With regard to RVUs, the top performer gained 78% of endovascular, 42% of spinal, and 70% of cranial possible RVUs. With regard to accuracy, AI platforms on average outperformed Google (45% vs. 25%, P = 0.04236). CONCLUSIONS The ability of publicly available AIs to successfully code for neurosurgical procedures holds great promise in the future. Future development of AI should focus on improving accuracy with regard to CPT codes and providing supporting documentation for its decisions. Improvement on the existing capabilities of AI platforms can allow for increased operational efficiency and cost savings for practices.
Collapse
Affiliation(s)
- Geoffrey R O'Malley
- Department of Neurosurgery, Hackensack Meridian School of Medicine, Nutley, New Jersey, USA.
| | - Syed A Sarwar
- Department of Neurosurgery, Hackensack Meridian Health-Jersey Shore University Medical Center, Neptune, New Jersey, USA
| | - Nicholas D Cassimatis
- Department of Neurosurgery, Hackensack Meridian School of Medicine, Nutley, New Jersey, USA
| | - Rohit Prem Kumar
- Department of Neurosurgery, Hackensack Meridian School of Medicine, Nutley, New Jersey, USA
| | - Sean Munier
- Department of Neurosurgery, Hackensack Meridian Health-Jersey Shore University Medical Center, Neptune, New Jersey, USA
| | - Steven Shill
- Department of Neurosurgery, Hackensack Meridian Health-Jersey Shore University Medical Center, Neptune, New Jersey, USA
| | - William Maggio
- Department of Neurosurgery, Hackensack Meridian School of Medicine, Nutley, New Jersey, USA; Department of Neurosurgery, Hackensack Meridian Health-Jersey Shore University Medical Center, Neptune, New Jersey, USA
| | - Ghasan Ahmad
- Department of Neurosurgery, Hackensack Meridian School of Medicine, Nutley, New Jersey, USA; Department of Neurosurgery, Hackensack Meridian Health-Jersey Shore University Medical Center, Neptune, New Jersey, USA
| | - Jasdeep S Hundal
- Department of Neurology, Hackensack Meridian Health-Jersey Shore University Medical Center, Neptune, New Jersey, USA
| | - Shabbar F Danish
- Department of Neurosurgery, Hackensack Meridian School of Medicine, Nutley, New Jersey, USA; Department of Neurosurgery, Hackensack Meridian Health-Jersey Shore University Medical Center, Neptune, New Jersey, USA
| | - Nitesh V Patel
- Department of Neurosurgery, Hackensack Meridian School of Medicine, Nutley, New Jersey, USA; Department of Neurosurgery, Hackensack Meridian Health-Jersey Shore University Medical Center, Neptune, New Jersey, USA
| |
Collapse
|