1
|
The Detection of Pulp Stones with Automatic Deep Learning in Panoramic Radiographies: An AI Pilot Study. Diagnostics (Basel) 2024; 14:890. [PMID: 38732305 PMCID: PMC11082950 DOI: 10.3390/diagnostics14090890] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/01/2024] [Revised: 04/18/2024] [Accepted: 04/22/2024] [Indexed: 05/13/2024] Open
Abstract
This study aims to evaluate the effectiveness of employing a deep learning approach for the automated detection of pulp stones in panoramic imaging. A comprehensive dataset comprising 2409 panoramic radiography images (7564 labels) underwent labeling using the CranioCatch labeling program, developed in Eskişehir, Turkey. The dataset was stratified into three distinct subsets: training (n = 1929, 80% of the total), validation (n = 240, 10% of the total), and test (n = 240, 10% of the total) sets. To optimize the visual clarity of labeled regions, a 3 × 3 clash operation was applied to the images. The YOLOv5 architecture was employed for artificial intelligence modeling, yielding F1, sensitivity, and precision metrics of 0.7892, 0.8026, and 0.7762, respectively, during the evaluation of the test dataset. Among deep learning-based artificial intelligence algorithms applied to panoramic radiographs, the use of numerical identification for the detection of pulp stones has achieved remarkable success. It is expected that the success rates of training models will increase by using datasets consisting of a larger number of images. The use of artificial intelligence-supported clinical decision support system software has the potential to increase the efficiency and effectiveness of dentists.
Collapse
|
2
|
Surveying the landscape of diagnostic imaging in dentistry's future: Four emerging technologies with promise. J Am Dent Assoc 2024:S0002-8177(24)00056-4. [PMID: 38520421 DOI: 10.1016/j.adaj.2024.01.005] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/24/2023] [Revised: 01/04/2024] [Accepted: 01/07/2024] [Indexed: 03/25/2024]
Abstract
BACKGROUND Advances in digital radiography for both intraoral and panoramic imaging and cone-beam computed tomography have led the way to an increase in diagnostic capabilities for the dental care profession. In this article, the authors provide information on 4 emerging technologies with promise. TYPES OF STUDIES REVIEWED The authors feature the following: artificial intelligence in the form of deep learning using convolutional neural networks, dental magnetic resonance imaging, stationary intraoral tomosynthesis, and second-generation cone-beam computed tomography sources based on carbon nanotube technology and multispectral imaging. The authors review and summarize articles featuring these technologies. RESULTS The history and background of these emerging technologies are previewed along with their development and potential impact on the practice of dental diagnostic imaging. The authors conclude that these emerging technologies have the potential to have a substantial influence on the practice of dentistry as these systems mature. The degree of influence most likely will vary, with artificial intelligence being the most influential of the 4. CONCLUSIONS AND PRACTICAL IMPLICATIONS The readers are informed about these emerging technologies and the potential effects on their practice going forward, giving them information on which to base decisions on adopting 1 or more of these technologies. The 4 technologies reviewed in this article have the potential to improve imaging diagnostics in dentistry thereby leading to better patient care and heightened professional satisfaction.
Collapse
|
3
|
Challenges and Potential of Artificial Intelligence in Neuroradiology. Clin Neuroradiol 2024:10.1007/s00062-024-01382-7. [PMID: 38285239 DOI: 10.1007/s00062-024-01382-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/13/2023] [Accepted: 01/03/2024] [Indexed: 01/30/2024]
Abstract
PURPOSE Artificial intelligence (AI) has emerged as a transformative force in medical research and is garnering increased attention in the public consciousness. This represents a critical time period in which medical researchers, healthcare providers, insurers, regulatory agencies, and patients are all developing and shaping their beliefs and policies regarding the use of AI in the healthcare sector. The successful deployment of AI will require support from all these groups. This commentary proposes that widespread support for medical AI must be driven by clear and transparent scientific reporting, beginning at the earliest stages of scientific research. METHODS A review of relevant guidelines and literature describing how scientific reporting plays a central role at key stages in the life cycle of an AI software product was conducted. To contextualize this principle within a specific medical domain, we discuss the current state of predictive tissue outcome modeling in acute ischemic stroke and the unique challenges presented therein. RESULTS AND CONCLUSION Translating AI methods from the research to the clinical domain is complicated by challenges related to model design and validation studies, medical product regulations, and healthcare providers' reservations regarding AI's efficacy and affordability. However, each of these limitations is also an opportunity for high-impact research that will help to accelerate the clinical adoption of state-of-the-art medical AI. In all cases, establishing and adhering to appropriate reporting standards is an important responsibility that is shared by all of the parties involved in the life cycle of a prospective AI software product.
Collapse
|
4
|
A retrospective longitudinal assessment of artificial intelligence-assisted radiographic prediction of lower third molar eruption. Sci Rep 2024; 14:994. [PMID: 38200067 PMCID: PMC10781671 DOI: 10.1038/s41598-024-51393-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/08/2023] [Accepted: 01/04/2024] [Indexed: 01/12/2024] Open
Abstract
Prediction of lower third molar eruption is crucial for its timely extraction. Therefore, the primary aim of this study was to investigate the prediction of lower third molar eruption and its uprighting with the assistance of an artificial intelligence (AI) tool. The secondary aim was identifying the incidence of fully erupted lower third molars with hygienic cleansability. In total, 771 patients having two panoramic radiographs were recruited, where the first radiograph was acquired at 8-15 years of age (T1) and the second acquisition was between 16 and 23 years (T2). The predictive model for third molar eruption could not be obtained as few teeth reached full eruption. However, uprighting model at T2 showed that in cases with sufficient retromolar space, an initial angulation of < 32° predicted uprighting. Full eruption was observed for 13.9% of the teeth, and only 1.7% showed hygienic cleansability. The predictions model of third molar uprighting could act as a valuable aid for guiding a clinician with the decision-making process of extracting third molars which fail to erupt in an upright fashion. In addition, a low incidence of fully erupted molars with hygienic cleansability suggest that a clinician might opt for prophylactic extraction.
Collapse
|
5
|
Applications of artificial intelligence in dentomaxillofacial imaging-a systematic review. Oral Surg Oral Med Oral Pathol Oral Radiol 2024:S2212-4403(23)01566-3. [PMID: 38637235 DOI: 10.1016/j.oooo.2023.12.790] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/10/2023] [Revised: 12/02/2023] [Accepted: 12/22/2023] [Indexed: 04/20/2024]
Abstract
BACKGROUND Artificial intelligence (AI) technology has been increasingly developed in oral and maxillofacial imaging. The aim of this systematic review was to assess the applications and performance of the developed algorithms in different dentomaxillofacial imaging modalities. STUDY DESIGN A systematic search of PubMed and Scopus databases was performed. The search strategy was set as a combination of the following keywords: "Artificial Intelligence," "Machine Learning," "Deep Learning," "Neural Networks," "Head and Neck Imaging," and "Maxillofacial Imaging." Full-text screening and data extraction were independently conducted by two independent reviewers; any mismatch was resolved by discussion. The risk of bias was assessed by one reviewer and validated by another. RESULTS The search returned a total of 3,392 articles. After careful evaluation of the titles, abstracts, and full texts, a total number of 194 articles were included. Most studies focused on AI applications for tooth and implant classification and identification, 3-dimensional cephalometric landmark detection, lesion detection (periapical, jaws, and bone), and osteoporosis detection. CONCLUSION Despite the AI models' limitations, they showed promising results. Further studies are needed to explore specific applications and real-world scenarios before confidently integrating these models into dental practice.
Collapse
|
6
|
A systematic review and meta-analysis of artificial intelligence diagnostic accuracy in prostate cancer histology identification and grading. Prostate Cancer Prostatic Dis 2023; 26:681-692. [PMID: 37185992 DOI: 10.1038/s41391-023-00673-3] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/15/2023] [Accepted: 04/17/2023] [Indexed: 05/17/2023]
Abstract
BACKGROUND Artificial intelligence (AI) is a promising tool in pathology, including cancer diagnosis, subtyping, grading, and prognostic prediction. METHODS The aim of the study is to assess AI application in prostate cancer (PCa) histology. We carried out a systematic literature search in 3 databases. Primary outcome was AI accuracy in differentiating between PCa and benign hyperplasia. Secondary outcomes were AI accuracy in determining Gleason grade and agreement among AI and pathologists. RESULTS Our final sample consists of 24 studies conducted from 2007 to 2021. They aggregate data from roughly 8000 cases of prostate biopsy and 458 cases of radical prostatectomy (RP). Sensitivity for PCa diagnostic exceeded 90% and ranged from 87% to 100%, and specificity varied from 68% to 99%. Overall accuracy ranged from 83.7% to 98.3% with AUC reaching 0.99. The meta-analysis using the Mantel-Haenszel method showed pooled sensitivity of 0.96 with I2 = 80.7% and pooled specificity of 0.95 with I2 = 86.1%. Pooled positive likehood ratio was 15.3 with I2 = 87.3% and negative - was 0.04 with I2 = 78.6%. SROC (symmetric receiver operating characteristics) curve represents AUC = 0.99. For grading the accuracy of AI was lower: sensitivity for Gleason grading ranged from 77% to 87%, and specificity from 82% to 90%. CONCLUSIONS The accuracy of AI for PCa identification and grading is comparable to expert pathologists. This is a promising approach which has several possible clinical applications resulting in expedite and optimize pathology reports. AI introduction into common practice may be limited by difficult and time-consuming convolutional neural network training and tuning.
Collapse
|
7
|
Comparison of artificial intelligence vs. junior dentists' diagnostic performance based on caries and periapical infection detection on panoramic images. Quant Imaging Med Surg 2023; 13:7494-7503. [PMID: 37969638 PMCID: PMC10644137 DOI: 10.21037/qims-23-762] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/28/2023] [Accepted: 09/04/2023] [Indexed: 11/17/2023]
Abstract
Background There is information missing in the literature about the comparison of dentists vs. artificial intelligence (AI) based on diagnostic capability. The aim of this study is to evaluate the diagnostic performance based on radiological diagnoses regarding caries and periapical infection detection by comparing AI software with junior dentists who have 1 or 2 years of experience, based on the valid determinations by specialist dentists. Methods In the initial stage of the study, 2 specialist dentists evaluated the presence of caries and periapical lesions on 500 digital panoramic radiographs, and the detection time was recorded in seconds. In the second stage, 3 junior dentists and an AI software performed diagnoses on the same panoramic radiographs, and the diagnostic results and durations were recorded in seconds. Results The AI and the three junior dentists, respectively, detected dental caries at a sensitivity (SEN) of 0.907, 0.889, 0.491, 0.907; a specificity (SPEC) of 0.760, 0.740, 0.454, 0.696; a positive predictive value (PPV) of 0.693, 0.470, 0.155, 0.666; a negative predictive value (NPV) of 0.505, 0.415, 0.275, 0.367 and a F1-score of 0.786, 0.615, 0.236, 0.768. The AI and the three junior dentists respectively detected periapical lesions at an SEN of 0.973, 0.962, 0.758, 0.958; a SPEC of 0.629, 0.421, 0.404, 0.621; a PPV of 0.861, 0.651, 0.312, 0.648; a NPV of 0.689, 0.673, 0.278, 0.546 and an F1-score of 0.914, 0.777, 0.442, 0.773. The AI software gave more accurate results, especially in detecting periapical lesions. On the other hand, in caries detection, the underdiagnosis rate was high for both AI and junior dentists. Conclusions Regarding the evaluation time needed, AI performed faster, on average.
Collapse
|
8
|
Intra-oral scan segmentation using deep learning. BMC Oral Health 2023; 23:643. [PMID: 37670290 PMCID: PMC10481506 DOI: 10.1186/s12903-023-03362-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/07/2023] [Accepted: 08/26/2023] [Indexed: 09/07/2023] Open
Abstract
OBJECTIVE Intra-oral scans and gypsum cast scans (OS) are widely used in orthodontics, prosthetics, implantology, and orthognathic surgery to plan patient-specific treatments, which require teeth segmentations with high accuracy and resolution. Manual teeth segmentation, the gold standard up until now, is time-consuming, tedious, and observer-dependent. This study aims to develop an automated teeth segmentation and labeling system using deep learning. MATERIAL AND METHODS As a reference, 1750 OS were manually segmented and labeled. A deep-learning approach based on PointCNN and 3D U-net in combination with a rule-based heuristic algorithm and a combinatorial search algorithm was trained and validated on 1400 OS. Subsequently, the trained algorithm was applied to a test set consisting of 350 OS. The intersection over union (IoU), as a measure of accuracy, was calculated to quantify the degree of similarity between the annotated ground truth and the model predictions. RESULTS The model achieved accurate teeth segmentations with a mean IoU score of 0.915. The FDI labels of the teeth were predicted with a mean accuracy of 0.894. The optical inspection showed excellent position agreements between the automatically and manually segmented teeth components. Minor flaws were mostly seen at the edges. CONCLUSION The proposed method forms a promising foundation for time-effective and observer-independent teeth segmentation and labeling on intra-oral scans. CLINICAL SIGNIFICANCE Deep learning may assist clinicians in virtual treatment planning in orthodontics, prosthetics, implantology, and orthognathic surgery. The impact of using such models in clinical practice should be explored.
Collapse
|
9
|
Applications, functions, and accuracy of artificial intelligence in restorative dentistry: A literature review. J ESTHET RESTOR DENT 2023; 35:842-859. [PMID: 37522291 DOI: 10.1111/jerd.13079] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/01/2023] [Revised: 06/18/2023] [Accepted: 06/19/2023] [Indexed: 08/01/2023]
Abstract
OBJECTIVE The applications of artificial intelligence (AI) are increasing in restorative dentistry; however, the AI performance is unclear for dental professionals. The purpose of this narrative review was to evaluate the applications, functions, and accuracy of AI in diverse aspects of restorative dentistry including caries detection, tooth preparation margin detection, tooth restoration design, metal structure casting, dental restoration/implant detection, removable partial denture design, and tooth shade determination. OVERVIEW An electronic search was performed on Medline/PubMed, Embase, Web of Science, Cochrane, Scopus, and Google Scholar databases. English-language articles, published from January 1, 2000, to March 1, 2022, relevant to the aforementioned aspects were selected using the key terms of artificial intelligence, machine learning, deep learning, artificial neural networks, convolutional neural networks, clustering, soft computing, automated planning, computational learning, computer vision, and automated reasoning as inclusion criteria. A manual search was also performed. Therefore, 157 articles were included, reviewed, and discussed. CONCLUSIONS Based on the current literature, the AI models have shown promising performance in the mentioned aspects when being compared with traditional approaches in terms of accuracy; however, as these models are still in development, more studies are required to validate their accuracy and apply them to routine clinical practice. CLINICAL SIGNIFICANCE AI with its specific functions has shown successful applications with acceptable accuracy in diverse aspects of restorative dentistry. The understanding of these functions may lead to novel applications with optimal accuracy for AI in restorative dentistry.
Collapse
|
10
|
Teeth Lesion Detection Using Deep Learning and the Internet of Things Post-COVID-19. SENSORS (BASEL, SWITZERLAND) 2023; 23:6837. [PMID: 37571620 PMCID: PMC10422255 DOI: 10.3390/s23156837] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/05/2023] [Revised: 07/26/2023] [Accepted: 07/29/2023] [Indexed: 08/13/2023]
Abstract
With a view of the post-COVID-19 world and probable future pandemics, this paper presents an Internet of Things (IoT)-based automated healthcare diagnosis model that employs a mixed approach using data augmentation, transfer learning, and deep learning techniques and does not require physical interaction between the patient and physician. Through a user-friendly graphic user interface and availability of suitable computing power on smart devices, the embedded artificial intelligence allows the proposed model to be effectively used by a layperson without the need for a dental expert by indicating any issues with the teeth and subsequent treatment options. The proposed method involves multiple processes, including data acquisition using IoT devices, data preprocessing, deep learning-based feature extraction, and classification through an unsupervised neural network. The dataset contains multiple periapical X-rays of five different types of lesions obtained through an IoT device mounted within the mouth guard. A pretrained AlexNet, a fast GPU implementation of a convolutional neural network (CNN), is fine-tuned using data augmentation and transfer learning and employed to extract the suitable feature set. The data augmentation avoids overtraining, whereas accuracy is improved by transfer learning. Later, support vector machine (SVM) and the K-nearest neighbors (KNN) classifiers are trained for lesion classification. It was found that the proposed automated model based on the AlexNet extraction mechanism followed by the SVM classifier achieved an accuracy of 98%, showing the effectiveness of the presented approach.
Collapse
|
11
|
Advancing glaucoma detection with convolutional neural networks: a paradigm shift in ophthalmology. Rom J Ophthalmol 2023; 67:222-237. [PMID: 37876506 PMCID: PMC10591431 DOI: 10.22336/rjo.2023.39] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 09/24/2023] [Indexed: 10/26/2023] Open
Abstract
A leading cause of irreversible vision loss, glaucoma needs early detection for effective management. Intraocular Pressure (IOP) is a significant risk factor for glaucoma. Convolutional Neural Networks (CNN) demonstrate exceptional capabilities in analyzing retinal fundus images, a non-invasive and cost-effective imaging technique widely used in glaucoma diagnosis. By learning from large datasets of annotated images, CNN can identify subtle changes in the optic nerve head and retinal structures indicative of glaucoma. This enables early and precise glaucoma diagnosis, empowering clinicians to implement timely interventions. CNNs excel in analyzing complex medical images, detecting subtle changes indicative of glaucoma with high precision. Another valuable diagnostic tool for glaucoma evaluation, Optical Coherence Tomography (OCT), provides high-resolution cross-sectional images of the retina. CNN can effectively analyze OCT scans and extract meaningful features, facilitating the identification of structural abnormalities associated with glaucoma. Visual field testing, performed using devices like the Humphrey Field Analyzer, is crucial for assessing functional vision loss in glaucoma. The integration of CNN with retinal fundus images, OCT scans, visual field testing, and IOP measurements represents a transformative approach to glaucoma detection. These advanced technologies have the potential to revolutionize ophthalmology by enabling early detection, personalized management, and improved patient outcomes. CNNs facilitate remote expert opinions and enhance treatment monitoring. Overcoming challenges such as data scarcity and interpretability can optimize CNN utilization in glaucoma diagnosis. Measuring retinal nerve fiber layer thickness as a diagnostic marker proves valuable. CNN implementation reduces healthcare costs and improves access to quality eye care. Future research should focus on optimizing architectures and incorporating novel biomarkers. CNN integration in glaucoma detection revolutionizes ophthalmology, improving patient outcomes and access to care. This review paves the way for innovative CNN-based glaucoma detection methods. Abbreviations: CNN = Convolutional Neural Networks, AI = Artificial Intelligence, IOP = Intraocular Pressure, OCT = Optical Coherence Tomography, CLSO = Confocal Scanning Laser Ophthalmoscopy, AUC-ROC = Area Under the Receiver Operating Characteristic Curve, RNFL = Retinal Nerve Fiber Layer, RNN = Recurrent Neural Networks, VF = Visual Field, AP = Average Precision, MD = Mean Defect, sLV = square-root of Loss Variance, NN = Neural Network, WHO = World Health Organization.
Collapse
|
12
|
Patients' perspectives on the use of artificial intelligence in dentistry: a regional survey. Head Face Med 2023; 19:23. [PMID: 37349791 PMCID: PMC10288769 DOI: 10.1186/s13005-023-00368-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/05/2023] [Accepted: 06/13/2023] [Indexed: 06/24/2023] Open
Abstract
The use of artificial intelligence (AI) in dentistry is rapidly evolving and could play a major role in a variety of dental fields. This study assessed patients' perceptions and expectations regarding AI use in dentistry. An 18-item questionnaire survey focused on demographics, expectancy, accountability, trust, interaction, advantages and disadvantages was responded to by 330 patients; 265 completed questionnaires were included in this study. Frequencies and differences between age groups were analysed using a two-sided chi-squared or Fisher's exact tests with Monte Carlo approximation. Patients' perceived top three disadvantages of AI use in dentistry were (1) the impact on workforce needs (37.7%), (2) new challenges on doctor-patient relationships (36.2%) and (3) increased dental care costs (31.7%). Major expected advantages were improved diagnostic confidence (60.8%), time reduction (48.3%) and more personalised and evidencebased disease management (43.0%). Most patients expected AI to be part of the dental workflow in 1-5 (42.3%) or 5-10 (46.8%) years. Older patients (> 35 years) expected higher AI performance standards than younger patients (18-35 years) (p < 0.05). Overall, patients showed a positive attitude towards AI in dentistry. Understanding patients' perceptions may allow professionals to shape AI-driven dentistry in the future.
Collapse
|
13
|
Exploring the Intersection of Artificial Intelligence and Clinical Healthcare: A Multidisciplinary Review. Diagnostics (Basel) 2023; 13:1995. [PMID: 37370890 DOI: 10.3390/diagnostics13121995] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/09/2023] [Revised: 05/31/2023] [Accepted: 06/05/2023] [Indexed: 06/29/2023] Open
Abstract
Artificial intelligence (AI) plays a more and more important role in our everyday life due to the advantages that it brings when used, such as 24/7 availability, a very low percentage of errors, ability to provide real time insights, or performing a fast analysis. AI is increasingly being used in clinical medical and dental healthcare analyses, with valuable applications, which include disease diagnosis, risk assessment, treatment planning, and drug discovery. This paper presents a narrative literature review of AI use in healthcare from a multi-disciplinary perspective, specifically in the cardiology, allergology, endocrinology, and dental fields. The paper highlights data from recent research and development efforts in AI for healthcare, as well as challenges and limitations associated with AI implementation, such as data privacy and security considerations, along with ethical and legal concerns. The regulation of responsible design, development, and use of AI in healthcare is still in early stages due to the rapid evolution of the field. However, it is our duty to carefully consider the ethical implications of implementing AI and to respond appropriately. With the potential to reshape healthcare delivery and enhance patient outcomes, AI systems continue to reveal their capabilities.
Collapse
|
14
|
Are current clinical studies on artificial intelligence-based medical devices comprehensive enough to support a full health technology assessment? A systematic review. Artif Intell Med 2023; 140:102547. [PMID: 37210155 DOI: 10.1016/j.artmed.2023.102547] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/31/2022] [Revised: 03/28/2023] [Accepted: 04/04/2023] [Indexed: 05/22/2023]
Abstract
INTRODUCTION Artificial Intelligence-based Medical Devices (AI-based MDs) are experiencing exponential growth in healthcare. This study aimed to investigate whether current studies assessing AI contain the information required for health technology assessment (HTA) by HTA bodies. METHODS We conducted a systematic literature review based on the Preferred Reporting Items for Systematic Reviews and Meta-Analyses methodology to extract articles published between 2016 and 2021 related to the assessment of AI-based MDs. Data extraction focused on study characteristics, technology, algorithms, comparators, and results. AI quality assessment and HTA scores were calculated to evaluate whether the items present in the included studies were concordant with the HTA requirements. We performed a linear regression for the HTA and AI scores with the explanatory variables of the impact factor, publication date, and medical specialty. We conducted a univariate analysis of the HTA score and a multivariate analysis of the AI score with an alpha risk of 5 %. RESULTS Of 5578 retrieved records, 56 were included. The mean AI quality assessment score was 67 %; 32 % of articles had an AI quality score ≥ 70 %, 50 % had a score between 50 % and 70 %, and 18 % had a score under 50 %. The highest quality scores were observed for the study design (82 %) and optimisation (69 %) categories, whereas the scores were lowest in the clinical practice category (23 %). The mean HTA score was 52 % for all seven domains. 100 % of the studies assessed clinical effectiveness, whereas only 9 % evaluated safety, and 20 % evaluated economic issues. There was a statistically significant relationship between the impact factor and the HTA and AI scores (both p = 0.046). DISCUSSION Clinical studies on AI-based MDs have limitations and often lack adapted, robust, and complete evidence. High-quality datasets are also required because the output data can only be trusted if the inputs are reliable. The existing assessment frameworks are not specifically designed to assess AI-based MDs. From the perspective of regulatory authorities, we suggest that these frameworks should be adapted to assess the interpretability, explainability, cybersecurity, and safety of ongoing updates. From the perspective of HTA agencies, we highlight that transparency, professional and patient acceptance, ethical issues, and organizational changes are required for the implementation of these devices. Economic assessments of AI should rely on a robust methodology (business impact or health economic models) to provide decision-makers with more reliable evidence. CONCLUSION Currently, AI studies are insufficient to cover HTA prerequisites. HTA processes also need to be adapted because they do not consider the important specificities of AI-based MDs. Specific HTA workflows and accurate assessment tools should be designed to standardise evaluations, generate reliable evidence, and create confidence.
Collapse
|
15
|
Detection of pulpal calcifications on bite-wing radiographs using deep learning. Clin Oral Investig 2023; 27:2679-2689. [PMID: 36564651 DOI: 10.1007/s00784-022-04839-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/24/2022] [Accepted: 12/21/2022] [Indexed: 12/25/2022]
Abstract
OBJECTIVES Pulpal calcifications are discrete hard calcified masses of varying sizes in the dental pulp cavity. This study is aimed at measuring the performance of the YOLOv4 deep learning algorithm to automatically determine whether there is calcification in the pulp chambers in bite-wing radiographs. MATERIALS AND METHODS In this study, 2000 bite-wing radiographs were collected from the faculty database. The oral radiologists labeled the pulp chambers on the radiographs as "Present" and "Absent" according to whether there was calcification. The data were randomly divided into 80% training, 10% validation, and 10% testing. The weight file for pulpal calcification was obtained by training the YOLOv4 algorithm with the transfer learning method. Using the weights obtained, pulp chambers and calcifications were automatically detected on the test radiographs that the algorithm had never seen. Two oral radiologists evaluated the test results, and performance criteria were calculated. RESULTS The results obtained on the test data were evaluated in two stages: detection of pulp chambers and detection of pulpal calcification. The detection performance of pulp chambers was as follows: recall 86.98%, precision 98.94%, F1-score 91.60%, and accuracy 86.18%. Pulpal calcification "Absent" and "Present" detection performance was as follows: recall 86.39%, precision 85.23%, specificity 97.94%, F1-score 85.49%, and accuracy 96.54%. CONCLUSION The YOLOv4 algorithm trained with bite-wing radiographs detected pulp chambers and calcification with high success rates. CLINICAL RELEVANCE Automatic detection of pulpal calcifications with deep learning will be used in clinical practice as a decision support system with high accuracy rates in diagnosing dentists.
Collapse
|
16
|
Artificial Intelligence in Medicine and Dentistry. Acta Stomatol Croat 2023; 57:70-84. [PMID: 37288152 PMCID: PMC10243707 DOI: 10.15644/asc57/1/8] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/02/2023] [Accepted: 03/01/2023] [Indexed: 09/14/2023] Open
Abstract
INTRODUCTION Artificial intelligence has been applied in various fields throughout history, but its integration into daily life is more recent. The first applications of AI were primarily in academia and government research institutions, but as technology has advanced, AI has also been applied in industry, commerce, medicine and dentistry. OBJECTIVE Considering that the possibilities of applying artificial intelligence are developing rapidly and that this field is one of the areas with the greatest increase in the number of newly published articles, the aim of this paper was to provide an overview of the literature and to give an insight into the possibilities of applying artificial intelligence in medicine and dentistry. In addition, the aim was to discuss its advantages and disadvantages. CONCLUSION The possibilities of applying artificial intelligence to medicine and dentistry are just being discovered. Artificial intelligence will greatly contribute to developments in medicine and dentistry, as it is a tool that enables development and progress, especially in terms of personalized healthcare that will lead to much better treatment outcomes.
Collapse
|
17
|
Artificial intelligence in dentistry—A review. FRONTIERS IN DENTAL MEDICINE 2023. [DOI: 10.3389/fdmed.2023.1085251] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/22/2023] Open
Abstract
Artificial Intelligence (AI) is the ability of machines to perform tasks that normally require human intelligence. AI is not a new term, the concept of AI can be dated back to 1950. However, it has not become a practical tool until two decades ago. Owing to the rapid development of three cornerstones of current AI technology—big data (coming through digital devices), computational power, and AI algorithm—in the past two decades, AI applications have been started to provide convenience to people's lives. In dentistry, AI has been adopted in all dental disciplines, i.e., operative dentistry, periodontics, orthodontics, oral and maxillofacial surgery, and prosthodontics. The majority of the AI applications in dentistry go to the diagnosis based on radiographic or optical images, while other tasks are not as applicable as image-based tasks mainly due to the constraints of data availability, data uniformity, and computational power for handling 3D data. Evidence-based dentistry (EBD) is regarded as the gold standard for the decision-making of dental professionals, while AI machine learning (ML) models learn from human expertise. ML can be seen as another valuable tool to assist dental professionals in multiple stages of clinical cases. This review narrated the history and classification of AI, summarised AI applications in dentistry, discussed the relationship between EBD and ML, and aimed to help dental professionals to understand AI as a tool better to assist their routine work with improved efficiency.
Collapse
|
18
|
Machine Learning in Dentistry: A Scoping Review. J Clin Med 2023; 12:jcm12030937. [PMID: 36769585 PMCID: PMC9918184 DOI: 10.3390/jcm12030937] [Citation(s) in RCA: 12] [Impact Index Per Article: 12.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/10/2022] [Revised: 01/06/2023] [Accepted: 01/23/2023] [Indexed: 01/27/2023] Open
Abstract
Machine learning (ML) is being increasingly employed in dental research and application. We aimed to systematically compile studies using ML in dentistry and assess their methodological quality, including the risk of bias and reporting standards. We evaluated studies employing ML in dentistry published from 1 January 2015 to 31 May 2021 on MEDLINE, IEEE Xplore, and arXiv. We assessed publication trends and the distribution of ML tasks (classification, object detection, semantic segmentation, instance segmentation, and generation) in different clinical fields. We appraised the risk of bias and adherence to reporting standards, using the QUADAS-2 and TRIPOD checklists, respectively. Out of 183 identified studies, 168 were included, focusing on various ML tasks and employing a broad range of ML models, input data, data sources, strategies to generate reference tests, and performance metrics. Classification tasks were most common. Forty-two different metrics were used to evaluate model performances, with accuracy, sensitivity, precision, and intersection-over-union being the most common. We observed considerable risk of bias and moderate adherence to reporting standards which hampers replication of results. A minimum (core) set of outcome and outcome metrics is necessary to facilitate comparisons across studies.
Collapse
|
19
|
Economic Evaluations of Preventive Interventions for Dental Caries and Periodontitis: A Systematic Review. APPLIED HEALTH ECONOMICS AND HEALTH POLICY 2023; 21:53-70. [PMID: 36089630 PMCID: PMC9834378 DOI: 10.1007/s40258-022-00758-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Accepted: 08/16/2022] [Indexed: 06/15/2023]
Abstract
OBJECTIVES To critically examine the methods used for full economic evaluations of preventive interventions for dental caries and periodontitis. METHODS Published literature post-2000 was searched to April 2021. Based on a developed intervention classification framework for dental caries and periodontitis, only universal, selective or indicated interventions were included in this review. The Drummond 10-point checklist was used for quality appraisal. RESULTS Of 3,007 unique records screened for relevance, 73 studies were reviewed. Most model-based studies (61/73) used cost-effectiveness analysis (49%) or cost-benefit analysis (28%). Trial-based studies (16/73) commonly used cost-effectiveness analysis (59%). Four studies used both economic evaluation methods. Sixty-four papers (88%) were on dental caries, eight papers (11%) focused on periodontitis, and one paper (1%) included both oral diseases; 72% of model-based and 82% of trial-based studies were of good quality. The most frequently investigated dental caries preventive interventions were water fluoridation (universal intervention; cost-saving or cost-effective), fissure sealant and fluoride varnish (selective and indicated interventions; cost-effectiveness outcomes were inconsistent). Supportive periodontal therapy with oral health education (indicated intervention; cost-effective) was the most frequently evaluated preventive intervention for periodontitis. Thirty percent of studies with a time horizon > 1 year did not apply an appropriate discount rate and 26% did not comprehensively discuss other important considerations beyond the technical analysis. CONCLUSIONS Generic health outcome measures should be incorporated for economic evaluations on preventive interventions for dental caries and periodontitis, and an increased focus to prevent periodontitis using economic evaluation methods is needed to inform resource allocation and policy decision-making.
Collapse
|
20
|
Applications and perspectives of artificial intelligence, machine learning and “dentronics” in dentistry: A literature review. J Int Soc Prev Community Dent 2023; 13:1-8. [PMID: 37153930 PMCID: PMC10155874 DOI: 10.4103/jispcd.jispcd_35_22] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/11/2022] [Revised: 06/08/2022] [Accepted: 06/28/2022] [Indexed: 03/11/2023] Open
Abstract
Objective The aim of this study was to describe artificial intelligence, machine learning, and "Dentronics" applications and perspectives in dentistry. Materials and Methods A literature review was carried out to identify the applications of artificial intelligence in the field of dentistry. A specialized search for information was carried out in three databases such as Scopus, PubMed, and Web of Science. Manuscripts published from January 1988 to November 2021 were analyzed. Articles were included without any restriction by language or country. Results Scopus, PubMed, and Web of Science were found to have 215, 1023, and 98 registered manuscripts, respectively. Duplicates (191 manuscripts) were eliminated. Finally, 4 letters, 12 editorials, 5 books, 1 erratum, 54 conference papers, 3 conference reviews, and 222 reviews were excluded. Conclusions Artificial intelligence has revolutionized prediction, diagnosis, and therapeutic management in modern dentistry. Finally, artificial intelligence is a potential complement to managing future data in this area.
Collapse
|
21
|
Personalized dental medicine, artificial intelligence, and their relevance for dentomaxillofacial imaging. Dentomaxillofac Radiol 2023; 52:20220335. [PMID: 36472627 PMCID: PMC9793453 DOI: 10.1259/dmfr.20220335] [Citation(s) in RCA: 14] [Impact Index Per Article: 14.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/15/2022] [Revised: 11/08/2022] [Accepted: 11/11/2022] [Indexed: 12/12/2022] Open
Abstract
Personalized medicine refers to the tailoring of diagnostics and therapeutics to individuals based on one's biological, social, and behavioral characteristics. While personalized dental medicine is still far from being a reality, advanced artificial intelligence (AI) technologies with improved data analytic approaches are expected to integrate diverse data from the individual, setting, and system levels, which may facilitate a deeper understanding of the interaction of these multilevel data and therefore bring us closer to more personalized, predictive, preventive, and participatory dentistry, also known as P4 dentistry. In the field of dentomaxillofacial imaging, a wide range of AI applications, including several commercially available software options, have been proposed to assist dentists in the diagnosis and treatment planning of various dentomaxillofacial diseases, with performance similar or even superior to that of specialists. Notably, the impact of these dental AI applications on treatment decision, clinical and patient-reported outcomes, and cost-effectiveness has so far been assessed sparsely. Such information should be further investigated in future studies to provide patients, providers, and healthcare organizers a clearer picture of the true usefulness of AI in daily dental practice.
Collapse
|
22
|
Artificial intelligence (AI) in restorative dentistry: Performance of AI models designed for detection of interproximal carious lesions on primary and permanent dentition. Digit Health 2023; 9:20552076231216681. [PMID: 38047163 PMCID: PMC10693222 DOI: 10.1177/20552076231216681] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/20/2023] [Accepted: 11/08/2023] [Indexed: 12/05/2023] Open
Abstract
Objective The objective of this study was to evaluate the effectiveness of deep learning methods in detecting dental caries from radiographic images. Methods A total of 771 bitewing radiographs were divided into two groups: adult (n = 554) and pediatric (n = 217). Two distinct semantic segmentation models were constructed for each group. They were manually labeled by general dentists for semantic segmentation. The inter-examiner reliability of the two examiners was also measured. Finally, the models were trained using transfer learning methodology along with computer science advanced tools, such as ensemble U-Nets with ResNet50, ResNext101, and Vgg19 as the encoders, which were all pretrained on ImageNet weights using a training dataset. Results Intersection over union (IoU) score was used to evaluate the outcomes of the deep learning model. For the adult dataset, the IoU averaged 98%, 23%, 19%, and 51% for zero, primary, moderate, and advanced carious lesions, respectively. For pediatric bitewings, the IoU averaged 97%, 8%, 17%, and 25% for zero, primary, moderate, and advanced caries, respectively. Advanced caries was more accurately detected than primary caries on adults and pediatric bitewings P < 0.05. Conclusions The proposed deep learning models can accurately detect advanced caries in permanent or primary bitewing radiographs. Misclassification mostly occurs between primary and moderate caries. Although the model performed well in correctly classifying the lesions, it can misclassify one as the other or does not accurately capture the depth of the lesion at this early stage.
Collapse
|
23
|
Convolutional neural network-based automatic cervical vertebral maturation classification method. Dentomaxillofac Radiol 2022; 51:20220070. [PMID: 35612567 PMCID: PMC10043621 DOI: 10.1259/dmfr.20220070] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/23/2022] [Revised: 05/05/2022] [Accepted: 05/10/2022] [Indexed: 11/05/2022] Open
Abstract
OBJECTIVES This study aimed to develop a fully automated artificial intelligence-aided cervical vertebral maturation (CVM) classification method based on convolutional neural networks (CNNs) to provide an auxiliary diagnosis for orthodontists. METHODS This study consisted of cephalometric images from patients aged between 5 and 18 years. After grouping them into six cervical stages (CSs) by orthodontists, a data set was constructed for analyzing CVM using CNNs. The data set was divided into training, validation, and test sets in the ratio of 70, 15, and 15%. Four CNN models namely, VGG16, GoogLeNet, DenseNet161, and ResNet152 were selected as the candidate models. After training and validation, the models were evaluated to determine which of them is most suitable for CVM analysis. Heat maps were analyzed for a deeper understanding of what the CNNs had learned. RESULTS The final classification accuracy ranking was ResNet152>DenseNet161>GoogLeNet>VGG16, as evaluated on the test set. ResNet152 proved to be the best model among the four models for CVM classification with a weighted κ of 0.826, an average AUC of 0.933 and total accuracy of 67.06%. The F1 score rank for each subgroup was: CS6>CS1>CS4>CS5>CS3>CS2. The area of the third (C3) and fourth (C4) cervical vertebrae were activated when CNNs were assessing the images. CONCLUSION CNN models proved to be a convenient, fast and reliable method for CVM analysis. CNN models have the potential to provide automatic auxiliary diagnostic tools in the future.
Collapse
|
24
|
Abstract
If increasing practitioners’ diagnostic accuracy, medical artificial intelligence (AI)
may lead to better treatment decisions at lower costs, while uncertainty remains around
the resulting cost-effectiveness. In the present study, we assessed how enlarging the data
set used for training an AI for caries detection on bitewings affects cost-effectiveness
and also determined the value of information by reducing the uncertainty around other
input parameters (namely, the costs of AI and the population’s caries risk profile). We
employed a convolutional neural network and trained it on 10%, 25%, 50%, or 100% of a
labeled data set containing 29,011 teeth without and 19,760 teeth with caries lesions
stemming from bitewing radiographs. We employed an established health economic modeling
and analytical framework to quantify cost-effectiveness and value of information. We
adopted a mixed public–private payer perspective in German health care; the health outcome
was tooth retention years. A Markov model, allowing to follow posterior teeth over the
lifetime of an initially 12-y-old individual, and Monte Carlo microsimulations were
employed. With an increasing amount of data used to train the AI sensitivity and
specificity increased nonlinearly, increasing the data set from 10% to 25% had the largest
impact on accuracy and, consequently, cost-effectiveness. In the base-case scenario, AI
was more effective (tooth retention for a mean [2.5%–97.5%] 62.8 [59.2–65.5] y) and less
costly (378 [284–499] euros) than dentists without AI (60.4 [55.8–64.4] y; 419 [270–593]
euros), with considerable uncertainty. The economic value of reducing the uncertainty
around AI’s accuracy or costs was limited, while information on the population’s risk
profile was more relevant. When developing dental AI, informed choices about the data set
size may be recommended, and research toward individualized application of AI for caries
detection seems warranted to optimize cost-effectiveness.
Collapse
|
25
|
Where Is the Artificial Intelligence Applied in Dentistry? Systematic Review and Literature Analysis. Healthcare (Basel) 2022; 10:healthcare10071269. [PMID: 35885796 PMCID: PMC9320442 DOI: 10.3390/healthcare10071269] [Citation(s) in RCA: 22] [Impact Index Per Article: 11.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/07/2022] [Revised: 06/25/2022] [Accepted: 06/30/2022] [Indexed: 12/29/2022] Open
Abstract
This literature research had two main objectives. The first objective was to quantify how frequently artificial intelligence (AI) was utilized in dental literature from 2011 until 2021. The second objective was to distinguish the focus of such publications; in particular, dental field and topic. The main inclusion criterium was an original article or review in English focused on dental utilization of AI. All other types of publications or non-dental or non-AI-focused were excluded. The information sources were Web of Science, PubMed, Scopus, and Google Scholar, queried on 19 April 2022. The search string was “artificial intelligence” AND (dental OR dentistry OR tooth OR teeth OR dentofacial OR maxillofacial OR orofacial OR orthodontics OR endodontics OR periodontics OR prosthodontics). Following the removal of duplicates, all remaining publications were returned by searches and were screened by three independent operators to minimize the risk of bias. The analysis of 2011–2021 publications identified 4413 records, from which 1497 were finally selected and calculated according to the year of publication. The results confirmed a historically unprecedented boom in AI dental publications, with an average increase of 21.6% per year over the last decade and a 34.9% increase per year over the last 5 years. In the achievement of the second objective, qualitative assessment of dental AI publications since 2021 identified 1717 records, with 497 papers finally selected. The results of this assessment indicated the relative proportions of focal topics, as follows: radiology 26.36%, orthodontics 18.31%, general scope 17.10%, restorative 12.09%, surgery 11.87% and education 5.63%. The review confirms that the current use of artificial intelligence in dentistry is concentrated mainly around the evaluation of digital diagnostic methods, especially radiology; however, its implementation is expected to gradually penetrate all parts of the profession.
Collapse
|
26
|
Application and Performance of Artificial Intelligence Technology in Detection, Diagnosis and Prediction of Dental Caries (DC)—A Systematic Review. Diagnostics (Basel) 2022; 12:diagnostics12051083. [PMID: 35626239 PMCID: PMC9139989 DOI: 10.3390/diagnostics12051083] [Citation(s) in RCA: 14] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/20/2022] [Revised: 04/12/2022] [Accepted: 04/25/2022] [Indexed: 01/27/2023] Open
Abstract
Evolution in the fields of science and technology has led to the development of newer applications based on Artificial Intelligence (AI) technology that have been widely used in medical sciences. AI-technology has been employed in a wide range of applications related to the diagnosis of oral diseases that have demonstrated phenomenal precision and accuracy in their performance. The aim of this systematic review is to report on the diagnostic accuracy and performance of AI-based models designed for detection, diagnosis, and prediction of dental caries (DC). Eminent electronic databases (PubMed, Google scholar, Scopus, Web of science, Embase, Cochrane, Saudi Digital Library) were searched for relevant articles that were published from January 2000 until February 2022. A total of 34 articles that met the selection criteria were critically analyzed based on QUADAS-2 guidelines. The certainty of the evidence of the included studies was assessed using the GRADE approach. AI has been widely applied for prediction of DC, for detection and diagnosis of DC and for classification of DC. These models have demonstrated excellent performance and can be used in clinical practice for enhancing the diagnostic performance, treatment quality and patient outcome and can also be applied to identify patients with a higher risk of developing DC.
Collapse
|
27
|
Detecting Proximal Caries on Periapical Radiographs Using Convolutional Neural Networks with Different Training Strategies on Small Datasets. Diagnostics (Basel) 2022; 12:diagnostics12051047. [PMID: 35626203 PMCID: PMC9139265 DOI: 10.3390/diagnostics12051047] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/23/2022] [Revised: 04/14/2022] [Accepted: 04/19/2022] [Indexed: 02/05/2023] Open
Abstract
The present study aimed to evaluate the performance of convolutional neural networks (CNNs) that were trained with small datasets using different strategies in the detection of proximal caries at different levels of severity on periapical radiographs. Small datasets containing 800 periapical radiographs were randomly categorized into a training and validation dataset (n = 600) and a test dataset (n = 200). A pretrained Cifar-10Net CNN was used in the present study. Different training strategies were used to train the CNN model independently; these strategies were defined as image recognition (IR), edge extraction (EE), and image segmentation (IS). Different metrics, such as sensitivity and area under the receiver operating characteristic curve (AUC), for the trained CNN and human observers were analysed to evaluate the performance in detecting proximal caries. IR, EE, and IS recognition modes and human eyes achieved AUCs of 0.805, 0.860, 0.549, and 0.767, respectively, with the EE recognition mode having the highest values (p all < 0.05). The EE recognition mode was significantly more sensitive in detecting both enamel and dentin caries than human eyes (p all < 0.05). The CNN trained with the EE strategy, the best performer in the present study, showed potential utility in detecting proximal caries on periapical radiographs when using small datasets.
Collapse
|
28
|
Abstract
Oral squamous cell carcinoma (OSCC) is prevalent around the world and is associated with poor prognosis. OSCC is typically diagnosed from tissue biopsy sections by pathologists who rely on their empirical experience. Deep learning models may improve the accuracy and speed of image classification, thus reducing human error and workload. Here we developed a custom-made deep learning model to assist pathologists in detecting OSCC from histopathology images. We collected and analyzed a total of 2,025 images, among which 1,925 images were included in the training set and 100 images were included in the testing set. Our model was able to automatically evaluate these images and arrive at a diagnosis with a sensitivity of 0.98, specificity of 0.92, positive predictive value of 0.924, negative predictive value of 0.978, and F1 score of 0.951. Using a subset of 100 images, we examined whether our model could improve the diagnostic performance of junior and senior pathologists. We found that junior pathologists were able to delineate OSCC in these images 6.26 min faster when assisted by the model than when working alone. When the clinicians were assisted by the model, their average F1 score improved from 0.9221 to 0.9566 in the case of junior pathologists and from 0.9361 to 0.9463 in the case of senior pathologists. Our findings indicate that deep learning can improve the accuracy and speed of OSCC diagnosis from histopathology images.
Collapse
|
29
|
Intelligent systems for precision dental diagnosis and treatment planning – A review. CUMHURIYET DENTAL JOURNAL 2022. [DOI: 10.7126/cumudj.991480] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
Machines have changed the course of mankind. Simple machines were the basis of human civilization. Today with humongous technological development, machines are intelligent enough to carry out very complex nerve-racking tasks. The ability of a machine to learn from algorithms changed eventually into, the machine learning by itself, which constitutes artificial intelligence. Literature has plausible evidence for the use of intelligent systems in medical field. Artificial intelligence has been used in the multiple denominations of dentistry. These machines are used in the precision diagnosis, interpretation of medical images, accumulation of data, classification and compilation of records, determination of treatment and construction of a personalized treatment plan. Artificial intelligence can help in timely diagnosis of complex dental diseases which would ultimately aid in rapid commencement of treatment. Research helps us understand the effectiveness and challenges in the use of this technology. The apt use of intelligent systems could transform the entire medical system for the better.
Collapse
|
30
|
Deep Learning for Caries Detection: A Systematic Review. J Dent 2022; 122:104115. [DOI: 10.1016/j.jdent.2022.104115] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/02/2022] [Revised: 03/24/2022] [Accepted: 03/28/2022] [Indexed: 12/21/2022] Open
|
31
|
Systematic Review of Health Economic Evaluations Focused on Artificial Intelligence in Healthcare: The Tortoise and the Cheetah. VALUE IN HEALTH : THE JOURNAL OF THE INTERNATIONAL SOCIETY FOR PHARMACOECONOMICS AND OUTCOMES RESEARCH 2022; 25:340-349. [PMID: 35227444 DOI: 10.1016/j.jval.2021.11.1362] [Citation(s) in RCA: 12] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/09/2021] [Revised: 10/14/2021] [Accepted: 11/10/2021] [Indexed: 06/14/2023]
Abstract
OBJECTIVES This study aimed to systematically review recent health economic evaluations (HEEs) of artificial intelligence (AI) applications in healthcare. The aim was to discuss pertinent methods, reporting quality and challenges for future implementation of AI in healthcare, and additionally advise future HEEs. METHODS A systematic literature review was conducted in 2 databases (PubMed and Scopus) for articles published in the last 5 years. Two reviewers performed independent screening, full-text inclusion, data extraction, and appraisal. The Consolidated Health Economic Evaluation Reporting Standards and Philips checklist were used for the quality assessment of included studies. RESULTS A total of 884 unique studies were identified; 20 were included for full-text review, covering a wide range of medical specialties and care pathway phases. The most commonly evaluated type of AI was automated medical image analysis models (n = 9, 45%). The prevailing health economic analysis was cost minimization (n = 8, 40%) with the costs saved per case as preferred outcome measure. A total of 9 studies (45%) reported model-based HEEs, 4 of which applied a time horizon >1 year. The evidence supporting the chosen analytical methods, assessment of uncertainty, and model structures was underreported. The reporting quality of the articles was moderate as on average studies reported on 66% of Consolidated Health Economic Evaluation Reporting Standards items. CONCLUSIONS HEEs of AI in healthcare are limited and often focus on costs rather than health impact. Surprisingly, model-based long-term evaluations are just as uncommon as model-based short-term evaluations. Consequently, insight into the actual benefits offered by AI is lagging behind current technological developments.
Collapse
|
32
|
Cost-effectiveness of Artificial Intelligence as a Decision-Support System Applied to the Detection and Grading of Melanoma, Dental Caries, and Diabetic Retinopathy. JAMA Netw Open 2022; 5:e220269. [PMID: 35289862 PMCID: PMC8924723 DOI: 10.1001/jamanetworkopen.2022.0269] [Citation(s) in RCA: 24] [Impact Index Per Article: 12.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/13/2022] Open
Abstract
OBJECTIVE To assess the cost-effectiveness of artificial intelligence (AI) for supporting clinicians in detecting and grading diseases in dermatology, dentistry, and ophthalmology. IMPORTANCE AI has been referred to as a facilitator for more precise, personalized, and safer health care, and AI algorithms have been reported to have diagnostic accuracies at or above the average physician in dermatology, dentistry, and ophthalmology. DESIGN, SETTING, AND PARTICIPANTS This economic evaluation analyzed data from 3 Markov models used in previous cost-effectiveness studies that were adapted to compare AI vs standard of care to detect melanoma on skin photographs, dental caries on radiographs, and diabetic retinopathy on retina fundus imaging. The general US and German population aged 50 and 12 years, respectively, as well as individuals with diabetes in Brazil aged 40 years were modeled over their lifetime. Monte Carlo microsimulations and sensitivity analyses were used to capture lifetime efficacy and costs. An annual cycle length was chosen. Data were analyzed between February 2021 and August 2021. EXPOSURE AI vs standard of care. MAIN OUTCOMES AND MEASURES Association of AI with tooth retention-years for dentistry and quality-adjusted life-years (QALYs) for individuals in dermatology and ophthalmology; diagnostic costs. RESULTS In 1000 microsimulations with 1000 random samples, AI as a diagnostic-support system showed limited cost-savings and gains in tooth retention-years and QALYs. In dermatology, AI showed mean costs of $750 (95% CI, $608-$970) and was associated with 86.5 QALYs (95% CI, 84.9-87.9 QALYs), while the control showed higher costs $759 (95% CI, $618-$970) with similar QALY outcome. In dentistry, AI accumulated costs of €320 (95% CI, €299-€341) (purchasing power parity [PPP] conversion, $429 [95% CI, $400-$458]) with 62.4 years per tooth retention (95% CI, 60.7-65.1 years). The control was associated with higher cost, €342 (95% CI, €318-€368) (PPP, $458; 95% CI, $426-$493) and fewer tooth retention-years (60.9 years; 95% CI, 60.5-63.1 years). In ophthalmology, AI accrued costs of R $1321 (95% CI, R $1283-R $1364) (PPP, $559; 95% CI, $543-$577) at 8.4 QALYs (95% CI, 8.0-8.7 QALYs), while the control was less expensive (R $1260; 95% CI, R $1222-R $1303) (PPP, $533; 95% CI, $517-$551) and associated with similar QALYs. Dominance in favor of AI was dependent on small differences in the fee paid for the service and the treatment assumed after diagnosis. The fee paid for AI was a factor in patient preferences in cost-effectiveness between strategies. CONCLUSIONS AND RELEVANCE The findings of this study suggest that marginal improvements in diagnostic accuracy when using AI may translate into a marginal improvement in outcomes. The current evidence supporting AI as decision support from a cost-effectiveness perspective is limited; AI should be evaluated on a case-specific basis to capture not only differences in costs and payment mechanisms but also treatment after diagnosis.
Collapse
|
33
|
Artificial intelligence in oral radiology: A checklist proposal. JOURNAL OF ORAL AND MAXILLOFACIAL RADIOLOGY 2022. [DOI: 10.4103/jomr.jomr_21_22] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/30/2022] Open
|
34
|
Abstract
Developers proposing new machine learning for health (ML4H) tools often pledge to match or even surpass the performance of existing tools, yet the reality is usually more complicated. Reliable deployment of ML4H to the real world is challenging as examples from diabetic retinopathy or Covid-19 screening show. We envision an integrated framework of algorithm auditing and quality control that provides a path towards the effective and reliable application of ML systems in healthcare. In this editorial, we give a summary of ongoing work towards that vision and announce a call for participation to the special issue Machine Learning for Health: Algorithm Auditing & Quality Control in this journal to advance the practice of ML4H auditing.
Collapse
|
35
|
A systematic scoping review analysing clinical, technical and financial aspects of cost-effectiveness of Artificial Intelligence applied in medicine: A theory and framework of analysis (Preprint). JMIR Med Inform 2021; 10:e33703. [PMID: 35969458 PMCID: PMC9419048 DOI: 10.2196/33703] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/20/2021] [Revised: 03/29/2022] [Accepted: 05/13/2022] [Indexed: 11/13/2022] Open
Abstract
Background Cost-effectiveness analysis of artificial intelligence (AI) in medicine demands consideration of clinical, technical, and economic aspects to generate impactful research of a novel and highly versatile technology. Objective We aimed to systematically scope existing literature on the cost-effectiveness of AI and to extract and summarize clinical, technical, and economic dimensions required for a comprehensive assessment. Methods A scoping literature review was conducted to map medical, technical, and economic aspects considered in studies on the cost-effectiveness of medical AI. Based on these, a framework for health policy analysis was developed. Results Among 4820 eligible studies, 13 met the inclusion criteria for our review. Internal medicine and emergency medicine were the clinical disciplines most frequently analyzed. Most of the studies included were from the United States (5/13, 39%), assessed solutions requiring market access (9/13, 69%), and proposed optimization of direct resources as the most frequent value proposition (7/13, 53%). On the other hand, technical aspects were not uniformly disclosed in the studies we analyzed. A minority of articles explicitly stated the payment mechanism assumed (5/13, 38%), while it remained unspecified in the majority (8/13, 62%) of studies. Conclusions Current studies on the cost-effectiveness of AI do not allow to determine if the investigated AI solutions are clinically, technically, and economically viable. Further research and improved reporting on these dimensions seem relevant to recommend and assess potential use cases for this technology.
Collapse
|
36
|
Deep Learning-Based Prediction of Paresthesia after Third Molar Extraction: A Preliminary Study. Diagnostics (Basel) 2021; 11:diagnostics11091572. [PMID: 34573914 PMCID: PMC8469771 DOI: 10.3390/diagnostics11091572] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/21/2021] [Revised: 08/25/2021] [Accepted: 08/28/2021] [Indexed: 01/04/2023] Open
Abstract
The purpose of this study was to determine whether convolutional neural networks (CNNs) can predict paresthesia of the inferior alveolar nerve using panoramic radiographic images before extraction of the mandibular third molar. The dataset consisted of a total of 300 preoperative panoramic radiographic images of patients who had planned mandibular third molar extraction. A total of 100 images taken of patients who had paresthesia after tooth extraction were classified as Group 1, and 200 images taken of patients without paresthesia were classified as Group 2. The dataset was randomly divided into a training and validation set (n = 150 [50%]), and a test set (n = 150 [50%]). CNNs of SSD300 and ResNet-18 were used for deep learning. The average accuracy, sensitivity, specificity, and area under the curve were 0.827, 0.84, 0.82, and 0.917, respectively. This study revealed that CNNs can assist in the prediction of paresthesia of the inferior alveolar nerve after third molar extraction using panoramic radiographic images.
Collapse
|
37
|
Scope and challenges of machine learning-based diagnosis and prognosis in clinical dentistry: A literature review. J Clin Transl Res 2021; 7:523-539. [PMID: 34541366 PMCID: PMC8445629] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/19/2021] [Revised: 04/17/2021] [Accepted: 05/24/2021] [Indexed: 11/18/2022] Open
Abstract
BACKGROUND Machine learning (ML) has emerged as a branch of artificial intelligence dealing with the analysis of large amounts of data. The applications of ML algorithms have also expanded to health care, including dentistry. Recent advances in this field point to future improvements in diagnostic techniques and the prognosis of various diseases of the teeth and other maxillofacial structures. AIM The aim of this literature review is to describe the basis for ML being applied to different dental sub-fields in recent years, to identify typical algorithms used in the studies, and to summarize the scope and challenges of using these techniques in dental clinical practice. RELEVANCE FOR PATIENTS The proficiency of emerging technologies that have begun to show encouraging results in the diagnosis and prognosis of oral diseases can improve the precision in the selection of treatment for patients. It is necessary to understand the challenges associated with using these tools to effectively use them in dental services and ensure a higher quality of care for patients.
Collapse
|
38
|
Abstract
Data are a key resource for modern societies and expected to improve quality, accessibility, affordability, safety, and equity of health care. Dental care and research are currently transforming into what we term data dentistry, with 3 main applications: 1) medical data analysis uses deep learning, allowing one to master unprecedented amounts of data (language, speech, imagery) and put them to productive use. 2) Data-enriched clinical care integrates data from individual (e.g., demographic, social, clinical and omics data, consumer data), setting (e.g., geospatial, environmental, provider-related data), and systems level (payer or regulatory data to characterize input, throughput, output, and outcomes of health care) to provide a comprehensive and continuous real-time assessment of biologic perturbations, individual behaviors, and context. Such care may contribute to a deeper understanding of health and disease and a more precise, personalized, predictive, and preventive care. 3) Data for research include open research data and data sharing, allowing one to appraise, benchmark, pool, replicate, and reuse data. Concerns and confidence into data-driven applications, stakeholders’ and system’s capabilities, and lack of data standardization and harmonization currently limit the development and implementation of data dentistry. Aspects of bias and data-user interaction require attention. Action items for the dental community circle around increasing data availability, refinement, and usage; demonstrating safety, value, and usefulness of applications; educating the dental workforce and consumers; providing performant and standardized infrastructure and processes; and incentivizing and adopting open data and data sharing.
Collapse
|
39
|
Machine learning in dental, oral and craniofacial imaging: a review of recent progress. PeerJ 2021; 9:e11451. [PMID: 34046262 PMCID: PMC8136280 DOI: 10.7717/peerj.11451] [Citation(s) in RCA: 15] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/02/2020] [Accepted: 04/22/2021] [Indexed: 02/05/2023] Open
Abstract
Artificial intelligence has been emerging as an increasingly important aspect of our daily lives and is widely applied in medical science. One major application of artificial intelligence in medical science is medical imaging. As a major component of artificial intelligence, many machine learning models are applied in medical diagnosis and treatment with the advancement of technology and medical imaging facilities. The popularity of convolutional neural network in dental, oral and craniofacial imaging is heightening, as it has been continually applied to a broader spectrum of scientific studies. Our manuscript reviews the fundamental principles and rationales behind machine learning, and summarizes its research progress and its recent applications specifically in dental, oral and craniofacial imaging. It also reviews the problems that remain to be resolved and evaluates the prospect of the future development of this field of scientific study.
Collapse
|
40
|
Abstract
An increasing number of studies on artificial intelligence (AI) are published in the dental and oral sciences. The reporting, but also further aspects of these studies, suffer from a range of limitations. Standards towards reporting, like the recently published Consolidated Standards of Reporting Trials (CONSORT)-AI extension can help to improve studies in this emerging field, and the Journal of Dental Research (JDR) encourages authors, reviewers, and readers to adhere to these standards. Notably, though, a wide range of aspects beyond reporting, located along various steps of the AI lifecycle, should be considered when conceiving, conducting, reporting, or evaluating studies on AI in dentistry.
Collapse
|