1
|
Lu A, Williams RO, Maniruzzaman M. 3D printing of biologics-what has been accomplished to date? Drug Discov Today 2024; 29:103823. [PMID: 37949427 DOI: 10.1016/j.drudis.2023.103823] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/18/2023] [Revised: 10/27/2023] [Accepted: 11/06/2023] [Indexed: 11/12/2023]
Abstract
Three-dimensional (3D) printing is a promising approach for the stabilization and delivery of non-living biologics. This versatile tool builds complex structures and customized resolutions, and has significant potential in various industries, especially pharmaceutics and biopharmaceutics. Biologics have become increasingly prevalent in the field of medicine due to their diverse applications and benefits. Stability is the main attribute that must be achieved during the development of biologic formulations. 3D printing could help to stabilize biologics by entrapment, support binding, or crosslinking. Furthermore, gene fragments could be transited into cells during co-printing, when the pores on the membrane are enlarged. This review provides: (i) an introduction to 3D printing technologies and biologics, covering genetic elements, therapeutic proteins, antibodies, and bacteriophages; (ii) an overview of the applications of 3D printing of biologics, including regenerative medicine, gene therapy, and personalized treatments; (iii) information on how 3D printing could help to stabilize and deliver biologics; and (iv) discussion on regulations, challenges, and future directions, including microneedle vaccines, novel 3D printing technologies and artificial-intelligence-facilitated research and product development. Overall, the 3D printing of biologics holds great promise for enhancing human health by providing extended longevity and enhanced quality of life, making it an exciting area in the rapidly evolving field of biomedicine.
Collapse
Affiliation(s)
- Anqi Lu
- Division of Molecular Pharmaceutics and Drug Delivery, College of Pharmacy, The University of Texas at Austin, Austin, TX 78712, USA
| | - Robert O Williams
- Division of Molecular Pharmaceutics and Drug Delivery, College of Pharmacy, The University of Texas at Austin, Austin, TX 78712, USA
| | - Mohammed Maniruzzaman
- Division of Molecular Pharmaceutics and Drug Delivery, College of Pharmacy, The University of Texas at Austin, Austin, TX 78712, USA; Pharmaceutical Engineering and 3D Printing (PharmE3D) Lab, Department of Pharmaceutics and Drug Delivery, School of Pharmacy, The University of Mississippi, University, MS 38677, USA.
| |
Collapse
|
2
|
Morris JM, Wentworth A, Houdek MT, Karim SM, Clarke MJ, Daniels DJ, Rose PS. The Role of 3D Printing in Treatment Planning of Spine and Sacral Tumors. Neuroimaging Clin N Am 2023; 33:507-529. [PMID: 37356866 DOI: 10.1016/j.nic.2023.05.001] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/27/2023]
Abstract
Three-dimensional (3D) printing technology has proven to have many advantages in spine and sacrum surgery. 3D printing allows the manufacturing of life-size patient-specific anatomic and pathologic models to improve preoperative understanding of patient anatomy and pathology. Additionally, virtual surgical planning using medical computer-aided design software has enabled surgeons to create patient-specific surgical plans and simulate procedures in a virtual environment. This has resulted in reduced operative times, decreased complications, and improved patient outcomes. Combined with new surgical techniques, 3D-printed custom medical devices and instruments using titanium and biocompatible resins and polyamides have allowed innovative reconstructions.
Collapse
Affiliation(s)
- Jonathan M Morris
- Division of Neuroradiology, Department of Radiology, Anatomic Modeling Unit, Biomedical and Scientific Visualization, Mayo Clinic, 200 1st Street, Southwest, Rochester, MN, 55905, USA.
| | - Adam Wentworth
- Department of Radiology, Anatomic Modeling Unit, Mayo Clinic, Rochester, MN, USA
| | - Matthew T Houdek
- Division of Orthopedic Oncology, Orthopedic Surgery, Mayo Clinic, Rochester, MN, USA
| | - S Mohammed Karim
- Division of Orthopedic Oncology, Orthopedic Surgery, Mayo Clinic, Rochester, MN, USA
| | | | | | - Peter S Rose
- Division of Orthopedic Oncology, Orthopedic Surgery, Mayo Clinic, Rochester, MN, USA
| |
Collapse
|
3
|
Gharibshahian M, Salehi M, Beheshtizadeh N, Kamalabadi-Farahani M, Atashi A, Nourbakhsh MS, Alizadeh M. Recent advances on 3D-printed PCL-based composite scaffolds for bone tissue engineering. Front Bioeng Biotechnol 2023; 11:1168504. [PMID: 37469447 PMCID: PMC10353441 DOI: 10.3389/fbioe.2023.1168504] [Citation(s) in RCA: 36] [Impact Index Per Article: 18.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/17/2023] [Accepted: 06/05/2023] [Indexed: 07/21/2023] Open
Abstract
Population ageing and various diseases have increased the demand for bone grafts in recent decades. Bone tissue engineering (BTE) using a three-dimensional (3D) scaffold helps to create a suitable microenvironment for cell proliferation and regeneration of damaged tissues or organs. The 3D printing technique is a beneficial tool in BTE scaffold fabrication with appropriate features such as spatial control of microarchitecture and scaffold composition, high efficiency, and high precision. Various biomaterials could be used in BTE applications. PCL, as a thermoplastic and linear aliphatic polyester, is one of the most widely used polymers in bone scaffold fabrication. High biocompatibility, low cost, easy processing, non-carcinogenicity, low immunogenicity, and a slow degradation rate make this semi-crystalline polymer suitable for use in load-bearing bones. Combining PCL with other biomaterials, drugs, growth factors, and cells has improved its properties and helped heal bone lesions. The integration of PCL composites with the new 3D printing method has made it a promising approach for the effective treatment of bone injuries. The purpose of this review is give a comprehensive overview of the role of printed PCL composite scaffolds in bone repair and the path ahead to enter the clinic. This study will investigate the types of 3D printing methods for making PCL composites and the optimal compounds for making PCL composites to accelerate bone healing.
Collapse
Affiliation(s)
- Maliheh Gharibshahian
- Student Research Committee, School of Medicine, Shahroud University of Medical Sciences, Shahroud, Iran
| | - Majid Salehi
- Department of Tissue Engineering, School of Medicine, Shahroud University of Medical Sciences, Shahroud, Iran
- Tissue Engineering and Stem Cells Research Center, Shahroud University of Medical Sciences, Shahroud, Iran
| | - Nima Beheshtizadeh
- Regenerative Medicine Group (REMED), Universal Scientific Education and Research Network (USERN), Tehran, Iran
- Department of Tissue Engineering, School of Advanced Technologies in Medicine, Tehran University of Medical Sciences, Tehran, Iran
| | | | - Amir Atashi
- Tissue Engineering and Stem Cells Research Center, Shahroud University of Medical Sciences, Shahroud, Iran
| | | | - Morteza Alizadeh
- Department of Tissue Engineering, School of Medicine, Shahroud University of Medical Sciences, Shahroud, Iran
| |
Collapse
|
4
|
Rahman MA, Saleh T, Jahan MP, McGarry C, Chaudhari A, Huang R, Tauhiduzzaman M, Ahmed A, Mahmud AA, Bhuiyan MS, Khan MF, Alam MS, Shakur MS. Review of Intelligence for Additive and Subtractive Manufacturing: Current Status and Future Prospects. MICROMACHINES 2023; 14:508. [PMID: 36984915 PMCID: PMC10056501 DOI: 10.3390/mi14030508] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/20/2022] [Revised: 02/17/2023] [Accepted: 02/17/2023] [Indexed: 06/18/2023]
Abstract
Additive manufacturing (AM), an enabler of Industry 4.0, recently opened limitless possibilities in various sectors covering personal, industrial, medical, aviation and even extra-terrestrial applications. Although significant research thrust is prevalent on this topic, a detailed review covering the impact, status, and prospects of artificial intelligence (AI) in the manufacturing sector has been ignored in the literature. Therefore, this review provides comprehensive information on smart mechanisms and systems emphasizing additive, subtractive and/or hybrid manufacturing processes in a collaborative, predictive, decisive, and intelligent environment. Relevant electronic databases were searched, and 248 articles were selected for qualitative synthesis. Our review suggests that significant improvements are required in connectivity, data sensing, and collection to enhance both subtractive and additive technologies, though the pervasive use of AI by machines and software helps to automate processes. An intelligent system is highly recommended in both conventional and non-conventional subtractive manufacturing (SM) methods to monitor and inspect the workpiece conditions for defect detection and to control the machining strategies in response to instantaneous output. Similarly, AM product quality can be improved through the online monitoring of melt pool and defect formation using suitable sensing devices followed by process control using machine learning (ML) algorithms. Challenges in implementing intelligent additive and subtractive manufacturing systems are also discussed in the article. The challenges comprise difficulty in self-optimizing CNC systems considering real-time material property and tool condition, defect detections by in-situ AM process monitoring, issues of overfitting and underfitting data in ML models and expensive and complicated set-ups in hybrid manufacturing processes.
Collapse
Affiliation(s)
- M. Azizur Rahman
- Department of Mechanical and Production Engineering, Ahsanullah University of Science and Technology, Dhaka 1208, Bangladesh
- McMaster Manufacturing Research Institute (MMRI), Department of Mechanical Engineering, McMaster University, Hamilton, ON L8S4L7, Canada
| | - Tanveer Saleh
- Autonomous Systems and Robotics Research Unit (ASRRU), Department of Mechatronics Engineering, International Islamic University Malaysia (IIUM), Kuala Lumpur 53100, Malaysia
| | - Muhammad Pervej Jahan
- Department of Mechanical and Manufacturing Engineering, Miami University, Oxford, OH 45056, USA
| | - Conor McGarry
- Department of Mechanical and Manufacturing Engineering, Miami University, Oxford, OH 45056, USA
| | - Akshay Chaudhari
- Department of Mechanical Engineering, National University of Singapore, Singapore 117575, Singapore
| | - Rui Huang
- Singapore Institute of Manufacturing Technology, 73 Nanyang Drive, Singapore 637662, Singapore
| | - M. Tauhiduzzaman
- National Research Council of Canada, 800 Collip Circle, London, ON N6G 4X8, Canada
| | - Afzaal Ahmed
- Department of Mechanical Engineering, Indian Institute of Technology Palakkad, Palakkad 678557, India
| | - Abdullah Al Mahmud
- School of Design, Swinburne University of Technology, Melbourne, VIC 3122, Australia
| | - Md. Shahnewaz Bhuiyan
- Department of Mechanical and Production Engineering, Ahsanullah University of Science and Technology, Dhaka 1208, Bangladesh
| | - Md Faysal Khan
- Department of Mechanical and Production Engineering, Ahsanullah University of Science and Technology, Dhaka 1208, Bangladesh
- Department of Mechanical Engineering, Auburn University, Auburn, AL 36849, USA
| | - Md. Shafiul Alam
- McMaster Manufacturing Research Institute (MMRI), Department of Mechanical Engineering, McMaster University, Hamilton, ON L8S4L7, Canada
| | - Md Shihab Shakur
- Department of Industrial & Production Engineering, Bangladesh University of Engineering & Technology (BUET), Dhaka 1000, Bangladesh
| |
Collapse
|
5
|
Strickler EAT, Thomas J, Thomas JP, Benjamin B, Shamsuddin R. Exploring a global interpretation mechanism for deep learning networks when predicting sepsis. Sci Rep 2023; 13:3067. [PMID: 36810645 PMCID: PMC9945464 DOI: 10.1038/s41598-023-30091-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/15/2022] [Accepted: 02/15/2023] [Indexed: 02/24/2023] Open
Abstract
The purpose of this study is to identify additional clinical features for sepsis detection through the use of a novel mechanism for interpreting black-box machine learning models trained and to provide a suitable evaluation for the mechanism. We use the publicly available dataset from the 2019 PhysioNet Challenge. It has around 40,000 Intensive Care Unit (ICU) patients with 40 physiological variables. Using Long Short-Term Memory (LSTM) as the representative black-box machine learning model, we adapted the Multi-set Classifier to globally interpret the black-box model for concepts it learned about sepsis. To identify relevant features, the result is compared against: (i) features used by a computational sepsis expert, (ii) clinical features from clinical collaborators, (iii) academic features from literature, and (iv) significant features from statistical hypothesis testing. Random Forest was found to be the computational sepsis expert because it had high accuracies for solving both the detection and early detection, and a high degree of overlap with clinical and literature features. Using the proposed interpretation mechanism and the dataset, we identified 17 features that the LSTM used for sepsis classification, 11 of which overlaps with the top 20 features from the Random Forest model, 10 with academic features and 5 with clinical features. Clinical opinion suggests, 3 LSTM features have strong correlation with some clinical features that were not identified by the mechanism. We also found that age, chloride ion concentration, pH and oxygen saturation should be investigated further for connection with developing sepsis. Interpretation mechanisms can bolster the incorporation of state-of-the-art machine learning models into clinical decision support systems, and might help clinicians to address the issue of early sepsis detection. The promising results from this study warrants further investigation into creation of new and improvement of existing interpretation mechanisms for black-box models, and into clinical features that are currently not used in clinical assessment of sepsis.
Collapse
Affiliation(s)
- Ethan A T Strickler
- Physics and Mathematics, East Central University, PO Box 385, Ada, OK, 74820, USA
| | - Joshua Thomas
- Department of Internal Medicine, Rush University Medical Center, 1700 W Van Buren St, 5th Floor, Chicago, IL, 60612, USA
| | - Johnson P Thomas
- Oklahoma State University, 201 Math and Science Building, Stillwater, OK, 74078, USA
| | - Bruce Benjamin
- School of Biomedical Sciences, Center for Health Sciences, 1111 W. 17th st., Tulsa, OK, 74107, USA
| | - Rittika Shamsuddin
- Oklahoma State University, 212 Math and Science Building, Stillwater, OK, 74078, USA.
| |
Collapse
|
6
|
Establishing a Point-of-Care Virtual Planning and 3D Printing Program. Semin Plast Surg 2022; 36:133-148. [PMID: 36506280 PMCID: PMC9729064 DOI: 10.1055/s-0042-1754351] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/12/2022]
Abstract
Virtual surgical planning (VSP) and three-dimensional (3D) printing have become a standard of care at our institution, transforming the surgical care of complex patients. Patient-specific, anatomic models and surgical guides are clinically used to improve multidisciplinary communication, presurgical planning, intraoperative guidance, and the patient informed consent. Recent innovations have allowed both VSP and 3D printing to become more accessible to various sized hospital systems. Insourcing such work has several advantages including quicker turnaround times and increased innovation through collaborative multidisciplinary teams. Centralizing 3D printing programs at the point-of-care provides a greater cost-efficient investment for institutions. The following article will detail capital equipment needs, institutional structure, operational personnel, and other considerations necessary in the establishment of a POC manufacturing program.
Collapse
|
7
|
Drabiak K. Leveraging law and ethics to promote safe and reliable AI/ML in healthcare. FRONTIERS IN NUCLEAR MEDICINE (LAUSANNE, SWITZERLAND) 2022; 2:983340. [PMID: 39354991 PMCID: PMC11440832 DOI: 10.3389/fnume.2022.983340] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/30/2022] [Accepted: 09/12/2022] [Indexed: 10/03/2024]
Abstract
Artificial intelligence and machine learning (AI/ML) is poised to disrupt the structure and delivery of healthcare, promising to optimize care clinical care delivery and information management. AI/ML offers potential benefits in healthcare, such as creating novel clinical decision support tools, pattern recognition software, and predictive modeling systems. This raises questions about how AI/ML will impact the physician-patient relationship and the practice of medicine. Effective utilization and reliance on AI/ML also requires that these technologies are safe and reliable. Potential errors could not only pose serious risks to patient safety, but also expose physicians, hospitals, and AI/ML manufacturers to liability. This review describes how the law provides a mechanism to promote safety and reliability of AI/ML systems. On the front end, the Food and Drug Administration (FDA) intends to regulate many AI/ML as medical devices, which corresponds to a set of regulatory requirements prior to product marketing and use. Post-development, a variety of mechanisms in the law provide guardrails for careful deployment into clinical practice that can also incentivize product improvement. This review provides an overview of potential areas of liability arising from AI/ML including malpractice, informed consent, corporate liability, and products liability. Finally, this review summarizes strategies to minimize risk and promote safe and reliable AI/ML.
Collapse
Affiliation(s)
- Katherine Drabiak
- College of Public Health, University of South Florida, Tampa, FL United States
| |
Collapse
|
8
|
Computational AI models in VAT photopolymerization: a review, current trends, open issues, and future opportunities. Neural Comput Appl 2022. [DOI: 10.1007/s00521-022-07694-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/15/2022]
|
9
|
Gomez Rossi J, Feldberg B, Krois J, Schwendicke F. Evaluation of the Clinical, Technical, and Financial Aspects of Cost-Effectiveness Analysis of Artificial Intelligence in Medicine: Scoping Review and Framework of Analysis. JMIR Med Inform 2022; 10:e33703. [PMID: 35969458 PMCID: PMC9419048 DOI: 10.2196/33703] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/20/2021] [Revised: 03/29/2022] [Accepted: 05/13/2022] [Indexed: 11/13/2022] Open
Abstract
BACKGROUND Cost-effectiveness analysis of artificial intelligence (AI) in medicine demands consideration of clinical, technical, and economic aspects to generate impactful research of a novel and highly versatile technology. OBJECTIVE We aimed to systematically scope existing literature on the cost-effectiveness of AI and to extract and summarize clinical, technical, and economic dimensions required for a comprehensive assessment. METHODS A scoping literature review was conducted to map medical, technical, and economic aspects considered in studies on the cost-effectiveness of medical AI. Based on these, a framework for health policy analysis was developed. RESULTS Among 4820 eligible studies, 13 met the inclusion criteria for our review. Internal medicine and emergency medicine were the clinical disciplines most frequently analyzed. Most of the studies included were from the United States (5/13, 39%), assessed solutions requiring market access (9/13, 69%), and proposed optimization of direct resources as the most frequent value proposition (7/13, 53%). On the other hand, technical aspects were not uniformly disclosed in the studies we analyzed. A minority of articles explicitly stated the payment mechanism assumed (5/13, 38%), while it remained unspecified in the majority (8/13, 62%) of studies. CONCLUSIONS Current studies on the cost-effectiveness of AI do not allow to determine if the investigated AI solutions are clinically, technically, and economically viable. Further research and improved reporting on these dimensions seem relevant to recommend and assess potential use cases for this technology.
Collapse
Affiliation(s)
- Jesus Gomez Rossi
- Department of Oral Diagnostics, Digital Health and Health Services Research, Charité-Universitätsmedizin, Berlin, Germany
| | - Ben Feldberg
- Department of Oral Diagnostics, Digital Health and Health Services Research, Charité-Universitätsmedizin, Berlin, Germany
| | - Joachim Krois
- Department of Oral Diagnostics, Digital Health and Health Services Research, Charité-Universitätsmedizin, Berlin, Germany
| | - Falk Schwendicke
- Department of Oral Diagnostics, Digital Health and Health Services Research, Charité-Universitätsmedizin, Berlin, Germany
| |
Collapse
|
10
|
Xiong S, E B, Zhang Z, Tang J, Rong X, Gong H, Yi C. Innovative Application of Three-Dimensional-Printed Breast Model-Aided Reduction Mammaplasty. Front Surg 2022; 9:890177. [PMID: 35756468 PMCID: PMC9223078 DOI: 10.3389/fsurg.2022.890177] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/05/2022] [Accepted: 05/23/2022] [Indexed: 11/24/2022] Open
Abstract
Symptomatic macromastia places a severe physical and psychological burden on patients. Reduction mammaplasty is the primary treatment; however, conventional surgery may lead to postoperative nipple-areolar complex necrosis due to damage to the dominant supplying arteries. In this study, we designed and fabricated an innovative, three-dimensional-printed breast vascular model to provide surgical guidance for reduction mammaplasty. Preoperative computed tomography angiography scanning data of patients were collected. The data were then processed and reconstructed using the E3D digital medical modeling software (version 17.06); the reconstructions were then printed into a personalized model using stereolithography. The three-dimensional-printed breast vascular model was thus developed for individualized preoperative surgical design. This individualized model could be used to intuitively visualize the dominant supplying arteries’ spatial location in the breasts, thereby allowing effective surgical planning for reduction mammaplasty. The three-dimensional-printed breast vascular model can therefore provide an individualized preoperative design and patient education, avoid necrosis of the nipple-areolar complex, shorten operation duration, and ensure safe and effective surgery in patients.
Collapse
Affiliation(s)
- Shaoheng Xiong
- Department of Plastic Surgery, Xijing Hospital, Fourth Military Medical University, Xi’an, China
| | - Bei E
- Department of Radiology, Xijing Hospital, Fourth Military Medical University, Xi’an, China
| | - Zhaoxiang Zhang
- Department of Plastic Surgery, Xijing Hospital, Fourth Military Medical University, Xi’an, China
| | - Jiezhang Tang
- Department of Plastic Surgery, Xijing Hospital, Fourth Military Medical University, Xi’an, China
| | - Xiangke Rong
- Department of Plastic Surgery, Xijing Hospital, Fourth Military Medical University, Xi’an, China
| | - Haibo Gong
- The State Key Laboratory for Manufacturing Systems Engineering, Xi’an Jiaotong University, Xi’an, China
| | - Chenggang Yi
- Department of Plastic Surgery, The Second Affiliated Hospital, Zhejiang University School of Medicine, Hangzhou, China
- Correspondence: Chenggang Yi
| |
Collapse
|
11
|
Deep Learning-Based Automatic Segmentation of Mandible and Maxilla in Multi-Center CT Images. APPLIED SCIENCES-BASEL 2022. [DOI: 10.3390/app12031358] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/21/2022]
Abstract
Sophisticated segmentation of the craniomaxillofacial bones (the mandible and maxilla) in computed tomography (CT) is essential for diagnosis and treatment planning for craniomaxillofacial surgeries. Conventional manual segmentation is time-consuming and challenging due to intrinsic properties of craniomaxillofacial bones and head CT such as the variance in the anatomical structures, low contrast of soft tissue, and artifacts caused by metal implants. However, data-driven segmentation methods, including deep learning, require a large consistent dataset, which creates a bottleneck in their clinical applications due to limited datasets. In this study, we propose a deep learning approach for the automatic segmentation of the mandible and maxilla in CT images and enhanced the compatibility for multi-center datasets. Four multi-center datasets acquired by various conditions were applied to create a scenario where the model was trained with one dataset and evaluated with the other datasets. For the neural network, we designed a hierarchical, parallel and multi-scale residual block to the U-Net (HPMR-U-Net). To evaluate the performance, segmentation with in-house dataset and with external datasets from multi-center were conducted in comparison to three other neural networks: U-Net, Res-U-Net and mU-Net. The results suggest that the segmentation performance of HPMR-U-Net is comparable to that of other models, with superior data compatibility.
Collapse
|
12
|
Veerankutty FH, Jayan G, Yadav MK, Manoj KS, Yadav A, Nair SRS, Shabeerali TU, Yeldho V, Sasidharan M, Rather SA. Artificial Intelligence in hepatology, liver surgery and transplantation: Emerging applications and frontiers of research. World J Hepatol 2021; 13:1977-1990. [PMID: 35070002 PMCID: PMC8727218 DOI: 10.4254/wjh.v13.i12.1977] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/16/2021] [Revised: 05/09/2021] [Accepted: 11/25/2021] [Indexed: 02/06/2023] Open
Abstract
The integration of artificial intelligence (AI) and augmented realities into the medical field is being attempted by various researchers across the globe. As a matter of fact, most of the advanced technologies utilized by medical providers today have been borrowed and extrapolated from other industries. The introduction of AI into the field of hepatology and liver surgery is relatively a recent phenomenon. The purpose of this narrative review is to highlight the different AI concepts which are currently being tried to improve the care of patients with liver diseases. We end with summarizing emerging trends and major challenges in the future development of AI in hepatology and liver surgery.
Collapse
Affiliation(s)
- Fadl H Veerankutty
- Comprehensive Liver Care, VPS Lakeshore Hospital, Cochin 682040, Kerala, India
| | - Govind Jayan
- Hepatobiliary Pancreatic and Liver Transplant Surgery, Kerala Institute of Medical Sciences, Trivandrum 695029, Kerala, India
| | - Manish Kumar Yadav
- Department of Radiodiagnosis, Kerala Institute of Medical Sciences, Trivandrum 695029, Kerala, India
| | - Krishnan Sarojam Manoj
- Department of Radiodiagnosis, Kerala Institute of Medical Sciences, Trivandrum 695029, Kerala, India
| | - Abhishek Yadav
- Comprehensive Liver Care, VPS Lakeshore Hospital, Cochin 682040, Kerala, India
| | - Sindhu Radha Sadasivan Nair
- Hepatobiliary Pancreatic and Liver Transplant Surgery, Kerala Institute of Medical Sciences, Trivandrum 695029, Kerala, India
| | - T U Shabeerali
- Hepatobiliary Pancreatic and Liver Transplant Surgery, Kerala Institute of Medical Sciences, Trivandrum 695029, Kerala, India
| | - Varghese Yeldho
- Hepatobiliary Pancreatic and Liver Transplant Surgery, Kerala Institute of Medical Sciences, Trivandrum 695029, Kerala, India
| | - Madhu Sasidharan
- Gastroenterology and Hepatology, Kerala Institute of Medical Sciences, Thiruvananthapuram 695029, India
| | - Shiraz Ahmad Rather
- Hepatobiliary Pancreatic and Liver Transplant Surgery, Kerala Institute of Medical Sciences, Trivandrum 695029, Kerala, India
| |
Collapse
|
13
|
Qiu B, van der Wel H, Kraeima J, Glas HH, Guo J, Borra RJH, Witjes MJH, van Ooijen PMA. Automatic Segmentation of Mandible from Conventional Methods to Deep Learning-A Review. J Pers Med 2021; 11:629. [PMID: 34357096 PMCID: PMC8307673 DOI: 10.3390/jpm11070629] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/28/2021] [Revised: 06/26/2021] [Accepted: 06/28/2021] [Indexed: 01/05/2023] Open
Abstract
Medical imaging techniques, such as (cone beam) computed tomography and magnetic resonance imaging, have proven to be a valuable component for oral and maxillofacial surgery (OMFS). Accurate segmentation of the mandible from head and neck (H&N) scans is an important step in order to build a personalized 3D digital mandible model for 3D printing and treatment planning of OMFS. Segmented mandible structures are used to effectively visualize the mandible volumes and to evaluate particular mandible properties quantitatively. However, mandible segmentation is always challenging for both clinicians and researchers, due to complex structures and higher attenuation materials, such as teeth (filling) or metal implants that easily lead to high noise and strong artifacts during scanning. Moreover, the size and shape of the mandible vary to a large extent between individuals. Therefore, mandible segmentation is a tedious and time-consuming task and requires adequate training to be performed properly. With the advancement of computer vision approaches, researchers have developed several algorithms to automatically segment the mandible during the last two decades. The objective of this review was to present the available fully (semi)automatic segmentation methods of the mandible published in different scientific articles. This review provides a vivid description of the scientific advancements to clinicians and researchers in this field to help develop novel automatic methods for clinical applications.
Collapse
Affiliation(s)
- Bingjiang Qiu
- 3D Lab, University Medical Center Groningen, University of Groningen, Hanzeplein 1, 9713 GZ Groningen, The Netherlands; (B.Q.); (H.v.d.W.); (J.K.); (H.H.G.); (M.J.H.W.)
- Department of Radiation Oncology, University Medical Center Groningen, University of Groningen, Hanzeplein 1, 9713 GZ Groningen, The Netherlands;
- Data Science Center in Health (DASH), University Medical Center Groningen, University of Groningen, Hanzeplein 1, 9713 GZ Groningen, The Netherlands
| | - Hylke van der Wel
- 3D Lab, University Medical Center Groningen, University of Groningen, Hanzeplein 1, 9713 GZ Groningen, The Netherlands; (B.Q.); (H.v.d.W.); (J.K.); (H.H.G.); (M.J.H.W.)
- Department of Oral and Maxillofacial Surgery, University Medical Center Groningen, University of Groningen, Hanzeplein 1, 9713 GZ Groningen, The Netherlands
| | - Joep Kraeima
- 3D Lab, University Medical Center Groningen, University of Groningen, Hanzeplein 1, 9713 GZ Groningen, The Netherlands; (B.Q.); (H.v.d.W.); (J.K.); (H.H.G.); (M.J.H.W.)
- Department of Oral and Maxillofacial Surgery, University Medical Center Groningen, University of Groningen, Hanzeplein 1, 9713 GZ Groningen, The Netherlands
| | - Haye Hendrik Glas
- 3D Lab, University Medical Center Groningen, University of Groningen, Hanzeplein 1, 9713 GZ Groningen, The Netherlands; (B.Q.); (H.v.d.W.); (J.K.); (H.H.G.); (M.J.H.W.)
- Department of Oral and Maxillofacial Surgery, University Medical Center Groningen, University of Groningen, Hanzeplein 1, 9713 GZ Groningen, The Netherlands
| | - Jiapan Guo
- Department of Radiation Oncology, University Medical Center Groningen, University of Groningen, Hanzeplein 1, 9713 GZ Groningen, The Netherlands;
- Data Science Center in Health (DASH), University Medical Center Groningen, University of Groningen, Hanzeplein 1, 9713 GZ Groningen, The Netherlands
| | - Ronald J. H. Borra
- Medical Imaging Center (MIC), University Medical Center Groningen, University of Groningen, Hanzeplein 1, 9713 GZ Groningen, The Netherlands;
| | - Max Johannes Hendrikus Witjes
- 3D Lab, University Medical Center Groningen, University of Groningen, Hanzeplein 1, 9713 GZ Groningen, The Netherlands; (B.Q.); (H.v.d.W.); (J.K.); (H.H.G.); (M.J.H.W.)
- Department of Oral and Maxillofacial Surgery, University Medical Center Groningen, University of Groningen, Hanzeplein 1, 9713 GZ Groningen, The Netherlands
| | - Peter M. A. van Ooijen
- Department of Radiation Oncology, University Medical Center Groningen, University of Groningen, Hanzeplein 1, 9713 GZ Groningen, The Netherlands;
- Data Science Center in Health (DASH), University Medical Center Groningen, University of Groningen, Hanzeplein 1, 9713 GZ Groningen, The Netherlands
| |
Collapse
|
14
|
Qiu B, Guo J, Kraeima J, Glas HH, Zhang W, Borra RJH, Witjes MJH, van Ooijen PMA. Recurrent Convolutional Neural Networks for 3D Mandible Segmentation in Computed Tomography. J Pers Med 2021; 11:jpm11060492. [PMID: 34072714 PMCID: PMC8229770 DOI: 10.3390/jpm11060492] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/03/2021] [Revised: 05/26/2021] [Accepted: 05/28/2021] [Indexed: 12/24/2022] Open
Abstract
Purpose: Classic encoder–decoder-based convolutional neural network (EDCNN) approaches cannot accurately segment detailed anatomical structures of the mandible in computed tomography (CT), for instance, condyles and coronoids of the mandible, which are often affected by noise and metal artifacts. The main reason is that EDCNN approaches ignore the anatomical connectivity of the organs. In this paper, we propose a novel CNN-based 3D mandible segmentation approach that has the ability to accurately segment detailed anatomical structures. Methods: Different from the classic EDCNNs that need to slice or crop the whole CT scan into 2D slices or 3D patches during the segmentation process, our proposed approach can perform mandible segmentation on complete 3D CT scans. The proposed method, namely, RCNNSeg, adopts the structure of the recurrent neural networks to form a directed acyclic graph in order to enable recurrent connections between adjacent nodes to retain their connectivity. Each node then functions as a classic EDCNN to segment a single slice in the CT scan. Our proposed approach can perform 3D mandible segmentation on sequential data of any varied lengths and does not require a large computation cost. The proposed RCNNSeg was evaluated on 109 head and neck CT scans from a local dataset and 40 scans from the PDDCA public dataset. The final accuracy of the proposed RCNNSeg was evaluated by calculating the Dice similarity coefficient (DSC), average symmetric surface distance (ASD), and 95% Hausdorff distance (95HD) between the reference standard and the automated segmentation. Results: The proposed RCNNSeg outperforms the EDCNN-based approaches on both datasets and yields superior quantitative and qualitative performances when compared to the state-of-the-art approaches on the PDDCA dataset. The proposed RCNNSeg generated the most accurate segmentations with an average DSC of 97.48%, ASD of 0.2170 mm, and 95HD of 2.6562 mm on 109 CT scans, and an average DSC of 95.10%, ASD of 0.1367 mm, and 95HD of 1.3560 mm on the PDDCA dataset. Conclusions: The proposed RCNNSeg method generated more accurate automated segmentations than those of the other classic EDCNN segmentation techniques in terms of quantitative and qualitative evaluation. The proposed RCNNSeg has potential for automatic mandible segmentation by learning spatially structured information.
Collapse
Affiliation(s)
- Bingjiang Qiu
- 3D Lab, University Medical Center Groningen, University of Groningen, Hanzeplein 1, 9713GZ Groningen, The Netherlands; (B.Q.); (J.K.); (H.H.G.); (M.J.H.W.)
- Department of Radiation Oncology, University Medical Center Groningen, University of Groningen, Hanzeplein 1, 9713GZ Groningen, The Netherlands;
- Data Science Center in Health (DASH), University Medical Center Groningen, University of Groningen, Hanzeplein 1, 9713GZ Groningen, The Netherlands
| | - Jiapan Guo
- Department of Radiation Oncology, University Medical Center Groningen, University of Groningen, Hanzeplein 1, 9713GZ Groningen, The Netherlands;
- Data Science Center in Health (DASH), University Medical Center Groningen, University of Groningen, Hanzeplein 1, 9713GZ Groningen, The Netherlands
- Correspondence:
| | - Joep Kraeima
- 3D Lab, University Medical Center Groningen, University of Groningen, Hanzeplein 1, 9713GZ Groningen, The Netherlands; (B.Q.); (J.K.); (H.H.G.); (M.J.H.W.)
- Department of Oral and Maxillofacial Surgery, University Medical Center Groningen, University of Groningen, Hanzeplein 1, 9713GZ Groningen, The Netherlands
| | - Haye Hendrik Glas
- 3D Lab, University Medical Center Groningen, University of Groningen, Hanzeplein 1, 9713GZ Groningen, The Netherlands; (B.Q.); (J.K.); (H.H.G.); (M.J.H.W.)
- Department of Oral and Maxillofacial Surgery, University Medical Center Groningen, University of Groningen, Hanzeplein 1, 9713GZ Groningen, The Netherlands
| | - Weichuan Zhang
- Institute for Integrated and Intelligent System, Griffith University, Nathan, QLD 4111, Australia;
- CSIRO Data61, Epping, NSW 1710, Australia
| | - Ronald J. H. Borra
- Medical Imaging Center (MIC), University Medical Center Groningen, University of Groningen, Hanzeplein 1, 9713GZ Groningen, The Netherlands;
| | - Max Johannes Hendrikus Witjes
- 3D Lab, University Medical Center Groningen, University of Groningen, Hanzeplein 1, 9713GZ Groningen, The Netherlands; (B.Q.); (J.K.); (H.H.G.); (M.J.H.W.)
- Department of Oral and Maxillofacial Surgery, University Medical Center Groningen, University of Groningen, Hanzeplein 1, 9713GZ Groningen, The Netherlands
| | - Peter M. A. van Ooijen
- Department of Radiation Oncology, University Medical Center Groningen, University of Groningen, Hanzeplein 1, 9713GZ Groningen, The Netherlands;
- Data Science Center in Health (DASH), University Medical Center Groningen, University of Groningen, Hanzeplein 1, 9713GZ Groningen, The Netherlands
| |
Collapse
|
15
|
Pijpker PAJ, Oosterhuis TS, Witjes MJH, Faber C, van Ooijen PMA, Kosinka J, Kuijlen JMA, Groen RJM, Kraeima J. A semi-automatic seed point-based method for separation of individual vertebrae in 3D surface meshes: a proof of principle study. Int J Comput Assist Radiol Surg 2021; 16:1447-1457. [PMID: 34043144 PMCID: PMC8354998 DOI: 10.1007/s11548-021-02407-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/15/2021] [Accepted: 05/11/2021] [Indexed: 11/25/2022]
Abstract
PURPOSE The purpose of this paper is to present and validate a new semi-automated 3D surface mesh segmentation approach that optimizes the laborious individual human vertebrae separation in the spinal virtual surgical planning workflow and make a direct accuracy and segmentation time comparison with current standard segmentation method. METHODS The proposed semi-automatic method uses the 3D bone surface derived from CT image data for seed point-based 3D mesh partitioning. The accuracy of the proposed method was evaluated on a representative patient dataset. In addition, the influence of the number of used seed points was studied. The investigators analyzed whether there was a reduction in segmentation time when compared to manual segmentation. Surface-to-surface accuracy measurements were applied to assess the concordance with the manual segmentation. RESULTS The results demonstrated a statically significant reduction in segmentation time, while maintaining a high accuracy compared to the manual segmentation. A considerably smaller error was found when increasing the number of seed points. Anatomical regions that include articulating areas tend to show the highest errors, while the posterior laminar surface yielded an almost negligible error. CONCLUSION A novel seed point initiated surface based segmentation method for the laborious individual human vertebrae separation was presented. This proof-of-principle study demonstrated the accuracy of the proposed method on a clinical CT image dataset and its feasibility for spinal virtual surgical planning applications.
Collapse
Affiliation(s)
- Peter A J Pijpker
- 3D-Lab and Department of Neurosurgery, University of Groningen, University Medical Center Groningen, Hanzeplein 1, 9713, GZ, Groningen, The Netherlands.
| | - Tim S Oosterhuis
- 3D-Lab and Bernoulli Institute, University of Groningen, University Medical Center Groningen, Hanzeplein 1, 9713, GZ, Groningen, The Netherlands
| | - Max J H Witjes
- 3D-Lab and Department of Oral and Maxillofacial Surgery, University of Groningen, University Medical Center Groningen, Groningen, The Netherlands
| | - Chris Faber
- Department of Orthopedic Surgery, University of Groningen, University Medical Center Groningen, Groningen, The Netherlands
| | - Peter M A van Ooijen
- Department of Radiation Oncology and Data Science Center in Health, University of Groningen, University Medical Center Groningen, Groningen, The Netherlands
| | - Jiří Kosinka
- Bernoulli Institute, University of Groningen, Groningen, The Netherlands
| | - Jos M A Kuijlen
- Department of Neurosurgery, University of Groningen, University Medical Center Groningen, Groningen, The Netherlands
| | - Rob J M Groen
- Department of Neurosurgery, University of Groningen, University Medical Center Groningen, Groningen, The Netherlands
| | - Joep Kraeima
- 3D-Lab and Department of Oral and Maxillofacial Surgery, University of Groningen, University Medical Center Groningen, Groningen, The Netherlands
| |
Collapse
|
16
|
|
17
|
Qiu B, Guo J, Kraeima J, Glas HH, Borra RJH, Witjes MJH, van Ooijen PMA. Automatic segmentation of the mandible from computed tomography scans for 3D virtual surgical planning using the convolutional neural network. ACTA ACUST UNITED AC 2019; 64:175020. [DOI: 10.1088/1361-6560/ab2c95] [Citation(s) in RCA: 32] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/27/2022]
|
18
|
Imperfect Segmentation Labels: How Much Do They Matter? INTRAVASCULAR IMAGING AND COMPUTER ASSISTED STENTING AND LARGE-SCALE ANNOTATION OF BIOMEDICAL DATA AND EXPERT LABEL SYNTHESIS 2018. [DOI: 10.1007/978-3-030-01364-6_13] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/07/2023]
|