3D cinematic rendering of the calvarium, maxillofacial structures, and skull base: preliminary observations

Cinematic rendering in the evaluation of complex vascular injury of the lower extremities: how we do it

Lower extremity trauma is one of the most common injury patterns seen in emergency medical and surgical practice. Vascular injuries occur in less than one percent of all civilian fractures. However, if not treated promptly, such injuries can lead to ischemia and death. Computed tomography angiography (CTA) is the non-invasive imaging gold standard and plays a crucial part in the decision-making process for treating lower extremity trauma. A novel, FDA-approved 3D reconstruction technique known as cinematic rendering (CR) yields photorealistic reconstructions of lower extremity vascular injuries depicting clinically important aspects of those injuries, aiding in patient workup and surgical planning, and thus improving patient outcomes. In this article, we provide clinical examples of the use of CR in evaluating lower extremity vascular injuries, including the relationship of these injuries to adjacent osseous structures and overlying soft tissues, and its role in management of lower extremity trauma.

Cinematic rendering of paediatric musculoskeletal pathologies: initial experiences with CT

Cinematic rendering (CR) is a novel post-processing technique similar to volume rendering (VR), which allows for a more photorealistic imaging reconstruction by using a complex light modelling algorithm, incorporating information from multiple light paths and predicted photon scattering patterns. Several recent publications relating to adult imaging have argued that CR gives a better "realism" and "expressiveness" experience over VR techniques. CR has also been shown to improve visualisation of musculoskeletal and vascular anatomy compared with conventional CT viewing, and may help non-radiologists to understand complex patient anatomy. In this review, we provide an overview of how CR could be used in paediatric musculoskeletal imaging, particularly in complex diagnoses, surgical planning, and patient consent processes. We present a direct comparison of VR and CR reconstructions across a range of congenital and acquired musculoskeletal pathologies, highlighting potential advantages and areas for further research.

3D Modeling and Advanced Visualization of the Pediatric Brain, Neck, and Spine

The ready availability of advanced visualization tools on picture archiving and communication systems workstations or even standard laptops through server-based or cloud-based solutions has enabled greater adoption of these techniques. We describe how radiologists can tailor imaging techniques for optimal 3D reconstructions provide a brief overview of the standard and newer "on-screen" techniques. We describe the process of creating 3D printed models for surgical simulation and education, with examples from the authors' institution and the existing literature. Finally, the review highlights current uses and potential future use cases for virtual reality and augmented reality applications in a pediatric neuroimaging setting.

Cone-beam computed tomography cinematic rendering: clinical, teaching and research applications

Cone-beam computed tomography (CBCT) is an essential imaging method that increases the accuracy of diagnoses, planning and follow-up of endodontic complex cases. Image postprocessing and subsequent visualization relies on software for three-dimensional navigation, and application of indexation tools to provide clinically useful information according to a set of volumetric data. Image postprocessing has a crucial impact on diagnostic quality and various techniques have been employed on computed tomography (CT) and magnetic resonance imaging (MRI) data sets. These include: multiplanar reformations (MPR), maximum intensity projection (MIP) and volume rendering (VR). A recent advance in 3D data visualization is the new cinematic rendering reconstruction method, a technique that generates photorealistic 3D images from conventional CT and MRI data. This review discusses the importance of CBCT cinematic rendering for clinical decision-making, teaching, and research in Endodontics, and a presents series of cases that illustrate the diagnostic value of 3D cinematic rendering in clinical care.

Comparison of Cinematic Rendering and Computed Tomography for Speed and Comprehension of Surgical Anatomy

Question

Does the use of cinematic rendering improve the comprehension of the surgical anatomy?

Findings

In this German preclinical randomized crossover study, visualization with cinematic rendering allowed a more correct and faster comprehension of the surgical anatomy compared with conventional computed tomography independent of the level of surgical experience.

Meaning

Cinematic rendering is a tool that may assist general surgeons with preoperative preparation and intraoperative guidance through an improved interpretation of computed tomography imaging data.

Importance

Three-dimensional (3-D) volume rendering has been shown to improve visualization in general surgery. Cinematic rendering (CR), a novel 3-D visualization technology for postprocessing of computed tomographaphy (CT) images, provides photorealistic images with the potential to improve visualization of anatomic details.

Objective

To determine the value of CR for the comprehension of the surgical anatomy.

Design, Setting, and Participants

This preclinical, randomized, 2-sequence crossover study was conducted from February to November 1, 2018, at University Hospital of Erlangen, Germany. The 40 patient cases were evaluated by 18 resident and attending surgeons using a prepared set of CT and CR images. The patient cases were randomized to 2 assessment sequences (CR-CT and CT-CR). During each assessment period, participants answered 1 question per case that addressed crucial issues of anatomic understanding, preoperative planning, and intraoperative strategies. After a washout period of 2 weeks, case evaluations were crossed over to the respective second image modality.

Main Outcomes and Measures

The primary outcome measure was the correctness of answers. Secondary outcome was the time needed to answer.

Results

The mean (SD) interperiod differences for the percentage of correct answers in the CR-CT sequence (8.5% [7.0%]) differed significantly from those in the CT-CR sequence (−13.1% [6.3%]) (P < .001). The mean (SD) interperiod differences for the time spent to answer the questions in the CR-CT sequence (−18.3 [76.9] seconds) also differed significantly from those in the CT-CR sequence (52.4 [88.5] seconds) (P < .001). Subgroup analysis revealed that residents as well as attending physicians benefitted from CR visualization. Analysis of the case assessment questionnaire showed that CR added significant value to the comprehension of the surgical anatomy (overall mean [SD] score, 4.53 [0.75]). No carryover or period effects were observed.

Conclusions and Relevance

The visualization with CR allowed a more correct and faster comprehension of the surgical anatomy compared with conventional CT imaging, independent of level of surgeon experience. Therefore, CR may assist general surgeons with preoperative preparation and intraoperative guidance.

Calvarial osteomyelitis in secondary syphilis: evaluation by MRI and CT, including cinematic rendering

This is a case of a 22-year-old, HIV-negative, male patient with asymptomatic syphilitic osteomyelitis of the skull in the context of secondary syphilis. The diagnosis was made based on serology as well as CT and MRI scans. CT volumetric data was post-processed with cinematic rendering, which is a novel algorithm that allows for a photorealistic visualization of the lesions. Imaging and follow-up scans after treatment confirmed the diagnosis without the need to perform invasive procedures such as a biopsy.

The application of cinematic rendering to CT evaluation of upper tract urothelial tumors: principles and practice

Upper tract urothelial carcinoma (UTUC) is a relatively uncommon but aggressive genitourinary malignancy for which multi-phase contrast-enhanced computed tomography (CT) plays an important role in evaluation and staging. 3D imaging with maximum intensity projection (MIP) and volume-rendered (VR) images has been described as a useful means of evaluating UTUC. In this study, we describe the technique of a novel 3D methodology known as cinematic rendering (CR) and provide clinical examples of UTUC visualized with CR. CR utilizes a complex universal lighting model in order to create photorealistic images with improved detail and depth in comparison to MIP or VR images. In the case of UTUC, CR can be used in different contrast phases to show abnormally thickened and enhancing urothelium or filling defects in the renal collecting system or ureters in the excretory phase. CR images can also be manipulated in order to generate translucent views of the upper urinary tract in order to add conspicuity to intraluminal findings.

3D-cinematic rendering for dental and maxillofacial imaging

OBJECTIVES

Aim of this technical note is to show the applicability of cinematic rendering (CR) for a photorealistic 3-dimensional (3D) visualization of maxillofacial structures. The focus is on maxillofacial hard tissue pathologies.

METHODS

High density maxillofacial pathologies were selected in which CR is applicable. Data from both, CT and cone beam CT (CBCT) were postprocessed using a prototype CR software.

RESULTS

CR 3D postprocessing of CT and CBCT imaging data is applicable on high density structures and pathologies such as bones, teeth, and tissue calcifications. Image reconstruction allows for a detailed visualization of surface structures, their plasticity, and 3D configuration.

CONCLUSIONS

CR allows for the generation of photorealistic 3D reconstructions of high density structures and pathologies. Potential applications for maxillofacial bone and tooth imaging are given and examples for CT and CBCT images are displayed.

Value of the Cinematic Rendering From Volumetric Computed Tomography Data in Evaluating the Relationship Between Deep Soft Tissue Sarcomas of the Extremities and Adjacent Major Vessels: A Preliminary Study

Supplemental digital content is available in the text.

Objective

The aim of the study was to assess the value of cinematic rendering (CR) from volumetric computed tomography data in evaluating the relationship between deep soft tissue sarcomas (STSs) of the extremities and the adjacent major vessels.

Methods

Preoperative contrast-enhanced axial imaging (CEAI) in the arterial phase with three-dimensional volume rendering (VR) and CR of contrast-enhanced computed tomography were used to assess adjacent vascular invasion in 43 cases of deep STSs of the extremities. The imaging assessments were compared with surgical findings and interpreted as negative (no vascular invasion) or positive (vascular invasion was present). Intrareader and interreader agreement were assessed using Cohen κ statistics. The diagnostic performance of CEAI, VR, and CR was evaluated by receiver operating curve analysis and compared using the DeLong test.

Results

Thirty-four and nine cases were classified as negative and positive, respectively, in surgery. Intrareader agreement values for the CEAI, VR, and CR assessments were all excellent (0.984, 0.934, and 0.914, respectively), whereas the interreader agreement for CEAI assessments was greater than that for VR and CR (0.969 vs 0.804 and 0.761). Cinematic rendering showed lower accuracy (0.698), sensitivity (0.778), specificity (0.676), positive predictive values (0.389), and negative predictive values (0.920) for vascular invasion diagnosis than CEAI or VR; the accuracy, sensitivity, specificity, positive predictive values, and negative predictive values increased to 0.767, 0.889, 0.735, 0.471, and 0.962 for both CEAI and VR. The results were not statistically significant (all P > 0.05).

Conclusions

Cinematic rendering has the potential to be used to evaluate vascular invasion in cases of deep STSs of the extremities, but it should be used alongside the traditional methods such as CEAI.

Cinematic rendering of small bowel pathology: preliminary observations from this novel 3D CT visualization method

3D visualization methods for volumetric CT data have played an important role in diagnostic imaging of the small bowel, a structure which intrinsically crosses numerous slices in any 2D imaging plane. Recently, a new approach to 3D CT image creation has become available-cinematic rendering (CR). CR differs from other 3D methods in making use of a global lighting model that produces high surface detail and realistic shadowing effects that lead to 3D visualizations with photorealistic quality. Although the utility of these images for improving diagnostic accuracy has not yet been established, our group's early experience in regions of complex anatomy and pathology has been encouraging. In this pictorial review, we review the established role of 3D CT in many of the most common small bowel pathologies, provide examples of those pathologies visualized with CR, and suggest future directions for researchers to pursue.

Deep learning with cinematic rendering: fine-tuning deep neural networks using photorealistic medical images

Deep learning has emerged as a powerful artificial intelligence tool to interpret medical images for a growing variety of applications. However, the paucity of medical imaging data with high-quality annotations that is necessary for training such methods ultimately limits their performance. Medical data is challenging to acquire due to privacy issues, shortage of experts available for annotation, limited representation of rare conditions and cost. This problem has previously been addressed by using synthetically generated data. However, networks trained on synthetic data often fail to generalize to real data. Cinematic rendering simulates the propagation and interaction of light passing through tissue models reconstructed from CT data, enabling the generation of photorealistic images. In this paper, we present one of the first applications of cinematic rendering in deep learning, in which we propose to fine-tune synthetic data-driven networks using cinematically rendered CT data for the task of monocular depth estimation in endoscopy. Our experiments demonstrate that: (a) convolutional neural networks (CNNs) trained on synthetic data and fine-tuned on photorealistic cinematically rendered data adapt better to real medical images and demonstrate more robust performance when compared to networks with no fine-tuning, (b) these fine-tuned networks require less training data to converge to an optimal solution, and (c) fine-tuning with data from a variety of photorealistic rendering conditions of the same scene prevents the network from learning patient-specific information and aids in generalizability of the model. Our empirical evaluation demonstrates that networks fine-tuned with cinematically rendered data predict depth with 56.87% less error for rendered endoscopy images and 27.49% less error for real porcine colon endoscopy images.