Deep learning tomographic reconstruction through hierarchical decomposition of domain transforms

RoboCT: The State and Current Challenges of Industrial Twin Robotic CT Systems

Twin robotic X-ray computed tomography (CT) refers to CT systems in which two robotic arms are used to independently move the X-ray source and the X-ray detector around the object. This setup enables flexible CT scans by using robots to move the X-ray source and the X-ray detector around an object's region of interest. This allows scans of large objects, image quality optimization and scan time reduction. Despite these advantages, robotic CT systems still face challenges that limit their widespread adoption. This paper discusses the state of twin robotic CT and its current main challenges. These challenges include the optimization of scanning trajectories, precise geometric calibration and advanced 3D reconstruction techniques.

Deep learning corrects artifacts in RASER MRI profiles

A newly developed magnetic resonance imaging (MRI) approach is based on "Radiowave amplification by the stimulated emission of radiation" (RASER). RASER MRI potentially allows for higher resolution, is inherently background-free, and does not require radio-frequency excitation. However, RASER MRI can be "nearly unusable" as heavy distortions from nonlinear effects can occur. In this work, we show that deep learning (DL) reduces such artifacts in RASER images. We trained a two-step DL pipeline on purely synthetic data, which was generated based on a previously published, theoretical model for RASER MRI. A convolutional neural network was trained on 630'000 1D RASER projections, and a U-net on 2D random images. The DL pipeline generalizes well when applied from synthetic to experimental RASER MRI data.

IQAGPT: computed tomography image quality assessment with vision-language and ChatGPT models

Large language models (LLMs), such as ChatGPT, have demonstrated impressive capabilities in various tasks and attracted increasing interest as a natural language interface across many domains. Recently, large vision-language models (VLMs) that learn rich vision-language correlation from image-text pairs, like BLIP-2 and GPT-4, have been intensively investigated. However, despite these developments, the application of LLMs and VLMs in image quality assessment (IQA), particularly in medical imaging, remains unexplored. This is valuable for objective performance evaluation and potential supplement or even replacement of radiologists' opinions. To this end, this study introduces IQAGPT, an innovative computed tomography (CT) IQA system that integrates image-quality captioning VLM with ChatGPT to generate quality scores and textual reports. First, a CT-IQA dataset comprising 1,000 CT slices with diverse quality levels is professionally annotated and compiled for training and evaluation. To better leverage the capabilities of LLMs, the annotated quality scores are converted into semantically rich text descriptions using a prompt template. Second, the image-quality captioning VLM is fine-tuned on the CT-IQA dataset to generate quality descriptions. The captioning model fuses image and text features through cross-modal attention. Third, based on the quality descriptions, users verbally request ChatGPT to rate image-quality scores or produce radiological quality reports. Results demonstrate the feasibility of assessing image quality using LLMs. The proposed IQAGPT outperformed GPT-4 and CLIP-IQA, as well as multitask classification and regression models that solely rely on images.