Computer-assisted detection of infectious lung diseases: a review

Plasmonic Fluorescence Sensors in Diagnosis of Infectious Diseases

The increasing demand for rapid, cost-effective, and reliable diagnostic tools in personalized and point-of-care medicine is driving scientists to enhance existing technology platforms and develop new methods for detecting and measuring clinically significant biomarkers. Humanity is confronted with growing risks from emerging and recurring infectious diseases, including the influenza virus, dengue virus (DENV), human immunodeficiency virus (HIV), Ebola virus, tuberculosis, cholera, and, most notably, SARS coronavirus-2 (SARS-CoV-2; COVID-19), among others. Timely diagnosis of infections and effective disease control have always been of paramount importance. Plasmonic-based biosensing holds the potential to address the threat posed by infectious diseases by enabling prompt disease monitoring. In recent years, numerous plasmonic platforms have risen to the challenge of offering on-site strategies to complement traditional diagnostic methods like polymerase chain reaction (PCR) and enzyme-linked immunosorbent assays (ELISA). Disease detection can be accomplished through the utilization of diverse plasmonic phenomena, such as propagating surface plasmon resonance (SPR), localized SPR (LSPR), surface-enhanced Raman scattering (SERS), surface-enhanced fluorescence (SEF), surface-enhanced infrared absorption spectroscopy, and plasmonic fluorescence sensors. This review focuses on diagnostic methods employing plasmonic fluorescence sensors, highlighting their pivotal role in swift disease detection with remarkable sensitivity. It underscores the necessity for continued research to expand the scope and capabilities of plasmonic fluorescence sensors in the field of diagnostics.

[Benefits and drawbacks of CT scan as a triple rule-out exam in acute chest pain to exclude acute coronary syndrome, pulmonary embolism and aortic dissection]

Chest pain is one of the major causes for admission in the Emergency Room in most countries and one of the principal reasons for urgent consultation with a cardiologist or a general practitioner. After clinical examination and initial biological measurements, substantial patients require further explorations. CT scan allows the search for pulmonary embolism in the early stage of pulmonary arteries iodine contrast exploration. During the same exam at the systemic arterial phase, the search for aortic dissection or coronary artery disease is possible while exploring the later contrast in the aortic artery. This triple rule-out exam allows correct diagnosis in case of acute chest pain with suspected pulmonary embolism, aortic dissection and other acute aortic syndromes or acute coronary syndrome. But X-rays are substantially increased as well as iodine contrast agent quantity while exam quality is globally decreased. Artificial intelligence may play an important role in the development of this protocol.

Artificial Intelligence and Infectious Disease Imaging

The mass production of the graphics processing unit and the coronavirus disease 2019 (COVID-19) pandemic have provided the means and the motivation, respectively, for rapid developments in artificial intelligence (AI) and medical imaging techniques. This has led to new opportunities to improve patient care but also new challenges that must be overcome before these techniques are put into practice. In particular, early AI models reported high performances but failed to perform as well on new data. However, these mistakes motivated further innovation focused on developing models that were not only accurate but also stable and generalizable to new data. The recent developments in AI in response to the COVID-19 pandemic will reap future dividends by facilitating, expediting, and informing other medical AI applications and educating the broad academic audience on the topic. Furthermore, AI research on imaging animal models of infectious diseases offers a unique problem space that can fill in evidence gaps that exist in clinical infectious disease research. Here, we aim to provide a focused assessment of the AI techniques leveraged in the infectious disease imaging research space, highlight the unique challenges, and discuss burgeoning solutions.

New definitions of human lymphoid and follicular cell entities in lymphatic tissue by machine learning

Histological sections of the lymphatic system are usually the basis of static (2D) morphological investigations. Here, we performed a dynamic (4D) analysis of human reactive lymphoid tissue using confocal fluorescent laser microscopy in combination with machine learning. Based on tracks for T-cells (CD3), B-cells (CD20), follicular T-helper cells (PD1) and optical flow of follicular dendritic cells (CD35), we put forward the first quantitative analysis of movement-related and morphological parameters within human lymphoid tissue. We identified correlations of follicular dendritic cell movement and the behavior of lymphocytes in the microenvironment. In addition, we investigated the value of movement and/or morphological parameters for a precise definition of cell types (CD clusters). CD-clusters could be determined based on movement and/or morphology. Differentiating between CD3- and CD20 positive cells is most challenging and long term-movement characteristics are indispensable. We propose morphological and movement-related prototypes of cell entities applying machine learning models. Finally, we define beyond CD clusters new subgroups within lymphocyte entities based on long term movement characteristics. In conclusion, we showed that the combination of 4D imaging and machine learning is able to define characteristics of lymphocytes not visible in 2D histology.

Plasmonic Biosensors: Review

Biosensors have globally been considered as biomedical diagnostic tools required in abundant areas including the development of diseases, detection of viruses, diagnosing ecological pollution, food monitoring, and a wide range of other diagnostic and therapeutic biomedical research. Recently, the broadly emerging and promising technique of plasmonic resonance has proven to provide label-free and highly sensitive real-time analysis when used in biosensing applications. In this review, a thorough discussion regarding the most recent techniques used in the design, fabrication, and characterization of plasmonic biosensors is conducted in addition to a comparison between those techniques with regard to their advantages and possible drawbacks when applied in different fields.

Machine learning for lung CT texture analysis: Improvement of inter-observer agreement for radiological finding classification in patients with pulmonary diseases

PURPOSE

To evaluate the capability ML-based CT texture analysis for improving interobserver agreement and accuracy of radiological finding assessment in patients with COPD, interstitial lung diseases or infectious diseases.

MATERIALS AND METHODS

Training cases (n = 28), validation cases (n = 17) and test cases (n = 89) who underwent thin-section CT at a 320-detector row CT with wide volume scan and two 64-detector row CTs with helical scan were enrolled in this study. From 89 CT data, a total of 350 computationally selected ROI including normal lung, emphysema, nodular lesion, ground-glass opacity, reticulation and honeycomb were evaluated by three radiologists as well as by the software. Inter-observer agreements between consensus reading with and without using the software or software alone and standard references determined by consensus of pulmonologists and chest radiologists were determined using κ statistics. Overall distinguishing accuracies were compared among all methods by McNemar's test.

RESULTS

Agreements for consensus readings obtained with and without the software or the software alone with standard references were determined as significant and substantial or excellent (with the software: κ = 0.91, p < 0.0001; without the software: κ = 0.81, p < 0.0001; the software alone: κ = 0.79, p < 0.0001). Overall differentiation accuracy of consensus reading using the software (94.9 [332/350] %) was significantly higher than that of consensus reading without using the software (84.3 [295/350] %, p < 0.0001) and the software alone (82.3 [288/350] %, p < 0.0001).

CONCLUSION

ML-based CT texture analysis software has potential for improving interobserver agreement and accuracy for radiological finding assessments in patients with COPD, interstitial lung diseases or infectious diseases.

Robust segmentation of lung in chest x-ray: applications in analysis of acute respiratory distress syndrome

Background

This study outlines an image processing algorithm for accurate and consistent lung segmentation in chest radiographs of critically ill adults and children typically obscured by medical equipment. In particular, this work focuses on applications in analysis of acute respiratory distress syndrome – a critical illness with a mortality rate of 40% that affects 200,000 patients in the United States and 3 million globally each year.

Methods

Chest radiographs were obtained from critically ill adults (n = 100), adults diagnosed with acute respiratory distress syndrome (ARDS) (n = 25), and children (n = 100) hospitalized at Michigan Medicine. Physicians annotated the lung field of each radiograph to establish the ground truth. A Total Variation-based Active Contour (TVAC) lung segmentation algorithm was developed and compared to multiple state-of-the-art methods including a deep learning model (U-Net), a random walker algorithm, and an active spline model, using the Sørensen–Dice coefficient to measure segmentation accuracy.

Results

The TVAC algorithm accurately segmented lung fields in all patients in the study. For the adult cohort, an averaged Dice coefficient of 0.86 ±0.04 (min: 0.76) was reported for TVAC, 0.89 ±0.12 (min: 0.01) for U-Net, 0.74 ±0.19 (min: 0.15) for the random walker algorithm, and 0.64 ±0.17 (min: 0.20) for the active spline model. For the pediatric cohort, a Dice coefficient of 0.85 ±0.04 (min: 0.75) was reported for TVAC, 0.87 ±0.09 (min: 0.56) for U-Net, 0.67 ±0.18 (min: 0.18) for the random walker algorithm, and 0.61 ±0.18 (min: 0.18) for the active spline model.

Conclusion

The proposed algorithm demonstrates the most consistent performance of all segmentation methods tested. These results suggest that TVAC can accurately identify lung fields in chest radiographs in critically ill adults and children.

Machine learning for clinical decision support in infectious diseases: a narrative review of current applications

BACKGROUND

Machine learning (ML) is a growing field in medicine. This narrative review describes the current body of literature on ML for clinical decision support in infectious diseases (ID).

OBJECTIVES

We aim to inform clinicians about the use of ML for diagnosis, classification, outcome prediction and antimicrobial management in ID.

SOURCES

References for this review were identified through searches of MEDLINE/PubMed, EMBASE, Google Scholar, biorXiv, ACM Digital Library, arXiV and IEEE Xplore Digital Library up to July 2019.

CONTENT

We found 60 unique ML-clinical decision support systems (ML-CDSS) aiming to assist ID clinicians. Overall, 37 (62%) focused on bacterial infections, 10 (17%) on viral infections, nine (15%) on tuberculosis and four (7%) on any kind of infection. Among them, 20 (33%) addressed the diagnosis of infection, 18 (30%) the prediction, early detection or stratification of sepsis, 13 (22%) the prediction of treatment response, four (7%) the prediction of antibiotic resistance, three (5%) the choice of antibiotic regimen and two (3%) the choice of a combination antiretroviral therapy. The ML-CDSS were developed for intensive care units (n = 24, 40%), ID consultation (n = 15, 25%), medical or surgical wards (n = 13, 20%), emergency department (n = 4, 7%), primary care (n = 3, 5%) and antimicrobial stewardship (n = 1, 2%). Fifty-three ML-CDSS (88%) were developed using data from high-income countries and seven (12%) with data from low- and middle-income countries (LMIC). The evaluation of ML-CDSS was limited to measures of performance (e.g. sensitivity, specificity) for 57 ML-CDSS (95%) and included data in clinical practice for three (5%).

IMPLICATIONS

Considering comprehensive patient data from socioeconomically diverse healthcare settings, including primary care and LMICs, may improve the ability of ML-CDSS to suggest decisions adapted to various clinical contexts. Currents gaps identified in the evaluation of ML-CDSS must also be addressed in order to know the potential impact of such tools for clinicians and patients.

Automatic emphysema detection using weakly labeled HRCT lung images

PURPOSE

A method for automatically quantifying emphysema regions using High-Resolution Computed Tomography (HRCT) scans of patients with chronic obstructive pulmonary disease (COPD) that does not require manually annotated scans for training is presented.

METHODS

HRCT scans of controls and of COPD patients with diverse disease severity are acquired at two different centers. Textural features from co-occurrence matrices and Gaussian filter banks are used to characterize the lung parenchyma in the scans. Two robust versions of multiple instance learning (MIL) classifiers that can handle weakly labeled data, miSVM and MILES, are investigated. Weak labels give information relative to the emphysema without indicating the location of the lesions. The classifiers are trained with the weak labels extracted from the forced expiratory volume in one minute (FEV1) and diffusing capacity of the lungs for carbon monoxide (DLCO). At test time, the classifiers output a patient label indicating overall COPD diagnosis and local labels indicating the presence of emphysema. The classifier performance is compared with manual annotations made by two radiologists, a classical density based method, and pulmonary function tests (PFTs).

RESULTS

The miSVM classifier performed better than MILES on both patient and emphysema classification. The classifier has a stronger correlation with PFT than the density based method, the percentage of emphysema in the intersection of annotations from both radiologists, and the percentage of emphysema annotated by one of the radiologists. The correlation between the classifier and the PFT is only outperformed by the second radiologist.

CONCLUSIONS

The presented method uses MIL classifiers to automatically identify emphysema regions in HRCT scans. Furthermore, this approach has been demonstrated to correlate better with DLCO than a classical density based method or a radiologist, which is known to be affected in emphysema. Therefore, it is relevant to facilitate assessment of emphysema and to reduce inter-observer variability.

Feature selection using ant colony optimization with tandem-run recruitment to diagnose bronchitis from CT scan images

BACKGROUND AND OBJECTIVES

Computer-aided diagnosis (CAD) plays a vital role in the routine clinical activity for the detection of lung disorders using computed tomography (CT) images. It serves as a source of second opinion that radiologists may consider in order to interpret CT images. In this work, the purpose of CAD is to improve the diagnostic accuracy of pulmonary bronchitis from CT images of the lung.

METHODS

Left and right lung fields are segmented using optimal thresholding from the lung CT images. Texture and shape features are extracted from the pathology bearing regions. A hybrid feature selection approach based on ant colony optimization (ACO) combining cosine similarity and support vector machine (SVM) classifier is used to select relevant features. Additionally, tandem run recruitment strategy is included in the selection activity to choose the promising features. The SVM classifier is trained using the selected features and the performance of the trained classifier is evaluated using trivial performance evaluation measures.

RESULTS

The training and testing datasets used in building the classifier model are disjoint and contains 200 CT slices affected with bronchitis, 50 normal slices and 300 slices with cancer. Out of 100 features extracted from each CT slice, a subset of 60 features is used for classification. ACO with tandem run strategy yielded 81.66% of accuracy whereas ACO without tandem run yielded an accuracy of 77.52%. When all the features are used for classifier training without feature selection algorithm, an accuracy of 75.14% is achieved.

CONCLUSION

From the results, it is inferred that identifying relevant features to train the classifier has a definite impact on the classifier performance.

Holistic classification of CT attenuation patterns for interstitial lung diseases via deep convolutional neural networks

Interstitial lung diseases (ILD) involve several abnormal imaging patterns observed in computed tomography (CT) images. Accurate classification of these patterns plays a significant role in precise clinical decision making of the extent and nature of the diseases. Therefore, it is important for developing automated pulmonary computer-aided detection systems. Conventionally, this task relies on experts' manual identification of regions of interest (ROIs) as a prerequisite to diagnose potential diseases. This protocol is time consuming and inhibits fully automatic assessment. In this paper, we present a new method to classify ILD imaging patterns on CT images. The main difference is that the proposed algorithm uses the entire image as a holistic input. By circumventing the prerequisite of manual input ROIs, our problem set-up is significantly more difficult than previous work but can better address the clinical workflow. Qualitative and quantitative results using a publicly available ILD database demonstrate state-of-the-art classification accuracy under the patch-based classification and shows the potential of predicting the ILD type using holistic image.

Segmentation and Image Analysis of Abnormal Lungs at CT: Current Approaches, Challenges, and Future Trends

The computer-based process of identifying the boundaries of lung from surrounding thoracic tissue on computed tomographic (CT) images, which is called segmentation, is a vital first step in radiologic pulmonary image analysis. Many algorithms and software platforms provide image segmentation routines for quantification of lung abnormalities; however, nearly all of the current image segmentation approaches apply well only if the lungs exhibit minimal or no pathologic conditions. When moderate to high amounts of disease or abnormalities with a challenging shape or appearance exist in the lungs, computer-aided detection systems may be highly likely to fail to depict those abnormal regions because of inaccurate segmentation methods. In particular, abnormalities such as pleural effusions, consolidations, and masses often cause inaccurate lung segmentation, which greatly limits the use of image processing methods in clinical and research contexts. In this review, a critical summary of the current methods for lung segmentation on CT images is provided, with special emphasis on the accuracy and performance of the methods in cases with abnormalities and cases with exemplary pathologic findings. The currently available segmentation methods can be divided into five major classes: (a) thresholding-based, (b) region-based, (c) shape-based, (d) neighboring anatomy-guided, and (e) machine learning-based methods. The feasibility of each class and its shortcomings are explained and illustrated with the most common lung abnormalities observed on CT images. In an overview, practical applications and evolving technologies combining the presented approaches for the practicing radiologist are detailed.

Computer-aided pulmonary image analysis in small animal models

PURPOSE

To develop an automated pulmonary image analysis framework for infectious lung diseases in small animal models.

METHODS

The authors describe a novel pathological lung and airway segmentation method for small animals. The proposed framework includes identification of abnormal imaging patterns pertaining to infectious lung diseases. First, the authors' system estimates an expected lung volume by utilizing a regression function between total lung capacity and approximated rib cage volume. A significant difference between the expected lung volume and the initial lung segmentation indicates the presence of severe pathology, and invokes a machine learning based abnormal imaging pattern detection system next. The final stage of the proposed framework is the automatic extraction of airway tree for which new affinity relationships within the fuzzy connectedness image segmentation framework are proposed by combining Hessian and gray-scale morphological reconstruction filters.

RESULTS

133 CT scans were collected from four different studies encompassing a wide spectrum of pulmonary abnormalities pertaining to two commonly used small animal models (ferret and rabbit). Sensitivity and specificity were greater than 90% for pathological lung segmentation (average dice similarity coefficient > 0.9). While qualitative visual assessments of airway tree extraction were performed by the participating expert radiologists, for quantitative evaluation the authors validated the proposed airway extraction method by using publicly available EXACT'09 data set.

CONCLUSIONS

The authors developed a comprehensive computer-aided pulmonary image analysis framework for preclinical research applications. The proposed framework consists of automatic pathological lung segmentation and accurate airway tree extraction. The framework has high sensitivity and specificity; therefore, it can contribute advances in preclinical research in pulmonary diseases.

Statistical Analysis of Haralick Texture Features to Discriminate Lung Abnormalities

The Haralick texture features are a well-known mathematical method to detect the lung abnormalities and give the opportunity to the physician to localize the abnormality tissue type, either lung tumor or pulmonary edema. In this paper, statistical evaluation of the different features will represent the reported performance of the proposed method. Thirty-seven patients CT datasets with either lung tumor or pulmonary edema were included in this study. The CT images are first preprocessed for noise reduction and image enhancement, followed by segmentation techniques to segment the lungs, and finally Haralick texture features to detect the type of the abnormality within the lungs. In spite of the presence of low contrast and high noise in images, the proposed algorithms introduce promising results in detecting the abnormality of lungs in most of the patients in comparison with the normal and suggest that some of the features are significantly recommended than others.

A hybrid method for airway segmentation and automated measurement of bronchial wall thickness on CT

Inflammatory and infectious lung diseases commonly involve bronchial airway structures and morphology, and these abnormalities are often analyzed non-invasively through high resolution computed tomography (CT) scans. Assessing airway wall surfaces and the lumen are of great importance for diagnosing pulmonary diseases. However, obtaining high accuracy from a complete 3-D airway tree structure can be quite challenging. The airway tree structure has spiculated shapes with multiple branches and bifurcation points as opposed to solid single organ or tumor segmentation tasks in other applications, hence, it is complex for manual segmentation as compared with other tasks. For computerized methods, a fundamental challenge in airway tree segmentation is the highly variable intensity levels in the lumen area, which often causes a segmentation method to leak into adjacent lung parenchyma through blurred airway walls or soft boundaries. Moreover, outer wall definition can be difficult due to similar intensities of the airway walls and nearby structures such as vessels. In this paper, we propose a computational framework to accurately quantify airways through (i) a novel hybrid approach for precise segmentation of the lumen, and (ii) two novel methods (a spatially constrained Markov random walk method (pseudo 3-D) and a relative fuzzy connectedness method (3-D)) to estimate the airway wall thickness. We evaluate the performance of our proposed methods in comparison with mostly used algorithms using human chest CT images. Our results demonstrate that, on publicly available data sets and using standard evaluation criteria, the proposed airway segmentation method is accurate and efficient as compared with the state-of-the-art methods, and the airway wall estimation algorithms identified the inner and outer airway surfaces more accurately than the most widely applied methods, namely full width at half maximum and phase congruency.

A sparse representation based method to classify pulmonary patterns of diffuse lung diseases

We applied and optimized the sparse representation (SR) approaches in the computer-aided diagnosis (CAD) to classify normal tissues and five kinds of diffuse lung disease (DLD) patterns: consolidation, ground-glass opacity, honeycombing, emphysema, and nodule. By using the K-SVD which is based on the singular value decomposition (SVD) and orthogonal matching pursuit (OMP), it can achieve a satisfied recognition rate, but too much time was spent in the experiment. To reduce the runtime of the method, the K-Means algorithm was substituted for the K-SVD, and the OMP was simplified by searching the desired atoms at one time (OMP1). We proposed three SR based methods for evaluation: SR1 (K-SVD+OMP), SR2 (K-Means+OMP), and SR3 (K-Means+OMP1). 1161 volumes of interest (VOIs) were used to optimize the parameters and train each method, and 1049 VOIs were adopted to evaluate the performances of the methods. The SR based methods were powerful to recognize the DLD patterns (SR1: 96.1%, SR2: 95.6%, SR3: 96.4%) and significantly better than the baseline methods. Furthermore, when the K-Means and OMP1 were applied, the runtime of the SR based methods can be reduced by 98.2% and 55.2%, respectively. Therefore, we thought that the method using the K-Means and OMP1 (SR3) was efficient for the CAD of the DLDs.

Shape and texture based novel features for automated juxtapleural nodule detection in lung CTs

Lung cancer is one of the types of cancer with highest mortality rate in the world. In case of early detection and diagnosis, the survival rate of patients significantly increases. In this study, a novel method and system that provides automatic detection of juxtapleural nodule pattern have been developed from cross-sectional images of lung CT (Computerized Tomography). Shape-based and both shape and texture based 7 features are contributed to the literature for lung nodules. System that we developed consists of six main stages called preprocessing, lung segmentation, detection of nodule candidate regions, feature extraction, feature selection (with five feature ranking criteria) and classification. LIDC dataset containing cross-sectional images of lung CT has been utilized, 1410 nodule candidate regions and 40 features have been extracted from 138 cross-sectional images for 24 patients. Experimental results for 10 classifiers are obtained and presented. Adding our derived features to known 33 features has increased nodule recognition performance from 0.9639 to 0.9679 AUC value on generalized linear model regression (GLMR) for 22 selected features and being reached one of the most successful results in the literature.

A generic approach to pathological lung segmentation

In this study, we propose a novel pathological lung segmentation method that takes into account neighbor prior constraints and a novel pathology recognition system. Our proposed framework has two stages; during stage one, we adapted the fuzzy connectedness (FC) image segmentation algorithm to perform initial lung parenchyma extraction. In parallel, we estimate the lung volume using rib-cage information without explicitly delineating lungs. This rudimentary, but intelligent lung volume estimation system allows comparison of volume differences between rib cage and FC based lung volume measurements. Significant volume difference indicates the presence of pathology, which invokes the second stage of the proposed framework for the refinement of segmented lung. In stage two, texture-based features are utilized to detect abnormal imaging patterns (consolidations, ground glass, interstitial thickening, tree-inbud, honeycombing, nodules, and micro-nodules) that might have been missed during the first stage of the algorithm. This refinement stage is further completed by a novel neighboring anatomy-guided segmentation approach to include abnormalities with weak textures, and pleura regions. We evaluated the accuracy and efficiency of the proposed method on more than 400 CT scans with the presence of a wide spectrum of abnormalities. To our best of knowledge, this is the first study to evaluate all abnormal imaging patterns in a single segmentation framework. The quantitative results show that our pathological lung segmentation method improves on current standards because of its high sensitivity and specificity and may have considerable potential to enhance the performance of routine clinical tasks.

Objective CT-based quantification of lung sequelae in treated patients with paracoccidioidomycosis

This study presents methodology for objectively quantifying the pulmonary region affected by emphysemic and fibrotic sequelae in treated patients with paracoccidioidomycosis. This methodology may also be applied to any other disease that results in these sequelae in the lungs.Pulmonary high-resolution computed tomography examinations of 30 treated paracoccidioidomycosis patients were used in the study. The distribution of voxel attenuation coefficients was analyzed to determine the percentage of lung volume that consisted of emphysemic, fibrotic, and normal tissue. Algorithm outputs were compared with subjective evaluations by radiologists using a scale that is currently used for clinical diagnosis.Affected regions in the patient images were determined by computational analysis and compared with estimates by radiologists, revealing mean (± standard deviation) differences in the scores for fibrotic and emphysemic regions of 0.1% ± 1.2% and -0.2% ± 1.0%, respectively.The computational results showed a strong correlation with the radiologist estimates, but the computation results were more reproducible, objective, and reliable.

Computer-aided detection and quantification of cavitary tuberculosis from CT scans

PURPOSE

To present a computer-aided detection tool for identifying, quantifying, and evaluating tuberculosis (TB) cavities in the infected lungs from computed tomography (CT) scans.

METHODS

The authors' proposed method is based on a novel shape-based automated detection algorithm on CT scans followed by a fuzzy connectedness (FC) delineation procedure. In order to assess interaction between cavities and airways, the authors first roughly identified air-filled structures (airway, cavities, esophagus, etc.) by thresholding over Hounsfield unit of CT image. Then, airway and cavity structure detection was conducted within the support vector machine classification algorithm. Once airway and cavities were detected automatically, the authors extracted airway tree using a hybrid multiscale approach based on novel affinity relations within the FC framework and segmented cavities using intensity-based FC algorithm. At final step, the authors refined airway structures within the local regions of FC with finer control. Cavity segmentation results were compared to the reference truths provided by expert radiologists and cavity formation was tracked longitudinally from serial CT scans through shape and volume information automatically determined through the authors' proposed system. Morphological evolution of the cavitary TB were analyzed accordingly with this process. Finally, the authors computed the minimum distance between cavity surface and nearby airway structures by using the linear time distance transform algorithm to explore potential role of airways in cavity formation and morphological evolution.

RESULTS

The proposed methodology was qualitatively and quantitatively evaluated on pulmonary CT images of rabbits experimentally infected with TB, and multiple markers such as cavity volume, cavity surface area, minimum distance from cavity surface to the nearest bronchial-tree, and longitudinal change of these markers (namely, morphological evolution of cavities) were determined precisely. While accuracy of the authors' cavity detection algorithm was 94.61%, airway detection part of the proposed methodology showed even higher performance by 99.8%. Dice similarity coefficients for cavitary segmentation experiments were found to be approximately 99.0% with respect to the reference truths provided by two expert radiologists (blinded to their evaluations). Moreover, the authors noted that volume derived from the authors' segmentation method was highly correlated with those provided by the expert radiologists (R(2) = 0.99757 and R(2) = 0.99496, p < 0.001, with respect to the observer 1 and observer 2) with an interobserver agreement of 98%. The authors quantitatively confirmed that cavity formation was positioned by the nearby bronchial-tree after exploring the respective spatial positions based on the minimum distance measurement. In terms of efficiency, the core algorithms take less than 2 min on a linux machine with 3.47 GHz CPU and 24 GB memory.

CONCLUSION

The authors presented a fully automatic method for cavitary TB detection, quantification, and evaluation. The performance of every step of the algorithm was qualitatively and quantitatively assessed. With the proposed method, airways and cavities were automatically detected and subsequently delineated in high accuracy with heightened efficiency. Furthermore, not only morphological information of cavities were obtained through the authors' proposed framework, but their spatial relation to airways, and longitudinal analysis was also provided to get further insight on cavity formation in tuberculosis disease. To the authors' best of knowledge, this is the first study in computerized analysis of cavitary tuberculosis from CT scans.

A review on segmentation of positron emission tomography images

Positron Emission Tomography (PET), a non-invasive functional imaging method at the molecular level, images the distribution of biologically targeted radiotracers with high sensitivity. PET imaging provides detailed quantitative information about many diseases and is often used to evaluate inflammation, infection, and cancer by detecting emitted photons from a radiotracer localized to abnormal cells. In order to differentiate abnormal tissue from surrounding areas in PET images, image segmentation methods play a vital role; therefore, accurate image segmentation is often necessary for proper disease detection, diagnosis, treatment planning, and follow-ups. In this review paper, we present state-of-the-art PET image segmentation methods, as well as the recent advances in image segmentation techniques. In order to make this manuscript self-contained, we also briefly explain the fundamentals of PET imaging, the challenges of diagnostic PET image analysis, and the effects of these challenges on the segmentation results.

Digitization of medicine: how radiology can take advantage of the digital revolution

In the era of medical cost containment, radiologists must continually maintain their actual and perceived value to patients, payers, and referring providers. Exploitation of current and future digital technologies may be the key to defining and promoting radiology's "brand" and assure our continued relevance in providing predictive, preventive, personalized, and participatory medicine. The Association of University of Radiologists Radiology Research Alliance Digitization of Medicine Task Force was formed to explore the opportunities and challenges of the digitization of medicine that are relevant to radiologists, which include the reporting paradigm, computational biology, and imaging informatics. In addition to discussing these opportunities and challenges, we consider how change occurs in medicine, and how change may be effected in medical imaging community. This review article is a summary of the research of the task force and hopefully can be used as a stimulus for further discussions and development of action plans by radiology leaders.

Segmentation of PET images for computer-aided functional quantification of tuberculosis in small animal models

Pulmonary infections often cause spatially diffuse and multi-focal radiotracer uptake in positron emission tomography (PET) images, which makes accurate quantification of the disease extent challenging. Image segmentation plays a vital role in quantifying uptake due to the distributed nature of immuno-pathology and associated metabolic activities in pulmonary infection, specifically tuberculosis (TB). For this task, thresholding-based segmentation methods may be better suited over other methods; however, performance of the thresholding-based methods depend on the selection of thresholding parameters, which are often suboptimal. Several optimal thresholding techniques have been proposed in the literature, but there is currently no consensus on how to determine the optimal threshold for precise identification of spatially diffuse and multi-focal radiotracer uptake. In this study, we propose a method to select optimal thresholding levels by utilizing a novel intensity affinity metric within the affinity propagation clustering framework. We tested the proposed method against 70 longitudinal PET images of rabbits infected with TB. The overall dice similarity coefficient between the segmentation from the proposed method and two expert segmentations was found to be 91.25 ±8.01% with a sensitivity of 88.80 ±12.59% and a specificity of 96.01 ±9.20%. High accuracy and heightened efficiency of our proposed method, as compared to other PET image segmentation methods, were reported with various quantification metrics.

A computational pipeline for quantification of pulmonary infections in small animal models using serial PET-CT imaging

Background

Infectious diseases are the second leading cause of death worldwide. In order to better understand and treat them, an accurate evaluation using multi-modal imaging techniques for anatomical and functional characterizations is needed. For non-invasive imaging techniques such as computed tomography (CT), magnetic resonance imaging (MRI), and positron emission tomography (PET), there have been many engineering improvements that have significantly enhanced the resolution and contrast of the images, but there are still insufficient computational algorithms available for researchers to use when accurately quantifying imaging data from anatomical structures and functional biological processes. Since the development of such tools may potentially translate basic research into the clinic, this study focuses on the development of a quantitative and qualitative image analysis platform that provides a computational radiology perspective for pulmonary infections in small animal models. Specifically, we designed (a) a fast and robust automated and semi-automated image analysis platform and a quantification tool that can facilitate accurate diagnostic measurements of pulmonary lesions as well as volumetric measurements of anatomical structures, and incorporated (b) an image registration pipeline to our proposed framework for volumetric comparison of serial scans. This is an important investigational tool for small animal infectious disease models that can help advance researchers’ understanding of infectious diseases.

Methods

We tested the utility of our proposed methodology by using sequentially acquired CT and PET images of rabbit, ferret, and mouse models with respiratory infections of Mycobacterium tuberculosis (TB), H1N1 flu virus, and an aerosolized respiratory pathogen (necrotic TB) for a total of 92, 44, and 24 scans for the respective studies with half of the scans from CT and the other half from PET. Institutional Administrative Panel on Laboratory Animal Care approvals were obtained prior to conducting this research. First, the proposed computational framework registered PET and CT images to provide spatial correspondences between images. Second, the lungs from the CT scans were segmented using an interactive region growing (IRG) segmentation algorithm with mathematical morphology operations to avoid false positive (FP) uptake in PET images. Finally, we segmented significant radiotracer uptake from the PET images in lung regions determined from CT and computed metabolic volumes of the significant uptake. All segmentation processes were compared with expert radiologists’ delineations (ground truths). Metabolic and gross volume of lesions were automatically computed with the segmentation processes using PET and CT images, and percentage changes in those volumes over time were calculated. (Continued on next page)(Continued from previous page) Standardized uptake value (SUV) analysis from PET images was conducted as a complementary quantitative metric for disease severity assessment. Thus, severity and extent of pulmonary lesions were examined through both PET and CT images using the aforementioned quantification metrics outputted from the proposed framework.

Results

Each animal study was evaluated within the same subject class, and all steps of the proposed methodology were evaluated separately. We quantified the accuracy of the proposed algorithm with respect to the state-of-the-art segmentation algorithms. For evaluation of the segmentation results, dice similarity coefficient (DSC) as an overlap measure and Haussdorf distance as a shape dissimilarity measure were used. Significant correlations regarding the estimated lesion volumes were obtained both in CT and PET images with respect to the ground truths (R²=0.8922,p<0.01 and R²=0.8664,p<0.01, respectively). The segmentation accuracy (DSC (%)) was 93.4±4.5% for normal lung CT scans and 86.0±7.1% for pathological lung CT scans. Experiments showed excellent agreements (all above 85%) with expert evaluations for both structural and functional imaging modalities. Apart from quantitative analysis of each animal, we also qualitatively showed how metabolic volumes were changing over time by examining serial PET/CT scans. Evaluation of the registration processes was based on precisely defined anatomical landmark points by expert clinicians. An average of 2.66, 3.93, and 2.52 mm errors was found in rabbit, ferret, and mouse data (all within the resolution limits), respectively. Quantitative results obtained from the proposed methodology were visually related to the progress and severity of the pulmonary infections as verified by the participating radiologists. Moreover, we demonstrated that lesions due to the infections were metabolically active and appeared multi-focal in nature, and we observed similar patterns in the CT images as well. Consolidation and ground glass opacity were the main abnormal imaging patterns and consistently appeared in all CT images. We also found that the gross and metabolic lesion volume percentage follow the same trend as the SUV-based evaluation in the longitudinal analysis.

Conclusions

We explored the feasibility of using PET and CT imaging modalities in three distinct small animal models for two diverse pulmonary infections. We concluded from the clinical findings, derived from the proposed computational pipeline, that PET-CT imaging is an invaluable hybrid modality for tracking pulmonary infections longitudinally in small animals and has great potential to become routinely used in clinics. Our proposed methodology showed that automated computed-aided lesion detection and quantification of pulmonary infections in small animal models are efficient and accurate as compared to the clinical standard of manual and semi-automated approaches. Automated analysis of images in pre-clinical applications can increase the efficiency and quality of pre-clinical findings that ultimately inform downstream experimental design in human clinical studies; this innovation will allow researchers and clinicians to more effectively allocate study resources with respect to research demands without compromising accuracy.

Automated computer quantification of breast cancer in small-animal models using PET-guided MR image co-segmentation

BACKGROUND

Care providers use complementary information from multiple imaging modalities to identify and characterize metastatic tumors in early stages and perform surveillance for cancer recurrence. These tasks require volume quantification of tumor measurements using computed tomography (CT) or magnetic resonance imaging (MRI) and functional characterization through positron emission tomography (PET) imaging. In vivo volume quantification is conducted through image segmentation, which may require both anatomical and functional images available for precise tumor boundary delineation. Although integrating multiple image modalities into the segmentation process may improve the delineation accuracy and efficiency, due to variable visibility on image modalities, complex shape of metastatic lesions, and diverse visual features in functional and anatomical images, a precise and efficient segmentation of metastatic breast cancer remains a challenging goal even for advanced image segmentation methods. In response to these challenges, we present here a computer-assisted volume quantification method for PET/MRI dual modality images using PET-guided MRI co-segmentation. Our aims in this study were (1) to determine anatomical tumor volumes automatically from MRI accurately and efficiently, (2) to evaluate and compare the accuracy of the proposed method with different radiotracers (18F-Z HER2-Affibody and 18F-flourodeoxyglucose (18F-FDG)), and (3) to confirm the proposed method's determinations from PET/MRI scans in comparison with PET/CT scans.

METHODS

After the Institutional Administrative Panel on Laboratory Animal Care approval was obtained, 30 female nude mice were used to construct a small-animal breast cancer model. All mice were injected with human breast cancer cells and HER2-overexpressing MDA-MB-231HER2-Luc cells intravenously. Eight of them were selected for imaging studies, and selected mice were imaged with MRI, CT, and 18F-FDG-PET at weeks 9 and 10 and then imaged with 18F-Z HER2-Affibody-PET 2 days after the scheduled structural imaging (MRI and CT). After CT and MR images were co-registered with corresponding PET images, all images were quantitatively analyzed by the proposed segmentation technique.Automatically determined anatomical tumor volumes were compared to radiologist-derived reference truths. Observer agreements were presented through Bland-Altman and linear regression analyses. Segmentation evaluations were conducted using true-positive (TP) and false-positive (FP) volume fractions of delineated tissue samples, as complied with the state-of-the-art evaluation techniques for image segmentation. Moreover, the PET images, obtained using different radiotracers, were examined and compared using the complex wavelet-based structural similarity index (CWSSI). (continued on the next page) (continued from the previous page)

RESULTS

PET/MR dual modality imaging using the 18F-Z HER2-Affibody imaging agent provided diagnostic image quality in all mice with excellent tumor delineations by the proposed method. The 18F-FDG radiotracer did not show accurate identification of the tumor regions. Structural similarity index (CWSSI) between PET images using 18F-FDG and 18F-Z HER2-Affibody agents was found to be 0.7838. MR showed higher diagnostic image quality when compared to CT because of its better soft tissue contrast. Significant correlations regarding the anatomical tumor volumes were obtained between both PET-guided MRI co-segmentation and reference truth (R2=0.92, p<0.001 for PET/MR, and R2=0.84, p<0.001, for PET/CT). TP and FP volume fractions using the automated co-segmentation method in PET/MR and PET/CT were found to be (TP 97.3%, FP 9.8%) and (TP 92.3%, FP 17.2%), respectively.

CONCLUSIONS

The proposed PET-guided MR image co-segmentation algorithm provided an automated and efficient way of assessing anatomical tumor volumes and their spatial extent. We showed that although the 18F-Z HER2-Affibody radiotracer in PET imaging is often used for characterization of tumors rather than detection, sensitivity and specificity of the localized radiotracer in the tumor region were informative enough; therefore, roughly determined tumor regions from PET images guided the delineation process well in the anatomical image domain for extracting accurate tumor volume information. Furthermore, the use of 18F-FDG radiotracer was not as successful as the 18F-Z HER2-Affibody in guiding the delineation process due to false-positive uptake regions in the neighborhood of tumor regions; hence, the accuracy of the fully automated segmentation method changed dramatically. Last, we qualitatively showed that MRI yields superior identification of tumor boundaries when compared to conventional CT imaging.

Classification of pulmonary nodules by using hybrid features

Early detection of pulmonary nodules is extremely important for the diagnosis and treatment of lung cancer. In this study, a new classification approach for pulmonary nodules from CT imagery is presented by using hybrid features. Four different methods are introduced for the proposed system. The overall detection performance is evaluated using various classifiers. The results are compared to similar techniques in the literature by using standard measures. The proposed approach with the hybrid features results in 90.7% classification accuracy (89.6% sensitivity and 87.5% specificity).

Synergistic combination of clinical and imaging features predicts abnormal imaging patterns of pulmonary infections

We designed and tested a novel hybrid statistical model that accepts radiologic image features and clinical variables, and integrates this information in order to automatically predict abnormalities in chest computed-tomography (CT) scans and identify potentially important infectious disease biomarkers. In 200 patients, 160 with various pulmonary infections and 40 healthy controls, we extracted 34 clinical variables from laboratory tests and 25 textural features from CT images. From the CT scans, pleural effusion (PE), linear opacity (or thickening) (LT), tree-in-bud (TIB), pulmonary nodules, ground glass opacity (GGO), and consolidation abnormality patterns were analyzed and predicted through clinical, textural (imaging), or combined attributes. The presence and severity of each abnormality pattern was validated by visual analysis of the CT scans. The proposed biomarker identification system included two important steps: (i) a coarse identification of an abnormal imaging pattern by adaptively selected features (AmRMR), and (ii) a fine selection of the most important features from the previous step, and assigning them as biomarkers, depending on the prediction accuracy. Selected biomarkers were used to classify normal and abnormal patterns by using a boosted decision tree (BDT) classifier. For all abnormal imaging patterns, an average prediction accuracy of 76.15% was obtained. Experimental results demonstrated that our proposed biomarker identification approach is promising and may advance the data processing in clinical pulmonary infection research and diagnostic techniques.

Joint segmentation of anatomical and functional images: applications in quantification of lesions from PET, PET-CT, MRI-PET, and MRI-PET-CT images

We present a novel method for the joint segmentation of anatomical and functional images. Our proposed methodology unifies the domains of anatomical and functional images, represents them in a product lattice, and performs simultaneous delineation of regions based on random walk image segmentation. Furthermore, we also propose a simple yet effective object/background seed localization method to make the proposed segmentation process fully automatic. Our study uses PET, PET-CT, MRI-PET, and fused MRI-PET-CT scans (77 studies in all) from 56 patients who had various lesions in different body regions. We validated the effectiveness of the proposed method on different PET phantoms as well as on clinical images with respect to the ground truth segmentation provided by clinicians. Experimental results indicate that the presented method is superior to threshold and Bayesian methods commonly used in PET image segmentation, is more accurate and robust compared to the other PET-CT segmentation methods recently published in the literature, and also it is general in the sense of simultaneously segmenting multiple scans in real-time with high accuracy needed in routine clinical use.

Predicting future morphological changes of lesions from radiotracer uptake in 18F-FDG-PET images

We introduce a novel computational framework to enable automated identification of texture and shape features of lesions on ¹⁸F-FDG-PET images through a graph-based image segmentation method. The proposed framework predicts future morphological changes of lesions with high accuracy. The presented methodology has several benefits over conventional qualitative and semi-quantitative methods, due to its fully quantitative nature and high accuracy in each step of (i) detection, (ii) segmentation, and (iii) feature extraction. To evaluate our proposed computational framework, thirty patients received 2 ¹⁸F-FDG-PET scans (60 scans total), at two different time points. Metastatic papillary renal cell carcinoma, cerebellar hemongioblastoma, non-small cell lung cancer, neurofibroma, lymphomatoid granulomatosis, lung neoplasm, neuroendocrine tumor, soft tissue thoracic mass, nonnecrotizing granulomatous inflammation, renal cell carcinoma with papillary and cystic features, diffuse large B-cell lymphoma, metastatic alveolar soft part sarcoma, and small cell lung cancer were included in this analysis. The radiotracer accumulation in patients' scans was automatically detected and segmented by the proposed segmentation algorithm. Delineated regions were used to extract shape and textural features, with the proposed adaptive feature extraction framework, as well as standardized uptake values (SUV) of uptake regions, to conduct a broad quantitative analysis. Evaluation of segmentation results indicates that our proposed segmentation algorithm has a mean dice similarity coefficient of 85.75±1.75%. We found that 28 of 68 extracted imaging features were correlated well with SUV_max (p<0.05), and some of the textural features (such as entropy and maximum probability) were superior in predicting morphological changes of radiotracer uptake regions longitudinally, compared to single intensity feature such as SUV_max. We also found that integrating textural features with SUV measurements significantly improves the prediction accuracy of morphological changes (Spearman correlation coefficient = 0.8715, p<2e-16).

Toxicologic Pathology in the 21st Century

Toxicology is and will be heavily influenced by advances in many scientific disciplines. For toxicologic pathology, particularly relevant are the increasing array of molecular methods providing deeper insights into toxicity pathways, in vivo imaging techniques visualizing toxicodynamics and more powerful computers anticipated to allow (partly) automated morphological diagnoses. It appears unlikely that, in a foreseeable future, animal studies can be replaced by in silico and in vitro studies or longer term in vivo studies by investigations of biomarkers including toxicogenomics of shorter term studies, though the importance of such approaches will continue to increase. In addition to changes based on scientific progress, the work of toxicopathologists is and will be affected by social and financial factors, among them stagnating budgets, globalization, and outsourcing. The number of toxicopathologists in North America, Europe, and the Far East is not expected to grow. Many toxicopathologists will likely spend less time at the microscope but will be more heavily involved in early research activities, imaging, and as generalists with a broad biological understanding in evaluation and management of toxicity. Toxicologic pathology will remain important and is indispensable for validation of new methods, quality assurance of established methods, and for areas without good alternative methods.

AUTOMATIC QUANTIFICATION OF TREE-IN-BUD PATTERNS FROM CT SCANS

In this paper, we present a fully automatic method to quantify Tree-in-Bud (TIB) patterns for respiratory tract infections. The proposed quantification method is based on our previous effort to detect and track TIB patterns with a computer assisted detection (CAD) system [9]. In addition to accurately identifying TIB on CT, quantifying TIB is important for measuring the volume of affected lung as a potantial marker of disease severity. This quantification can be challenging due to the complex shape of TIB and high intensity variation contributing mixed features. Our proposed quantification method is based on a local scale concept such that TIB regions detected via the CAD system are quantified adaptively, and volume percentages of the quantified regions are compared to visual scoring of participating radiologists. We conducted the experiments with a data set of 94 chest CTs (laboratory confirmed 39 viral bronchiolitis caused by human parainfluenza (HPIV), 34 nontuberculous mycobacterial (NTM), and 21 normal control). Experimental results show that the proposed quantification system is well suited to the CAD system for detecting TIB patterns. Correlations of observer-CAD agreements are reported as (R² = 0.824, p < 0.01) and (R² = 0.801, p < 0.01) for HPIV and NTM cases, respectively.

Automatic detection and quantification of tree-in-bud (TIB) opacities from CT scans

This study presents a novel computer-assisted detection (CAD) system for automatically detecting and precisely quantifying abnormal nodular branching opacities in chest computed tomography (CT), termed tree-in-bud (TIB) opacities by radiology literature. The developed CAD system in this study is based on 1) fast localization of candidate imaging patterns using local scale information of the images, and 2) Möbius invariant feature extraction method based on learned local shape and texture properties of TIB patterns. For fast localization of candidate imaging patterns, we use ball-scale filtering and, based on the observation of the pattern of interest, a suitable scale selection is used to retain only small size patterns. Once candidate abnormality patterns are identified, we extract proposed shape features from regions where at least one candidate pattern occupies. The comparative evaluation of the proposed method with commonly used CAD methods is presented with a dataset of 60 chest CTs (laboratory confirmed 39 viral bronchiolitis human parainfluenza CTs and 21 normal chest CTs). The quantitative results are presented as the area under the receiver operator characteristics curves and a computer score (volume affected by TIB) provided as an output of the CAD system. In addition, a visual grading scheme is applied to the patient data by three well-trained radiologists. Interobserver and observer-computer agreements are obtained by the relevant statistical methods over different lung zones. Experimental results demonstrate that the proposed CAD system can achieve high detection rates with an overall accuracy of 90.96%. Moreover, correlations of observer-observer (R(2)=0.8848, and observer-CAD agreements (R(2)=0.824, validate the feasibility of the use of the proposed CAD system in detecting and quantifying TIB patterns.

Characterizing non-linear dependencies among pairs of clinical variables and imaging data

Advances in computer-aided diagnosis (CAD) systems have shown the benefits of using computer-based techniques to obtain quantitative image measurements of the extent of a particular disease. Such measurements provide more accurate information that can be used to better study the associations between anatomical changes and clinical findings. Unfortunately, even with the use of quantitative image features, the correlations between anatomical changes and clinical findings are often not apparent and definite conclusions are difficult to reach. This paper uses nonparametric exploration techniques to demonstrate that even when the associations between two-variables seems weak, advanced properties of the associations can be studied and used to better understand the relationships between individual measurements. This paper uses quantitative imaging findings and clinical measurements of 85 patients with pulmonary fibrosis to demonstrate the advantages of non-linear dependency analysis. Results show that even when the correlation coefficients between imaging and clinical findings seem small, statistical measurements such as the maximum asymmetry score (MAS) and maximum edge value (MEV) can be used to better understand the hidden associations between the variables.

An expert support system for breast cancer diagnosis using color wavelet features

Breast cancer diagnosis can be done through the pathologic assessments of breast tissue samples such as core needle biopsy technique. The result of analysis on this sample by pathologist is crucial for breast cancer patient. In this paper, nucleus of tissue samples are investigated after decomposition by means of the Log-Gabor wavelet on HSV color domain and an algorithm is developed to compute the color wavelet features. These features are used for breast cancer diagnosis using Support Vector Machine (SVM) classifier algorithm. The ability of properly trained SVM is to correctly classify patterns and make them particularly suitable for use in an expert system that aids in the diagnosis of cancer tissue samples. The results are compared with other multivariate classifiers such as Naïves Bayes classifier and Artificial Neural Network. The overall accuracy of the proposed method using SVM classifier will be further useful for automation in cancer diagnosis.