Fusion of spatial gray level dependency and fractal texture features for the characterization of thyroid lesions

Identification method of thyroid nodule ultrasonography based on self-supervised learning dual-branch attention learning framework

Thyroid ultrasound is a widely used diagnostic technique for thyroid nodules in clinical practice. However, due to the characteristics of ultrasonic imaging, such as low image contrast, high noise levels, and heterogeneous features, detecting and identifying nodules remains challenging. In addition, high-quality labeled medical imaging datasets are rare, and thyroid ultrasound images are no exception, posing a significant challenge for machine learning applications in medical image analysis. In this study, we propose a Dual-branch Attention Learning (DBAL) convolutional neural network framework to enhance thyroid nodule detection by capturing contextual information. Leveraging jigsaw puzzles as a pretext task during network training, we improve the network's generalization ability with limited data. Our framework effectively captures intrinsic features in a global-to-local manner. Experimental results involve self-supervised pre-training on unlabeled ultrasound images and fine-tuning using 1216 clinical ultrasound images from a collaborating hospital. DBAL achieves accurate discrimination of thyroid nodules, with a 88.5% correct diagnosis rate for malignant and benign nodules and a 93.7% area under the ROC curve. This novel approach demonstrates promising potential in clinical applications for its accuracy and efficiency.

Classifying Chewing and Rumination in Dairy Cows Using Sound Signals and Machine Learning

This research paper introduces a novel methodology for classifying jaw movements in dairy cattle into four distinct categories: bites, exclusive chews, chew-bite combinations, and exclusive sorting, under conditions of tall and short particle sizes in wheat straw and Alfalfa hay feeding. Sound signals were recorded and transformed into images using a short-time Fourier transform. A total of 31 texture features were extracted using the gray level co-occurrence matrix, spatial gray level dependence method, gray level run length method, and gray level difference method. Genetic Algorithm (GA) was applied to the data to select the most important features. Six distinct classifiers were employed to classify the jaw movements. The total precision found was 91.62%, 94.48%, 95.9%, 92.8%, 94.18%, and 89.62% for Naive Bayes, k-nearest neighbor, support vector machine, decision tree, multi-layer perceptron, and k-means clustering, respectively. The results of this study provide valuable insights into the nutritional behavior and dietary patterns of dairy cattle. The understanding of how cows consume different types of feed and the identification of any potential health issues or deficiencies in their diets are enhanced by the accurate classification of jaw movements. This information can be used to improve feeding practices, reduce waste, and ensure the well-being and productivity of the cows. The methodology introduced in this study can serve as a valuable tool for livestock managers to evaluate the nutrition of their dairy cattle and make informed decisions about their feeding practices.

A systematic review on artificial intelligence techniques for detecting thyroid diseases

The use of artificial intelligence approaches in health-care systems has grown rapidly over the last few years. In this context, early detection of diseases is the most common area of application. In this scenario, thyroid diseases are an example of illnesses that can be effectively faced if discovered quite early. Detecting thyroid diseases is crucial in order to treat patients effectively and promptly, by saving lives and reducing healthcare costs. This work aims at systematically reviewing and analyzing the literature on various artificial intelligence-related techniques applied to the detection and identification of various diseases related to the thyroid gland. The contributions we reviewed are classified according to different viewpoints and taxonomies in order to highlight pros and cons of the most recent research in the field. After a careful selection process, we selected and reviewed 72 papers, analyzing them according to three main research questions, i.e., which diseases of the thyroid gland are detected by different artificial intelligence techniques, which datasets are used to perform the aforementioned detection, and what types of data are used to perform the detection. The review demonstrates that the majority of the considered papers deal with supervised methods to detect hypo- and hyperthyroidism. The average accuracy of detection is high (96.84%), but the usage of private and outdated datasets with a majority of clinical data is very common. Finally, we discuss the outcomes of the systematic review, pointing out advantages, disadvantages, and future developments in the application of artificial intelligence for thyroid diseases detection.

Artificial intelligence in thyroid ultrasound

Artificial intelligence (AI), particularly deep learning (DL) algorithms, has demonstrated remarkable progress in image-recognition tasks, enabling the automatic quantitative assessment of complex medical images with increased accuracy and efficiency. AI is widely used and is becoming increasingly popular in the field of ultrasound. The rising incidence of thyroid cancer and the workload of physicians have driven the need to utilize AI to efficiently process thyroid ultrasound images. Therefore, leveraging AI in thyroid cancer ultrasound screening and diagnosis cannot only help radiologists achieve more accurate and efficient imaging diagnosis but also reduce their workload. In this paper, we aim to present a comprehensive overview of the technical knowledge of AI with a focus on traditional machine learning (ML) algorithms and DL algorithms. We will also discuss their clinical applications in the ultrasound imaging of thyroid diseases, particularly in differentiating between benign and malignant nodules and predicting cervical lymph node metastasis in thyroid cancer. Finally, we will conclude that AI technology holds great promise for improving the accuracy of thyroid disease ultrasound diagnosis and discuss the potential prospects of AI in this field.

Texture analysis of ultrasound images obtained with different beamforming techniques and dynamic ranges - A robustness study

Texture analysis of medical images gives quantitative information about the tissue characterization for possible pathology discrimination. Ultrasound B-mode images are generated through a process called beamforming. Then, to obtain the final 8-bit image, the dynamic range value must be set. It is currently unknown how different beamforming techniques or dynamic range values may alter the final image texture. We provide here a robustness analysis of first and higher order texture features using six beamforming methods and seven dynamic range values, on experimental phantom and in vivo musculoskeletal images acquired using two different ultrasound research scanners. To investigate the repeatability of the texture parameters, we applied the multivariate analysis of variance (MANOVA) and estimated the intraclass correlation coefficient (ICC) on the texture features calculated on the B-mode images created with different beamforming methods and dynamic range values. We demonstrated the high repeatability of texture features when varying the dynamic range and showed texture features can differentiate between beamforming methods through a MANOVA analysis, hinting at the potential future clinical application of specific beamformers.

A new xAI framework with feature explainability for tumors decision-making in Ultrasound data: comparing with Grad-CAM

BACKGROUND AND OBJECTIVE

The value of implementing artificial intelligence (AI) on ultrasound screening for thyroid cancer has been acknowledged, with numerous early studies confirming AI might help physicians acquire more accurate diagnoses. However, the black box nature of AI's decision-making process makes it difficult for users to grasp the foundation of AI's predictions. Furthermore, explainability is not only related to AI performance, but also responsibility and risk in medical diagnosis. In this paper, we offer Explainer, an intrinsically explainable framework that can categorize images and create heatmaps highlighting the regions on which its prediction is based.

METHODS

A dataset of 19341 thyroid ultrasound images with pathological results and physician-annotated TI-RADS features is used to train and test the robustness of the proposed framework. Then we conducted a benign-malignant classification study to determine whether physicians perform better with the assistance of an explainer than they do alone or with Gradient-weighted Class Activation Mapping (Grad-CAM).

RESULTS

Reader studies show that the Explainer can achieve a more accurate diagnosis while explaining heatmaps, and that physicians' performances are improved when assisted by the Explainer. Case study results confirm that the Explainer is capable of locating more reasonable and feature-related regions than the Grad-CAM.

CONCLUSIONS

The Explainer offers physicians a tool to understand the basis of AI predictions and evaluate their reliability, which has the potential to unbox the "black box" of medical imaging AI.

A Novel Deep-Learning-Based CADx Architecture for Classification of Thyroid Nodules Using Ultrasound Images

Nodules of thyroid cancer occur in the cells of the thyroid as benign or malign types. Thyroid sonographic images are mostly used for diagnosis of thyroid cancer. The aim of this study is to introduce a computer-aided diagnosis system that can classify the thyroid nodules with high accuracy using the data gathered from ultrasound images. Acquisition and labeling of sub-images were performed by a specialist physician. Then the number of these sub-images were increased using data augmentation methods. Deep features were obtained from the images using a pre-trained deep neural network. The dimensions of the features were reduced and features were improved. The improved features were combined with morphological and texture features. This feature group was rated by a value called similarity coefficient value which was obtained from a similarity coefficient generator module. The nodules were classified as benign or malignant using a multi-layer deep neural network with a pre-weighting layer designed with a novel approach. In this study, a novel multi-layer computer-aided diagnosis system was proposed for thyroid cancer detection. In the first layer of the system, a novel feature extraction method based on the class similarity of images was developed. In the second layer, a novel pre-weighting layer was proposed by modifying the genetic algorithm. The proposed system showed superior performance in different metrics compared to the literature.

Feature Extraction Using a Residual Deep Convolutional Neural Network (ResNet-152) and Optimized Feature Dimension Reduction for MRI Brain Tumor Classification

One of the top causes of mortality in people globally is a brain tumor. Today, biopsy is regarded as the cornerstone of cancer diagnosis. However, it faces difficulties, including low sensitivity, hazards during biopsy treatment, and a protracted waiting period for findings. In this context, developing non-invasive and computational methods for identifying and treating brain cancers is crucial. The classification of tumors obtained from an MRI is crucial for making a variety of medical diagnoses. However, MRI analysis typically requires much time. The primary challenge is that the tissues of the brain are comparable. Numerous scientists have created new techniques for identifying and categorizing cancers. However, due to their limitations, the majority of them eventually fail. In that context, this work presents a novel way of classifying multiple types of brain tumors. This work also introduces a segmentation algorithm known as Canny Mayfly. Enhanced chimpanzee optimization algorithm (EChOA) is used to select the features by minimizing the dimension of the retrieved features. ResNet-152 and the softmax classifier are then used to perform the feature classification process. Python is used to carry out the proposed method on the Figshare dataset. The accuracy, specificity, and sensitivity of the proposed cancer classification system are just a few of the characteristics that are used to evaluate its overall performance. According to the final evaluation results, our proposed strategy outperformed, with an accuracy of 98.85%.

Multi-Attribute Attention Network for Interpretable Diagnosis of Thyroid Nodules in Ultrasound Images

Ultrasound (US) is the primary imaging technique for the diagnosis of thyroid cancer. However, accurate identification of nodule malignancy is a challenging task that can elude less-experienced clinicians. Recently, many computer-aided diagnosis (CAD) systems have been proposed to assist this process. However, most of them do not provide the reasoning of their classification process, which may jeopardize their credibility in practical use. To overcome this, we propose a novel deep learning (DL) framework called multi-attribute attention network (MAA-Net) that is designed to mimic the clinical diagnosis process. The proposed model learns to predict nodular attributes and infer their malignancy based on these clinically-relevant features. A multi-attention scheme is adopted to generate customized attention to improve each task and malignancy diagnosis. Furthermore, MAA-Net utilizes nodule delineations as nodules spatial prior guidance for the training rather than cropping the nodules with additional models or human interventions to prevent losing the context information. Validation experiments were performed on a large and challenging dataset containing 4554 patients. Results show that the proposed method outperformed other state-of-the-art methods and provides interpretable predictions that may better suit clinical needs.

Automated Diagnosis and Assessment of Cardiac Structural Alteration in Hypertension Ultrasound Images

Hypertension (HTN) is a major risk factor for cardiovascular diseases. At least 45% of deaths due to heart disease and 51% of deaths due to stroke are the result of hypertension. According to research on the prevalence and absolute burden of HTN in India, HTN positively correlated with age and was present in 20.6% of men and 20.9% of women. It was estimated that this trend will increase to 22.9% and 23.6% for men and women, respectively, by 2025. Controlling blood pressure is therefore important to lower both morbidity and mortality. Computer-aided diagnosis (CAD) is a noninvasive technique which can determine subtle myocardial structural changes at an early stage. In this work, we show how a multi-resolution analysis-based CAD system can be utilized for the detection of early HTN-induced left ventricular heart muscle changes with the help of ultrasound imaging. Firstly, features were extracted from the ultrasound imagery, and then the feature dimensions were reduced using a locality sensitive discriminant analysis (LSDA). The decision tree classifier with contourlet and shearlet transform features was later employed for improved performance and maximized accuracy using only two features. The developed model is applicable for the evaluation of cardiac structural alteration in HTN and can be used as a standalone tool in hospitals and polyclinics.

A Local and Global Feature Disentangled Network: Toward Classification of Benign-Malignant Thyroid Nodules From Ultrasound Image

Thyroid nodules are one of the most common nodular lesions. The incidence of thyroid cancer has increased rapidly in the past three decades and is one of the cancers with the highest incidence. As a non-invasive imaging modality, ultrasonography can identify benign and malignant thyroid nodules, and it can be used for large-scale screening. In this study, inspired by the domain knowledge of sonographers when diagnosing ultrasound images, a local and global feature disentangled network (LoGo-Net) is proposed to classify benign and malignant thyroid nodules. This model imitates the dual-pathway structure of human vision and establishes a new feature extraction method to improve the recognition performance of nodules. We use the tissue-anatomy disentangled (TAD) block to connect the dual pathways, which decouples the cues of local and global features based on the self-attention mechanism. To verify the effectiveness of the model, we constructed a large-scale dataset and conducted extensive experiments. The results show that our method achieves an accuracy of 89.33%, which has the potential to be used in the clinical practice of doctors, including early cancer screening procedures in remote or resource-poor areas.

A Multi-Scale Densely Connected Convolutional Neural Network for Automated Thyroid Nodule Classification

Automated thyroid nodule classification in ultrasound images is an important way to detect thyroid nodules and to make a more accurate diagnosis. In this paper, we propose a novel deep convolutional neural network (CNN) model, called n-ClsNet, for thyroid nodule classification. Our model consists of a multi-scale classification layer, multiple skip blocks, and a hybrid atrous convolution (HAC) block. The multi-scale classification layer first obtains multi-scale feature maps in order to make full use of image features. After that, each skip-block propagates information at different scales to learn multi-scale features for image classification. Finally, the HAC block is used to replace the downpooling layer so that the spatial information can be fully learned. We have evaluated our n-ClsNet model on the TNUI-2021 dataset. The proposed n-ClsNet achieves an average accuracy (ACC) score of 93.8% in the thyroid nodule classification task, which outperforms several representative state-of-the-art classification methods.

A Novel N -Gram-Based Image Classification Model and Its Applications in Diagnosing Thyroid Nodule and Retinal OCT Images

Imbalanced classes and dimensional disasters are critical challenges in medical image classification. As a classical machine learning model, the n-gram model has shown excellent performance in addressing this issue in text classification. In this study, we proposed an algorithm to classify medical images by extracting their n-gram semantic features. This algorithm first converts an image classification problem to a text classification problem by building an n-gram corpus for an image. After that, the algorithm was based on the n-gram model to classify images. The algorithm was evaluated by two independent public datasets. The first experiment is to diagnose benign and malignant thyroid nodules. The best area under the curve (AUC) is 0.989. The second experiment is to diagnose the type of fundus lesion. The best result is that it correctly identified 86.667% of patients with dry age-related macular degeneration (AMD), 93.333% of patients with diabetic macular edema (DME), and 93.333% of normal individuals.

Novel Hypertrophic Cardiomyopathy Diagnosis Index Using Deep Features and Local Directional Pattern Techniques

Hypertrophic cardiomyopathy (HCM) is a genetic disorder that exhibits a wide spectrum of clinical presentations, including sudden death. Early diagnosis and intervention may avert the latter. Left ventricular hypertrophy on heart imaging is an important diagnostic criterion for HCM, and the most common imaging modality is heart ultrasound (US). The US is operator-dependent, and its interpretation is subject to human error and variability. We proposed an automated computer-aided diagnostic tool to discriminate HCM from healthy subjects on US images. We used a local directional pattern and the ResNet-50 pretrained network to classify heart US images acquired from 62 known HCM patients and 101 healthy subjects. Deep features were ranked using Student’s t-test, and the most significant feature (SigFea) was identified. An integrated index derived from the simulation was defined as 100·log10(SigFea/2) in each subject, and a diagnostic threshold value was empirically calculated as the mean of the minimum and maximum integrated indices among HCM and healthy subjects, respectively. An integrated index above a threshold of 0.5 separated HCM from healthy subjects with 100% accuracy in our test dataset.

Radiomic Detection of Malignancy within Thyroid Nodules Using Ultrasonography-A Systematic Review and Meta-Analysis

Background: Despite investigation, 95% of thyroid nodules are ultimately benign. Radiomics is a field that uses radiological features to inform individualized patient care. We aimed to evaluate the diagnostic utility of radiomics in classifying undetermined thyroid nodules into benign and malignant using ultrasonography (US). Methods: A diagnostic test accuracy systematic review and meta-analysis was performed in accordance with PRISMA guidelines. Sensitivity, specificity, and area under curve (AUC) delineating benign and malignant lesions were recorded. Results: Seventy-five studies including 26,373 patients and 46,175 thyroid nodules met inclusion criteria. Males accounted for 24.6% of patients, while 75.4% of patients were female. Radiomics provided a pooled sensitivity of 0.87 (95% CI: 0.86−0.87) and a pooled specificity of 0.84 (95% CI: 0.84−0.85) for characterizing benign and malignant lesions. Using convolutional neural network (CNN) methods, pooled sensitivity was 0.85 (95% CI: 0.84−0.86) and pooled specificity was 0.82 (95% CI: 0.82−0.83); significantly lower than studies using non-CNN: sensitivity 0.90 (95% CI: 0.89−0.90) and specificity 0.88 (95% CI: 0.87−0.89) (p < 0.05). The diagnostic ability of radiologists and radiomics were comparable for both sensitivity (OR 0.98) and specificity (OR 0.95). Conclusions: Radiomic analysis using US provides a reproducible, reliable evaluation of undetermined thyroid nodules when compared to current best practice.

Application of Machine Learning Methods to Improve the Performance of Ultrasound in Head and Neck Oncology: A Literature Review

Simple Summary

Ultrasound (US) is a non-invasive imaging method that is routinely utilized in head and neck cancer patients to assess the anatomic extent of tumors, nodal and non-nodal neck masses and for imaging the salivary glands. In this review, we summarize the present evidence on whether the application of machine learning (ML) methods can potentially improve the performance of US in head and neck cancer patients. We found that published clinical literature on ML methods applied to US datasets was limited but showed evidence of improved diagnostic and prognostic performance. However, a majority of these studies were based on retrospective evaluation and conducted at a single center with a limited number of datasets. The conduct of multi-center studies could help better validate the performance of ML-based US radiomics and facilitate the integration of these approaches into routine clinical practice.

Abstract

Radiomics is a rapidly growing area of research within radiology that involves the extraction and modeling of high-dimensional quantitative imaging features using machine learning/artificial intelligence (ML/AI) methods. In this review, we describe the published clinical evidence on the application of ML methods to improve the performance of ultrasound (US) in head and neck oncology. A systematic search of electronic databases (MEDLINE, PubMed, clinicaltrials.gov) was conducted according to Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. Of 15,080 initial articles identified, 34 studies were selected for in-depth analysis. Twenty-five out of 34 studies (74%) focused on the diagnostic application of US radiomics while 6 (18%) studies focused on response assessment and 3 (8%) studies utilized US radiomics for modeling normal tissue toxicity. Support vector machine (SVM) was the most commonly employed ML method (47%) followed by multivariate logistic regression (24%) and k-nearest neighbor analysis (21%). Only 11/34 (~32%) of the studies included an independent validation set. A majority of studies were retrospective in nature (76%) and based on single-center evaluation (85%) with variable numbers of patients (12–1609) and imaging datasets (32–1624). Despite these limitations, the application of ML methods resulted in improved diagnostic and prognostic performance of US highlighting the potential clinical utility of this approach.

Multi-channel convolutional neural network architectures for thyroid cancer detection

Early detection of malignant thyroid nodules leading to patient-specific treatments can reduce morbidity and mortality rates. Currently, thyroid specialists use medical images to diagnose then follow the treatment protocols, which have limitations due to unreliable human false-positive diagnostic rates. With the emergence of deep learning, advances in computer-aided diagnosis techniques have yielded promising earlier detection and prediction accuracy; however, clinicians' adoption is far lacking. The present study adopts Xception neural network as the base structure and designs a practical framework, which comprises three adaptable multi-channel architectures that were positively evaluated using real-world data sets. The proposed architectures outperform existing statistical and machine learning techniques and reached a diagnostic accuracy rate of 0.989 with ultrasound images and 0.975 with computed tomography scans through the single input dual-channel architecture. Moreover, the patient-specific design was implemented for thyroid cancer detection and has obtained an accuracy of 0.95 for double inputs dual-channel architecture and 0.94 for four-channel architecture. Our evaluation suggests that ultrasound images and computed tomography (CT) scans yield comparable diagnostic results through computer-aided diagnosis applications. With ultrasound images obtained slightly higher results, CT, on the other hand, can achieve the patient-specific diagnostic design. Besides, with the proposed framework, clinicians can select the best fitting architecture when making decisions regarding a thyroid cancer diagnosis. The proposed framework also incorporates interpretable results as evidence, which potentially improves clinicians' trust and hence their adoption of the computer-aided diagnosis techniques proposed with increased efficiency and accuracy.

A novel fusion-based deep learning model for sentiment analysis of COVID-19 tweets

Undoubtedly, coronavirus (COVID-19) has caused one of the biggest challenges of all times. The ongoing COVID-19 pandemic has caused more than 150 million infected cases and one million deaths globally as of May 5, 2021. Understanding the sentiment of people expressed in their social media comments can help in monitoring, controlling, and ultimately eradicating the disease. This is a sensitive matter as the threat of infectious disease significantly affects the way people think and behave in various ways. In this study, we proposed a novel method based on the fusion of four deep learning and one classical supervised machine learning model for sentiment analysis of coronavirus-related tweets from eight countries. Also, we analyzed coronavirus-related searches using Google Trends to better understand the change in the sentiment pattern at different times and places. Our findings reveal that the coronavirus attracted the attention of people from different countries at different times in varying intensities. Also, the sentiment in their tweets is correlated to the news and events that occurred in their countries including the number of newly infected cases, number of recoveries and deaths. Moreover, common sentiment patterns can be observed in various countries during the spread of the virus. We believe that different social media platforms have great impact on raising people's awareness about the importance of this disease as well as promoting preventive measures among people in the community.

Utility of a Deep-Learning Algorithm to Guide Novices to Acquire Echocardiograms for Limited Diagnostic Use

Importance

Artificial intelligence (AI) has been applied to analysis of medical imaging in recent years, but AI to guide the acquisition of ultrasonography images is a novel area of investigation. A novel deep-learning (DL) algorithm, trained on more than 5 million examples of the outcome of ultrasonographic probe movement on image quality, can provide real-time prescriptive guidance for novice operators to obtain limited diagnostic transthoracic echocardiographic images.

Objective

To test whether novice users could obtain 10-view transthoracic echocardiographic studies of diagnostic quality using this DL-based software.

Design, Setting, and Participants

This prospective, multicenter diagnostic study was conducted in 2 academic hospitals. A cohort of 8 nurses who had not previously conducted echocardiograms was recruited and trained with AI. Each nurse scanned 30 patients aged at least 18 years who were scheduled to undergo a clinically indicated echocardiogram at Northwestern Memorial Hospital or Minneapolis Heart Institute between March and May 2019. These scans were compared with those of sonographers using the same echocardiographic hardware but without AI guidance.

Interventions

Each patient underwent paired limited echocardiograms: one from a nurse without prior echocardiography experience using the DL algorithm and the other from a sonographer without the DL algorithm. Five level 3-trained echocardiographers independently and blindly evaluated each acquisition.

Main Outcomes and Measures

Four primary end points were sequentially assessed: qualitative judgement about left ventricular size and function, right ventricular size, and the presence of a pericardial effusion. Secondary end points included 6 other clinical parameters and comparison of scans by nurses vs sonographers.

Results

A total of 240 patients (mean [SD] age, 61 [16] years old; 139 men [57.9%]; 79 [32.9%] with body mass indexes >30) completed the study. Eight nurses each scanned 30 patients using the DL algorithm, producing studies judged to be of diagnostic quality for left ventricular size, function, and pericardial effusion in 237 of 240 cases (98.8%) and right ventricular size in 222 of 240 cases (92.5%). For the secondary end points, nurse and sonographer scans were not significantly different for most parameters.

Conclusions and Relevance

This DL algorithm allows novices without experience in ultrasonography to obtain diagnostic transthoracic echocardiographic studies for evaluation of left ventricular size and function, right ventricular size, and presence of a nontrivial pericardial effusion, expanding the reach of echocardiography to clinical settings in which immediate interrogation of anatomy and cardiac function is needed and settings with limited resources.

Ultrasound Image Classification of Thyroid Nodules Using Machine Learning Techniques

Background and Objectives: Thyroid nodules are lumps of solid or liquid-filled tumors that form inside the thyroid gland, which can be malignant or benign. Our aim was to test whether the described features of the Thyroid Imaging Reporting and Data System (TI-RADS) could improve radiologists' decision making when integrated into a computer system. In this study, we developed a computer-aided diagnosis system integrated into multiple-instance learning (MIL) that would focus on benign-malignant classification. Data were available from the Universidad Nacional de Colombia. Materials and Methods: There were 99 cases (33 Benign and 66 malignant). In this study, the median filter and image binarization were used for image pre-processing and segmentation. The grey level co-occurrence matrix (GLCM) was used to extract seven ultrasound image features. These data were divided into 87% training and 13% validation sets. We compared the support vector machine (SVM) and artificial neural network (ANN) classification algorithms based on their accuracy score, sensitivity, and specificity. The outcome measure was whether the thyroid nodule was benign or malignant. We also developed a graphic user interface (GUI) to display the image features that would help radiologists with decision making. Results: ANN and SVM achieved an accuracy of 75% and 96% respectively. SVM outperformed all the other models on all performance metrics, achieving higher accuracy, sensitivity, and specificity score. Conclusions: Our study suggests promising results from MIL in thyroid cancer detection. Further testing with external data is required before our classification model can be employed in practice.

Artificial Intelligence for Personalized Medicine in Thyroid Cancer: Current Status and Future Perspectives

Thyroid cancers (TC) have increasingly been detected following advances in diagnostic methods. Risk stratification guided by refined information becomes a crucial step toward the goal of personalized medicine. The diagnosis of TC mainly relies on imaging analysis, but visual examination may not reveal much information and not enable comprehensive analysis. Artificial intelligence (AI) is a technology used to extract and quantify key image information by simulating complex human functions. This latent, precise information contributes to stratify TC on the distinct risk and drives tailored management to transit from the surface (population-based) to a point (individual-based). In this review, we started with several challenges regarding personalized care in TC, for example, inconsistent rating ability of ultrasound physicians, uncertainty in cytopathological diagnosis, difficulty in discriminating follicular neoplasms, and inaccurate prognostication. We then analyzed and summarized the advances of AI to extract and analyze morphological, textural, and molecular features to reveal the ground truth of TC. Consequently, their combination with AI technology will make individual medical strategies possible.

Novel and accurate non-linear index for the automated detection of haemorrhagic brain stroke using CT images

Brain stroke is an emergency medical condition which occurs mainly due to insufficient blood flow to the brain. It results in permanent cellular-level damage. There are two main types of brain stroke, ischemic and hemorrhagic. Ischemic brain stroke is caused by a lack of blood flow, and the haemorrhagic form is due to internal bleeding. The affected part of brain will not function properly after this attack. Hence, early detection is important for more efficacious treatment. Computer-aided diagnosis is a type of non-invasive diagnostic tool which can help in detecting life-threatening disease in its early stage by utilizing image processing and soft computing techniques. In this paper, we have developed one such model to assess intracerebral haemorrhage by employing non-linear features combined with a probabilistic neural network classifier and computed tomography (CT) images. Our model achieved a maximum accuracy of 97.37% in discerning normal versus haemorrhagic subjects. An intracerebral haemorrhage index is also developed using only three significant features. The clinical and statistical validation of the model confirms its suitability in providing for improved treatment planning and in making strategic decisions.

Thyroid nodules risk stratification through deep learning based on ultrasound images

PURPOSE

Clinically, the risk stratification of thyroid nodules is usually used to formulate the next treatment plan. The American College of Radiology (ACR) thyroid imaging reporting and data system (TI-RADS) is a type of medical standard widely used in classification diagnosis. It divides the nodule's ACR TI-RADS level into five levels by quantitative scoring, from benign to high suspicion of malignancy. However, such assessment often relies on the radiologists' experience and is time consuming. So computer-aided diagnosis is necessary. But many deep learning (DL) models are difficult for doctors to understand, limiting their applicability in clinical practice. In this work, we mainly focus on how to achieve automatic thyroid nodules risk stratification based on deep integration of deep learning and clinical experience.

METHODS

An automatic hierarchical method of thyroid nodules risk based on deep learning is proposed, called risk stratification network (RS-Net). It incorporates medical experience based on ACR TI-RADS. The convolutional neural network (CNN) is used to classify the five categories in ACR TI-RADS and assign their points respectively. According to the point totals, the level of risk can be obtained. In addition, a dataset involving 13 984 thyroid ultrasound images is established to develop and evaluate the proposed method.

RESULTS

We have extensively compared the results of this paper with the evaluation results of sonographers. The accuracy of the risk stratification (TR1 to TR5) of the proposed method is 65%, and the mean absolute error (MAE) is 0.54. The MAE of the point totals (0 to 13 points) is 1.67. The Pearson's correlation between our method evaluation and doctor evaluation reached 0.84. For the benign and malignant classification, the performance indices accuracy, sensitivity, specificity, PPV, and NPV were 88.0%, 98.1%, 79.1%, 80.5%, and 97.9%, respectively. Our method's level of thyroid nodules risk stratification is comparable to that of a senior doctor.

CONCLUSIONS

This work provides a way to automate the risk stratification of thyroid nodules. Our method can effectively avoid missed diagnosis and misdiagnosis caused by the difference of observers so as to assist doctors to improve efficiency and diagnosis rate. Compared with the previous benign and malignant classification, the proposed method incorporates clinical experience. So it can greatly increase the clinicians' trust in the DL model, thereby improving the applicability of the model in clinical practice.

Deep learning enables automated localization of the metastatic lymph node for thyroid cancer on 131I post-ablation whole-body planar scans

The accurate detection of radioactive iodine-avid lymph node (LN) metastasis on 131I post-ablation whole-body planar scans (RxWBSs) is important in tracking the progression of the metastatic lymph nodes (mLNs) of patients with papillary thyroid cancer (PTC). However, severe noise artifacts and the indiscernible location of the mLN from adjacent tissues with similar gray-scale values make clinical decisions extremely challenging. This study aims (i) to develop a multilayer fully connected deep network (MFDN) for the automatic recognition of mLNs from thyroid remnant tissue by utilizing the dataset of RxWBSs and (ii) to evaluate its diagnostic performance using post-ablation single-photon emission computed tomography. Image patches focused on the mLN and remnant tissues along with their variations of probability of pixel positions were fed as inputs to the network. With this efficient automatic approach, we achieved a high F1-score and outperformed the physician score (P < 0.001) in detecting mLNs. Competitive segmentation networks on RxWBS displayed moderate performance for the mLN but remained robust for the remnant tissue. Our results demonstrated that the generalization performance with the multiple layers by replicating signal transmission overcome the constraint of local minimum optimization, it can be suitable to localize the unstable location of mLN region on RxWBS and therefore MFDN can be useful in clinical decision-making to track mLN progression for PTC.

Ultrasound Image-Based Diagnosis of Malignant Thyroid Nodule Using Artificial Intelligence

Computer-aided diagnosis systems have been developed to assist doctors in diagnosing thyroid nodules to reduce errors made by traditional diagnosis methods, which are mainly based on the experiences of doctors. Therefore, the performance of such systems plays an important role in enhancing the quality of a diagnosing task. Although there have been the state-of-the art studies regarding this problem, which are based on handcrafted features, deep features, or the combination of the two, their performances are still limited. To overcome these problems, we propose an ultrasound image-based diagnosis of the malignant thyroid nodule method using artificial intelligence based on the analysis in both spatial and frequency domains. Additionally, we propose the use of weighted binary cross-entropy loss function for the training of deep convolutional neural networks to reduce the effects of unbalanced training samples of the target classes in the training data. Through our experiments with a popular open dataset, namely the thyroid digital image database (TDID), we confirm the superiority of our method compared to the state-of-the-art methods.

Artificial Intelligence-Based Thyroid Nodule Classification Using Information from Spatial and Frequency Domains

Image-based computer-aided diagnosis (CAD) systems have been developed to assist doctors in the diagnosis of thyroid cancer using ultrasound thyroid images. However, the performance of these systems is strongly dependent on the selection of detection and classification methods. Although there are previous researches on this topic, there is still room for enhancement of the classification accuracy of the existing methods. To address this issue, we propose an artificial intelligence-based method for enhancing the performance of the thyroid nodule classification system. Thus, we extract image features from ultrasound thyroid images in two domains: spatial domain based on deep learning, and frequency domain based on Fast Fourier transform (FFT). Using the extracted features, we perform a cascade classifier scheme for classifying the input thyroid images into either benign (negative) or malign (positive) cases. Through expensive experiments using a public dataset, the thyroid digital image database (TDID) dataset, we show that our proposed method outperforms the state-of-the-art methods and produces up-to-date classification results for the thyroid nodule classification problem.

The Diagnostic Efficiency of Ultrasound Computer-Aided Diagnosis in Differentiating Thyroid Nodules: A Systematic Review and Narrative Synthesis

Computer-aided diagnosis (CAD) techniques have emerged to complement qualitative assessment in the diagnosis of benign and malignant thyroid nodules. The aim of this review was to summarize the current evidence on the diagnostic performance of various ultrasound CAD in characterizing thyroid nodules. PUBMED, EMBASE and Cochrane databases were searched for studies published until August 2019. The Quality Assessment of Studies of Diagnostic Accuracy included in Systematic Review 2 (QUADAS-2) tool was used to assess the methodological quality of the studies. Reported diagnostic performance data were analyzed and discussed. Fourteen studies with 2232 patients and 2675 thyroid nodules met the inclusion criteria. The study quality based on QUADAS-2 assessment was moderate. At best performance, grey scale CAD had a sensitivity of 96.7% while Doppler CAD was 90%. Combined techniques of qualitative grey scale features and Doppler CAD assessment resulted in overall increased sensitivity (92%) and optimal specificity (85.1%). The experience of the CAD user, nodule size and the thyroid malignancy risk stratification system used for interpretation were the main potential factors affecting diagnostic performance outcomes. The diagnostic performance of CAD of thyroid ultrasound is comparable to that of qualitative visual assessment; however, combined techniques have the potential for better optimized diagnostic accuracy.

Clinical Value of a Computer-Aided Diagnosis System in Thyroid Nodules: Analysis of a Reading Map Competition

We evaluated the accuracy of human and computer-aided diagnosis (CAD) in a reading map diagnosis competition for detection of thyroid cancers via ultrasonography (US). The competition comprised 33 thyroid nodule images randomly chosen between 2015 and 2017. One hundred seventy-seven contestants including one operator using CAD participated in the competition. The competition was separated into an online part and a live part. We compared the average accuracy of contestants and CAD in the detection of thyroid cancers. The accuracy of contestants and the CAD system was 60.3% and 84.8%, respectively. The accuracy of the CAD system was higher than that of the contestants with different technical titles. The areas under the curve for CAD and contestants were 0.985 (0.881-1.00) and 0.659 (0.645-0.673) (Z = 7.55, p < 0.01). The CAD system had high accuracy in this thyroid nodule reading map competition, and may be an adjuvant tool for radiologists.

Parametrical modelling for texture characterization-A novel approach applied to ultrasound thyroid segmentation

Texture analysis is an important topic in Ultrasound (US) image analysis for structure segmentation and tissue classification. In this work a novel approach for US image texture feature extraction is presented. It is mainly based on parametrical modelling of a signal version of the US image in order to process it as data resulting from a dynamical process. Because of the predictive characteristics of such a model representation, good estimations of texture features can be obtained with less data than generally used methods require, allowing higher robustness to low Signal-to-Noise ratio and a more localized US image analysis. The usability of the proposed approach was demonstrated by extracting texture features for segmenting the thyroid in US images. The obtained results showed that features corresponding to energy ratios between different modelled texture frequency bands allowed to clearly distinguish between thyroid and non-thyroid texture. A simple k-means clustering algorithm has been used for separating US image patches as belonging to thyroid or not. Segmentation of thyroid was performed in two different datasets obtaining Dice coefficients over 85%.

Patch-based classification of thyroid nodules in ultrasound images using direction independent features extracted by two-threshold binary decomposition

Ultrasound imaging of the thyroid gland is considered to be the best diagnostic choice for evaluating thyroid nodules in early stages, since it has been marked as cost-effective, non-invasive and risk-free. Computer aided diagnosis (CAD) systems can offer a second opinion to radiologists, thereby increasing the overall diagnostic accuracy of ultrasound imaging. Although current CAD systems exhibit promising results, their use in clinical practice is limited. Some of the main limitations are that the majority use direction dependent features so, they are only compatible with static images in just one plane (axial or longitudinal), requiring precise segmentation of a nodule. Our intention has been to design a CAD system which will use only direction independent features i.e., not dependent upon the orientation or inclination angle of the ultrasound probe when acquiring the image. In this study, 60 thyroid nodules (20 malignant, 40 benign) were divided into small patches of 17 × 17 pixels, which were then used to extract several direction independent features by employing Two-Threshold Binary Decomposition, a method that decomposes an image into the set of binary images. The features were then used in Random Forests (RF) and Support Vector Machine (SVM) classifiers to categorize nodules into malignant and benign classes. Classification was evaluated using group 10-fold cross-validation method. Performance on individual patches was then averaged to classify whole nodules with the following results: overall accuracy, sensitivity, specificity and area under receiver operating characteristics (ROC) curve: 95%, 95%, 95%, 0.971 for RF and; 91.6%, 95%, 90%, 0.965 for SVM respectively. The patch-based CAD system we present can provide support to radiologists in their current diagnosis of thyroid nodules, whereby it can increase the overall accuracy of ultrasound imaging.

Multitask Cascade Convolution Neural Networks for Automatic Thyroid Nodule Detection and Recognition

Thyroid ultrasonography is a widely used clinical technique for nodule diagnosis in thyroid regions. However, it remains difficult to detect and recognize the nodules due to low contrast, high noise, and diverse appearance of nodules. In today's clinical practice, senior doctors could pinpoint nodules by analyzing global context features, local geometry structure, and intensity changes, which would require rich clinical experience accumulated from hundreds and thousands of nodule case studies. To alleviate doctors' tremendous labor in the diagnosis procedure, we advocate a machine learning approach to the detection and recognition tasks in this paper. In particular, we develop a multitask cascade convolution neural network (MC-CNN) framework to exploit the context information of thyroid nodules. It may be noted that our framework is built upon a large number of clinically confirmed thyroid ultrasound images with accurate and detailed ground truth labels. Other key advantages of our framework result from a multitask cascade architecture, two stages of carefully designed deep convolution networks in order to detect and recognize thyroid nodules in a pyramidal fashion, and capturing various intrinsic features in a global-to-local way. Within our framework, the potential regions of interest after initial detection are further fed to the spatial pyramid augmented CNNs to embed multiscale discriminative information for fine-grained thyroid recognition. Experimental results on 4309 clinical ultrasound images have indicated that our MC-CNN is accurate and effective for both thyroid nodules detection and recognition. For the correct diagnosis rate of malignant and benign thyroid nodules, its mean Average Precision (mAP) performance can achieve up to [Formula: see text] accuracy, which outperforms the common CNNs by [Formula: see text] on average. In addition, we conduct rigorous user studies to confirm that our MC-CNN outperforms experienced doctors, yet only consuming roughly [Formula: see text] ( 1/48) of doctors' examination time on average. Therefore, the accuracy and efficiency of our new method exhibit its great potential in clinical applications.

Optimized multi-level elongated quinary patterns for the assessment of thyroid nodules in ultrasound images

Ultrasound imaging is one of the most common visualizing tools used by radiologists to identify the location of thyroid nodules. However, visual assessment of nodules is difficult and often affected by inter- and intra-observer variabilities. Thus, a computer-aided diagnosis (CAD) system can be helpful to cross-verify the severity of nodules. This paper proposes a new CAD system to characterize thyroid nodules using optimized multi-level elongated quinary patterns. In this study, higher order spectral (HOS) entropy features extracted from these patterns appropriately distinguished benign and malignant nodules under particle swarm optimization (PSO) and support vector machine (SVM) frameworks. Our CAD algorithm achieved a maximum accuracy of 97.71% and 97.01% in private and public datasets respectively. The evaluation of this CAD system on both private and public datasets confirmed its effectiveness as a secondary tool in assisting radiological findings.

Towards precision medicine: from quantitative imaging to radiomics

Radiology (imaging) and imaging-guided interventions, which provide multi-parametric morphologic and functional information, are playing an increasingly significant role in precision medicine. Radiologists are trained to understand the imaging phenotypes, transcribe those observations (phenotypes) to correlate with underlying diseases and to characterize the images. However, in order to understand and characterize the molecular phenotype (to obtain genomic information) of solid heterogeneous tumours, the advanced sequencing of those tissues using biopsy is required. Thus, radiologists image the tissues from various views and angles in order to have the complete image phenotypes, thereby acquiring a huge amount of data. Deriving meaningful details from all these radiological data becomes challenging and raises the big data issues. Therefore, interest in the application of radiomics has been growing in recent years as it has the potential to provide significant interpretive and predictive information for decision support. Radiomics is a combination of conventional computer-aided diagnosis, deep learning methods, and human skills, and thus can be used for quantitative characterization of tumour phenotypes. This paper discusses the overview of radiomics workflow, the results of various radiomics-based studies conducted using various radiological images such as computed tomography (CT), magnetic resonance imaging (MRI), and positron-emission tomography (PET), the challenges we are facing, and the potential contribution of radiomics towards precision medicine.

APPLICATION OF ENTROPIES FOR AUTOMATED DIAGNOSIS OF ABNORMALITIES IN ULTRASOUND IMAGES: A REVIEW

Automation of diagnosis process in medical imaging using various computer-aided techniques is a leading topic of research. Among many computer-aided methods, nonlinear entropies are widely applied in the development of automated algorithms to diagnose abnormalities present in medical images. The use of entropy features in development of Computer-Aided Diagnosis (CAD) may enhance the accuracy of the system. Entropy features depict the nonlinearity of images and thereby the presence of complexity in the images. Various types of entropies have been employed in medical image analysis for automated diagnosis of abnormalities present in the images. This paper focuses on the diverse types of entropies employed in the development of CAD systems for the diagnosis of abnormalities in the medical images. In addition to the diagnosis, these entropies can be used to differentiate the images based on the severity of the abnormalities and for other biomedical applications.