Inter-observer agreement for the evaluation of bone involvement on Whole Body Low Dose Computed Tomography (WBLDCT) in Multiple Myeloma (MM)

Low diagnostic accuracy and inter-observer agreement on CT and MRI in diagnosis of spinal fractures in multiple myeloma

Skeletal disease is common in multiple myeloma. We investigated the inter-observer agreement and diagnostic accuracy of spinal fractures diagnosed by computer tomography (CT) and magnetic resonance imaging (MRI) from 12 myeloma patients. Two radiologists independently assessed the images. CT, MRI, and other images were combined to a gold standard. The inter-observer agreement was assessed with Cohen’s kappa. Radiologist 1 diagnosed 20 malignant spinal fractures on CT and 26 on MRI, while radiologist 2 diagnosed 12 malignant spinal fractures on CT and 22 on MRI. In comparison the gold standard diagnosed 10 malignant spinal fractures. The sensitivity for malignant fractures varied from 0.5 to 1 for CT and MRI, and the specificity varied from 0.17 to 0.67. On MRI, the specificity for malignant spinal fractures was 0.17 for both radiologists. The inter-observer agreement for malignant spinal fractures on CT was -0.42 (Cohen’s kappa) and -0.13 for MRI, while for osteoporotic fractures it was -0.24 for CT and 0.53 for MRI. We conclude that malignant spinal fractures were over-diagnosed on CT and MRI. The inter-observer agreement was extremely poor.

Computed tomography with low-dose radiation versus standard-dose radiation for diagnosing fractures: systematic review and meta-analysis

BACKGROUND

Computed tomography (CT) accounts for 13% of all radiological examinations in the United States and 40-70% of the radiation that patients receive. Even with the advent of magnetic resonance imaging (MRI), CT continues to be the gold standard for diagnosing bone fractures. There is uncertainty as to whether CT with a low radiation dose has a fracture detection rate similar to that of standard-dose CT.

OBJECTIVE

To determine the detection rate of low-dose radiation CT and standard-dose radiation CT for fractures, in patients with suspected fractures.

DESIGN AND SETTING

Systematic review of comparative studies on diagnostic accuracy within the evidence-based health program at a federal university in São Paulo (SP), Brazil.

METHODS

We searched the electronic databases Cochrane Library, MEDLINE, EMBASE and LILACS up to June 29, 2020, for studies evaluating the detection rates of low-dose CT and standard-dose CT for diagnosing bone fractures. The Research Triangle Institute (RTI) item bank tool was used for methodological quality evaluation.

RESULTS

The fracture detection rate according to the number of bones evaluated, using CT with low-dose radiation was 20.3%, while with standard-dose radiation it was 19.2%, and the difference between the methods was not significant. The fracture detection rate according to the number of patients, using CT with low-dose radiation was 56.0%, while with standard-dose radiation it was 58.7%, and this difference between the methods was not significant, either.

CONCLUSION

CT with low-dose radiation presented detection rates similar to those of CT with standard-dose radiation, regardless of the bones evaluated.

REGISTRATION NUMBER

CRD42019148491 at the PROSPERO database.

Whole Body Low Dose Computed Tomography Using Third-Generation Dual-Source Multidetector With Spectral Shaping: Protocol Optimization and Literature Review

For decades, the main imaging tool for multiple myeloma (MM) patient's management has been the conventional skeleton survey. In 2014 international myeloma working group defined the advantages of the whole-body low dose computed tomography (WBLDCT) as a gold standard, among imaging modalities, for bone disease assessment and subsequently implemented this technique in the MM diagnostic workflow. The aim of this study is to investigate, in a group of 30 patients with a new diagnosis of MM, the radiation dose (CT dose index, dose-length product, effective dose), the subjective image quality score and osseous/extra-osseous findings rate with a modified WBLDCT protocol. Spectral shaping and third-generation dual-source multidetector CT scanner was used for the assessment of osteolytic lesions due to MM, and the dose exposure was compared with the literature findings reported until 2020. Mean radiation dose parameters were reported as follows: CT dose index 0.3 ± 0.1 mGy, Dose-Length Product 52.0 ± 22.5 mGy*cm, effective dose 0.44 ± 0.19 mSv. Subjective image quality was good/excellent in all subjects. 11/30 patients showed osteolytic lesions, with a percentage of extra-osseous findings detected in 9/30 patients. Our data confirmed the advantages of WBLDCT in the diagnosis of patients with MM, reporting an effective dose for our protocol as the lowest among previous literature findings.

The Problems with the Kappa Statistic as a Metric of Interobserver Agreement on Lesion Detection Using a Third-reader Approach When Locations Are Not Prespecified

RATIONALE AND OBJECTIVES

To point out the problems with Cohen kappa statistic and to explore alternative metrics to determine interobserver agreement on lesion detection when locations are not prespecified.

MATERIALS AND METHODS

Use of kappa and two alternative methods, namely index of specific agreement (ISA) and modified kappa, for measuring interobserver agreement on the location of detected lesions are presented. These indices of agreement are illustrated by application to a retrospective multireader study in which nine readers detected and scored prostate cancer lesions in 163 consecutive patients (n = 110 cases, n = 53 controls) using the guideline of Prostate Imaging Reporting and Data System version 2 on multiparametric magnetic resonance imaging.

RESULTS

The proposed modified kappa, which properly corrects for the amount of agreement by chance, is shown to be approximately equivalent to the ISA. In the prostate cancer data, average kappa, modified kappa, and ISA equaled 30%, 55%, and 57%, respectively, for all lesions and 20%, 87%, and 87%, respectively, for index lesions.

CONCLUSIONS

The application of kappa could result in a substantial downward bias in reader agreement on lesion detection when locations are not prespecified. ISA is recommended for assessment of reader agreement on lesion detection.

Improved MDCT monitoring of pelvic myeloma bone disease through the use of a novel longitudinal bone subtraction post-processing algorithm

PURPOSE

To evaluate the diagnostic performance of a novel CT post-processing software that generates subtraction maps of baseline and follow-up CT examinations in the course of myeloma bone lesions.

MATERIALS AND METHODS

This study included 61 consecutive myeloma patients who underwent repeated whole-body reduced-dose MDCT at our institution between November 2013 and June 2015. CT subtraction maps classified a progressive disease (PD) vs. stable disease (SD)/remission. Bone subtraction maps (BSMs) only and in combination with 1-mm (BSM+) source images were compared with 5-mm axial/MPR scans.

RESULTS

Haematological response categories at follow-up were: complete remission (n = 9), very good partial remission (n = 2), partial remission (n = 17) and SDh (n = 19) vs. PDh (n = 14). Five-millimetre CT scan yielded PD (n = 14) and SD/remission (n = 47) whereas bone subtraction + 1-mm axial scans (BSM+) reading resulted in PD (n = 18) and SD/remission (n = 43). Sensitivity/ specificity/accuracy for 5-mm/1-mm/BSM(alone)/BSM + in "lesion-by-lesion" reading was 89.4 %/98.9 %/98.3 %/ 99.5 %; 69.1 %/96.9 %/72 %/92.1 % and 83.8 %/98.4 %/92.1 %/98.3 %, respectively. The use of BSM+ resulted in a change of response classification in 9.8 % patients (n = 6) from SD to PD.

CONCLUSION

BSM reading is more accurate for monitoring myeloma compared to axial scans whereas BSM+ yields similar results with 1-mm reading (gold standard) but by significantly reduced reading time.

KEY POINTS

• CT evaluation of myeloma bone disease using a longitudinal bone subtraction post-processing algorithm. • Bone subtraction post-processing algorithm is more accurate for assessment of therapy. • Bone subtraction allowed improved and more efficient detection of myeloma bone lesions. • Post-processing tool demonstrating a change in response classification in 9.8 % patients (all showing PD). • Reading time could be substantially shortened as compared to regular CT assessment.