Technology Assessment in Radiology: Putting the Evidence in Evidence-based Radiology

Accuracy and reliability of magnetic resonance imaging in orthodontic diagnosis and treatment planning-a systematic review and meta-analysis

BACKGROUND

Magnetic resonance imaging (MRI) is a non-ionizing imaging technique. Using MRI in dentistry may potentially lower the general radiation dose of the examined population, provided MRI can replace various radiation-based images. Furthermore, novel MRI imaging modalities for three-dimensional and two-dimensional cephalometrics have recently been developed for orthodontic diagnosis.

OBJECTIVES

This systematic review aimed to determine the diagnostic accuracy and reliability of MRI in orthodontic diagnosis and treatment planning.

SEARCH METHODS

An electronic search was conducted on 20 November 2022 in the following databases: PubMed, LILACS, Web of Science, EMBASE, Scopus, and Cochrane. The search was updated on 30 August 2023. Furthermore, a grey literature search was performed in Google Scholar and Open-Grey.

SELECTION CRITERIA

This review included descriptive, observational, cohort studies, cross-sectional, case-control studies, and randomized/non-randomized trials related to the research question. The study excluded studies related to patients with syndromes, chronic diseases, craniofacial anomalies, or bone diseases.

DATA COLLECTION AND ANALYSIS

The included studies were quality assessed using the "Joanna Brigg's Critical Appraisal Tool for diagnostic test accuracy". The GRADE approach for non-randomized studies was used for strength-of-evidence analysis.

RESULTS

Eight of the 10 included studies compared MRI with either cone beam computed tomography or lateral cephalogram and found a high intra- and inter-rater agreement for landmark identification. The risk of bias was high in four studies, moderate in three, and low in three studies. Homogeneity was lacking among the included studies in terms of MRI imaging parameters and sample characteristics. This should be taken into consideration by future studies where uniformity with respect to these parameters may be considered.

CONCLUSIONS

Despite dissimilarity and heterogeneity in the sample population and other methodological aspects, all the included studies concluded that MRI enjoyed considerable intra- and inter-examiner reliability and was comparable to current diagnostic standards in orthodontics. Furthermore, the studies agreed on the innovative potential of MRI in radiation-free diagnosis and treatment planning in orthodontics in the future.

REGISTRATION

CRD number: CRD420223XXXXX.

Translating radiological research into practice-from discovery to clinical impact

At the European Society of Radiology (ESR), we strive to provide evidence for radiological practices that improve patient outcomes and have a societal impact. Successful translation of radiological research into clinical practice requires multiple factors including tailored methodology, a multidisciplinary approach aiming beyond technical validation, and a focus on unmet clinical needs. Low levels of evidence are a threat to radiology, resulting in low visibility and credibility. Here, we provide the background and rationale for the thematic series Translating radiological research into practice-from discovery to clinical impact, inviting authors to describe their processes of achieving clinically impactful radiological research. We describe the challenges unique to radiological research. Additionally, a survey was sent to non-radiological clinical societies. The majority of respondents (6/11) were in the field of gastrointestinal/abdominal medicine. The implementation of CT/MRI techniques for disease characterisation, detection and staging of cancer, and treatment planning and radiological interventions were mentioned as the most important radiological developments in the past years. The perception was that patients are substantially unaware of the impact of these developments. Unmet clinical needs were mostly early diagnosis and staging of cancer, microstructural/functional assessment of tissues and organs, and implant assessment. All but one respondent considered radiology important for research in their discipline, but five indicated that radiology is currently not involved in their research. Radiology research holds the potential for being transformative to medical practice. It is our responsibility to take the lead in studies including radiology and strive towards the highest levels of evidence.Critical relevance statement For radiological research to make a clinical and societal impact, radiologists should take the lead in radiological studies, go beyond the assessment of technical feasibility and diagnostic accuracy, and-in a multidisciplinary approach-address clinical unmet needs.Key points• Multiple factors are essential for radiological research to make a clinical and societal impact.• Radiological research needs to go beyond diagnostic accuracy and address unmet clinical needs.• Radiologists should take the lead in radiological studies with a multidisciplinary approach.

Qualitative study to explore radiologist and radiologic technologist perceptions of outcomes patients experience during imaging in the USA

OBJECTIVE

We aimed to explore the patient-centred outcomes (PCOs) radiologists and radiologic technologists perceive to be important to patients undergoing imaging procedures.

DESIGN

We conducted a qualitative study of individual semi-structured interviews.

PARTICIPANTS

We recruited multiple types of radiologists including general, musculoskeletal neuroradiology, body and breast imagers as well as X-ray, ultrasound, CT or MRI radiologic technologists from Washington and Idaho.

OUTCOME

Thematic analysis was conducted to identify themes and subthemes related to PCOs of imaging procedures.

RESULTS

Ten radiologists and six radiology technologists participated. Four main domains of PCOs were identified: emotions, physical factors, knowledge and patient burden. In addition to these outcomes, we also identified patient and provider factors that can potentially moderate these outcomes.

CONCLUSIONS

Radiologists and technologists perceived outcomes related to the effect of imaging procedures on patients' emotions, physical well-being, knowledge and burden from financial and opportunity costs to be important to patients undergoing imaging procedures. There are opportunities for the radiology community to measure and use these PCOs in comparisons of imaging procedures and potentially identify areas where these outcomes can be leveraged to drive a more patient-centred approach to radiology.

Encouraging MSK imaging research towards clinical impact is a necessity: opinion paper of the European Society of Musculoskeletal Radiology (ESSR)

Radiology has not been spared in recent economic crises with a substantial reduction in the turnover of imaging equipment. These problems are exacerbated by increasing demand for healthcare across Europe. Therefore, using existing radiological services while rigorously following evidence-based guidelines might improve patient care. Thus, diagnostic pathways should be assessed not only for technical and diagnostic performance but also for their impact on medical and social outcome. In this paper, we report the advice of the Research Committee of ESSR on how we may guide musculoskeletal radiological research towards studies that have useful clinical impact. The ESSR Research Committee intends to encourage research with potential to influence treatment, patient outcome, and social impact. Key Points • Research in medical imaging has the potential to improve human health. • High-level studies have the potential to place radiology at the pinnacle of quality in evidence-based practice. • The ESSR Research Committee intends to encourage research with potential to influence treatment, patient outcome, and social impact.

Surveillance magnetic resonance imaging for isolated optic pathway gliomas: is gadolinium necessary?

BACKGROUND

Pediatric optic pathway gliomas are typically indolent but have a variable clinical course. Treatment is dictated by symptoms and changes on contrast-enhanced MRI examinations. Gadolinium retention in children has motivated parsimonious use of gadolinium-based contrast agents.

OBJECTIVES

To determine surveillance MR factors that motivate changes in tumor-directed therapies and extrapolate cost-efficacy of a non-contrast follow-up protocol.

MATERIALS AND METHODS

Using an imaging database search we identified children with isolated optic pathway gliomas and ≥3 follow-up contrast-enhanced MRIs. We reviewed medical records and imaging for: (1) coincident changes on contrast-enhanced MRI and tumor-directed therapy, (2) demographics and duration of follow-up, (3) motivations for intervention, (4) assessment of gadolinium-based contrast agents' utility and (5) health care utilization data. We assessed cost impact in terms of relative value unit (RVU) burden.

RESULTS

We included 17 neurofibromatosis type 1 (NF1) and 21 non-NF1 patients who underwent a median 16.9 and 24.3 cumulative contrast-enhanced MR exams over 7.7 years and 8.1 years of follow-up, respectively. Eight children (one with NF1) had intervention based on contrast-enhanced MR findings alone. For these eight, increased tumor size was the only common feature, and it was apparent on non-contrast T2 sequences. For the median patient, a non-contrast follow-up protocol could result in 15.9 (NF1) and 23.3 (non-NF1) fewer gadolinium-based contrast agent administrations, and a 39% lower yearly RVU burden.

CONCLUSION

Pediatric patients with isolated optic pathway gliomas undergo a large number of routine contrast-enhanced MR follow-up exams. Gadolinium might not be needed for these exams to inform management decisions. Secondary benefits of a non-contrast follow-up protocol include decreased cost and risk to the patient.

Has the Objective Quality of Evidence in Imaging Papers Changed Over the Last 20 Years?

RATIONALE AND OBJECTIVES

We aimed to determine if both evidence level (EL) as well as clinical efficacy (CE) of imaging manuscripts have changed over the last 20 years.

MATERIALS AND METHODS

With our review of medical literature, Institutional Review Board approval was waived, and no informed consent was required. Using Web of Science, we determined the 10 highest impact factor imaging journals. For each journal the 10 most cited and 10 average cited papers were compared for the following years: 1994, 1998, 2002, 2006, 2010, and 2014. EL was graded using the same criteria as the Journal of Bone and Joint Surgery (Wright et al., 2003). CE was graded using the criteria of Thornbury and Fryback (1991). Statistical software R and package lme4 were used to fit mixed regression models with fixed effects for group, year, and a random effect for journal.

RESULTS

EL has improved -0.03 every year on average (P < .001). The more cited papers had better ELs (group effect = -0.23, SE 0.09, P = .011). CE is lower in top cited compared to average cited articles, although the differences were not statistically significant (group effect = -0.14, SE = 0.09, P = .16). CE level increased modestly in both groups over this 20-year time period (0.06 per year, SE = 0.007, P < .001).

CONCLUSION

Over the last 20 years, imaging journal articles have improved modestly in quality of evidence, as measured by EL and CE.

Developing a Curriculum for Information and Communications Technology Use in Global Health Research and Training: A Qualitative Study Among Chinese Health Sciences Graduate Students

BACKGROUND

Rapid development of information and communications technology (ICT) during the last decade has transformed biomedical and population-based research and has become an essential part of many types of research and educational programs. However, access to these ICT resources and the capacity to use them in global health research are often lacking in low- and middle-income country (LMIC) institutions.

OBJECTIVE

The aim of our study was to assess the practical issues (ie, perceptions and learning needs) of ICT use among health sciences graduate students at 6 major medical universities of southern China.

METHODS

Ten focus group discussions (FGDs) were conducted from December 2015 to March 2016, involving 74 health sciences graduate students studying at 6 major medical universities in southern China. The sampling method was opportunistic, accounting for the graduate program enrolled and the academic year. All FGDs were audio recorded and thematic content analysis was performed.

RESULTS

Researchers had different views and arguments about the use of ICT which are summarized under six themes: (1) ICT use in routine research, (2) ICT-related training experiences, (3) understanding about the pros and cons of Web-based training, (4) attitudes toward the design of ICT training curriculum, (5) potential challenges to promoting ICT courses, and (6) related marketing strategies for ICT training curriculum. Many graduate students used ICT on a daily basis in their research to stay up-to-date on current development in their area of research or study or practice. The participants were very willing to participate in ICT courses that were relevant to their academic majors and would count credits. Suggestion for an ICT curriculum included (1) both organized training course or short lecture series, depending on the background and specialty of the students, (2) a mixture of lecture and Web-based activities, and (3) inclusion of topics that are career focused.

CONCLUSIONS

The findings of this study suggest that a need exists for a specialized curriculum related to ICT use in health research for health sciences graduate students in China. The results have important implications for the design and implementation of ICT-related educational program in China or other developing countries.

Teaching Critical Thinking in Graduate Medical Education: Lessons Learned in Diagnostic Radiology

The 2014 Institute of Medicine report, Graduate Medical Education that Meets the Nation's Health Needs, challenged the current graduate medical training process and encouraged new opportunities to redefine the fundamental skills and abilities of the physician workforce. This workforce should be skilled in critically evaluating the current systems to improve care delivery and health. To meet these goals, current challenges, motivations, and educational models at the medical school and graduate medical education levels related to formal training in nonclinical aspects of medicine, especially critical thinking, are reviewed. Our diagnostic radiology training program is presented as a "case study" to frame the review.

Evidence-based Practice of Radiology

Current health care reform in the United States is producing a shift in radiology practice from the traditional volume-based role of performing and interpreting a large number of examinations to providing a more affordable and higher-quality service centered on patient outcomes, which is described as a value-based approach to the provision of health care services. In the 1990 s, evidence-based medicine was defined as the integration of current best evidence with clinical expertise and patient values. When these methods are applied outside internal medicine, the process is called evidence-based practice (EBP). EBP facilitates understanding, interpretation, and application of the best current evidence into radiology practice, which optimizes patient care. It has been incorporated into "Practice-based Learning and Improvement" and "Systems-based Practice," which are two of the six core resident competencies of the Accreditation Council for Graduate Medical Education and two of the 12 American Board of Radiology milestones for diagnostic radiology. Noninterpretive skills, such as systems-based practice, are also formally assessed in the "Quality and Safety" section of the American Board of Radiology Core and Certifying examinations. This article describes (a) the EBP framework, with particular focus on its relevance to the American Board of Radiology certification and maintenance of certification curricula; (b) how EBP can be integrated into a residency program; and (c) the current value and likely place of EBP in the radiology information technology infrastructure. Online supplemental material is available for this article.

[Introduction to critical reading of articles: study design and biases]

The critical evaluation of an article enables professionals to make good use of the new information and therefore has direct repercussions for the benefit of our patients. Before undertaking a detailed critical reading of the chosen article, we need to consider whether the study used the most appropriate design for the question it aimed to answer (i.e., whether the level of evidence is adequate). To do this, we need to know how to classify studies in function of their design (descriptive or analytical; prospective or retrospective; cross-sectional or longitudinal) as well as their correlation with the levels of evidence. In critical reading it is also important to know the main systematic errors or biases that can affect a study. Biases can appear in any phase of a study; they can affect the sample, the development of the study, or the measurement of the results.

Including patient-reported outcomes and patient-reported resource-use questionnaires in studies

RATIONALE

More efficient and better informed healthcare systems are expected to have improved knowledge of the impact of interventions on patient outcomes and resources used by patients and providers in specific health conditions.

OBJECTIVES

To describe trends related to putting patients at the center of healthcare decision making, regulatory trends and best practice recommendations for developing high-quality patient-reported outcomes (PROs), and strategic issues related to including PROs in studies.

MATERIALS AND METHODS

We summarize PRO concepts, definitions, and broadly-accepted scientific standards for developing, assessing, and interpreting PROs. Three conceptual models are presented as examples for assessing PROs in relation to other outcomes. We discuss different perspectives for stakeholders, including regulatory issues pertaining to formal guidance for PRO development and for use in trials. We provide examples of PROs used in studies for assessing health outcomes in oncology and resource-use outcomes in low back pain patients.

RESULTS

Psychometric scientists working closely with multi-disciplinary teams and regulatory authorities have greatly improved the science of collecting, assessing, and understanding patient-reported outcomes in clinical trials. A simplified framework is presented for strategic considerations for including PROs in studies, such as the appropriate timing for PRO endpoints. Asking patients about their health status and/or use of resources improves our understanding of how interventions and care processes may impact their lives and their budgets. We provide examples from a back pain trial of patient-reported resource-use questionnaires for medicines taken and other services or products used by patients.

CONCLUSIONS

Healthcare stakeholders are placing increased emphasis on resource use and the impact of interventions on patients, including effects associated with diagnostic tests. Patient-reported outcomes are being used in clinical practice and in clinical research, supported by formal best-practice guidelines. Radiology has a role as an engaged stakeholder in the design, conduct, and interpretation of patient-based evidence, and in its relevance to health policy implementation.

Using health services research to meet ACGME resident research requirements

Health services research is a field of research that crosses many disciplines. It represents a novel way to address the Accreditation Council for Graduate Medical Education requirements for scholarly activity of residents and faculty in academic radiology departments. In addition to meeting training requirements, it offers future radiologists the opportunity to develop skills that will be essential as we transition from a volume based health care delivery system to an outcome based delivery system. This report introduces examples of health services research projects and the types of data resources that are available to facilitate such projects.

Evidence-based imaging and effective utilization: lessons in neuroradiology

Expensive advanced imaging, such as magnetic resonance (MR) imaging, contributes to the unsustainable growth of health care costs in the United States. Evidence-based imaging decreases costs and improves outcomes by guiding appropriate utilization of imaging. Low back pain is an important case illustration. Despite strong evidence that early advanced imaging with MR imaging for uncomplicated low back pain leads to increased costs without significant clinical benefit, MR imaging utilization for acute low back pain has increased. Barriers to evidence-based imaging can be traced to patient- and physician-related factors. Radiologists have a critical role in addressing some of these barriers.

Advanced imaging: use and misuse

SUMMARY

The primary purpose of diagnostic imaging is to enable clinicians to make correct decisions about a patient's diagnosis and severity of its condition and, thereby, to contribute to effective and efficient treatment. Advanced imaging modalities are inherently better detectors of morphological lesions than radiography; hence, they offer the possibility of more accurate diagnosis and staging, with correspondingly better patient outcomes. However, there is a lack of evidence that better outcomes are being realised for veterinary patients. Furthermore, increased use of advanced imaging carries the possibility of increased misuse, primarily through unnecessary studies that contribute little to patient management other than increased costs.

SCOPE

This article is intended to be relevant to all veterinary species. Advanced imaging of cats is not sufficiently developed as a specific discipline that a balanced review could be based purely on feline examples or references.

Accuracy, risk and the intrinsic value of diagnostic imaging: a review of the cost-utility literature

RATIONALE AND OBJECTIVES

The aim of this study was to systematically review the reporting of the value of imaging unrelated to treatment consequences and test characteristics in all imaging-related published cost-utility analyses (CUAs) in the medical literature.

MATERIALS AND METHODS

All CUAs published between 1976 and 2008 evaluating diagnostic imaging technologies contained in the CEA Registry, a publicly available comprehensive database of health related CUAs, were screened. Publication characteristics, imaging modality, and the inclusion of test characteristics including accuracy, costs, risks, and the potential value unrelated to treatment consequences (eg, reassurance or anxiety) were assessed.

RESULTS

Ninety-six published CUAs evaluating 155 different imaging technologies were included in the final sample; 27 studies were published in imaging-specialized journals. Fifty-two studies (54%) evaluated the performance of a single imaging modality, while 44 studies (46%) compared two or more different imaging modalities. The most common areas of interest were cardiovascular (45%) and neuroradiology (17%). Forty-two technologies (27%) concerned ultrasound, while 34 (22%) concerned magnetic resonance. Seventy-nine (51%) technologies used ionizing radiation. Test accuracy was reported or calculated for 90% (n = 133 and n = 5, respectively) and assumed perfect (reference test or gold-standard test without alternative testing strategy to capture false-negatives and false-positives) for 8% (n = 12) of technologies. Only 22 studies (23%) assessing 40 imaging technologies (26%) considered inconclusive or indeterminate results. The risk of testing was reported for 32 imaging technologies (21%). Fifteen studies (16%) considered the value of diagnostic imaging unrelated to treatment. Four studies incorporated it as quality-of-life adjustments, while 10 studies mentioned it only in their discussions or as a limitation.

CONCLUSIONS

The intrinsic value of imaging (the value of imaging unrelated to treatment) has not been appropriately defined or incorporated in the existing cost-utility literature, which could be due to a lack of evidence on the issue. Thus, more research is needed on metrics for a more comprehensive evaluation of diagnostic imaging. Similarly, the incorporation of variations in imaging tests accuracy, inconclusive results and associated risks has lacked uniformity in the cost-utility literature. Acknowledgment of these characteristics in future cost-utility publications will enhance their value and provide results that more closely resemble routine clinical practice.

Comparison between CT colonography and double-contrast barium enema for colonic evaluation in patients with renal insufficiency

Objective

To compare the CT colonography (CTC) and double-contrast barium enema (DCBE) for colonic evaluation in patients with renal insufficiency.

Materials and Methods

Two sequential groups of consecutive patients with renal insufficiency who had a similar risk for colorectal cancer, were examined by DCBE (n = 182; mean ± SD in age, 51 ± 6.4 years) and CTC (n = 176; 50 ± 6.7 years), respectively. CTC was performed after colon cleansing with 250-mL magnesium citrate (n = 87) or 4-L polyethylene glycol (n = 89) and fecal tagging. DCBE was performed after preparation with 250-mL magnesium citrate. Patients with colonic polyps/masses of ≥ 6 mm were subsequently recommended to undergo a colonoscopy. Diagnostic yield and positive predictive value (PPV) for colonic polyps/masses, examination quality, and examination-related serum electrolyte change were retrospectively compared between the two groups.

Results

Both the CTC and DCBE were positive for colonic polyps/masses in 28 (16%) of 176 and 11 (6%) of 182 patients, respectively (p = 0.004). Among patients with positive findings, 17 CTC and six DCBE patients subsequently underwent a colonoscopy and yielded a PPV of 88% (15 of 17 patients) and 50% (3 of 6 patients), respectively (p = 0.089). Thirteen patients with adenomatous lesions were detected in the CTC group (adenocarcinoma [n = 1], advanced adenoma [n = 6], and non-advanced adenoma [n = 6]), as compared with two patients (each with adenocarcinoma and advanced adenoma) in the DCBE group (p = 0.003). Six (3%) of 176 CTC and 16 (9%) of 182 DCBE examinations deemed to be inadequate (p = 0.046). Electrolyte changes were similar in the two groups.

Conclusion

In patients with renal insufficiency, CTC has a higher diagnostic yield and a marginally higher PPV for detecting colorectal neoplasia, despite a similar diagnostic yield for adenocarcinoma, and a lower rate of inadequate examinations as compared with DCBE.

Does MR perfusion imaging impact management decisions for patients with brain tumors? A prospective study

BACKGROUND AND PURPOSE

MR perfusion imaging can be used to help predict glial tumor grade and disease progression. Our purpose was to evaluate whether perfusion imaging has a diagnostic or therapeutic impact on clinical management planning in patients with glioma.

MATERIALS AND METHODS

Standard MR imaging protocols were interpreted by a group of 3 NRs in consensus, with each case being interpreted twice: first, including routine sequences; and second, with the addition of perfusion imaging. A multidisciplinary team of treating physicians assessed tumor status and created hypothetical management plans, on the basis of clinical presentation and routine MR imaging and then routine MR imaging plus perfusion MR imaging. Physicians' confidence in the tumor status assessment and management plan was measured by using Likert-type items.

RESULTS

Fifty-nine consecutive subjects with glial tumors were evaluated; 50 had known pathologic diagnoses. NRs and the treatment team agreed on tumor status in 45/50 cases (κ = 0.81). With the addition of perfusion, confidence in status assessment increased in 20 (40%) for NRs and in 28 (56%) for the treatment team. Of the 59 patient-care episodes, the addition of perfusion was associated with a change in management plan in 5 (8.5%) and an increase in the treatment team's confidence in their management plan in 34 (57.6%). NRs and the treatment team found perfusion useful in most episodes of care and wanted perfusion included in future MR images for >80% of these subjects.

CONCLUSIONS

Perfusion imaging appears to have a significant impact on clinical decision-making and subspecialist physicians' confidence in management plans for patients with brain tumor.

[Evidence-based radiology for diagnostic imaging: what it is and how to practice it]

Evidence-based radiology is defined as the decision that results from integrating clinical information to select the most appropriate imaging test on the basis of the best available evidence, the physician's experience, and the patient's expectations. The practice of evidence-based radiology consists of five steps: formulating the question, performing an efficient search of the literature, critically evaluating the literature, applying the results of the search and evaluation while taking into account our experience and the patient's values, and evaluating the results obtained within our own practice. In diagnostic imaging, the number of resources available for evidence-based radiology is increasing: apart from books, articles, and web pages on this subject, evidence-based radiology is receiving more attention at diagnostic imaging conferences. The principles of evidence-based radiology will help promote the appropriate use of resources, greatly benefiting patients (decreasing the use of examinations that use ionizing radiation), professionals (less overload), and managers (more efficient use of resources).

Economic evaluation in radiology: reviewing the literature and examples in oncology

RATIONALE AND OBJECTIVES

To review US health care trends related to medical imaging utilization and costs as well as to present standard methods for conducting economic evaluation for health care interventions and medical imaging specifically.

MATERIALS AND METHODS

A review of the medical literature was performed to assess health policy and health technology assessment trends, expenditures, and cost-effectiveness analysis (CEA) related to medical imaging. Standard approaches to conducting economic evaluation and cost-effectiveness analysis were reviewed and summarized. Examples of CEA evidence related to imaging in select oncology conditions were presented.

RESULTS

Several high-quality methodology publications have provided guidance for conducting economic evaluation and CEA in radiology. There is variability in the quality of CEA models and their dissemination. However, there are numerous methodologically sound cost-effectiveness analyses for radiology procedures, and the evidence base of CEA studies for medical imaging continues to increase. Advanced imaging approaches for diagnosing and staging oncology conditions have the potential to provide cost-effective care when used in appropriate patient subpopulations.

CONCLUSIONS

Additional rigorous comparative effectiveness studies for advanced imaging, including cost-effectiveness analyses, can provide useful information to policy makers and health care providers on the relative effects and costs associated with diagnostic alternatives.

Evidence-based radiology: why and how?

PURPOSE

To provide an overview of evidence-based medicine (EBM) in relation to radiology and to define a policy for adoption of this principle in the European radiological community.

RESULTS

Starting from Sackett's definition of EBM we illustrate the top-down and bottom-up approaches to EBM as well as EBM's limitations. Delayed diffusion and peculiar features of evidence-based radiology (EBR) are defined with emphasis on the need to shift from the demonstration of the increasing ability to see more and better, to the demonstration of a significant change in treatment planning or, at best, of a significant gain in patient outcome. The "as low as reasonably achievable" (ALARA) principle is thought as a dimension of EBR while EBR is proposed as part of the core curriculum of radiology residency. Moreover, we describe the process of health technology assessment in radiology with reference to the six-level scale of hierarchy of studies on diagnostic tests, the main sources of bias in studies on diagnostic performance, and levels of evidence and degrees of recommendations according to the Centre for Evidence-Based Medicine (Oxford, UK) as well as the approach proposed by the GRADE working group. Problems and opportunities offered by evidence-based guidelines in radiology are considered. Finally, we suggest nine points to be actioned by the ESR in order to promote EBR.

CONCLUSION

Radiology will benefit greatly from the improvement in practice that will result from adopting this more rigorous approach to all aspects of our work.

Should radiology residents be taught evidence-based radiology? An experiment with "the EBR Journal Club"

RATIONALE AND OBJECTIVES

Introduce radiology residents to evidence-based radiology (EBR) using a journal club format based on the Radiology Alliance for Health Services Research/American Alliance of Academic Chief Residents in Radiology (RAHSR/A3CR2) Critical Thinking Skills sessions and EBR series of articles published in Radiology in 2007.

MATERIALS AND METHODS

The club began with a presentation outlining the process that would occur in an alternating format, with topics and articles chosen by residents. In session A, questions were rephrased in a Patient/Population, Intervention, Comparison, Outcome format, and a literature search was performed. Articles were discussed in session B, with residents assigned by year to the tasks of article summary, technology assessment, and comparison to checklists (Standards for Reporting of Diagnostic Accuracy, Consolidated Standards of Reporting Trials, or Quality of Reporting of Meta-analysis). The residents collectively assigned a level of evidence to each article, and a scribe provided a summary.

RESULTS

Twenty-two residents participated, with 12/22 (55%) of residents submitting any question, 6/22 (27.3%) submitting more than one question, and 4 residents submitting questions in more than one session. Topics included radiation risk, emergency radiology, screening examinations, modality comparisons, and technology assessment. Of the 31 articles submitted for review, 15 were in radiology journals and 5 were published before 2000. For 2/9 topics searched, no single article that the residents selected was available through our library's subscription service. The maximum level of evidence assigned by residents was level III, "limited evidence." In each session, the residents concluded that they became less confident in the "right answer." They proposed that future reading recommendations come from attendings rather than literature searches.

CONCLUSION

A journal club format is an effective tool to teach radiology residents EBR principles. Resistance comes from the difficulty in accessing good literature for review and in constructing good review questions.

Applying evidence-based imaging to policy: the Washington State experience

In response to escalating medical costs and a lack of evidence supporting some medical procedures, the state of Washington initiated a new program to use evidence-based medicine to determine if medical technologies should be covered for reimbursement by state agencies. The Washington State Health Technology Assessment Program was formed to commission evidence reports on selected technologies and to determine reimbursement on the basis of evidence of effectiveness, safety, and cost-effectiveness. To date, the program has reviewed the imaging technologies of upright magnetic resonance imaging, computed tomographic colonography, and lumbar discography and has not found sufficient evidence to support reimbursement. This report details the structure of the program, the reasons for the committee's decisions, and the implications for radiology. Under the Washington model, stronger evidence for the effectiveness, safety, and cost-effectiveness of imaging will be required for the dissemination of new technologies and for reimbursement for some existing imaging approaches.

Resting-state spontaneous fluctuations in brain activity: a new paradigm for presurgical planning using fMRI

RATIONALE AND OBJECTIVES

Task-evoked functional MRI (fMRI) has been used successfully in the study of brain function and clinically for presurgical localization of eloquent brain regions prior to the performance of brain surgery. This method requires patient cooperation and is not useful in young children or if the patient has cognitive dysfunction or physical impairment. An alternative method that can overcome some of these disadvantages measures the intrinsic function of the brain using resting-state fMRI. This method does not require any task performance and measures the spontaneous low-frequency (<0.1 Hz) fluctuations of the fMRI signal over time. Our objective in the present work is to provide preliminary information on the possible clinical utility of this technique for presurgical planning and on possible future applications.

MATERIALS AND METHODS

Data from prior fMRI resting-state studies were reviewed for their potential use in preoperative mapping. Structural and resting-state fMRI data from normal subjects and patients with brain tumors were preprocessed and seed regions were placed in key regions of the brain; the related functional networks were identified using correlation analysis.

RESULTS

Several key functional networks can be identified in patients with brain tumors from resting-state fMRI data.

CONCLUSION

Resting-state fMRI data can provide valuable presurgical information in many patients who cannot benefit from traditional task-based fMRI. Adoption of this method has the potential to improve individualized patient-centered care.

Evidence-based radiology: review and dissemination

Evidence-based radiology (EBR) is an important tool for the practice of radiology. The user of the EBR approach identifies evidence in a systematic fashion and then assimilates information through in-depth, explicit critical review of the best-designed and most recent literature on the subject in question. Clinical decision making is then based on the best current evidence, clinical expertise, and patient values. Substantial progress has been made in the review and dissemination of EBR. Dissemination of EBR within radiology has two critical aspects. The first is increased understanding of the methods required for EBR and of the appropriate use of EBR. The second important component is the dissemination of the data and critical literature reviews necessary to allow use of the EBR approach. Resources available for both EBR methods and EBR data in radiology include societies, journals, medical meetings, Web sites, and textbooks. Although radiology has made important progress in this field in recent years, the specialty is still behind other specialties that have been at the forefront of evidence-based medicine in the past decade.