Validation of primary and outcome data quality in a Swedish population-based breast cancer quality registry

BACKGROUND

Population-based cancer quality registries are of great importance for the improvement of cancer care. However, little is known about the quality of recurrence data in cancer quality registries. The aim of this study was to evaluate data quality in the regional Breast Cancer Quality Registry of Central Sweden, with emphasis on the validity of recorded information on recurrence.

METHODS

Validation by re-abstraction was performed on a random sample of 800 women with primary invasive breast cancer stage I-III diagnosed between 1993 and 2010, of which 400 had at least one registered recurrence and 400 had no registered recurrence. Registry data were compared with data from medical records. Exact agreement, correlation and kappa values, sensitivity and specificity were calculated.

RESULTS

Seven hundred forty-seven women (93%) were available for analysis. Exact agreement was high for diagnostics, tumor characteristics, surgery, and adjuvant oncological treatment (90% or more for most variables). The registry's sensitivity was low for regional recurrence (47%), but higher for local and distant recurrence (80% and 75%), whereas specificity was overall high (≥ 95%). Combining all recurrence categories irrespective of localization improved sensitivity to 90% with a specificity of 91%. In 87% of women, the date of first recurrence according to medical records fell within ± 90 days of the date recorded in the registry.

CONCLUSIONS

While the quality of data in the regional Breast Cancer Quality Registry was generally high, data accuracy on recurrences was lower. The overall precision of identifying any recurrence, irrespective of localization, was high. However, the accuracy of classification of recurrences (local, regional or distant) was lower, with evidence of underreporting for each of the recurrence categories. Given the importance of recurrence-related outcomes in the assessment of quality of care, efforts should be made to improve the reporting of recurrences.

The Norwegian registry for spine surgery (NORspine): cohort profile

PURPOSE

To review and describe the development, methods and cohort of the lumbosacral part of the Norwegian registry for spine surgery (NORspine).

METHODS

NORspine was established in 2007. It is government funded, covers all providers and captures consecutive cases undergoing operations for degenerative disorders. Patients' participation is voluntary and requires informed consent. A set of baseline-, process- and outcome-variables (3 and 12 months) recommended by the International Consortium for Health Outcome Measurement is reported by surgeons and patients. The main outcome is the Oswestry disability index (ODI) at 12 months.

RESULTS

We show satisfactory data quality assessed by completeness, timeliness, accuracy, relevance and comparability. The coverage rate has been 100% since 2016 and the capture rate has increased to 74% in 2021. The cohort consists of 60,647 (47.6% women) cases with mean age 55.7 years, registered during the years 2007 through 2021. The proportions > 70 years and with an American Society of Anaesthesiologists' Physical Classification System (ASA) score > II has increased gradually to 26.1% and 19.3%, respectively. Mean ODI at baseline was 43.0 (standard deviation 17.3). Most cases were operated with decompression for disc herniation (n = 26,557, 43.8%) or spinal stenosis (n = 26,545, 43.8%), and 7417 (12.2%) with additional or primary fusion. The response rate at 12 months follow-up was 71.6%.

CONCLUSION

NORspine is a well-designed population-based comprehensive national clinical quality registry. The register's methods ensure appropriate data for quality surveillance and improvement, and research.

Starting a Swedish national quality registry for orthognathic surgery: a tool for auditing fundamentals of care

BACKGROUND

National quality registries (NQRs) provide open data for user-directed acquisition. National Quality Registry (NQR) data are often used to analyze the rates of treatment success and adverse events for studies that aim to improve treatment quality and patient satisfaction. Thus, NQRs promote the goal of achieving evidence-based therapies. However, the scientific literature seldom focuses on the complex process of initiating, designing, and implementing an NQR. Starting an NQR may be particularly challenging in a setting where specialized care is decentralized, such as orthognathic surgery in Sweden. The present study describes the initiation and early phases of a new NQR for orthognathic surgery in Sweden.

METHODS

The initial inventory phase included gaining knowledge on regulations, creating economic plans, and identifying pitfalls in existing NQRs. Next, a crude framework for the registry was achieved. Outcome measures were selected with a nation-wide questionnaire, followed by a Delphi-like process for selecting parameters to include in the NQR. Our inclusive process comprised a stepwise introduction, feedback-based modifications, and preparatory educational efforts. Descriptive data were collected, based on the first 2 years (2018-2019) of registry operation.

RESULTS

Two years after implementation, 862 patients that underwent 1320 procedures were registered. This number corresponded to a 91% coverage rate. Bimaxillary treatments predominated, and the most common were a Le Fort I osteotomy combined with a bilateral sagittal split osteotomy (n = 275). Reoperations were conducted in 32 patients (3.6%), and the rate of patient satisfaction was 95%.

CONCLUSIONS

A National Quality Registry should preferentially be started and maintained by an appointed task force of active clinicians. A collaborative, transparent, inclusive process may be an important factor for achieving credibility and high coverage, particularly in a decentralized setting.

Administrative healthcare data as an addition to the Dutch surgaical aneurysm audit to evaluate mid-term reinterventions following abdominal aortic aneurysm repair: A pilot study

BACKGROUND

The Dutch Surgical Aneurysm Audit (DSAA) is a nationwide mandatory quality registry that evaluates the perioperative outcomes of abdominal aortic aneurysms (AAAs). The DSAA includes perioperative outcomes that occur up to 30 days, but various complications following AAA repair occur after this period. Administrative healthcare data yield the possibility to evaluate later occuring outcomes such as reinterventions, without increasing the registration burden. The aim of this study is to assess the feasibility and the potential benefit of administrative healthcare data to evaluate mid-term reinterventions following intact AAA repair.

METHOD

All patients that underwent primary endovascular aneurysm repair (EVAR) or open surgical repair (OSR) for an intact infrarenal AAA between January 2017 and December 2018 were selected from the DSAA. Subsequently, these patients were identified in a database containing reimbursement data. Healthcare activity codes that refer to reinterventions following AAA repair were examined to assess reinterventions within 12 and 15 months following EVAR and OSR.

RESULTS

We selected 4043 patients from the DSAA, and 2059 (51%) patients could be identified in the administrative healthcare database. Reintervention rates of 10.4% following EVAR and 9.5% following OSR within 12 months (p = 0.719), and 11.5% following EVAR and 10.8% following OSR within 15 months (p = 0.785) were reported.

CONCLUSION

Administrative healthcare data as an addition to the DSAA is potentially beneficial to evaluate mid-term reinterventions following intact AAA repair without increasing the registration burden for clinicians. Further validation is necessary before reliable implementation of this tool is warranted.

Using real-world data to monitor and improve quality of care in coronary artery disease: results from the Netherlands Heart Registration

Worldwide, quality registries for cardiovascular diseases enable the use of real-world data to monitor and improve the quality of cardiac care. In the Netherlands Heart Registration (NHR), cardiologists and cardiothoracic surgeons register baseline, procedural and outcome data across all invasive cardiac interventional, electrophysiological and surgical procedures. This paper provides insight into the governance and processes as organised by the NHR in collaboration with the hospitals. To clarify the processes, examples are given from the percutaneous coronary intervention and coronary artery bypass grafting registries. Physicians who are mandated by their hospital to instruct the NHR to process their data are united in registration committees. The committees determine standard sets of variables and periodically discuss the completeness and quality of data and patient-relevant outcomes. In the case of significant variation in outcomes, processes of healthcare delivery are discussed and good practices are shared in a non-competitive and safe setting. To create new insights for further improvement in patient-relevant outcomes, quality projects are initiated on, for example, multivessel disease treatment, cardiogenic shock and diagnostic intracoronary procedures. Moreover, possibilities are explored to expand the quality registries through additional relevant indicators, such as resource use before and after the procedure, by enriching NHR data with other existing data resources.

Challenges to ensuring valid and useful waiting time monitoring - a qualitative study in Swedish specialist care

BACKGROUND

Access to health care is an essential health policy issue. In several countries, waiting time guarantees mandate set time limits for assessment and treatment. High-quality waiting time data are necessary to evaluate and improve waiting times. This study's aim was to investigate health care providers and administrative management professionals' perceptions of validity and usefulness of waiting time reporting in specialist care.

METHODS

Semi-structured interviews (n = 28) were conducted with administrative management and care professionals (line managers and care providers) in specialized clinics in the Stockholm Region, Sweden. Clinic-specific data from the waiting time registry was used in the care provider interviews to assess face validity. Clinics were purposefully sampled for maximum variation in complexity of care, volume of production, geographical location, private or public ownership, and local waiting times. Thematic analysis was used.

RESULTS

The waiting time registry was perceived to have low validity and usefulness. Perceived validity and usefulness were interconnected, with mechanisms that reinforced the connection. Structural and cognitive barriers to validity included technical and procedural errors, errors caused by role division, misinterpretation of guidelines, diverging interpretations of nonregulated cases and extensive willful manipulation of data.

CONCLUSIONS

We identify four misconceptions underpinning the current waiting time reporting system: passive dissemination of guidelines is sufficient as implemented, cognitive load of care providers to report waiting times is negligible, soft-law regulation and presentation of outcome data is sufficient to drive improvement, and self-reported data linked to incentives poses a low risk of data corruption. To counter low validity and usefulness, we propose the following for policy makers and administrative management when developing and implementing waiting time monitoring: communicate guidelines with instructions for operationalization, address barriers to implementation, ensure quality through monitoring of implementation and adherence to guidelines, develop IT ontology together with professionals, avoid parallel measurement infrastructures, ensure waiting times are presented to suit management needs, provide timely waiting time data, enable the study of single cases, minimize manual data entry, and perform spot-checks or external validity checks. Several of these strategies should be transferable to waiting time monitoring in other contexts.

The SWEDEHEART secondary prevention and cardiac rehabilitation registry (SWEDEHEART CR registry)

AIMS

The quality registry SWEDEHEART covers data across the patient pathway after an acute myocardial infarction (MI), from hospital care to secondary prevention. Although cardiac rehabilitation (CR) is strongly recommended after an MI, there is still heterogeneity regarding standards, uptake, and adherence rates. The aim of the SWEDEHEART-CR registry is to provide continuous information on secondary prevention and CR performance to support the audit and development of evidence-based practice. To facilitate quality improvement and research initiatives, a description of the characteristics and development of the SWEDEHEART-CR registry is needed.

METHODS AND RESULTS

The SWEDEHEART-CR registry starts with data obtained during hospital care and then collects data at out-patient visits 2 months and 1-year after discharge, and at start and end of an exercise-based CR programme. The registry data covers comorbidities, biochemistry, blood pressure, anthropometric variables, medication, psychosocial- and lifestyle variables, readmissions, patient-reported outcome measures, attendance in CR-related programmes, and physical fitness variables. Over 100 000 patients with MI have been included in the SWEDEHEART-CR registry since its start in 2005. From initially covering 35 centres (47%) and 2200 patients annually (27%), SWEDEHEART-CR has developed to a nation-wide registry with 75 centres (100%) and 8800 patients annually (80%) in 2020.

CONCLUSION

The SWEDEHEART-CR registry includes a high proportion of the national MI population entering a CR programme and is a powerful tool for quality audit, improvement, and research. The registry provides insights into the characteristics, treatment, and outcomes of evidence-based secondary preventive practice, ultimately leading to better cardiovascular health.

Linking of global intensive care (LOGIC): An international benchmarking in critical care initiative

Benchmarking is a common and effective method for measuring and analyzing ICU performance. With the existence of national registries, objective information can now be obtained to allow benchmarking of ICU care within and between countries. The present manuscript briefly describes the current status of benchmarking in healthcare and critical care and presents the LOGIC project, an initiative to promote international benchmarking for intensive care units. Currently 13 registries have joined LOGIC. We showed large differences in the utilization of ICU as well as resources and in outcomes. Despite the need for careful interpretation of differences due to variation in definitions and limited risk adjustment, LOGIC is a growing worldwide initiative that allows access to insightful epidemiologic data from ICUs in multiple databases and registries.

International Validation of the Population Based Malta Vascular Registry: A Vascunet Report

Introduction

Quality registries can be used to study treatment patterns and changes in trends of complications related to procedures and devices. To ensure that such study is possible in registries, there is a need to use standardised variables and the registry must have high internal and external validity. This study was an international external and internal validation of the newly initiated Maltese Vascular Registry.

Report

Two international vascular registry consultants visited the Maltese Vascular Registry (MVR), and conducted an external validation on all carotid and aortic aneurysm repairs performed in 2017-18. The external validation was conducted by comparing hospital administration lists with the MVR list. Using randomly chosen numbers, an internal validation was conducted of 20 random cases of carotid and 20 aortic aneurysms, 10 from 2017 and 10 from 2018, to validate date of operation and procedure against the patient's medical record. The registry is built as a database using national personal identifier codes, with variables for date and type of procedure, and anaesthetic method used, to which a note is attached describing the indication, intervention, and follow up. Between the hospital registry and the MVR, 111 of 115 cases could be identified correctly, corresponding to 97% external validity. Between the patient case records and the MVR, the dates and procedures of 20/20 carotid and 20/20 aortic aneurysm procedure were identical, indicating 100% internal validity.

Discussion

The MVR showed an external validity of 97% and internal validity of 100%. Future work should incorporate specific variables for comorbidity, procedures, and outcomes, with the registry aiming to incorporate international recommended variables for comorbidity, procedure, and outcome.

A registry based analysis of the patient reported outcome after surgery for trapeziometacarpal joint osteoarthritis

BACKGROUND

The aim of the study was to evaluate patient reported outcome measures (PROM) before and after trapeziectomy with or without ligament reconstruction and tendon interposition for trapeziometacarpal joint arthritis with special focus on possible differences due to gender, age and surgical method.

METHODS

Data from the Swedish quality registry for hand surgery (HAKIR) was analyzed preoperatively, 3 months and 1 year postoperatively for 1850 patients (mean age 63 years, 79% women).

RESULTS

One year postoperatively, mean pain at rest was reduced from 50 to 12 of maximum 100. However, pain on load and weakness had not abated to the same extent (mean 30 and 34 of 100, respectively). The mean improvement in PROM did not differ between age groups or gender. The result was similar after trapeziectomy with ligament reconstruction and tendon interposition (86% of the patients) and simple trapeziectomy but few patients were operated with the latter method.

CONCLUSION

Pain on load and weakness remains to some extent 1 year after surgery for trapeziometacarpal joint arthritis. The result is similar after trapeziectomy with or without ligament reconstruction and tendon interposition and the same improvement can be expected after surgery regardless of age and gender.

Adherence to a regulation that aims to prevent and treat malnutrition-The case of Swedish elderly care

Malnutrition constitutes a serious and challenging problem in elderly care. In 2015, a Swedish regulation that aims to prevent and treat malnutrition came into effect. This study set out to explore associations between level of adoption of the regulation reported as: no, started, yes, in a previous survey, and registrations in a national quality registry. Registry data on screening and actions extracted from the first trimester in 2014 (n=18967), 2016 (n=20318) and 2017 (n= 25669) represented 209, 197 and 199 of 290 Swedish municipalities respectively. A repeated measures ANOVA showed that there was no effect on screened nutritional status, Pearson's chi-square that there were minor differences in types of actions, and regression analysis that the number of actions increased on average by 0.3 due to a higher level of adoption of the regulation. Over the years studied, five actions were prominent regardless of level of adoption or screened nutritional status. Hence, to date, no firm conclusions regarding effects of the regulation can be drawn. Despite the regulatory nature, it appear as if the regulation and the level of adoption reported so far is routine in theory, although not yet leveraged to an implemented practice visible in the quality registry but instead decoupled from practice.

Predictors before and after multimodal rehabilitation for pain acceptance and engagement in activities at a 1-year follow-up for patients with whiplash-associated disorders (WAD)-a study based on the Swedish Quality Registry for Pain Rehabilitation (SQRP)

BACKGROUND CONTEXT

Studies have shown that pain acceptance strategies related to psychological flexibility are important in the presence of chronic musculoskeletal pain. However, the predictors of these strategies have not been studied extensively in patients with whiplash-associated disorders (WAD).

PURPOSE

The purpose of this study was to predict chronic pain acceptance and engagement in activities at 1-year follow-up with pain intensity, fear of movement, perceived responses from significant others, outcome expectancies, and demographic variables in patients with WAD before and after multimodal rehabilitation (MMR).

STUDY DESIGN

The design of this investigation was a cohort study with 1-year postrehabilitation follow-up.

STUDY SETTING

The subjects participated in MMR at a Swedish rehabilitation clinic during 2009-2015.

PATIENT SAMPLE

The patients had experienced a whiplash trauma (WAD grade I-II) and were suffering from pain and reduced functionality. A total of 386 participants were included: 297 fulfilled the postrehabilitation measures, and 177 were followed up at 1 year after MMR.

OUTCOME MEASURES

Demographic variables, pain intensity, fear of movement, perceived responses from significant others, and outcome expectations were measured at the start and after MMR. Chronic pain acceptance and engagement in activities were measured at follow-up.

METHODS

The data were obtained from a Swedish Quality Registry for Pain Rehabilitation (SQRPR).

RESULTS

Outcome expectancies of recovery, supporting and distracting responses of significant others, and fear of (re)injury and movement before MMR were significant predictors of engagement in activities at follow-up. Pain intensity and fear of (re)injury and movement after MMR significantly predicted engagement in activities at follow-up. Supporting responses of significant others and fear of (re)injury and movement before MMR were significant predictors of pain acceptance at the 1-year follow-up. Solicitous responses of significant others and fear of (re)injury and movement at postrehabilitation significantly predicted pain acceptance at follow-up.

CONCLUSION

For engagement in activities and pain acceptance, the fear of movement appears to emerge as the strongest predictor, but patients' perceived reactions from their spouses need to be considered in planning the management of WAD.

Improving quality of care through patient-reported outcome measures (PROMs): expert interviews using the NHS PROMs Programme and the Swedish quality registers for knee and hip arthroplasty as examples

BACKGROUND

Patient reported outcome measures (PROMs) have been integrated in national quality registries or specific national monitoring initiatives to inform the improvement of quality of care on a national scale. However there are many unanswered questions, such as: how these systems are set up, whether they lead to improved quality of care, which stakeholders use the information once it is available. The aim of this study was to examine supporting and hindering factors relevant to integrating patient-reported outcome measures (PROMs) in selected health information systems (HIS) tailored toward improving quality of care across the entire health system.

METHODS

First, a systematic search and review was conducted to outline previously identified factors relevant to the integration of PROMs in the selected HIS. A social network analysis was performed to identify networks of experts in these systems. Second, expert interviews were conducted to discuss and elaborate on the identified factors. Directive content analysis was applied using a HIS Evaluation Framework as the frame of reference. This framework is structured into four components: Organization, Human, Technology, and Net benefits.

RESULTS

The literature review revealed 37 papers for the NHS PROMs Programme and 26 papers for the SHPR and SKAR: Five networks of researchers were identified for the NHS PROMs Programme and 1 for the SHPR and SKAR. Seven experts related to the NHS PROMs Programme and 3 experts related to the SKAR and SHPR participated in the study. The main themes which revealed in relation to Organization were Governance and Capacity building; to Human: Reporting and Stakeholder Engagement; to Technology: the Selection and Collection of PROMs and Data linkage. In relation to Net benefits, system-specific considerations are presented.

CONCLUSION

Both examples succeeded in integrating PROMs into HIS on a national scale. The lack of an established standard on what change PROMs should be achieved by an intervention limits their usefulness for monitoring quality of care. Whether the PROMs data collected within these systems can be used in routine clinical practice is considered a challenge in both countries.

The performativity of numbers in illness management: The case of Swedish Rheumatology

While there is a proliferation of numerical data in healthcare, little attention has been paid to the role of numbers in constituting the healthcare reality they are intended to depict. This study explores the performativity of numbers in the microlevel management of rheumatoid disease. We draw on a study of patients' and physicians' use of the numbers in the Swedish Rheumatology Quality Registry, conducted between 2009 and 2014. We show how the numbers performed by constructing the disease across time, and by framing action. The numerical performances influenced patients and physicians in different ways, challenging the former to quantify embodied disease and the latter to subsume the disease into one of many possible trajectory standards. Based on our findings, we provide a model of the dynamic performativity of numbers in the on-going management of illness. The model conceptualises how numbers generate new possibilities; by creating tension and alignment they may open up new avenues for communication between patients and physicians.

Body Mass Index in Different Dementia Disorders: Results from the Swedish Dementia Quality Registry (SveDem)

Background

Most patients with dementia lose body weight over the course of the disease and have a lower body mass index (BMI) than subjects with normal cognition.

Aims

To examine body mass index and how it correlates with cognitive status, age and gender in patients with different dementia disorders.

Materials and Methods

Data from newly diagnosed dementia patients in the Swedish Dementia Quality Registry (SveDem) and recorded information about age, gender, cognitive status and BMI was analyzed using independent samples t tests and one-way analysis of variance.

Results

A total of 12,015 patients, 7,121 females and 4,894 males were included in the study. The average BMI was 24. More than a quarter of the patients had a BMI of <22. Females were significantly older (p < 0.001) and males had a significantly higher BMI (p < 0.001) at the time of diagnosis. BMI differed significantly by gender in various dementia disorders and correlated significantly with cognitive status and age.

Conclusion

At the time of diagnosis, patients with various dementia disorders had a BMI within the normal range. However, a significant number had a BMI in a lower, suboptimal range for older persons stressing the need for nutritional assessment as part of the dementia work up. Further analyses with longitudinal follow-up are needed to investigate BMI changes over time.