Large-Scale Evaluation of Quality of Care in 6 Countries of Eastern Europe and Central Asia Using Clinical Performance and Value Vignettes

General practitioners' clinical decision-making in patients that could have cancer: a vignette study comparing the Baltic states with four Nordic countries

OBJECTIVE

Relative one-year cancer survival rates in the Baltic states are lower than the European mean; in the Nordic countries they are higher than the mean. This study investigated the likelihood of General Practitioners (GPs) investigating or referring patients with a low but significant risk of cancer in these two regions, and how this was affected by GP demographics.

DESIGN

A survey of GPs using clinical vignettes.

SETTING

General Practice in Denmark, Estonia, Finland, Latvia, Lithuania, Norway, and Sweden.

SUBJECTS

General Practitioners.

OUTCOME MEASURES

A regional comparison of GPs' stated immediate diagnostic actions (whether or not they would perform a key diagnostic test and/or refer to a specialist) for patients with a low but significant risk of cancer (between 1.2 and 3.6%).

RESULTS

Of the 427 GPs that completed the questionnaire, those in the Baltic states, and GPs that were more experienced, were more likely to arrange a key diagnostic test and/or refer their patient to a specialist than those in Nordic Countries or who were less experienced (p < 0.001 for both measures). Neither GP sex nor practice location within a country showed a significant association with these measures.

CONCLUSION

While relative one-year cancer survival rates are lower in the Baltic states than in four Nordic countries, we found no evidence that this is due to their GPs' reluctance to take immediate diagnostic action, as GPs in the Baltic states were more likely to investigate and/or refer at the first consultation. Research on patient and secondary care factors is needed to explain the survival differences.

A Randomized Controlled Study on Clinical Adherence to Evidence-Based Guidelines in the Management of Simulated Patients With Barrett's Esophagus and the Clinical Utility of a Tissue Systems Pathology Test: Results From Q-TAB

INTRODUCTION

Barrett's esophagus (BE) is a precursor to esophageal adenocarcinoma. Physicians infrequently adhere to guidelines for managing BE, leading to either reduced detection of dysplasia or inappropriate re-evaluation.

METHODS

We conducted a three-arm randomized controlled trial with 2 intervention arms to determine the impact of a tissue systems pathology (TSP-9) test on the adherence to evidence-based guidelines for simulated patients with BE. Intervention 1 received TSP-9 results, and intervention 2 had the option to order TSP-9 results. We collected data from 259 practicing gastroenterologists and gastrointestinal surgeons who evaluated and made management decisions for 3 types of simulated patients with BE: nondysplastic BE, indefinite for dysplasia, and low-grade dysplasia.

RESULTS

Intervention 1 was significantly more likely to correctly assess risk of progression to high-grade dysplasia/esophageal adenocarcinoma and offer treatment in accordance with US society guidelines compared with the control group (+6.9%, 95% confidence interval +1.4% to +12.3%). There was no significant difference in ordering guideline-recommended endoscopic eradication therapy. However, for cases requiring annual endoscopic surveillance, we found significant improvement in adherence for intervention 1, with a difference-in-difference of +18.5% ( P = 0.019). Intervention 2 ordered the TSP-9 test in 21.9% of their cases. Those who ordered the test performed similarly to intervention 1; those who did not, performed similarly to the control group.

DISCUSSION

The TSP-9 test optimized adherence to clinical guidelines for surveillance and treatment of both patients with BE at high and low risk of disease progression. Use of the TSP-9 test can enable physicians to make risk-aligned management decisions, leading to improved patient health outcomes.

Introducing value-based healthcare perspectives into hospital performance assessment: A scoping review

OBJECTIVE

Value-based healthcare (VBHC) puts patient outcomes at the center of the healthcare process while optimizing the use of hospital resources across multiple stakeholders. This scoping review was conducted to summarize how VBHC had been represented in theory and in practice, how it had been applied to assess hospital performance, and how well it had been ultimately implemented.

METHODS

For this review, we followed the PRISMA-ScR protocol and searched five major online databases for articles published between January 2006 and July 2022. We included original articles that used the concept of VBHC to conduct performance assessments of healthcare organizations. We extracted and analyzed key concepts and information on the dimensions of VBHC, specific strategies and methods for using VBHC in performance assessment, and the effectiveness of the assessment.

RESULTS

We identified 48 eligible studies from 7866 articles. Nineteen nonempirical studies focused on the development of a VBHC performance assessment indicator system, and 29 empirical studies reported on the ways and points of introducing VBHC into performance assessment and its effectiveness. Ultimately, we summarized the key dimensions, processes, and effects of performance assessment after introducing VBHC.

CONCLUSION

Current healthcare performance assessment has begun to focus on implementing VBHC as an integrated strategy, and future work should further clarify the reliability of metrics and their association with evaluation outcomes and consider the effective integration of clinical outcomes and patient-reported outcomes.

Randomized prospective trial to detect and distinguish between medication nonadherence, drug-drug interactions, and disease progression in chronic cardiometabolic disease

BACKGROUND

Disentangling nonadherence (NA), drug-drug interactions (DDIs), and disease progression from each other is an important clinical challenge for providers caring for patients with cardiometabolic diseases. NAs and DDIs are both ubiquitous and often overlooked. We studied a novel chronic disease management (CDM) test to detect medication adherence and the presence and severity of DDIs.

MATERIALS AND METHODS

We conducted a prospective, randomized controlled trial of 236 primary care physicians using computer-based, simulated patients, measuring clinical care with and without access to the CDM test. The primary outcomes were whether use of the CDM test increased the accuracy of diagnoses and ordering better treatments and how effective the intervention materials were in getting participants to order the CDM test.

RESULTS

Physicians given the CDM test results showed a + 13.2% improvement in their diagnosis and treatment quality-of-care scores (p < 0.001) in the NA patient cases and a + 13.6% improvement in the DDI cases (p < 0.001). The difference-in-difference calculations between the intervention and control groups were + 10.4% for NA and + 10.8% for DDI (p < 0.01 for both). After controlling for physician and practice co-factors, intervention, compared to control, was 50.4x more likely to recognize medication NA and 3.3x more likely to correctly treat it. Intervention was 26.9x more likely to identify the DDI and 15.7x more likely to stop/switch the interacting medication compared to control. We found no significant improvements for the disease progression patient cases.

CONCLUSION

Distinguishing between nonadherence, drug-drug interactions, and disease progression is greatly improved using a reliable test, like the CDM test; improved diagnostic accuracy and treatment has the potential to improve patient quality of life, medication safety, clinical outcomes, and efficiency of health delivery.

TRIAL REGISTRATION

clinicaltrials.gov (NCT05192590).

Gaps in the Care of Pulmonary Hypertension: A Cross-Sectional Patient Simulation Study Among Practicing Cardiologists and Pulmonologists

Background Diagnosis of pulmonary hypertension (PH) is often delayed or missed, leading to disease progression and missed treatment opportunities. In this study, we measured variation in care provided by board-certified cardiologists and pulmonologists in simulated patients with potentially undiagnosed PH. Methods and Results In a cross-sectional study (https://www.clinicaltrials.gov, NCT04693793), 219 US practicing cardiologists and pulmonologists cared for simulated patients presenting with symptoms of chronic dyspnea and associated signs of potential PH. We scored the clinical quality-of-care decisions made in a clinical encounter against predetermined evidence-based criteria. Overall, quality-of-care scores ranged from 18% to 74%, averaging 43.2%±11.5%. PH, when present, was correctly suspected 49.1% of the time. Conversely, physicians incorrectly identified PH in 53.7% of non-PH cases. Physicians ordered 2-dimensional echocardiography in just 64.3% of cases overall. Physicians who ordered 2-dimensional echocardiography in the PH cases were significantly more likely to get the presumptive diagnosis (61.9% versus 30.7%; P<0.001). Ordering other diagnostic work-up items showed similar results for ventilation/perfusion scan (81.5% versus 51.4%; P=0.005) and high-resolution computed tomography (60.4% versus 43.2%; P=0.001). Physicians who correctly identified PH were significantly more likely to order confirmatory right heart catheterization or refer to PH center (67.3% versus 15.8%; P<0.001). Conclusions A wide range of care in the clinical practice among simulated patients presenting with possible PH was found, specifically in the evaluation and plan for definitive diagnosis of patients with PH. The delay or misdiagnosis of PH is likely attributed to a low clinical suspicion, nonspecific symptoms, and underuse of key diagnostic tests. Registration URL: https://www.clinicaltrials.gov; Unique identifier: NCT04693793.

Vignette Research Methodology: An Essential Tool for Quality Improvement Collaboratives

Variation in patient outcomes among institutions and within institutions is a major problem in healthcare. Some of this variation is due to differences in practice, termed practice variation. Some practice variation is expected due to appropriately personalized care for a given patient. However, some practice variation is due to the individual preference or style of the clinicians. Quality improvement collaboratives are commonly used to disseminate quality care on a wide scale. Practice variation is a notable barrier to any quality improvement effort. A detailed and accurate understanding of practice variation can help optimize the quality improvement efforts. The traditional survey methods do not capture the complex nuances of practice variation. Vignette methods have been shown to accurately measure the actual practice variation and quality of care delivered by clinicians. Vignette methods are cost-effective relative to other methods of measuring quality of care. This review describes our experience and lessons from implementing vignette research methods in quality improvement collaboratives in California neonatal intensive care units. Vignette methodology is an ideal tool to address practice variation in quality improvement collaboratives, actively engage a large number of participants, and support more evidence-based practice to improve outcomes.

Post-Laryngectomy Voice Prosthesis Changes by Speech-Language Pathologists: Preliminary Results

BACKGROUND

In the present study, we assess the feasibility and success outcomes of voice prosthesis (VP) changes when performed by a speech-language pathologist (SLP).

METHODS

Patients treated with total laryngectomy (TL) from January 2020 to December 2020 were prospectively recruited from our medical center. Patients benefited from tracheoesophageal puncture. The VP changes were performed by the senior SLP and the following data were collected for each VP change: date of placement; change or removal; VP type and size; reason for change or removal; and use of a washer for periprosthetic leakage. A patient-reported outcome questionnaire including six items was proposed to patients at each VP change. Items were assessed with a 10-point Likert-scale.

RESULTS

Fifty-two VP changes were performed by the senior SLP during the study period. The mean duration of the SLP consultation, including patient history, examination and VP change procedure, was 20 min (range: 15-30). The median prosthesis lifetime was 88 days. The main reasons for VP changes were transprosthetic (n = 34; 79%) and periprosthetic (n = 7; 21%) leakages. SLP successfully performed all VP changes. He did not change one VP, but used a periprosthetic silastic to stop the periprosthetic leakages. In two cases, SLP needed the surgeon's examination to discuss the following indication: implant mucosa inclusion and autologous fat injection. The patient satisfaction was high according to the speed and the quality of care by the SLP.

CONCLUSIONS

The delegation of VP change from the otolaryngologist-head and neck surgeon to the speech-language pathologist (SLP) may be achieved without significant complications. The delegation of VP change procedure to SLP may be interesting in some rural regions with otolaryngologist shortages.

Assessing competence of mid-level providers delivering primary health care in India: a clinical vignette-based study in Chhattisgarh state

BACKGROUND

The global commitment to primary health care (PHC) has been reconfirmed in the declaration of Astana, 2018. India has also seen an upswing in national commitment to implement PHC. Health and wellness centres (HWCs) have been introduced, one at every 5000 population, with the fundamental purpose of bringing a comprehensive range of primary care services closer to where people live. The key addition in each HWC is of a mid-level healthcare provider (MLHP). Nurses were provided a 6-month training to play this role as community health officers (CHOs). But no assessments are available of the clinical competence of this newly inducted cadre for delivering primary care. The current study was aimed at providing an assessment of competence of CHOs in the Indian state of Chhattisgarh.

METHODS

The assessment involved a comparison of CHOs with rural medical assistants (RMAs) and medical officers (MO), the two main existing clinical cadres providing primary care in Chhattisgarh. Standardized clinical vignettes were used to measure knowledge and clinical reasoning of providers. Ten ailments were included, based on primary care needs in Chhattisgarh. Each part of clinical vignettes was standardized using expert consultations and standard treatment guidelines. Sample size was adequate to detect 15% difference between scores of different cadres and the assessment covered 132 CHOs, 129 RMAs and 50 MOs.

RESULTS

The overall mean scores of CHOs, RMAs and MOs were 50.1%, 63.1% and 68.1%, respectively. They were statistically different (p < 0.05). The adjusted model also confirmed the above pattern. CHOs performed well in clinical management of non-communicable diseases and malaria. CHOs also scored well in clinical knowledge for diagnosis. Around 80% of prescriptions written by CHOs for hypertension and diabetes were found correct.

CONCLUSION

The non-physician MLHP cadre of CHOs deployed in rural facilities under the current PHC initiative in India exhibited the potential to manage ambulatory care for illnesses. Continuous training inputs, treatment protocols and medicines are needed to improve performance of MLHPs. Making comprehensive primary care services available close to people is essential to PHC and well-trained mid-level providers will be crucial for making it a reality in developing countries.

Assessing the Quality of Care at Primary Health Care Level in Two Pilot Regions of Albania

The quality of care (QoC) of primary health care (PHC) services in Albania faces challenges on multiple levels including governance, access, infrastructure and health care workers. In addition, there is a lack of trust in the latter. The Health for All Project (HAP) funded by the Swiss Agency for Development and Cooperation therefore aimed at enhancing the population's health by improving PHC services and implementing health promotion activities following a multi-strategic health system strengthening approach. The objective of this article is to compare QoC before and after the 4 years of project implementation. A cross-sectional study was implemented at 38 PHC facilities in urban and rural locations in the Diber and Fier regions of Albania in 2015 and in 2018. A survey measured the infrastructure of the different facilities, provider–patient interactions through clinical observation and patient satisfaction. During clinical observations, special attention was given to diabetes and hypertensive patients. Infrastructure scores improved from base- to endline with significant changes seen on national level and for rural facilities (p < 0.01). Facility infrastructure and overall cleanliness, hygiene and basic/essential medical equipment and supplies improved at endline, while for public accountability/transparency and guidelines and materials no significant change was observed. The overall clinical observation score increased at endline overall, in both areas and in rural and urban setting. However, infection prevention and control procedures and diabetes treatment still experienced relatively low levels of performance at endline. Patient satisfaction on PHC services is generally high and higher yet at endline. The changes observed in the 38 PHC facilities in two regions in Albania between 2015 and 2018 were overall positive with improvements seen at all three levels assessed, e.g., infrastructure, service provision and patient satisfaction. However, to gain overall improvements in the QoC and move toward a more efficient and sustainable health system requires continuous investments in infrastructure alongside interventions at the provider and user level.

Characterizing health care provider knowledge: Evidence from HIV services in Kenya, Rwanda, South Africa, and Zambia

BACKGROUND

Identifying approaches to improve levels of health care provider knowledge in resource-poor settings is critical. We assessed level of provider knowledge for HIV testing and counseling (HTC), prevention of mother-to-child transmission (PMTCT), and voluntary medical male circumcision (VMMC). We also explored the association between HTC, PMTCT, and VMMC provider knowledge and provider and facility characteristics.

METHODS

We used data collected in 2012 and 2013. Vignettes were administered to physicians, nurses, and counselors in facilities in Kenya (66), Rwanda (67), South Africa (57), and Zambia (58). The analytic sample consisted of providers of HTC (755), PMTCT (709), and VMMC (332). HTC, PMTCT, and VMMC provider knowledge scores were constructed using item response theory (IRT). We used GLM regressions to examine associations between provider knowledge and provider and facility characteristics focusing on average patient load, provider years in position, provider working in another facility, senior staff in facility, program age, proportion of intervention exclusive staff, person-days of training in facility, and management score. We estimated three models: Model 1 estimated standard errors without clustering, Model 2 estimated robust standard errors, and Model 3 estimated standard errors clustering by facility.

RESULTS

The mean knowledge score was 36 for all three interventions. In Model 1, we found that provider knowledge scores were higher among providers in facilities with senior staff and among providers in facilities with higher proportions of intervention exclusive staff. We also found negative relationships between the outcome and provider years in position, average program age, provider working in another facility, person-days of training, and management score. In Model 3, only the coefficients for provider years in position, average program age, and management score remained statistically significant at conventional levels.

CONCLUSIONS

HTC, PMTCT, and VMMC provider knowledge was low in Kenya, Rwanda, South Africa, and Zambia. Our study suggests that unobservable organizational factors may facilitate communication, learning, and knowledge. On the one hand, our study shows that the presence of senior staff and staff dedication may enable knowledge acquisition. On the other hand, our study provides a note of caution on the potential knowledge depreciation correlated with the time staff spend in a position and program age.

Perspectives of Public and Private Primary Healthcare Users in Two Regions of Albania on Non-Clinical Quality of Care

Background:

Aiming to tackle the rise of non-communicable diseases and an ageing population, Albania is engaged in boosting primary healthcare services and quality of care. The patients’ perspectives on their experience with public and private providers are, however, missing, although their viewpoints are critical while shaping the developing services. Consequently, we analyze perceptions of users of primary healthcare as it relates to non-clinical quality of care and the association to sociodemographic characteristics of patients and the type of provider.

Methods:

A facility-based survey was conducted in 2018 using the World Health Organization responsiveness questionnaire which is based on a 4-point scale along with 8 non-clinical domains of quality of care. The data of 954 patients were analyzed through descriptive statistics and linear mixed regression models.

Results:

Similar mean values were reported on total scale of the quality of care for private and public providers, also after sociodemographic adjustments. The highest mean score was reported for the domain “communication” (3.75) followed by “dignity” (3.65), while the lowest mean scores were given for “choice” (2.89) and “prompt attention” (3.00). Urban governmental PHC services were rated significantly better than private outpatient clinics in “coordination of care” (2.90 vs 2.12, P < .001). In contrast, private outpatient clinics were judged significantly better than urban PHC clinics in “confidentiality” (3.77 vs 3.38, P = .04) and “quality of basic amenities” (3.70 vs 3.02, P < .001). “Autonomy” was reported as least important attribute of quality.

Conclusion:

While the perception of non-clinical care quality was found to be high and similar for public and private providers, promptness and coordination of care require attention to meet patient’s expectations on good quality of care. There is a need to raise the awareness on autonomy and the involvement of patients’ aspects concerning their health.

Measuring the Variation in the Prevention and Treatment of CI-AKI Among Interventional Cardiologists

Contrast-induced acute kidney injury (CI-AKI) occurs in up to 10% of cardiac catheterizations and coronary interventions, resulting in increased morbidity, mortality, and cost. One main reason for these complications and costs is under-recognition of CI-AKI risk and under-treatment of patients with impaired renal status. 157 interventional cardiologists each cared for three simulated patients with common conditions requiring intravascular contrast media in three typical settings: pre-procedurally, during the procedure, and post-procedure. We evaluated their ability to assess the risk of developing CI-AKI, make the diagnosis, and treat CI-AKI, including proper volume expansion and withholding nephrotoxic medications. Overall, the quality-of-care scores averaged 46.0% ± 10.5, varying between 18% to 78%. The diagnostic scores for accurately assessing risk of CI-AKI were low at 57.1% ± 21.2% and the accuracy of diagnosis pre-existing chronic kidney disease was 50.2%. Poor diagnostic accuracy led to poor treatment: proper volume expansion done in only 30.7% of cases, in-hospital repeat creatinine evaluation performed in 32.1%, and avoiding nephrotoxic medications occurred in 14.2%. While volume expansion was relatively similar across the three settings (P = 0.287), the cardiologists were less likely to discontinue nephrotoxic medications in pre-procedurally (9.7%) compared to the other settings (27.0%), and to order in-hospital creatinine testing in peri-procedurally (18.8%) compared to post-procedure (57.8%) (P < 0.05 for both). The overall care of patients at risk for contrast-induced acute kidney injury varied widely and showed room for improvement. Improving care for this condition will require greater awareness by cardiologists and better diagnostic tools to guide them.

Efficiency, quality, and management practices in health facilities providing outpatient HIV services in Kenya, Nigeria, Rwanda, South Africa and Zambia

Few studies have assessed the efficiency and quality of HIV services in low-resource settings or considered the factors that determine both performance dimensions. To provide insights on the performance of outpatient HIV prevention units, we used benchmarking methods to identify best-practices in terms of technical efficiency and process quality and uncover management practices with the potential to improve efficiency and quality. We used data collected in 338 facilities in Kenya, Nigeria, Rwanda, South Africa, and Zambia. Data envelopment analysis (DEA) was used to estimate technical efficiency. Process quality was estimated using data from medical vignettes. We mapped the relationship between efficiency and quality scores and studied the managerial determinants of best performance in terms of both efficiency and quality. We also explored the relationship between management factors and efficiency and quality independently. We found levels of both technical efficiency and process quality to be low, though there was substantial variation across countries. One third of facilities were mapped in the best-performing group with above-median efficiency and above-median quality. Several management practices were associated with best performance in terms of both efficiency and quality. When considering efficiency and quality independently, the patterns of associations between management practices and the two performance dimensions were not necessarily the same. One management characteristic was associated with best performance in terms of efficiency and quality and also positively associated with efficiency and quality independently: number of supervision visits to HIV units.

A nationwide program to improve clinical care quality in the Kyrgyz Republic

BACKGROUND

To assess baseline quality of care in the Kyrgyz Republic in 2019 and determine the effect of online simulated patients in changing doctors' practice in three specific disease areas: non-communicable disease, neonatal/child health, and maternal health.

METHODS

Over 2000 family health, pediatric, neonatology, therapy, and obstetric-gynecologic doctors from every rayon (district) hospital and at least one associated family health (Primary) care clinic participated. To adequately scale the project, the Ministry of Health used online simulated Clinical Performance and Value (CPV) vignettes. All doctors cared for the same set of patients in their clinical area. Over eight months in 2019, we gathered three rounds of CPV data in seven oblasts.

RESULTS

Overall quality scores were highly variable at baseline (59.2% + 13.5%). After three rounds the average score increased 6.5% (P < 0.001). By the end of round three, the lowest scoring oblast was providing higher quality care compared to the highest scoring oblast in the initial round (64.2% in round 3 vs 62.4% in round 1), indicating greater adherence to the evidence base. Additionally, family health doctors ordered 26% fewer unnecessary tests (P < 0.05), while specialists ordered 39% fewer unnecessary tests (P < 0.05). If trends continue, this translates into a net annual savings of 63 million Kyrgyz som.

CONCLUSIONS

This study demonstrates serial measurement of care provided by over 2000 physicians in the Kyrgyz Republic can be improved as measured by CPVs. This project may be a useful template to improve health care quality at a national level in other low- and middle-income country settings.

Factors associated with the utilisation of primary care services: a cross-sectional study in public and private facilities in Albania

OBJECTIVES

To identify key factors influencing the utilisation of governmental and private primary healthcare services in Albania.

DESIGN

A cross-sectional health facility survey using a 4-point Likert scale questionnaire to rank the importance of factors driving services utilisation.

SETTING

Exit interviews with patients who consulted one of 23 primary care providers (18 public and 5 private) in Fier district of Albania from the period of July-August 2018.

PARTICIPANTS

Representative sample of 629 adults ≥18 years of age.

MAIN OUTCOMES MEASURES

(1) Factors influencing the decision to visit a governmental or private primary care provider and (2) the association of sociodemographic characteristics and patients' decision to attend a given provider. Data were analysed using mixed logistic regression models.

RESULTS

Nearly half of the participants in this study were older than 60 years (45%). The majority (63%) reported to suffer from a chronic condition. Prevailing determinants for choosing a provider were 'quality of care' and 'healthcare professionals' attitudes. Solely looking at patients using a public provider, 'geographical proximity' was the most important factor guiding the decision (85% vs 11%, p<0.001). For private provider's patients, the 'availability of diagnostic devices' was the most important factor (69% vs 9%, p<0.001). The odds of using public facilities were significantly higher among the patients who perceived their health as poor (OR 5.59; 95% CI 2.62 to 11.92), suffered from chronic conditions (OR 3.13; 95% CI 1.36 to 7.24) or were benefiting from a socioeconomic aid scheme (OR 3.52; 95% CI 1.64 to 7.56).

CONCLUSION

The use of primary healthcare is strongly influenced by geographical and financial access for public facility users and availability of equipment for private users. This study found that aspects of acceptability and adequacy of services are equally valued. Additional commitment to further develop primary care through engagement of local decision-makers and professional associations is needed.

Primary care practitioners' diagnostic action when the patient may have cancer: an exploratory vignette study in 20 European countries

OBJECTIVES

Cancer survival rates vary widely between European countries, with differences in timeliness of diagnosis thought to be one key reason. There is little evidence on the way in which different healthcare systems influence primary care practitioners' (PCPs) referral decisions in patients who could have cancer.This study aimed to explore PCPs' diagnostic actions (whether or not they perform a key diagnostic test and/or refer to a specialist) in patients with symptoms that could be due to cancer and how they vary across European countries.

DESIGN

A primary care survey. PCPs were given vignettes describing patients with symptoms that could indicate cancer and asked how they would manage these patients. The likelihood of taking immediate diagnostic action (a diagnostic test and/or referral) in the different participating countries was analysed. Comparisons between the likelihood of taking immediate diagnostic action and physician characteristics were calculated.

SETTING

Centres in 20 European countries with widely varying cancer survival rates.

PARTICIPANTS

A total of 2086 PCPs answered the survey question, with a median of 72 PCPs per country.

RESULTS

PCPs' likelihood of immediate diagnostic action at the first consultation varied from 50% to 82% between countries. PCPs who were more experienced were more likely to take immediate diagnostic action than their peers.

CONCLUSION

When given vignettes of patients with a low but significant possibility of cancer, more than half of PCPs across Europe would take diagnostic action, most often by ordering diagnostic tests. However, there are substantial between-country variations.

The Heterogeneity of Global Pediatric Surgery: Defining Needs and Opportunities Around the World

BACKGROUND

The global burden of pediatric surgical conditions continues to remain inadequately addressed, particularly in low- and middle-income countries. Among the many factors contributing to this gap are a lack of access to care secondary to resource shortages and inequitable distribution, underfinancing of healthcare systems, poor quality of care, and contextual challenges such as natural disasters and conflict. The relative contribution of these and other factors varies widely by region and even with countries of a region.

METHODS

This review seeks to discuss the heterogeneity of global pediatric surgery and offer recommendations for addressing the barriers to high-quality pediatric surgical care throughout the world.

RESULTS

There is significant heterogeneity in pediatric surgical challenges, both between regions and among countries in the same region, although data are limited. This heterogeneity can reflect differences in demographics, epidemiology, geography, income level, health spending, historical health policies, and cultural practices, among others.

CONCLUSION

Country-level research and stakeholder engagement are needed to better understand the heterogeneity of local needs and drive policy changes that contribute to sustainable reforms. Key to these efforts will be improved financing, access to and quality of pediatric surgical care.

Towards improved health service quality in Tanzania: appropriateness of an electronic tool to assess quality of primary healthcare

BACKGROUND

Progress in health service quality is vital to reach the target of Universal Health Coverage. However, in order to improve quality, it must be measured, and the assessment results must be actionable. We analyzed an electronic tool, which was developed to assess and monitor the quality of primary healthcare in Tanzania in the context of routine supportive supervision. The electronic assessment tool focused on areas in which improvements are most effective in order to suit its purpose of routinely steering improvement measures at local level.

METHODS

Due to the lack of standards regarding how to best measure quality of care, we used a range of different quantitative and qualitative methods to investigate the appropriateness of the quality assessment tool. The quantitative methods included descriptive statistics, linear regression models, and factor analysis; the qualitative methods in-depth interviews and observations.

RESULTS

Quantitative and qualitative results were overlapping and consistent. Robustness checks confirmed the tool's ability to assign scores to health facilities and revealed the usefulness of grouping indicators into different quality dimensions. Focusing the quality assessment on processes and structural adequacy of healthcare was an appropriate approach for the assessment's intended purpose, and a unique key feature of the electronic assessment tool. The findings underpinned the accuracy of the assessment tool to measure and monitor quality of primary healthcare for the purpose of routinely steering improvement measures at local level. This was true for different level and owner categories of primary healthcare facilities in Tanzania.

CONCLUSION

The electronic assessment tool demonstrated a feasible option for routine quality measures of primary healthcare in Tanzania. The findings, combined with the more operational results of companion papers, created a solid foundation for an approach that could lastingly improve services for patients attending primary healthcare. However, the results also revealed that the use of the electronic assessment tool outside its intended purpose, for example for performance-based payment schemes, accreditation and other systematic evaluations of healthcare quality, should be considered carefully because of the risk of bias, adverse effects and corruption.

Methods to improve quality performance at scale in lower- and middle-income countries

Universal Health Coverage is one of the Sustainable Development Goal targets. But coverage without quality health services limits benefits to populations. Performance-based financing programs (PBF) use strategic purchasing of services to expand coverage and promote quality by measuring quality and rewarding good performance. The widespread presence of PBF programs in lower and middle-income countries provide an opportunity to introduce and test new approaches for measuring and improving quality at scale. This article describes four approaches to improve quality of health services at scale in PBF programs. These approaches looked at structural and process measures of quality as well as outcome measures like patient satisfaction. Three types of tools were used in these approaches: clinical vignettes, competency tests and patient satisfaction surveys. Specific tools within each of the approaches are used in Kyrgyzstan, Cambodia, Democratic Republic of Congo and the Republic of Congo.

Making Triage Decisions for the Acute Community Care Program: Paramedics Caring for Urgent Health Problems in Patients' Homes

The Acute Community Care Program (ACCP) initiative sends specially trained paramedics to evaluate and treat patients with urgent care problems in their residences during evening hours. ACCP safety depends on making appropriate triage decisions from patients' reports during phone calls about whether paramedics could care for patients' urgent needs or whether they require emergency department (ED) services. Furthermore, after ACCP paramedics are on scene, patients may nonetheless need ED care if their urgent health problems are not adequately treated by the paramedic's interventions. To train clinical staff participating in all aspects of ACCP, including these triage decisions, ACCP clinical leaders developed brief vignettes: 27 represented initial ACCP triage decisions and 10 the subsequent decision to send patients to EDs. This report describes findings from an online survey completed by 24 clinical staff involved with ACCP triage. Clinical vignettes could be useful for staff training and quality control in such paramedic initiatives.