The theoretical and practical difficulties of evaluating a community-based 'whole systems' obesity prevention intervention: a research team's critical reflection

AIMS

This article critically discusses the purpose, pragmatics and politics of conducting commissioned evaluations on behalf of public sector organisations by drawing on the experience of evaluating a community-based 'whole systems' obesity prevention intervention for an English local council.

METHODS

The study presented in this article incorporated two approaches: an evaluability assessment that interrogated the theoretical and practical difficulties of evaluating the intervention in a non-political way, and a retrospective analysis using Soft Systems Methodology that interrogated the more political difficulties of conducting such an evaluation in the 'real world'. The information and insights that enabled these reflections came from over 3 years of working closely with the programme team, attending and participating in stakeholder events and meetings, presenting to the Council's Scrutiny Committee meetings, four interviews with the programme manager, and multiple face-to-face group meetings, email exchanges and telephone conversations.

RESULTS

The study reveals and analyses three key inter-related challenges that arose during the evaluation of the 'whole systems' obesity prevention intervention: the programme's evaluability, the evaluation purpose, and the nature, role and quality of evidence.

CONCLUSIONS

The evaluability assessment was important for defining the programme's theoretical and practical evaluability, and the retrospective analysis using Soft Systems Methodology enabled a greater understanding of the political tensions that existed. Key learning points related to the challenges that arose during this evaluation have broad applicability.

Impact of a community-based pilot intervention to tackle childhood obesity: a 'whole-system approach' case study

Background

Go-Golborne was a three-year pilot programme to test an innovative, community-based ‘whole system’ approach to preventing overweight in children in Golborne ward, London. Whilst there is a growing interest in local whole systems approaches to obesity, understandings of what they look like in practice are newly emerging. Go-Golborne was designed, implemented and evaluated within this context.

Methods

The evaluation used a case-study design and theory of change approach to assess the effectiveness of the intervention. Height/weight measurements of children in the six participating primary schools were recorded annually for 4 years. For behavioural outcomes, children aged six-11 completed four annual on-line surveys (total 4331 responses). Parents were surveyed in year one and year four (177 responses). Three focus group discussions were held with children aged 10–11 (N = 21); interviews were conducted with parents (N = 11), and school representatives (N = 4). Stakeholders were surveyed twice (37 responses), and interviews were conducted with key stakeholders (N = 11). An extensive range of programme documents were reviewed and additional process data was collected from the programme team. The RE-AIM framework was used to synthesise findings and examine public health impact.

Results

Go-Golborne reached a diverse range of partners across Golborne. Events were attended by over 3360 local children and families and all six primary schools in the ward actively engaged in activities. The proportion of children in the above healthy weight categories remained stable over time. A number of changes in home, school and neighbourhood environments to support healthy behaviour change were evidenced. There was some qualitative evidence of positive changes in children’s behaviours, though significant or sustained changes were not evidenced by the quantitative data.

Conclusions

Go-Golborne helped stakeholders and parents to develop a shared commitment to improving healthy weight in children, to identify barriers to a healthy lifestyle, and to start to make changes in their services/behaviours. The campaigns and changes made at micro-level appeared to be insufficient, in the face of counteracting forces and personal factors, to achieve significant behaviour change within 3 years. This highlights the need for local initiatives to be reinforced by supporting action at regional, national and global levels.

Supplementary information

Supplementary information accompanies this paper at 10.1186/s12889-020-09694-2.

Patient experiences of receiving a diagnosis of Parkinson's disease

OBJECTIVE

To report patients' own experiences of receiving a diagnosis of Parkinson's disease (PD) and to identify factors influencing this experience.

METHODS

A survey by the European Parkinson's Disease Association in 11 European countries.

RESULTS

1775 patients with an average age of 69.7 years participated of whom 54% were male. Those living in rural areas reported having waited longer to seek medical help (p < 0.05). A possible diagnosis of PD was made at the first appointment in a third of respondents. When the diagnosis was made, only 50% reported that the diagnosis was communicated sensitively. 38% of patients reported having been given enough time to ask questions and discuss concerns, but 29% did not. 98% of participants reported having been given information about PD at the time of diagnosis but 36% did not find the information given helpful. Patient satisfaction with the diagnostic consultation was positively associated with more sensitive delivery of diagnosis, the helpfulness and quantity of the information provided and time to ask questions (all p < 0.001). Where diagnosis was given by a specialist, participants reported greater perceived satisfaction with the diagnostic consultation, greater sensitivity of communicating the diagnosis, time to ask questions, provision and helpfulness of information, and earlier medication prescription (all p < 0.0001).

CONCLUSIONS

There is a need to improve how the diagnosis of PD is communicated to patients, the opportunity to ask questions soon after diagnosis, and the amount, timing and quality of life information provided, as this is associated with greater satisfaction with the diagnostic process.

Impact of membrane solid-liquid separation on design of biological nutrient removal activated sludge systems

Installing membranes for solid-liquid separation into biological nutrient removal (BNR) activated sludge (AS) systems makes a profound difference not only in the design of the BNR system itself, but also in the design approach for the whole wastewater treatment plant (WWTP). In multizone BNR systems with membranes in the aerobic reactor and fixed volumes for the anaerobic, anoxic, and aerobic zones (i.e., fixed volume fractions), the mass fractions can be controlled (within a range) with the interreactor recycle ratios. This zone mass fraction flexibility is a significant advantage in membrane BNR systems over conventional BNR systems with SSTs, because it allows for changing of the mass fractions to optimize biological N and P removal in conformity with influent wastewater characteristics and the effluent N and P concentrations required. For PWWF/ADWF ratios in the upper range (f(q) approximately 2.0), aerobic mass fractions in the lower range (f(maer) < 0.60), and high (usually raw) wastewater strengths, the indicated mode of operation of MBR BNR systems is as extended aeration WWTPs. Although the volume reduction compared with equivalent conventional BNR systems with secondary settling tanks is not as large (40% to 60%), the cost of the membranes can be offset against sludge thickening and stabilization costs. Moving from a flow-unbalanced raw wastewater system to a flow-balanced (f(q) = 1), low (usually settled) wastewater strength system can double the ADWF capacity of the biological reactor, but the design approach of the WWTP changes from extended aeration to include primary sludge stabilization. The cost of primary sludge treatment then has to be paid from the savings from the increased WWTP capacity.

Multiple lifestyle and psychosocial risks and delivery of small for gestational age infants

OBJECTIVE

To examine the occurrence of multiple risk behaviors during pregnancy among women who delivered a live birth and to examine the risk of delivering small for gestational age (SGA) infants for women with multiple risks.

METHODS

We used data from the Pregnancy Risk Assessment Monitoring System to conduct the research. Pregnancy Risk Assessment System is a population-based, mixed-mode surveillance system that collects information on maternal behaviors and experiences. We used data for 1997 from 13 (n = 19,331) states that had response rates of over 70%. We considered ten self-reported individual risk behaviors or exposures (eg, smoking, unintended pregnancy) and several demographic variables. The main outcome was SGA.

RESULTS

Pregnant women engage in or are exposed to multiple risks and often these risks are inter-related. The occurrence of multiple risks appears to be associated with an increased likelihood of delivering an SGA infant. Compared with women with no reported risks or exposures, the adjusted odds ratios for delivering an SGA infant were as follows: 1.29 (95% confidence interval [CI] 0.69, 2.43) for one, 1.86 (95% CI 1.00, 3.44) for two, 1.67 (95% CI 0.90, 3.10) for three, 2.06 (95% CI 1.10, 3.89) for four, 3.53 (95% CI 1.71, 7.30) for five, and 3.82 (95% CI 1.97, 7.41) for six or more risks or exposures.

CONCLUSION

A large proportion of pregnant women engage in or are exposed to multiple risks. Women with a larger number of risks are at greater risk for delivering an SGA infant than women with fewer or no risks.

Moderate alcohol feeding attenuates postinjury vascular cell proliferation in rabbit angioplasty model

Our studies in the cholesterol-fed rabbit model indicate that moderate alcohol consumption reduces the risk of restenosis by preventing low-density lipoprotein (LDL) oxidation. Eighteen hypercholesterolemic rabbits underwent arterial injury by Fogerty balloon endothelial denudation of iliac arteries. Two weeks later, balloon angioplasty of atherogenic or atherosclerotic arterial segments was performed. Nine rabbits (control) received water ad lib, whereas nine rabbits (moderate alcohol treated) received an average of 2.5 ml alcohol per 500 ml water daily, from the day of feeding hypercholesterolemic diet until they were killed, 10 weeks later. There was a 26% increase in lumen size of the moderate alcohol-treated group compared with the control group. The percentage neointima formation (NI) values of the moderate alcohol-treated and control groups were 77 +/- 2.1 and 61 +/- 1.9, respectively (p < 0.001). The lumen/neointima (L/NI) ratio of the moderate alcohol-treated group was 0.71 +/- 0.07 compared with the control group, 0.33 +/- 0.04 (p < 0.001). The number of foam cells in the moderate alcohol-treated group was threefold less than the control group [i.e., 1.4 +/- 0.4 and 3.9 +/- 0.8, respectively (p = 0.005)]. The arterial lesion malondialdehyde (MDA) values of the control and the moderate alcohol-treated groups were 13.6 +/- 2.8 and 4.4 +/- 0.5 (p = 0.004), respectively. By radioimmunoassay, the moderate alcohol-treated group had less macrophage chemotactic protein-1 (MCP-1; 3,277 cpm/microg protein) and platelet-derived growth factor (PDGF; 2,261 cpm/microg protein) compared with the controls (MCP-1, 4,529 cpm/microg protein; PDGF, 3,583 cpm/microg protein). Thus we conclude that low concentrations of alcohol reduce neointimal formation, and the extent of lipid oxidation, the number of foam cells in the neointimal area and may decrease the expression of MCP-1 and PDGF by reducing LDL oxidation in an animal model of postangioplasty restenosis.

The effect of torso geometry on magnetocardiographic isofield maps

Using a computer model of a realistically shaped human torso with lungs and intraventricular blood masses, we have assessed how torso geometry and composition affect the extracorporal magnetic field produced by a current dipole in the centre of the ventricular mass. The magnetic induction vector B arising from the dipole has been calculated at points of a precordial measuring grid and the influence of boundaries has been assessed qualitatively, by comparing contour maps of the B component normal to the torso's frontal plane. We found that the maps reflected relatively faithfully the underlying dipolar source for the homogeneous torso and even for the torso with lungs. However, the intraventricular blood masses caused a noticeable rotation of the maps' extrema. Both lungs and blood masses tended to swing the distribution towards the distribution that would have been caused by a dipole oriented along the anatomical axis of the heart.