Valuing and embracing complexity: How an understanding of complex interventions needs to shape our evaluation capacities building initiatives

Using theory knitting to conceptualize social phenomena in the design and evaluation of dance programs for people living with Parkinson's disease

Dance programs for people living with Parkinson's disease (PwPD) offer participants an opportunity to exercise, engage in artistic self-expression, and form new relationships. While it is understood that the social dimension of dance programs for PwPD contributes to dancer satisfaction and program sustainability, the social mechanisms instrumental to program success are under-examined. Engaging with theory from wider disciplines, or "theory knitting" can help program designers and evaluators examine the mechanisms and contextual factors that make classes socially meaningful with greater detail and specificity. This study identified and examined three theoretical frameworks that program planners and evaluators could use to conceptualize social engagement in dance for PwPD contexts and inform practice. Each theory was assessed for fit using the T-CaST theory comparison and selection tool developed by Birken et al. (2018). As an example, we used anthropologist Victor Turner's (1970; 1977) theory of liminality and communitas to identify five key areas for fostering a sense of social connection in dance for PwPD contexts: (1) selecting a meaningful dance space (2) creating a joyous atmosphere (3) marking entrance into the liminal time and space with rituals (4) embodying liminality and anti-structure and (5) inverting power relations and embracing fluid roles.

Towards an evolutionary approach to learning from assumptions: Lessons from the evaluation of Dancing with Parkinson's

This paper highlights how learnings from exploring assumptions can be strengthened by taking an evolutionary approach to theory building and analysis. We discuss theory-driven evaluation applied to a community-based intervention implemented by Dancing With Parkinson's in Toronto, Canada, targeting Parkinson's disease (PD), a neurodegenerative condition affecting movement. A major gap in the literature is understanding the mechanisms by which dance might make a difference in the daily lives of people living with PD. This study was an early exploratory evaluation to better understand mechanisms and short-term outcomes. Conventional thinking generally favors "permanent" over "transitory" changes, and "long-term" over "short-term" effects. Yet, for people living with degenerative conditions (and also people experiencing chronic pain and other chronic symptoms), transitory and short-term changes may be highly valued and welcomed relief. In order to study and link multiple longitudinal events to explore key linkages in the theory of change, we piloted the use of diaries, with brief entries filled out daily by participants. The aim was to better understand the short-term experiences of participants using their daily routines as a means of learning about potential mechanisms, what matters to participants, and to see if small effects could be observed on days when participants danced versus days when they did not dance and also longitudinally over several months. Our initial theoretical stance began with a view of dance as exercise and the well-established benefits of exercise; yet, we explored through the diary data collected, as well as client interviews and literature review, potential other mechanisms of dancing (such as group interaction, touch, stimulation by the music, and esthetics including "feeling lovely"). This paper does not develop a full, comprehensive theory of dance but moves towards a more comprehensive view that locates dance within the routine activities of participants' daily lives. We argue that given the challenges of evaluating complex interventions comprising multiple, interacting components, there is a need for an evolutionary learning process to understand heterogeneities in mechanisms -- what works for whom -- when faced with knowledge incompleteness in the theory of change.

Representing the values of program participants: Endogenous evaluative criteria

Evaluative conclusions are grounded in implicit and explicit criteria that describe a successful or high-quality intervention. Most often, evaluative criteria are drawn from program objectives that reflect the values and priorities of program designers and funders. Yet, an exclusive focus on program goals risks overlooking the values of program participants, the extent to which their actual needs and priorities are addressed, and, in certain types of programs, the choices participants make and agency they exercise. This article presents concepts and methods to guide evaluators in drawing some of the criteria used in an evaluation from program participants. The article outlines a typology of evaluative criteria and seven methods for drawing outcomes-focused criteria from program participants. The article concludes with a discussion of implications and future directions for research and practice.

Protocol for Outcome Evaluation of Ayahuasca-Assisted Addiction Treatment: The Case of Takiwasi Center

The present study describes the protocol for the Ayahuasca Treatment Outcome Project (ATOP) with a special focus on the evaluation of addiction treatment services provided through Takiwasi Center, the first ATOP study site. The goal of the project is to assess treatment outcomes and understand the therapeutic mechanisms of an Ayahuasca-assisted, integrative treatment model for addiction rehabilitation in the Peruvian Amazon. The proposed intervention protocol highlights the significance of treatment setting in the design, delivery, and efficacy of an addiction rehabilitation program that involves the potent psychedelic tea known as Ayahuasca. After describing the context of the study, we put forth details about our mixed-methods approach to data collection and analysis, with which we seek to gain an understanding of why, how, and for whom this specific ayahuasca-assisted treatment program is effective across a range of outcomes. The ATOP protocol employs qualitative research methods as a means to determine which aspects of the setting are meaningful to clients and practitioners, and how this may correlate with outcome measures. This paper delineates the core principles, methods, and measures of the overall ATOP umbrella, then discusses the role of ATOP in the context of the literature on long-term residential programs. To conclude, we discuss the strengths and limitations of the protocol and the intended future of the project.