Balancing clinical team perceptions of the workplace: Applying ‘work domain analysis’ to pediatric cardiac care

Context and Complexity in Telemedicine Evaluation: Work Domain Analysis in a Surgical Setting

Many promising telemedicine innovations fail to be accepted and used over time, and there are longstanding questions about how to best evaluate telemedicine services and other health information technologies. In response to these challenges, there is a growing interest in how to take the sociotechnical complexity of health care into account during design, implementation, and evaluation. This paper discusses the methodological implications of this complexity and how the sociotechnical context holds the key to understanding the effects and outcomes of telemedicine. Examples from a work domain analysis of a surgical setting, where a telemedicine service for remote surgical consultation was to be introduced, are used to show how abstracted functional modeling can provide a structured and rigorous means to analyze and represent the implementation context in complex health care settings.

Modeling the Implementation Context of a Telemedicine Service: Work Domain Analysis in a Surgical Setting

BACKGROUND

A telemedicine service enabling remote surgical consultation had shown promising results. When the service was to be scaled up, it was unclear how contextual variations among different clinical sites could affect the clinical outcomes and implementation of the service. It is generally recognized that contextual factors and work system complexities affect the implementation and outcomes of telemedicine. However, it is methodologically challenging to account for context in complex health care settings. We conducted a work domain analysis (WDA), an engineering method for modeling and analyzing complex work environments, to investigate and represent contextual influences when a telemedicine service was to be scaled up to multiple hospitals.

OBJECTIVE

We wanted to systematically characterize the implementation contexts at the clinics participating in the scale-up process. Conducting a WDA would allow us to identify, in a systematic manner, the functional constraints that shape clinical work at the implementation sites and set the sites apart. The findings could then be valuable for informed implementation and assessment of the telemedicine service.

METHODS

We conducted observations and semistructured interviews with a variety of stakeholders. Thematic analysis was guided by concepts derived from the WDA framework. We identified objects, functions, priorities, and values that shape clinical procedures. An iterative "discovery and modeling" approach allowed us to first focus on one clinic and then readjust the scope as our understanding of the work systems deepened.

RESULTS

We characterized three sets of constraints (ie, facets) in the domain: the treatment facet, administrative facet (providing resources for procedures), and development facet (training, quality improvement, and research). The constraints included medical equipment affecting treatment options; administrative processes affecting access to staff and facilities; values and priorities affecting assessments during endoscopic retrograde cholangiopancreatography; and resources for conducting the procedure.

CONCLUSIONS

The surgical work system is embedded in multiple sets of constraints that can be modeled as facets of the system. We found variations between the implementation sites that might interact negatively with the telemedicine service. However, there may be enough motivation and resources to overcome these initial disruptions given that values and priorities are shared across the sites. Contrasting the development facets at different sites highlighted the differences in resources for training and research. In some cases, this could indicate a risk that organizational demands for efficiency and effectiveness might be prioritized over the long-term outcomes provided by the telemedicine service, or a reduced willingness or ability to accept a service that is not yet fully developed or adapted. WDA proved effective in representing and analyzing these complex clinical contexts in the face of technological change. The models serve as examples of how to analyze and represent a complex sociotechnical context during telemedicine design, implementation, and assessment.

Anaesthesia and perioperative incident reporting systems: Opportunities and challenges

Incident Reporting Systems (IRS) continue to be an important influence on improving patient safety. IRS can provide valuable insights into how to prevent patients from being harmed at the organizational level. But inadequate expectations and misuse, for performance assessment, patient safety measurement or research, have hindered the full IRS potential. Health care organizations need to develop effective strategies built on trust and truth telling to improve the impact of IRS. This requires strategies to address the limited resources to analyse the near-misses or adverse events; avoid the punitive drift through maintaining the anonymity and protective legislation; integrating IRS and avoiding its confusion with mandatory adverse event response systems; training data analysts to focus on the system instead of the individual through a balanced simple taxonomy; combine the analyses at the local level, to reinforce effective and personalized feedback, with the potential of a national or supranational learning platform.