Advancing Italian biomedical information extraction with transformers-based models: Methodological insights and multicenter practical application

The introduction of computerized medical records in hospitals has reduced burdensome activities like manual writing and information fetching. However, the data contained in medical records are still far underutilized, primarily because extracting data from unstructured textual medical records takes time and effort. Information Extraction, a subfield of Natural Language Processing, can help clinical practitioners overcome this limitation by using automated text-mining pipelines. In this work, we created the first Italian neuropsychiatric Named Entity Recognition dataset, PsyNIT, and used it to develop a Transformers-based model. Moreover, we collected and leveraged three external independent datasets to implement an effective multicenter model, with overall F1-score 84.77 %, Precision 83.16 %, Recall 86.44 %. The lessons learned are: (i) the crucial role of a consistent annotation process and (ii) a fine-tuning strategy that combines classical methods with a "low-resource" approach. This allowed us to establish methodological guidelines that pave the way for Natural Language Processing studies in less-resourced languages.

An eHealth App (CAPABLE) Providing Symptom Monitoring, Well-Being Interventions, and Educational Material for Patients With Melanoma Treated With Immune Checkpoint Inhibitors: Protocol for an Exploratory Intervention Trial

BACKGROUND

Since treatment with immune checkpoint inhibitors (ICIs) is becoming standard therapy for patients with high-risk and advanced melanoma, an increasing number of patients experience treatment-related adverse events such as fatigue. Until now, studies have demonstrated the benefits of using eHealth tools to provide either symptom monitoring or interventions to reduce treatment-related symptoms such as fatigue. However, an eHealth tool that facilitates the combination of both symptom monitoring and symptom management in patients with melanoma treated with ICIs is still needed.

OBJECTIVE

In this pilot study, we will explore the use of the CAPABLE (Cancer Patients Better Life Experience) app in providing symptom monitoring, education, and well-being interventions on health-related quality of life (HRQoL) outcomes such as fatigue and physical functioning, as well as patients' acceptance and usability of using CAPABLE.

METHODS

This prospective, exploratory pilot study will examine changes in fatigue over time in 36 patients with stage III or IV melanoma during treatment with ICI using CAPABLE (a smartphone app and multisensory smartwatch). This cohort will be compared to a prospectively collected cohort of patients with melanoma treated with standard ICI therapy. CAPABLE will be used for a minimum of 3 and a maximum of 6 months. The primary endpoint in this study is the change in fatigue between baseline and 3 and 6 months after the start of treatment. Secondary end points include HRQoL outcomes, usability, and feasibility parameters.

RESULTS

Study inclusion started in April 2023 and is currently ongoing.

CONCLUSIONS

This pilot study will explore the effect, usability, and feasibility of CAPABLE in patients with melanoma during treatment with ICI. Adding the CAPABLE system to active treatment is hypothesized to decrease fatigue in patients with high-risk and advanced melanoma during treatment with ICIs compared to a control group receiving standard care. The Medical Ethics Committee NedMec (Amsterdam, The Netherlands) granted ethical approval for this study (reference number 22-981/NL81970.000.22).

TRIAL REGISTRATION

ClinicalTrials.gov NCT05827289; https://clinicaltrials.gov/study/NCT05827289.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/49252.

The Case Manager: An Agent Controlling the Activation of Knowledge Sources in a FHIR-Based Distributed Reasoning Environment

BACKGROUND

Within the CAPABLE project the authors developed a multi-agent system that relies on a distributed architecture. The system provides cancer patients with coaching advice and supports their clinicians with suitable decisions based on clinical guidelines.

OBJECTIVES

As in many multi-agent systems we needed to coordinate the activities of all agents involved. Moreover, since the agents share a common blackboard where all patients' data are stored, we also needed to implement a mechanism for the prompt notification of each agent upon addition of new information potentially triggering its activation.

METHODS

The communication needs have been investigated and modeled using the HL7-FHIR (Health Level 7-Fast Healthcare Interoperability Resources) standard to ensure proper semantic interoperability among agents. Then a syntax rooted in the FHIR search framework has been defined for representing the conditions to be monitored on the system blackboard for activating each agent.

RESULTS

The Case Manager (CM) has been implemented as a dedicated component playing the role of an orchestrator directing the behavior of all agents involved. Agents dynamically inform the CM about the conditions to be monitored on the blackboard, using the syntax we developed. The CM then notifies each agent whenever any condition of interest occurs. The functionalities of the CM and other actors have been validated using simulated scenarios mimicking the ones that will be faced during pilot studies and in production.

CONCLUSION

The CM proved to be a key facilitator for properly achieving the required behavior of our multi-agent system. The proposed architecture may also be leveraged in many clinical contexts for integrating separate legacy services, turning them into a consistent telemedicine framework and enabling application reusability.

Localizing in-domain adaptation of transformer-based biomedical language models

In the era of digital healthcare, the huge volumes of textual information generated every day in hospitals constitute an essential but underused asset that could be exploited with task-specific, fine-tuned biomedical language representation models, improving patient care and management. For such specialized domains, previous research has shown that fine-tuning models stemming from broad-coverage checkpoints can largely benefit additional training rounds over large-scale in-domain resources. However, these resources are often unreachable for less-resourced languages like Italian, preventing local medical institutions to employ in-domain adaptation. In order to reduce this gap, our work investigates two accessible approaches to derive biomedical language models in languages other than English, taking Italian as a concrete use-case: one based on neural machine translation of English resources, favoring quantity over quality; the other based on a high-grade, narrow-scoped corpus natively written in Italian, thus preferring quality over quantity. Our study shows that data quantity is a harder constraint than data quality for biomedical adaptation, but the concatenation of high-quality data can improve model performance even when dealing with relatively size-limited corpora. The models published from our investigations have the potential to unlock important research opportunities for Italian hospitals and academia. Finally, the set of lessons learned from the study constitutes valuable insights towards a solution to build biomedical language models that are generalizable to other less-resourced languages and different domain settings.

A comparative analysis of the effects of containment policies on the epidemiological manifestation of the COVID-19 pandemic across nine European countries

The COVID-19 pandemic has been a catastrophic event that has seriously endangered the world's population. Governments have largely been unprepared to deal with such an unprecedented calamity, partially due to the lack of sufficient or adequately fine-grained data necessary for forecasting the pandemic's evolution. To fill this gap, researchers worldwide have been collecting data about different aspects of COVID-19's evolution and government responses to them so as to provide the foundation for informative models and tools that can be used to mitigate the current pandemic and possibly prevent future ones. Indeed, since the early stages of the pandemic, a number of research initiatives were launched with this goal, including the PERISCOPE (Pan-European Response to the ImpactS of COVID-19 and future Pandemics and Epidemics) Project, funded by the European Commission. PERISCOPE aims to investigate the broad socio-economic and behavioral impacts of the COVID-19 pandemic, with the goal of making Europe more resilient and prepared for future large-scale risks. The purpose of this study, carried out as part of the PERISCOPE project, is to provide a first European-level analysis of the effect of government policies on the spread of the virus. To do so, we assessed the relationship between a novel index, the Policy Intensity Index, and four epidemiological variables collected by the European Centre for Disease Control and Prevention, and then applied a comprehensive Pan-European population model based on Multilevel Vector Autoregression. This model aims at identifying effects that are common to some European countries while treating country-specific policies as covariates, explaining the different evolution of the pandemic in nine selected countries due to data availability: Spain, France, Netherlands, Latvia, Slovenia, Greece, Ireland, Cyprus, Estonia. Results show that specific policies' effectiveness tend to vary consistently within the different countries, although in general policies related to Health Monitoring and Health Resources are the most effective for all countries.

Why did AI get this one wrong? - Tree-based explanations of machine learning model predictions

Increasingly complex learning methods such as boosting, bagging and deep learning have made ML models more accurate, but harder to interpret and explain, culminating in black-box machine learning models. Model developers and users alike are often presented with a trade-off between performance and intelligibility, especially in high-stakes applications like medicine. In the present article we propose a novel methodological approach for generating explanations for the predictions of a generic machine learning model, given a specific instance for which the prediction has been made. The method, named AraucanaXAI, is based on surrogate, locally-fitted classification and regression trees that are used to provide post-hoc explanations of the prediction of a generic machine learning model. Advantages of the proposed XAI approach include superior fidelity to the original model, ability to deal with non-linear decision boundaries, and native support to both classification and regression problems. We provide a packaged, open-source implementation of the AraucanaXAI method and evaluate its behaviour in a number of different settings that are commonly encountered in medical applications of AI. These include potential disagreement between the model prediction and physician's expert opinion and low reliability of the prediction due to data scarcity.

Improving Keyword-Based Topic Classification in Cancer Patient Forums with Multilingual Transformers

Online forums play an important role in connecting people who have crossed paths with cancer. These communities create networks of mutual support that cover different cancer-related topics, containing an extensive amount of heterogeneous information that can be mined to get useful insights. This work presents a case study where users' posts from an Italian cancer patient community have been classified combining both count-based and prediction-based representations to identify discussion topics, with the aim of improving message reviewing and filtering. We demonstrate that pairing simple bag-of-words representations based on keywords matching with pre-trained contextual embeddings significantly improves the overall quality of the predictions and allows the model to handle ambiguities and misspellings. By using non-English real-world data, we also investigated the reusability of pretrained multilingual models like BERT in lower data regimes like many local medical institutions.

Differential impact of the COVID-19 pandemic on primary care utilization related to common mental disorders in four European countries: A retrospective observational study

BACKGROUND

The COVID-19 pandemic is commonly believed to have increased common mental disorders (CMD, i.e., depression and anxiety), either directly due to COVID-19 contractions (death of near ones or residual conditions), or indirectly by increasing stress, economic uncertainty, and disruptions in daily life resulting from containment measure. Whereas studies reporting on initial changes in self-reported data frequently have reported increases in CMD, pandemic related changes in CMD related to primary care utilization are less well known. Analyzing time series of routinely and continuously sampled primary healthcare data from Sweden, Norway, Netherlands, and Latvia, we aimed to characterize the impact of the pandemic on CMD recorded prevalence in primary care. Furthermore, by relating these changes to country specific time-trajectories of two classes of containment measures, we evaluated the differential impact of containment strategies on CMD rates. Specifically, we wanted to test whether school restrictions would preferentially affect age groups corresponding to those of school children or their parents.

METHODS

For the four investigated countries, we collected time-series of monthly counts of unique CMD patients in primary healthcare from the year 2015 (or 2017) until 2021. Using pre-pandemic timepoints to train seasonal Auto Regressive Integrated Moving Average (ARIMA) models, we predicted healthcare utilization during the pandemic. Discrepancies between observed and expected time series were quantified to infer pandemic related changes. To evaluate the effects of COVID-19 measures on CMD related primary care utilization, the predicted time series were related to country specific time series of levels of social distancing and school restrictions.

RESULTS

In all countries except Latvia there was an initial (April 2020) decrease in CMD care prevalence, where largest drops were found in Sweden (Prevalence Ratio, PR = 0.85; 95% CI 0.81-0.90), followed by Netherlands (0.86; 95% CI 0.76-1.02) and Norway (0.90; 95% CI 0.83-0.98). Latvia on the other hand experienced increased rates (1.25; 95% CI 1.08-1.49). Whereas PRs in Norway and Netherlands normalized during the latter half of 2020, PRs stayed low in Sweden and elevated in Latvia. The overall changes in PR during the pandemic year 2020 was significantly changed only for Sweden (0.91; 95% CI 0.90-0.93) and Latvia (1.20; 95% CI 1.14-1.26). Overall, the relationship between containment measures and CMD care prevalence were weak and non-significant. In particular, we could not observe any relationship of school restriction to CMD care prevalence for the age groups best corresponding to school children or their parents.

CONCLUSION

Common mental disorders prevalence in primary care decreased during the initial phase of the COVID-19 pandemic in all countries except from Latvia, but normalized in Norway and Netherlands by the latter half of 2020. The onset of the pandemic and the containment strategies were highly correlated within each country, limiting strong conclusions on whether restriction policy had any effects on mental health. Specifically, we found no evidence of associations between school restrictions and CMD care prevalence. Overall, current results lend no support to the common belief that the pandemic severely impacted the mental health of the general population as indicated by healthcare utilization, apart from in Latvia. However, since healthcare utilization is affected by multiple factors in addition to actual need, future studies should combine complementary types of data to better understand the mental health impacts of the pandemic.

Quality of life and health-related utility after trans-oral surgery for head and neck cancers

Purpose

The purpose of this study was to assess utility coefficients of health states following two minimally invasive surgical approaches for head and neck cancer, namely trans-oral robotic surgery and trans-oral laser microsurgery. Those utility coefficients will be later exploited in an economic evaluation study comparing the two approaches.

Methods

The above cited economic evaluation will be done from the Swiss healthcare system perspective and, as such, Swiss healthcare professionals were interviewed to elicit utility coefficients. Health states, ranging from remission to palliative care, were described using clinical vignettes. A computerized tool (UceWeb) implementing standard gamble and rating scale methods was used.

Results

Utility coefficients for 18 different health states were elicited with the two methods from 47 individuals, for a total of 1692 values. Elicited values varied from 0.980 to 0.213. Comparison with values elicited in previous studies show the need for population-specific elicitation, mainly for the worst health states.

Conclusion

Herein we report health utility coefficients for the Swiss population for health states following minimally invasive trans-oral surgery. This study provides utility values that can be used not only for a specific cost-utility analysis, but also for future studies involving the same health states.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12955-021-01836-3.

Cost-utility of two minimally-invasive surgical techniques for operable oropharyngeal cancer: transoral robotic surgery versus transoral laser microsurgery

BACKGROUND

In the past few decades, a re-evaluation of treatment paradigms of head and neck cancers with a desire to spare patients the treatment-related toxicities of open surgery, has led to the development of new minimally invasive surgical techniques to improve outcomes. Besides Transoral Laser Microsurgery (TLM), a new robotic surgical technique namely Transoral Robotic Surgery (TORS) emerged for the first time as one of the two most prominent and widely used minimally invasive surgical approaches particularly for the treatment of oropharyngeal cancer, a sub-entity of head and neck cancers. Recent population-level data suggest equivalent tumor control, but different total costs, and need for adjuvant chemoradiation. A comparative analysis of these two techniques is therefore warranted from the cost-utility (C/U) point of view.

METHODS

A cost-utility analysis for comparing TORS and TLM was performed using a decision-analytical model. The analyses adopted the perspective of a Swiss hospital. Two tertiary referral centers in Lausanne and Zurich provided data for model quantificantion.

RESULTS

In the base case analysis TLM dominates TORS. This advantage remains robust, even if the costs for TORS reduce by up to 25%. TORS begins to dominate TLM, if less than 59,7% patients require adjuvant treatment, whereby in an interval between 55 and 62% cost effectiveness of TORS is sensitive to the prescription of adjuvant chemoradiation therapy (CRT). Exceeding 29% of TLM patients requiring a revision of surgical margins renders TORS more cost-effective.

CONCLUSION

Non-robotic endoscopic surgery (TLM) is more cost-effective than robotic endoscopic surgery (TORS) for the treatment of oropharyngeal cancers. However, this advantage is sensitive to various parameters, i.e.to the number of re-operations and adjuvant treatment.

A Health eLearning Ontology and Procedural Reasoning Approach for Developing Personalized Courses to Teach Patients about Their Medical Condition and Treatment

We propose a methodological framework to support the development of personalized courses that improve patients' understanding of their condition and prescribed treatment. Inspired by Intelligent Tutoring Systems (ITSs), the framework uses an eLearning ontology to express domain and learner models and to create a course. We combine the ontology with a procedural reasoning approach and precompiled plans to operationalize a design across disease conditions. The resulting courses generated by the framework are personalized across four patient axes-condition and treatment, comprehension level, learning style based on the VARK (Visual, Aural, Read/write, Kinesthetic) presentation model, and the level of understanding of specific course content according to Bloom's taxonomy. Customizing educational materials along these learning axes stimulates and sustains patients' attention when learning about their conditions or treatment options. Our proposed framework creates a personalized course that prepares patients for their meetings with specialists and educates them about their prescribed treatment. We posit that the improvement in patients' understanding of prescribed care will result in better outcomes and we validate that the constructs of our framework are appropriate for representing content and deriving personalized courses for two use cases: anticoagulation treatment of an atrial fibrillation patient and lower back pain management to treat a lumbar degenerative disc condition. We conduct a mostly qualitative study supported by a quantitative questionnaire to investigate the acceptability of the framework among the target patient population and medical practitioners.

A review of AI and Data Science support for cancer management

INTRODUCTION

Thanks to improvement of care, cancer has become a chronic condition. But due to the toxicity of treatment, the importance of supporting the quality of life (QoL) of cancer patients increases. Monitoring and managing QoL relies on data collected by the patient in his/her home environment, its integration, and its analysis, which supports personalization of cancer management recommendations. We review the state-of-the-art of computerized systems that employ AI and Data Science methods to monitor the health status and provide support to cancer patients managed at home.

OBJECTIVE

Our main objective is to analyze the literature to identify open research challenges that a novel decision support system for cancer patients and clinicians will need to address, point to potential solutions, and provide a list of established best-practices to adopt.

METHODS

We designed a review study, in compliance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines, analyzing studies retrieved from PubMed related to monitoring cancer patients in their home environments via sensors and self-reporting: what data is collected, what are the techniques used to collect data, semantically integrate it, infer the patient's state from it and deliver coaching/behavior change interventions.

RESULTS

Starting from an initial corpus of 819 unique articles, a total of 180 papers were considered in the full-text analysis and 109 were finally included in the review. Our findings are organized and presented in four main sub-topics consisting of data collection, data integration, predictive modeling and patient coaching.

CONCLUSION

Development of modern decision support systems for cancer needs to utilize best practices like the use of validated electronic questionnaires for quality-of-life assessment, adoption of appropriate information modeling standards supplemented by terminologies/ontologies, adherence to FAIR data principles, external validation, stratification of patients in subgroups for better predictive modeling, and adoption of formal behavior change theories. Open research challenges include supporting emotional and social dimensions of well-being, including PROs in predictive modeling, and providing better customization of behavioral interventions for the specific population of cancer patients.

How Do Spinal Surgeons Perceive The Impact of Factors Used in Post-Surgical Complication Risk Scores?

When deciding about surgical treatment options, an important aspect of the decision-making process is the potential risk of complications. A risk assessment performed by a spinal surgeon is based on their knowledge of the best available evidence and on their own clinical experience. The objective of this work is to demonstrate the differences in the way spine surgeons perceive the importance of attributes used to calculate risk of post-operative and quantify the differences by building individual formal models of risk perceptions. We employ a preference-learning method - ROR-UTADIS - to build surgeon-specific additive value functions for risk of complications. Comparing these functions enables the identification and discussion of differences among personal perceptions of risk factors. Our results show there exist differences in surgeons' perceived factors including primary diagnosis, type of surgery, patient's age, body mass index, or presence of comorbidities.

Eliciting and Exploiting Utility Coefficients in an Integrated Environment for Shared Decision-Making

Background In shared decision-making, a key step is quantifying the patient's preferences in relation to all the possible outcomes of the compared clinical options. According to utility theory, this can be done by eliciting utility coefficients (UCs) from the patient. The obtained UCs are then used in decision models (e.g., decision trees). The elicitation process involves the choice of one or more elicitation methods, which is not easy for decision-makers who are unfamiliar with the theoretical framework. Moreover, to our knowledge there are no tools that integrate functionalities for UC elicitation with functionalities to run decision models that include the elicited values.

Objectives The first aim of this work is to provide decision support to the clinicians for the selection of the elicitation method. The second aim is to bridge the gap between UC elicitation and the exploitation of those UCs in shared decision-making.

Methods Based on evidence from the utility theory literature, we developed a set of production rules that recommend the optimal elicitation method(s) according to the patient's profile and health state. We then complemented this decision support tool with a functionality for quantifying and running decision trees defined through the commercial software TreeAge.

Results The result is an integrated framework for shared decision-making. Given the primary aim of this work, we focus for result evaluation on the elicitation tool. It was tested on 51 volunteers, who expressed UCs for four purposely selected health states. The insights on the collected UCs validated the rules included in the decision support system. The usability of the tool was assessed through the System Usability Scale, obtaining positive results.

Conclusion We developed an integrated environment to facilitate shared decision-making in the clinical practice. The next step is the validation of the entire framework and its use besides shared decision-making. As a matter of fact, it may also be exploited to target cost-utility analysis to a specific patient population.

Spatial Enablement to Support Environmental, Demographic, Socioeconomics, and Health Data Integration and Analysis for Big Cities: A Case Study With Asthma Hospitalizations in New York City

The percentage of the world's population living in urban areas is projected to increase in the next decades. Big cities are heterogeneous environments in which socioeconomic and environmental differences among the neighborhoods are often very pronounced. Each individual, during his/her life, is constantly subject to a mix of exposures that have an effect on their phenotype but are frequently difficult to identify, especially in an urban environment. Studying how the combination of environmental and socioeconomic factors which the population is exposed to influences pathological outcomes can help transforming public health from a reactive to a predictive system. Thanks to the application of state-of-the-art spatially enabled methods, patients can be stratified according to their characteristics and the geographical context they live in, optimizing healthcare processes and the reducing its costs. Some public health studies focusing specifically on urban areas have been conducted, but they usually consider a coarse spatial subdivision, as a consequence of scarce availability of well-integrated data regarding health and environmental exposure at a sufficient level of granularity to enable meaningful statistical analyses. In this paper, we present an application of highly fine-grained spatial resolution methods to New York City data. We investigated the link between asthma hospitalizations and a combination of air pollution and other environmental and socioeconomic factors. We first performed an explorative analysis using spatial clustering methods that shows that asthma is related to numerous factors whose level of influence varies considerably among neighborhoods. We then performed a Geographically Weighted Regression with different covariates and determined which environmental and socioeconomic factors can predict hospitalizations and how they vary throughout the city. These methods showed to be promising both for visualization and analysis of demographic and epidemiological urban dynamics, that can be used to organize targeted intervention and treatment policies to address the single citizens considering the factors he/she is exposed to. We found a link between asthma and several factors such as PM2.5, age, health insurance coverage, race, poverty, obesity, industrial areas, and recycling. This study has been conducted within the PULSE project, funded by the European Commission, briefly presented in this paper.

Shared Decision-Making Ontology for a Healthcare Team Executing a Workflow, an Instantiation for Metastatic Spinal Cord Compression Management

Regardless of potential benefits and better outcomes, adoption of shared decision-making between a patient and providers involved in his/her care is still in its infancy. This paper intends to fill this gap by formalizing shared decision-making, situating it as part of team-based care delivery, and incorporating workflow concepts allowing for identification of shared decision-making tasks. We accomplish that by creating novel shared decision-making ontology which constitutes the first step required in the development of a decision support system for shared decision-making. The proposed ontology formally defines and describes the key concepts and relations in the shared decision-making domain and lays the foundation for the formalization and support of the patient management process. We illustrate the applicability of the proposed ontology by creating its instantiation for the complex patient management scenario involving shared decision-making about the treatment of metastatic spinal cord compression.

Patient similarity for precision medicine: A systematic review

Evidence-based medicine is the most prevalent paradigm adopted by physicians. Clinical practice guidelines typically define a set of recommendations together with eligibility criteria that restrict their applicability to a specific group of patients. The ever-growing size and availability of health-related data is currently challenging the broad definitions of guideline-defined patient groups. Precision medicine leverages on genetic, phenotypic, or psychosocial characteristics to provide precise identification of patient subsets for treatment targeting. Defining a patient similarity measure is thus an essential step to allow stratification of patients into clinically-meaningful subgroups. The present review investigates the use of patient similarity as a tool to enable precision medicine. 279 articles were analyzed along four dimensions: data types considered, clinical domains of application, data analysis methods, and translational stage of findings. Cancer-related research employing molecular profiling and standard data analysis techniques such as clustering constitute the majority of the retrieved studies. Chronic and psychiatric diseases follow as the second most represented clinical domains. Interestingly, almost one quarter of the studies analyzed presented a novel methodology, with the most advanced employing data integration strategies and being portable to different clinical domains. Integration of such techniques into decision support systems constitutes and interesting trend for future research.

Trusting telemedicine: A discussion on risks, safety, legal implications and liability of involved stakeholders

OBJECTIVES

The main purpose of the article is to raise awareness among all the involved stakeholders about the risks and legal implications connected to the development and use of modern telemedicine systems. Particular focus is given to the class of "active" telemedicine systems, that imply a real-world, non-mediated, interaction with the final user. A secondary objective is to give an overview of the European legal framework that applies to these systems, in the effort to avoid defensive medicine practices and fears, which might be a barrier to their broader adoption.

METHODS

We leverage on the experience gained during two international telemedicine projects, namely MobiGuide (pilot studies conducted in Spain and Italy) and AP@home (clinical trials enrolled patients in Italy, France, the Netherlands, United Kingdom, Austria and Germany), whose development our group has significantly contributed to in the last 4 years, to create a map of the potential criticalities of active telemedicine systems and comment upon the legal framework that applies to them. Two workshops have been organized in December 2015 and March 2016 where the topic has been discussed in round tables with system developers, researchers, physicians, nurses, legal experts, healthcare economists and administrators.

RESULTS

We identified 8 features that generate relevant risks from our example use cases. These features generalize to a broad set of telemedicine applications, and suggest insights on possible risk mitigation strategies. We also discuss the relevant European legal framework that regulate this class of systems, providing pointers to specific norms and highlighting possible liability profiles for involved stakeholders.

CONCLUSIONS

Patients are more and more willing to adopt telemedicine systems to improve home care and day-by-day self-management. An essential step towards a broader adoption of these systems consists in increasing their compliance with existing regulations and better defining responsibilities for all the involved stakeholders.

UceWeb: a Web-based Collaborative Tool for Collecting and Sharing Quality of Life Data

Objectives: This work aims at building a platform where quality-of-life data, namely utility coefficients, can be elicited not only for immediate use, but also systematically stored together with patient profiles to build a public repository to be further exploited in studies on specific target populations (e.g. cost/utility analyses).

Methods: We capitalized on utility theory and previous experience to define a set of desirable features such a tool should show to facilitate sound elicitation of quality of life. A set of visualization tools and algorithms has been developed to this purpose. To make it easily accessible for potential users, the software has been designed as a web application. A pilot validation study has been performed on 20 atrial fibrillation patients.

Results: A collaborative platform, UceWeb, has been developed and tested. It implements the standard gamble, time trade-off and rating-scale utility elicitation methods. It allows doctors and patients to choose the mode of interaction to maximize patients’ comfort in answering difficult questions. Every utility elicitation may contribute to the growth of the repository.

Conclusion: UceWeb can become a unique source of data allowing researchers both to perform more reliable comparisons among healthcare interventions and build statistical models to gain deeper insight into quality of life data.

Interplay between Clinical Guidelines and Organizational Workflow Systems

Background: Implementing a decision-support system within a healthcare organization requires integration of clinical domain knowledge with resource constraints. Computer-interpretable guidelines (CIG) are excellent instruments for addressing clinical aspects while business process management (BPM) languages and Workflow (Wf) engines manage the logistic organizational constraints.

Objectives: Our objective is the orchestra -tion of all the relevant factors needed for a successful execution of patient’s care pathways, especially when spanning the contin -uum of care, from acute to community or home care.

Methods: We considered three strategies for integrating CIGs with organizational work-flows: extending the CIG or BPM languages and their engines, or creating an interplay between them. We used the interplay approach to implement a set of use cases arising from a CIG implementation in the domain of Atrial Fibrillation. To provide a more scalable and standards-based solution, we explored the use of Cross-Enterprise Document Workflow Integration Profile.

Results: We describe our proof-of-concept implementation of five use cases. We utilized the Personal Health Record of the MobiGuide project to implement a loosely-coupled approach between the Activiti BPM engine and the Picard CIG engine. Changes in the PHR were detected by polling. IHE profiles were used to develop workflow documents that orchestrate cross-enterprise execution of cardioversion.

Conclusions: Interplay between CIG and BPM engines can support orchestration of care flows within organizational settings.

The Role of Nurses in E-Health: The MobiGuide Project Experience

Leveraging the experience of the European project MobiGuide, this paper elaborates on the nurses' role in developing, delivering and evaluating e-health based services. We focus on the home monitoring of atrial fibrillation. Patients enrolled in our study are provided with a smartphone and an ECG sensor, and receive recommendations, reminders and alerts concerning medications and measurements that they should perform through a mobile decision support system that is constantly updated by a backend system. Patients' data are sent to health care personnel that may visualize them, and act accordingly. Nurses play a central role in such setting. After being involved in the design of the caregiver interface, they are responsible for the patients' enrollment phase (which includes patients' training), for the daily checking of incoming data, for the triage of patients' complaints, and for the final phase of the study where patients are interviewed about their experience with the system.

Graphical representation of life paths to better convey results of decision models to patients

The inclusion of patients' perspectives in clinical practice has become an important matter for health professionals, in view of the increasing attention to patient-centered care. In this regard, this report illustrates a method for developing a visual aid that supports the physician in the process of informing patients about a critical decisional problem. In particular, we focused on interpretation of the results of decision trees embedding Markov models implemented with the commercial tool TreeAge Pro. Starting from patient-level simulations and exploiting some advanced functionalities of TreeAge Pro, we combined results to produce a novel graphical output that represents the distributions of outcomes over the lifetime for the different decision options, thus becoming a more informative decision support in a context of shared decision making. The training example used to illustrate the method is a decision tree for thromboembolism risk prevention in patients with nonvalvular atrial fibrillation.

Quality of Life Measurements in Spinal Cord Injury Patients

We recently developed UceWeb, an application for direct elicitation of utility coefficients (UCs), i.e. a measure of health states quality perceived by patients. UceWeb was used to interview a sample of patients affected by spinal cord injury (SCI). A standard questionnaire for measuring quality of life (QoL) and another one for the system evaluation were also administered to the same patients. The aims of this work are to (i) evaluate UceWeb usability; (ii) investigate relationships among QoL values elicited with different methods, (iii) create a reference set of UCs for the health states experienced by SCI patients. We show preliminary results obtained with the first 20 patients. Despite great variability found among QoL values elicited with the different methods, interesting correlations with patients' condition and profile have been found.

Data quality and completeness in a web stroke registry as the basis for data and process mining

Electronic health records often show missing values and errors jeopardizing their effective exploitation. We illustrate the re-engineering process needed to improve the data quality of a web-based, multicentric stroke registry by proposing a knowledge-based data entry support able to help users to homogeneously interpret data items, and to prevent and detect treacherous errors. The re-engineering also improves stroke units coordination and networking, through ancillary tools for monitoring patient enrollments, calculating stroke care indicators, analyzing compliance with clinical practice guidelines, and entering stroke units profiles. Finally we report on some statistics, such as calculation of indicators for assessing the quality of stroke care, data mining for knowledge discovery, and process mining for comparing different processes of care delivery. The most important results of the re-engineering are an improved user experience with data entry, and a definitely better data quality that guarantees the reliability of data analyses.

Supporting shared decision making within the MobiGuide project

This paper describes our approach for fostering and facilitating communication among patients and caregivers in the context of shared decision making, i.e., when decisions must be taken not only on the basis of scientific evidence but also of the patient's preferences and context. This happens because clinical practice guidelines cannot provide recommendations for every possible situation, and cannot foresee every change in a patient's context, which might imply the deviation from a previously acknowledged recommendation. Within the EU-funded project MobiGuide (www.mobiguide-project.eu), supporting remote patient management, we propose decision theory as a methodological framework for a tool that, during face to face encounters, is used to tailor pre-defined, generic decision models to the individual patient, by involving the patient himself in the customization of the model parameters. Although this approach is not appropriate for all patients, it leads, in well-chosen cases, to a more informed choice, with potentially better treatment compliance.