Constructing the public in public perceptions research: A case study of forest genomics

Contemporary scientific and technological endeavours face public and political pressure to adopt open, transparent and democratically accountable practices of public engagement. Prior research has identified different ways that experts 'imagine publics' - as uninformed, as disengaged, as a risk to science, and as co-producers of knowledge - but there has yet to be a systematic exploration of how these views emerge, interact and evolve. This article introduces a typology of imagined publics to analyse how publics are constructed in the field of forest genomics. We find that deficit views of publics have not been replaced by co-production. Instead, deficit and co-productive approaches to publics co-exist and overlap, informing both how publics are characterized and how public perceptions are studied. We outline an agenda for deepening and expanding research on public perceptions of novel technologies. Specifically, we call for more diverse and complex methodological approaches that account for relational dynamics over time.

Negotiating with digital self-monitoring: A qualitative study on how patients with multiple sclerosis use and experience digital self-monitoring within a scientific study

Research shows that patients can have values and use practices that are different from those envisioned by technology developers. Using sociomaterialism as an analytical lens, we show how patients negotiated with digital self-monitoring in the context of a scientific study. Our paper draws on interviews with 26 patients with the chronic neurological disease multiple sclerosis (MS) who were invited to use an activity tracker and a self-monitoring app for a period of 12 months as part of their everyday life. Our study aims to fill a gap: relatively little is known about how digital self-monitoring becomes materialized in the everyday lives of patients with chronic diseases. We show that patients engaged in digital self-monitoring because they are eager to participate in research to contribute knowledge that will benefit the larger community of patients rather than to improve their personal self-management. Although respondents adhered to digital self-monitoring during the study, it is not self-evident that they would do so for private self-monitoring purposes. It became clear that respondents did not necessarily perceive digital self-monitoring as useful for their self-management practices due to their established knowledge and routines. Moreover, respondents referred to the inconvenience of having to perform self-monitoring tasks and the emotional burden of being reminded of the MS because of the digital self-monitoring. We conclude by indicating what could be considered when designing scientific studies, including the suitability of conventional study designs for evaluating technologies used daily by patients and the challenge of integrating patients' experiential knowledge into scientific practices.

The rationale for a carbon ion radiation therapy facility in Australia

Australia has taken a collaborative nationally networked approach to achieve particle therapy capability. This supports the under-construction proton therapy facility in Adelaide, other potential proton centres and an under-evaluation proposal for a hybrid carbon ion and proton centre in western Sydney. A wide-ranging overview is presented of the rationale for carbon ion radiation therapy, applying observations to the case for an Australian facility and to the clinical and research potential from such a national centre.

Beyond the Clinic Walls: Examining Radiology Technicians' Experiences in Home-Based Radiography

In recent years, the landscape of diagnostic imaging has undergone a significant transformation with the emergence of home radiology, challenging the traditional paradigm. This shift, bringing diagnostic imaging directly to patients, has gained momentum and has been further accelerated by the global COVID-19 pandemic, highlighting the increasing importance and convenience of decentralized healthcare services. This study aims to offer a nuanced understanding of the attitudes and experiences influencing the integration of in-home radiography into contemporary healthcare practices. The research methodology involves a survey administered through Computer-Aided Web Interviewing (CAWI) tools, enabling real-time engagement with a diverse cohort of medical radiology technicians in the health domain. A second CAWI tool is submitted to experts to assess their feedback on the methodology. The survey explores key themes, including perceived advantages and challenges associated with domiciliary imaging, its impact on patient care, and the technological intricacies specific to conducting radiologic procedures outside the conventional clinical environment. Findings from a sample of 26 medical radiology technicians (drawn from a larger pool of 186 respondents) highlight a spectrum of opinions and constructive feedback. Enthusiasm is evident for the potential of domiciliary imaging to enhance patient convenience and provide a more patient-centric approach to healthcare. Simultaneously, this study suggests areas of intervention to improve the diffusion of home-based radiology. The methodology based on CAWI tools proves instrumental in the efficiency and depth of data collection, as evaluated by 16 experts from diverse professional backgrounds. The dynamic and responsive nature of this approach allows for a more allocated exploration of technicians' opinions, contributing to a comprehensive understanding of the evolving landscape of medical imaging services. Emphasis is placed on the need for national and international initiatives in the field, supported by scientific societies, to further explore the evolving landscape of teleradiology and the integration of artificial intelligence in radiology. This study encourages expansion involving other key figures in this practice, including, naturally, medical radiologists, general practitioners, medical physicists, and other stakeholders.

Cost-effectiveness of testosterone treatment utilising individual patient data from randomised controlled trials in men with low testosterone levels

BACKGROUND

Testosterone is safe and highly effective in men with organic hypogonadism, but worldwide testosterone prescribing has recently shifted towards middle-aged and older men, mostly with low testosterone related to age, diabetes and obesity, for whom there is less established evidence of clinical safety and benefit. The value of testosterone treatment in middle-aged and older men with low testosterone is yet to be determined. We therefore evaluated the cost-effectiveness of testosterone treatment in such men with low testosterone compared with no treatment.

METHODS

A cost-utility analysis comparing testosterone with no treatment was conducted following best practices in decision modelling. A cohort Markov model incorporating relevant care pathways for individuals with hypogonadism was developed for a 10-year-time horizon. Clinical outcomes were obtained from an individual patient meta-analysis of placebo-controlled, double-blind randomised studies. Three starting age categories were defined: 40, 60 and 75 years. Cost utility (quality-adjusted life years) accrued and costs of testosterone treatment, monitoring and cardiovascular complications were compared to estimate incremental cost-effectiveness ratios and cost-effectiveness acceptability curves for selected scenarios.

RESULTS

Ten-year excess treatment costs for testosterone compared with non-treatment ranged between £2306 and £3269 per patient. Quality-adjusted life years results depended on the instruments used to measure health utilities. Using Beck depression index-derived quality-adjusted life years data, testosterone was cost-effective (incremental cost-effectiveness ratio <£20,000) for men aged <75 years, regardless of morbidity and mortality sensitivity analyses. Testosterone was not cost-effective in men aged >75 years in models assuming increased morbidity and/or mortality.

CONCLUSIONS AND FUTURE RESEARCH

Our data suggest that testosterone is cost-effective in men <75 years when Beck depression index-derived quality-adjusted life years data are considered; cost-effectiveness in men >75 years is dependent on cardiovascular safety. However, more robust and longer-term cost-utility data are needed to verify our conclusion.

Translating ethical and quality principles for the effective, safe and fair development, deployment and use of artificial intelligence technologies in healthcare

OBJECTIVE

The complexity and rapid pace of development of algorithmic technologies pose challenges for their regulation and oversight in healthcare settings. We sought to improve our institution's approach to evaluation and governance of algorithmic technologies used in clinical care and operations by creating an Implementation Guide that standardizes evaluation criteria so that local oversight is performed in an objective fashion.

MATERIALS AND METHODS

Building on a framework that applies key ethical and quality principles (clinical value and safety, fairness and equity, usability and adoption, transparency and accountability, and regulatory compliance), we created concrete guidelines for evaluating algorithmic technologies at our institution.

RESULTS

An Implementation Guide articulates evaluation criteria used during review of algorithmic technologies and details what evidence supports the implementation of ethical and quality principles for trustworthy health AI. Application of the processes described in the Implementation Guide can lead to algorithms that are safer as well as more effective, fair, and equitable upon implementation, as illustrated through 4 examples of technologies at different phases of the algorithmic lifecycle that underwent evaluation at our academic medical center.

DISCUSSION

By providing clear descriptions/definitions of evaluation criteria and embedding them within standardized processes, we streamlined oversight processes and educated communities using and developing algorithmic technologies within our institution.

CONCLUSIONS

We developed a scalable, adaptable framework for translating principles into evaluation criteria and specific requirements that support trustworthy implementation of algorithmic technologies in patient care and healthcare operations.

Early technology review: towards an expedited pathway

OBJECTIVES

Evidence development for medical devices is often focused on satisfying regulatory requirements with the result that health professional and payer expectations may not be met, despite considerable investment in clinical trials. Early engagement with payers and health professionals could allow companies to understand these expectations and reflect them in clinical study design, increasing chances of positive coverage determination and adoption into clinical practice.

METHODS

An example of early engagement through the EXCITE International model using an early technology review (ETR) is described which includes engagement with payers and health professionals to better inform companies to develop data that meet their expectations. ETR is based on an early evidence review, a framework of expectations that guides the process and identified gaps in evidence. The first fourteen ETRs were reviewed for examples of advice to companies that provided additional information from payers and health professionals that was thought likely to impact on downstream outcomes or strategic direction. Given that limitations were imposed by confidentiality, examples were genericized.

RESULTS

Advice through early engagement can inform evidence development that coincides with expectations of payers and health professionals through a structured, objective, evidence-based approach. This could reduce the risk of business-related adverse outcomes such as failure to secure a positive coverage determination and/or acceptance by expert health professionals.

CONCLUSIONS

Early engagement with key stakeholders exemplified by the ETR approach offers an alternative to the current approach of focusing on regulatory expectations. This could reduce the time to reimbursement and clinical adoption and benefit patient outcomes and/or health system efficiencies.

Acceptability of self-administered antigen test for COVID-19 in the Philippines

OBJECTIVES

In response to the Omicron surge in early 2022, the HTA Philippines evaluated the acceptability of Filipinos in using self-administered antigen tests (SAAgTs) as part of COVID-19 HTAs in the Philippines.

METHODS

Scoping review from literature databases was initially conducted to identify preset codes in the use of SAAgT. Preset codes were used to establish the questions for focus group discussions (FGDs). Semi-structured questionnaires were created through Delphi technique. FGDs with four stakeholder groups (i.e., nine healthcare workers [HCWs], seven representatives of at-risk groups, six economic frontliners, and seven representatives of micro-small-medium-sized enterprises) were conducted.

RESULTS

Discomfort in being a target of stigma and being prescribed an "illness identity" when suspected or confirmed COVID-19-positive, along with lack of confidence to perform self-test, caused hesitancy in self-testing among participants. The need for subsidies for test kits from the government or employers was emphasized to increase its accessibility. Having a designated access point and reporting system for SAAgT was highlighted to avoid nepotism (padrino system attributed to debt of gratitude), inequitable distribution, and lapses in reporting. A participatory approach to education was perceived as crucial to reduce any misconceptions associated with the use of SAAgT.

CONCLUSIONS

All FGD groups expressed favorable reviews on the implementation of SAAgT because it can potentially reduce the burden of health facility-administered tests. These findings were considered by the HTA Council in the recommendation of SAAgT as part of the overarching national strategies for the diagnosis and screening of COVID-19.

Applications of artificial intelligence in gastroscopy: a narrative review

Gastroscopy, a critical tool for the diagnosis of upper gastrointestinal diseases, has recently incorporated artificial intelligence (AI) technology to alleviate the challenges involved in endoscopic diagnosis of some lesions, thereby enhancing diagnostic accuracy. This narrative review covers the current status of research concerning various applications of AI technology to gastroscopy, then discusses future research directions. By providing this review, we hope to promote the integration of gastroscopy and AI technology, with long-term clinical applications that can assist patients.

The value and impact of health technology assessment: discussions and recommendations from the 2023 Health Technology Assessment International Global Policy Forum

Health technology assessment (HTA) programs inform decision making about the value and reimbursement of new and existing health technologies; however, they are under increasing pressure to demonstrate that they are a cost-effective use of finite healthcare resources themselves. The 2023 HTAi Global Policy Forum (GPF) discussed the value and impact of HTA, including how it is assessed and communicated, and how it could be enhanced in the future. This article summarizes the discussions held at the 2023 HTAi GPF, where the challenges and opportunities related to the value and impact of HTA were debated. Core themes and recommendations identified that defining the purpose of value and impact assessment is an essential first step prior to undertaking it, and that it can be done through the use and expansion of existing tools. Further work around aligning HTA programs with underlying societal values is needed to ensure the long-term value and impact of HTA. HTA could also have a role in assessing the efficiency of the wider health system by applying HTA methods or concepts to broader budgetary allocations and organizational aspects of health care. Stakeholders (particularly patients, industry, and clinicians but also payers, wider society, and the media) should ideally be actively engaged when undertaking the value and impact assessment of HTA. More concerted efforts in communicating the role and remit of HTA bodies would also help stakeholders to better understand the value and impact of HTA, which in turn could improve the implementation of HTA recommendations and application to future actions in the lifecycle of technologies.

Real-world evidence: experiences and challenges for decision making in Latin America

OBJECTIVE

The Health Technology Assessment (HTA) process aims to optimize health system funding of technologies. In recent years there has been an increase in what is known as Real-World Evidence (RWE) as a complement to clinical trials. The objective of Health Technology Assessment International's Latin American Policy Forum 2022 was to explore the utility of incorporating RWE into HTA and decision-making processes in the region.

METHODS

This article is based on a background document, survey, and the deliberative work of the country representatives who participated in the Forum.

RESULTS

There is a growing interest in the use of Real-World Data / Real-World Evidence in HTA processes in Latin America, although currently there are no specific local guidelines for RWE use by HTA agencies. At present, its use is limited to certain areas such as adding context to HTA reports, the evaluation of adverse events, or cost estimation.Potential future uses of RWE were identified, including the creation of risk-sharing agreements, the assessment of technology performance in routine practice, providing information on outcomes that are not so easily evaluated in clinical trials (e.g., the identification of specific subpopulations or quality of life), and the estimation of input parameters for economic evaluations.

CONCLUSIONS

The participants agreed that there are several areas presenting significant potential to expand the application of RWD/RWE and that the development of normative frameworks for its use could be helpful.

A Multiclass Radiomics Method-Based WHO Severity Scale for Improving COVID-19 Patient Assessment and Disease Characterization From CT Scans

OBJECTIVES

The aim of this study was to evaluate the severity of COVID-19 patients' disease by comparing a multiclass lung lesion model to a single-class lung lesion model and radiologists' assessments in chest computed tomography scans.

MATERIALS AND METHODS

The proposed method, AssessNet-19, was developed in 2 stages in this retrospective study. Four COVID-19-induced tissue lesions were manually segmented to train a 2D-U-Net network for a multiclass segmentation task followed by extensive extraction of radiomic features from the lung lesions. LASSO regression was used to reduce the feature set, and the XGBoost algorithm was trained to classify disease severity based on the World Health Organization Clinical Progression Scale. The model was evaluated using 2 multicenter cohorts: a development cohort of 145 COVID-19-positive patients from 3 centers to train and test the severity prediction model using manually segmented lung lesions. In addition, an evaluation set of 90 COVID-19-positive patients was collected from 2 centers to evaluate AssessNet-19 in a fully automated fashion.

RESULTS

AssessNet-19 achieved an F1-score of 0.76 ± 0.02 for severity classification in the evaluation set, which was superior to the 3 expert thoracic radiologists (F1 = 0.63 ± 0.02) and the single-class lesion segmentation model (F1 = 0.64 ± 0.02). In addition, AssessNet-19 automated multiclass lesion segmentation obtained a mean Dice score of 0.70 for ground-glass opacity, 0.68 for consolidation, 0.65 for pleural effusion, and 0.30 for band-like structures compared with ground truth. Moreover, it achieved a high agreement with radiologists for quantifying disease extent with Cohen κ of 0.94, 0.92, and 0.95.

CONCLUSIONS

A novel artificial intelligence multiclass radiomics model including 4 lung lesions to assess disease severity based on the World Health Organization Clinical Progression Scale more accurately determines the severity of COVID-19 patients than a single-class model and radiologists' assessment.

Priority setting for health technology adoption at the national level: Lessons learned over 25 years' experience

BACKGROUND

Limited health budgets and continual advancement of health technologies require mechanisms for prioritization. Israel, with a publicly funded health service basket, has implemented and optimized such a health technology assessment process since 1999.We describe the process of evaluating technologies according to the Israeli model, analyze its outputs and benefits over two decades of implementation, and compare its key features with international experience.

METHODS

Retrospective data were collected between 1998 and 2023, including work processes, committee composition, number of applications submitted and approved by a clinical domain, and yearly cost of the basket. Features were evaluated within the evidence-informed deliberative process (EDP) framework.

RESULTS

This national model involves relevant stake holders in a participatory and transparent process, in a timely manner, and is accepted by the public, health professionals, and policy makers, facilitating early adoption of the newest medical technologies. Between 11 and 19 percent of applications are approved for reimbursement annually, mostly pharmaceuticals. On average 26 percent of approved technologies are added to the list without additional budget. Major domains of approved technologies were oncology, cardiology, and neurology.

CONCLUSIONS

Israel created a unique model for the expansion of the health service basket. Despite an increasing number of applications and rising costs, the mechanism enables a consensus to be reached on which technologies to fund, while remaining within budget constraints and facilitating immediate implementation. The process, which prioritizes transparency and stake holder involvement, allows just a resource allocation while maximizing the adoption of novel technologies, contributing to an outstanding national level of health despite relatively low health spending.

Dark-Field Chest Radiography Outperforms Conventional Chest Radiography for the Diagnosis and Staging of Pulmonary Emphysema

OBJECTIVES

Dark-field chest radiography (dfCXR) has recently reached clinical trials. Here we compare dfCXR to conventional radiography for the detection and staging of pulmonary emphysema.

MATERIALS AND METHODS

Subjects were included after a medically indicated computed tomography (CT) scan, showing either no lung impairments or different stages of emphysema. To establish a ground truth, all CT scans were assessed by 3 radiologists assigning emphysema severity scores based on the Fleischner Society classification scheme.Participants were imaged at a commercial chest radiography device and at a prototype for dfCXR, yielding both attenuation-based and dark-field images. Three radiologists blinded to CT score independently assessed images from both devices for presence and severity of emphysema (no, mild, moderate, severe).Statistical analysis included evaluation of receiver operating characteristic curves and pairwise comparison of adjacent Fleischner groups using an area under the curve (AUC)-based z test with a significance level of 0.05.

RESULTS

A total of 88 participants (54 men) with a mean age of 64 ± 12 years were included. Compared with conventional images (AUC = 0.73), readers were better able to identify emphysema with images from the dark-field prototype (AUC = 0.85, P = 0.005). Although ratings of adjacent emphysema severity groups with conventional radiographs differed only for trace and mild emphysema, ratings based on images from the dark-field prototype were different for trace and mild, mild and moderate, and moderate and confluent emphysema.

CONCLUSIONS

Dark-field chest radiography is superior to conventional chest radiography for emphysema diagnosis and staging, indicating the technique's potential as a low-dose diagnostic tool for emphysema assessment.

Pioneering neurohackers: between egocentric human enhancement and altruistic sacrifice

The growing field of neurotechnology (NT) is becoming more and more accessible in terms of reduced costs, increasing availability and reliability of materials, and ways to implant devices. As in other engineering fields such as bio-or information technology, there is a growing community of pioneering hackers who (self-)experiment with NT and develop novel applications. While most debates about NT, its goals and ethical ramifications are usually conducted by professionals in the field (neuroscientists, -engineers, -ethicists), little is known within these institutional frameworks about the motivations, goals and visions of neurohackers and how they view ethical ramifications of NT therapeutics vs. human enhancement. In this study we draw on qualitative interviews with 13 of these neurohacking pioneers, who are interacting with NT from a grassroots perspective (i.e., a bottom-up and community/subculture-oriented approach), and shed light on: how they understand themselves in the context of human enhancement; what the role of invasive NTs is when it comes to identifying as a cyborg; if their practices show a clear distinction between therapy and enhancement; whether human enhancement is always about performance, optimization and functionality; and to which extent neurohackers contribute to "mainstreaming" NT.

Lexical Speech Features of Spontaneous Speech in Older Persons With and Without Cognitive Impairment: Reliability Analysis

Background

Speech analysis data are promising digital biomarkers for the early detection of Alzheimer disease. However, despite its importance, very few studies in this area have examined whether older adults produce spontaneous speech with characteristics that are sufficiently consistent to be used as proxy markers of cognitive status.

Objective

This preliminary study seeks to investigate consistency across lexical characteristics of speech in older adults with and without cognitive impairment.

Methods

A total of 39 older adults from a larger, ongoing study (age: mean 81.1, SD 5.9 years) were included. Participants completed neuropsychological testing and both picture description tasks and expository tasks to elicit speech. Participants with T-scores of ≤40 on ≥2 cognitive tests were categorized as having mild cognitive impairment (MCI). Speech features were computed automatically by using Python and the Natural Language Toolkit.

Results

Reliability indices based on mean correlations for picture description tasks and expository tasks were similar in persons with and without MCI (with r ranging from 0.49 to 0.65 within tasks). Intraindividual variability was generally preserved across lexical speech features. Speech rate and filler rate were the most consistent indices for the cognitively intact group, and speech rate was the most consistent for the MCI group.

Conclusions

Our findings suggest that automatically calculated lexical properties of speech are consistent in older adults with varying levels of cognitive impairment. These findings encourage further investigation of the utility of speech analysis and other digital biomarkers for monitoring cognitive status over time.

Predicting pediatric healthcare provider use of virtual reality using a technology acceptance model

Objective

The primary aim of this study was to apply a novel technology acceptance model (TAM) for virtual reality (VR) in healthcare. The secondary aim was to assess reliability of this model to evaluate factors that predict the intentions of pediatric health providers' use of VR as an anxiolytic for hospitalized pediatric patients.

Materials and Methods

Healthcare providers that interacted with pediatric patients participated in a VR experience available as anxiolysis for minor procedures and then completed a survey evaluating attitudes, behaviors, and technology factors that influence adoption of new technologies.

Results

Reliability for all domain measurements were good, and all confirmatory factor analysis models demonstrated good fit. Usefulness, ease of use, curiosity, and enjoyment of the VR experience all strongly predict intention to use and purchase VR technologies. Age of providers, past use, and cost of technology did not influence future purchase or use, suggesting that VR technologies may be broadly adopted in the pediatric healthcare setting.

Discussion

Previous VR-TAM models in non-healthcare consumers formulated that age, past use, price willing to pay, and curiosity impacted perceived ease of use. This study established that age, past use, and cost may not influence use in healthcare. Future studies should be directed at evaluating the social influences and facilitating conditions within healthcare that play a larger influence on technology adoption.

Conclusion

The VR-TAM model demonstrated validity and reliability for predicting intent to use VR in a pediatric hospital.

Design and development of a Telemedicine Assessment Toolkit (TAT) for the assessment of audiovisual telemedicine encounters

Although the use of audiovisual telemedicine has grown in recent years especially during recent COVID-19-related lockdowns, evidence shows there is still a lack of tools that can be used for the assessment of telemedicine encounters. The few validated questionnaires that are available for assessing telemedicine encounters are not often used. Non-validated questionnaires dominate research, leading to results that cannot be compared or extrapolated to other research or medical sites. Development of standard measures for the assessment of telemedicine encounters has been advocated by stakeholders. The objective of this study is to provide a comprehensive set of measures by developing a conceptual approach and a preliminary Telemedicine Assessment Toolkit (TAT) for the assessment of audiovisual telemedicine encounters. A two-step conceptual approach was used to identify potential domains and sub-domains by qualitative analysis of a pool of questions from studies published from 2016 to 2021. Questions were adopted from validated questionnaires or generated to represent the underlying concept of each sub-domain, resulting in a core block of comprehensive questions. A toolkit is proposed with question-measures that cover the sub-domains relevant to the assessment of telemedicine encounters. This study recommended 11 domains to be used for the assessment of telemedicine encounters: "usability," "patient satisfaction," "patient-provider interaction," "patient perspectives," "telemedicine readiness," "qualitative feedback," "comparison to standard (in-person) care," "privacy," "technology," "patient feeling," and "patient costs." Of the 11 domains, 26 underlying sub-domains were created. From the subdomains, a 30-question core block was proposed. The core-block together with a precursor block aimed to retrieve demographic/patient characteristics and, together with a customizable clinical outcomes block, complete the comprehensive toolkit. The toolkit, upon testing and validation, would enable researchers and system owners to assess patient-oriented aspects of audiovisual telemedicine encounters more accurately and accelerate the adoption of common audiovisual telemedicine assessment measures.

HTA capacity building in Asia: towards one goal

OBJECTIVES

The aim of the 2022 Health Technology Assessment International (HTAi) Asia Policy Forum (APF) was to discuss experiences and challenges around health technology assessment (HTA) capacity building for both HTA agencies and companies in the Asia region and to identify possible solutions as part of a capacity building roadmap.

METHODS

Discussions during the 2022 APF, informed by a pre-meeting survey of HTA agencies and industry attendees from the region, form the basis of this paper.

RESULTS

HTA is an essential element of priority-setting in healthcare; however, the scarcity of skilled technical HTA practitioners is a rate-limiting step in the conduct of HTA. The lack of investment in HTA and the political will to mandate the use of HTA in decision-making may be due to a lack of understanding of the value of the HTA process, and how HTA is interpreted and used in the healthcare decision-making process.

CONCLUSIONS

Increased demand for HTA is created when the value of HTA is recognized. HTA capacity-building challenges may be mitigated by educating stakeholders, particularly policymakers, on the value of, and the need to invest in, HTA as a transparent process to ensure equitable access to health care for all. Investigating a means of funding and implementing an HTA intern program between agencies, in partnership with industry, to facilitate a supportive environment to foster HTA skills and knowledge, build capacity or strengthen existing capacity should be a priority.

Patient and citizen participation at the organizational level in health technology assessment: an exploratory study in five jurisdictions

OBJECTIVE

While patient participation in individual health technology assessments (HTAs) has been frequently described in the literature, patient and citizen participation at the organizational level is less described and may be less understood and practiced in HTA bodies. We aimed to better understand its use by describing current practice.

METHOD

To elicit descriptive case studies and insights we conducted semi-structured interviews and open-ended questionnaires with HTA body staff and patients and citizens participating at the organizational level in Belgium, France, Quebec, Scotland, and Wales.

RESULTS

We identified examples of organizational participation in managerial aspects: governance, defining patient involvement processes, evaluation processes and methods, and capacity building. Mechanisms included consultation, collaboration, and membership of standing (permanent) groups. These were sometimes combined. Participants were usually from umbrella patient organizations and patient associations, as well as individual patients and citizens.

DISCUSSION

Although the concept, participation at the organizational level, is not well-established, we observed a trend toward growth in each jurisdiction. Some goals were shared for this participation, but HTA bodies focused more on instrumental goals, especially improving participation in HTAs, while patients and citizens were more likely to offer democratic and developmental goals beyond improving participation processes.

CONCLUSION

Our findings provide rationales for organizational-level participation from the perspectives of HTA bodies and patients. The case studies provide insights into how to involve participants and who may be seen as legitimate participants. These findings may be useful to HTA bodies, the patient sector, and communities when devising an organizational-level participation framework.

A first exploration of the economic consequences of an autonomous surgical robot for lateral skull base surgery: an early health technology assessment

OBJECTIVES

Lateral skull base procedures, such as translabyrinthine approach (TLA), are challenging. An autonomous surgical robot might be a solution to these challenges. Our aim is to explore in an early phase the economic consequences of an autonomous surgical robot compared with conventional TLA.

METHODS

An early decision analytic model was constructed in order to perform a step-wise threshold analyses and a sensitivity analysis to analyze the impact of the several factors on the incremental costs.

RESULTS

Using surgical robot results in incremental costs - EUR 5,562 per procedure - compared to conventional TLA. These costs are most reduced by higher number of procedures, followed by lower price of the robot, saved operation time, and reduced risk of complication, respectively.

CONCLUSIONS

The incremental costs of using an autonomous surgical robot can be decreased by choosing applications with a high turnover rate, a long operation time, and a high complication rate.

Ethics information retrieval in HTA: state of current practice

OBJECTIVES

Though there have been longstanding discussions on the value of ethics in health technology assessment (HTA), less awareness exists on ethics information retrieval methods. This study aimed to scope available evidence and determine current practices for ethics information retrieval in HTA.

METHODS

Literature searches were conducted in Ovid MEDLINE, LISTA, Scopus, and Google Scholar. Once a list of relevant articles was determined, citation tracking was conducted via Scopus. HTA agency websites were searched for published guidance on ethics searching, and for reports which included ethical analyses. Methods sections of each report were analyzed to determine the databases, subject headings, and keywords used in search strategies. The team also reached out to information specialists for insight into current search practices.

RESULTS

Findings from this study indicate that there is still little published guidance from HTA agencies, few HTAs that contain substantial ethical analysis, and even less information on the methodology for ethics information retrieval. The researchers identified twenty-five relevant HTAs. Ten of these reports did not utilize subject-specific databases outside health sciences. Eight reports published ethics searches, with significant overlap in subject headings and text words.

CONCLUSIONS

This scoping study of current practice in HTA ethics information retrieval highlights findings of previous studies-while ethics analysis plays a crucial role in HTA, methods for literature searching remain relatively unclear. These findings provide insight into the current state of ethics searching, and will inform continued work on filter development, database selection, and grey literature searching.

Progress toward Health System Readiness for Genome-Based Testing in Canada

(1) Background: Genomic medicine harbors the real potential to improve the health and healthcare journey of patients, care provider experiences, and improve the health system efficiency-even reducing healthcare costs. There is expected to be an exponential growth in medically necessary new genome-based tests and test approaches in the coming years. Testing can also create scientific research and commercial opportunities beyond healthcare decision making. The purpose of this research is to generate a better understanding of Canada's state of readiness for genomic medicine, and to provide some insights for other healthcare systems. (2) Methods: A mixed-methods approach of a review of the literature and key informant interviews with a purposive sample of experts was used. The health system readiness was assessed using a previously published set of conditions. (3) Results: Canada has created some of the established conditions, but further action needs to be taken to improve the state of readiness for genome-based medicine. The important gaps to be filled are the need for linked information systems and data integration; evaluative processes that are timely and transparent; navigational tools for care providers; dedicated funding to facilitate rapid onboarding and support test development and proficiency testing; and broader engagement with innovation stakeholders beyond care providers and patients. These findings highlight the role of the organizational context, social influence, and other factors that are known to affect the diffusion of innovation within health systems.

Embedding the Patient-Citizen Perspective into an Operational Framework for the Development and the Introduction of New Technologies in Rehabilitation Care: The Smart&Touch-ID Model

To date, at least 2.41 billion people with Non-Communicable Diseases (NCDs) are in need of rehabilitation. Rehabilitation care through innovative technologies is the ideal candidate to reach all people with NCDs in need. To obtain these innovative solutions available in the public health system calls for a rigorous multidimensional evaluation that, with an articulated approach, is carried out through the Health Technology Assessment (HTA) methodology. In this context, the aim of the present paper is to illustrate how the Smart&TouchID (STID) model addresses the need to incorporate patients' evaluations into a multidimensional technology assessment framework by presenting a feasibility study of model application with regard to the rehabilitation experiences of people living with NCDs. After sketching out the STID model's vision and operational process, preliminary evidence on the experiences and attitudes of patients and citizens on rehabilitation care will be described and discussed, showing how they operate, enabling the co-design of technological solutions with a multi-stakeholder approach. Implications for public health are discussed including the view on the STID model as a tool to be integrated into public health governance strategies aimed at tuning the agenda-setting of innovation in rehabilitation care through a participatory methodology.

Impact of insufflator/aspirator versus exclusive insufflator during robotic radical prostatectomy: a comparative prospective cohort study

New generation devices that combine high-flow insufflation with smoke aspiration using continuous gas recirculation ]so-called Insufflator/aspirator systems (IAS)] have recently been developed to generate pneumoperitoneum. The use of an IAS could have an impact on surgical compared to conventional insufflation systems (CIS). The present study aimed to compare the clinical effectiveness/safety, healthorganizational, and pathological/oncological outcomes of the CIS versus IAS during robot-assisted radical prostatectomy (RARP).

Methods

Comparative retrospective cohort study including patients with non-metastatic prostate cancer treated with RARP by four expert surgeons at a robotic referral centre between January 2020 and December 2021. A CIS was used until 15 March 2021, and the IAS thereafter. Data were extracted from the Institutional Review Board-approved (#1064) retro and prospective institutional database.

Results

The final analysis included 299 patients (143 CIS; 156 IAS). We found no statistically significant differences in demographic data and preoperative results, allowing adequate group comparison. The rate of complications of any degree (9.1% and 1.9%, P<0.05) and major complications (4.2% and 0.6%, P<0.05) were lower in the IAS group. Accordingly, the hospital stay was shorter in the IAS group (P<0.05); however, the small size of this statistically significant difference probably lacks clinical value (1.9±1.6 vs. 1.6±0.8 days). There was no significant difference in surgical time, bleeding, pathological findings, or oncological results.

Conclusions

Data from this large group of patients showed that the rate of overall complications, the rate of major complications, and the length of stay were lower in the IAS group. Implementing the IAS in RARP patients increased the occurrence of SCE and affected our daily practice of transversus abdominis plane block. Interpretation of the results should be made with caution since the design of this study did not allow for the identification of a causal relationship.

Health technology assessment of tests for SARS-CoV-2 and treatments for COVID-19: A proposed approach and best-practice recommendations

OBJECTIVES

To develop best-practice guidance for health technology assessment (HTA) agencies when appraising diagnostic tests for SARS-CoV-2 and treatments for COVID-19.

METHODS

We used a policy sandbox approach to develop best-practice guidance for HTA agencies to approach known challenges associated with assessing tests and treatments for COVID-19. The guidance was developed by a multi-stakeholder workshop of twenty-one participants representing HTA agencies, clinical and patient experts, academia, industry, and a payer, from across Europe and North America. The workshop was supported by extensive background work to identify the key challenges, including: targeted reviews of existing COVID-related methods guidance for assessing interventions and clinical guidelines, engagement with clinical experts, a survey and workshop of HTA agencies, a systematic review of published economic evaluations, and a workshop of health economic modelers.

RESULTS

We suggest HTA agencies should consider using other types of evidence (e.g., real world) where high-quality randomized controlled trials may be lacking and healthcare systems would value timely HTA outputs. A "living" HTA approach may be useful, given the context of an evolving disease, scientific understanding and evidence base, allowing for decisions to be efficiently revisited in response to new information; particularly, if supported by a common "disease model" for COVID-19. Innovative ways of engaging with the public and clinicians, and early engagement with regulators and payers, are recommended.

CONCLUSIONS

HTA agencies should consider the elements of this guidance that are most suited to their existing processes to enable them to assess the effectiveness and value of interventions for COVID-19.

Multiple sclerosis health-related quality of life utility values from the UK MS register

Background

New interventions for multiple sclerosis (MS) commonly require a demonstration of cost-effectiveness using health-related quality of life (HRQoL) utility values. The EQ-5D is the utility measure approved for use in the UK NHS funding decision-making. There are also MS-specific utility measures - e.g., MS Impact Scale Eight Dimensions (MSIS-8D) and MSIS-8D-Patient (MSIS-8D-P).

Objectives

Provide EQ-5D, MSIS-8D and MSIS-8D-P utility values from a large UK MS cohort and investigate their association with demographic/clinical characteristics.

Methods

UK MS Register data from 14,385 respondents (2011 to 2019) were analysed descriptively and using multivariable linear regression, with self-report Expanded Disability Status Scale (EDSS) scores.

Results

The EQ-5D and MSIS-8D were both sensitive to differences in demographic/clinical characteristics. An inconsistency found in previous studies whereby mean EQ-5D values were higher for an EDSS score of 4 rather than 3 was not observed. Similar utility values were observed between MS types at each EDSS score. Regression showed EDSS score and age were associated with utility values from all three measures.

Conclusions

This study provides generic and MS-specific utility values for a large UK MS sample, with the potential for use in cost-effectiveness analyses of treatments for MS.

Alternatives to the quality-adjusted life year: How well do they address common criticisms?

OBJECTIVE

To analyze whether other outcome measures used in health technology assessment (HTA) address the criticisms of quality-adjusted life years (QALYs).

DATA SOURCES AND STUDY SETTING

HTA methods guidance from 11 US comparator countries (the G10 and Australia) and six value frameworks from US organizations were reviewed to identify health outcome measures currently used to evaluate the benefits of a drug.

STUDY DESIGN

The study involved a documentary analysis of guidelines to identify outcome measures used by the sampled HTA organizations. Similar outcomes were grouped together into outcome types. Each type was analyzed to determine the extent to which it replicates key advantages and responds to criticisms of QALYs extracted from the literature.

EXTRACTION METHODS

Outcomes were included if guidance from at least one HTA organization identified the outcome as acceptable for HTA. Outcomes measuring or evaluating the benefit, clinical effect, or impact of a drug or health technology was included; methods of calculating costs were excluded.

PRINCIPAL FINDINGS

Seven types of outcome measures were identified falling into three groups: preference-based, single-dimension outcomes, and outcomes using non-health perspectives. Among the seven QALY alternative outcome measures currently used for HTA by the sampled countries, no one outcome measure addresses all the QALY criticisms while retaining the advantageous features of the QALY.

CONCLUSIONS

Proposals to adopt health technology assessment (HTA) to support value-based pricing of prescription drugs in the US have faced pushback over the use of the QALY. There is no single "right" outcome measure, and the criticisms of QALYs apply to other outcome measures used to evaluate health. The measures identified have different features and strengths, which may be appropriate for specific decision making goals, but the QALY remains the best option for decision making that requires comparisons of the overall societal value of health gains.

Assessing the Quality and Impact of eHealth Tools: Systematic Literature Review and Narrative Synthesis

BACKGROUND

Technological advancements have opened the path for many technology providers to easily develop and introduce eHealth tools to the public. The use of these tools is increasingly recognized as a critical quality driver in health care; however, choosing a quality tool from the myriad of tools available for a specific health need does not come without challenges.

OBJECTIVE

This review aimed to systematically investigate the literature to understand the different approaches and criteria used to assess the quality and impact of eHealth tools by considering sociotechnical factors (from technical, social, and organizational perspectives).

METHODS

A structured search was completed following the participants, intervention, comparators, and outcomes framework. We searched the PubMed, Cochrane, Web of Science, Scopus, and ProQuest databases for studies published between January 2012 and January 2022 in English, which yielded 675 results, of which 40 (5.9%) studies met the inclusion criteria. The PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines and the Cochrane Handbook for Systematic Reviews of Interventions were followed to ensure a systematic process. Extracted data were analyzed using NVivo (QSR International), with a thematic analysis and narrative synthesis of emergent themes.

RESULTS

Similar measures from the different papers, frameworks, and initiatives were aggregated into 36 unique criteria grouped into 13 clusters. Using the sociotechnical approach, we classified the relevant criteria into technical, social, and organizational assessment criteria. Technical assessment criteria were grouped into 5 clusters: technical aspects, functionality, content, data management, and design. Social assessment criteria were grouped into 4 clusters: human centricity, health outcomes, visible popularity metrics, and social aspects. Organizational assessment criteria were grouped into 4 clusters: sustainability and scalability, health care organization, health care context, and developer.

CONCLUSIONS

This review builds on the growing body of research that investigates the criteria used to assess the quality and impact of eHealth tools and highlights the complexity and challenges facing these initiatives. It demonstrates that there is no single framework that is used uniformly to assess the quality and impact of eHealth tools. It also highlights the need for a more comprehensive approach that balances the social, organizational, and technical assessment criteria in a way that reflects the complexity and interdependence of the health care ecosystem and is aligned with the factors affecting users' adoption to ensure uptake and adherence in the long term.

The added value of applying a disinvestment approach to the process of health technology assessment in Italy

OBJECTIVES

The objective of the present policy analysis was to understand how a disinvestment approach to the process of health technology assessment (HTA), applied to the field of medical devices, might help Italian policymakers to properly spend the resources in healthcare.

METHODS

Previous international and national experiences in disinvestment for medical devices were reviewed. Precious insights for the rational expenditure of the resources were derived by assessing the evidence available.

RESULTS

The disinvestment of ineffective or inappropriate technologies or interventions with an inadequate value-for-money ratio has become a growing priority for National Health Systems. Different international disinvestment experiences of medical devices were identified and described through a rapid review. Although most of them have a strong theoretical framework, their practical application remains difficult. In Italy, there are no examples of large and complex HTA-based disinvestment practices, but their importance is becoming increasingly acknowledged, especially given the need to prioritize the funds provided by Recovery and Resilience Plan.

CONCLUSIONS

Anchoring decisions on health technologies without reassessing the current technological landscape through a robust HTA model might expose to the risk of not ensuring the best employment of the resources available. Thus, it is necessary to develop a strong HTA ecosystem in Italy through adequate consultation with stakeholders to enable a data-driven and evidence-based prioritization of resources toward choices characterized by high value for both patients and society as a whole.

Technical performance of a dual-energy CT system with a novel deep-learning based reconstruction process: Evaluation using an abdomen protocol

BACKGROUND

A new tube voltage-switching dual-energy (DE) CT system using a novel deep-learning based reconstruction process has been introduced. Characterizing the performance of this DE approach can help demonstrate its benefits and potential drawbacks.

PURPOSE

To evaluate the technical performance of a novel DECT system and compare it to that of standard single-kV CT and a rotate/rotate DECT, for abdominal imaging.

METHODS

DE and single-kV images of four different phantoms were acquired on a kV-switching DECT system, and on a rotate/rotate DECT. The dose for the acquisitions of each phantom was set to that selected for the kV-switching DE mode by the automatic tube current modulation (ATCM) at manufacturer-recommended settings. The dose that the ATCM would have selected in single-kV mode was also recorded. Virtual monochromatic images (VMIs) from 40 to 130 keV, as well as iodine maps, were reconstructed from the DE data. Single-kV images, acquired at 120 kV, were reconstructed using body hybrid iterative reconstruction. All reconstructions were made at 0.5 mm section thickness. Task transfer functions (TTFs) were determined for a Teflon and LDPE rod. Noise magnitude (SD), and noise power spectrum (NPS) were calculated using 240 and 320 mm diameter water phantoms. Iodine quantification accuracy and contrast-to-noise ratios (CNRs) relative to water for 2, 5, 10, and 15 mg I/ml were determined using a multi-energy CT (MECT) phantom. Low-contrast visibility was determined and the presence of beam-hardening artifacts and inhomogeneities were evaluated.

RESULTS

The TTFs of the kV-switching DE VMIs were higher than that of the single-kV images for Teflon (20% TTF: 6.8 lp/cm at 40 keV, 6.2 lp/cm for single-kV), while for LDPE the DE TTFs at 70 keV and above were equivalent or higher than the single-kV TTF. All TTFs of the kV-switching DECT were higher than for the rotate/rotate DECT. The SD was lowest in the 70 keV VMI (12.0 HU), which was lower than that of single-kV (18.3 HU). The average NPS frequency varied between 2.3 lp/cm and 4.2 lp/cm for the kV-switching VMIs and was 2.2 lp/cm for single-kV. The error in iodine quantification was at maximum 1 mg I/ml (at 5 mg I/ml). The highest CNR for all iodine concentrations was at 60 keV, 2.5 times higher than the CNR for single-kV. At 70-90 keV, the number of visible low contrast objects was comparable to that in single-kV, while other VMIs showed fewer objects. At manufacturer-recommended ATCM settings, the CTDI_vol for the DE acquisitions of the water and MECT phantoms were 12.6 and 15.4 mGy, respectively, and higher than that for single-kV. The 70 keV VMI had less severe beam hardening artifacts than single-kV images. Hyper- and hypo-dense blotches may appear in VMIs when object attenuation exceeds manufacturer recommended limits.

CONCLUSIONS

At manufacturer-recommended ATCM settings for abdominal imaging, this DE implementation results in higher CTDI_vol compared to single-kV acquisitions. However, it can create sharper, lower noise VMIs with up to 2.5 times higher iodine CNR compared to single-kV images acquired at the same dose.

Measuring adherence to inhaled control medication in patients with asthma: Comparison among an asthma app, patient self-report and physician assessment

BACKGROUND

Previous studies have demonstrated the feasibility of using an asthma app to support medication management and adherence but failed to compare with other measures currently used in clinical practice. However, in a clinical setting, any additional adherence measurement must be evaluated in the context of both the patient and physician perspectives so that it can also help improve the process of shared decision making. Thus, we aimed to compare different measures of adherence to asthma control inhalers in clinical practice, namely through an app, patient self-report and physician assessment.

METHODS

This study is a secondary analysis of three prospective multicentre observational studies with patients (≥13 years old) with persistent asthma recruited from 61 primary and secondary care centres in Portugal. Patients were invited to use the InspirerMundi app and register their inhaled medication. Adherence was measured by the app as the number of doses taken divided by the number of doses scheduled each day and two time points were considered for analysis: 1-week and 1-month. At baseline, patients and physicians independently assessed adherence to asthma control inhalers during the previous week using a Visual Analogue Scale (VAS 0-100).

RESULTS

A total of 193 patients (72% female; median [P25-P75] age 28 [19-41] years old) were included in the analysis. Adherence measured by the app was lower (1 week: 31 [0-71]%; 1 month: 18 [0-48]%) than patient self-report (80 [60-95]) and physician assessment (82 [51-94]) (p < 0.001). A negligible non-significant correlation was found between the app and subjective measurements (ρ 0.118-0.156, p > 0.05). There was a moderate correlation between patient self-report and physician assessment (ρ = 0.596, p < 0.001).

CONCLUSIONS

Adherence measured by the app was lower than that reported by the patient or the physician. This was expected as objective measurements are commonly lower than subjective evaluations, which tend to overestimate adherence. Nevertheless, the low adherence measured by the app may also be influenced by the use of the app itself and this needs to be considered in future studies.

[Evidence synthesis for COVID-19 interventions: update reports from Argentina's National Commission for Health Technology AssessmentSíntese de evidências para intervenções em COVID-19: relatórios de atualização da Comissão Nacional de Avaliação de Tecnologias em Saúde da Argentina]

This report presents the work done on the design, publication, and impact of updates on evidence-based COVID-19 interventions, in order to support decision-making with updated evidence syntheses based on living systematic reviews of therapeutic interventions. To this end, a specific working group was created within the National Commission for Health Technology Assessment (CONETEC) of the Ministry of Health of Argentina, in collaboration with the Pan American Health Organization (PAHO). A methodology was designed to develop and publish assessment documents aimed at supporting decision-making. These update reports were based on the exploration of three areas: health effects, feasibility of implementation, and evidence-based recommendations. A color-coded system was used to present the conclusions according to the balance between their positive and negative effects in different clinical scenarios, in order to improve their interpretation and implementation. In 2021, 16 evidence synthesis reports were published (13 original reports and three full updates). These were downloaded many times from the CONETEC website and the Regional Database of Health Technology Assessment Reports of the Americas (BRISA), highlighting the need for robust, up-to-date, reliable evidence summaries adapted for implementation in the country's health system. Other challenges include constant updating of information, appropriate dissemination, and sustained rigorous preparation of the reports.

Does an Adjusted Kinematic Model Predict the Relative Eccentric Force During Nordic Curl?

This study aimed to assess the combination of video-based kinematic variables adjusted by intrinsic covariates to predict the relative eccentric force (RelF) during the Nordic curl. The participants (n = 21) performed Nordic curls (3 trials; 3-min rest) on a device measuring the eccentric force. The peaks were normalized by body weight. Kinovea software was used to track angular and linear velocity and acceleration from recorded videos. Two prediction models with multiple linear regression equations associated kinematic, anthropometric, and age variables to adjust the actual RelF. The equations obtained the predicted RelF. The actual RelF was inversely correlated with height (r = -.52), tangential (r = -.50) and centripetal accelerations (r = -.715), and angular velocity (r = -.70). The best prediction models combined angular velocity with age (F2,18 = 15.1, P = .001, r = .792, r2 = .627) and with height (F2,18 = 14.5, P = .001, r = .785, r2 = .616). No differences were observed between actual and predicted values (P = .993-.994), with good levels of agreement and consistency (intraclass correlation coefficient = .77-.78; Cronbach α = .86-.87). Bland-Altman results showed high levels of agreement and low biases. The standard error of measurement and minimal detectable change ranges were 0.46 to 0.49 N/kg and 1.28 to 1.36 N/kg, respectively. Also, the percentage of standard error of measurement was below 10% (7.92%-8.35%). The coefficient of variation analysis returned a 14.54% and 15.13% for each model, respectively. Kinematic analysis offers portability and low cost to current expensive or technical impaired dynamometry-based techniques to assess the RelF.

Incorporating environmental and sustainability considerations into health technology assessment and clinical and public health guidelines: a scoping review

Healthcare systems account for a substantial proportion of global carbon emissions and contribute to wider environmental degradation. This scoping review aimed to summarize the evidence currently available on incorporation of environmental and sustainability considerations into health technology assessments (HTAs) and guidelines to support the National In stitute for Health and Care Excellence and analogous bodies in other jurisdictions developing theirown methods and processes. Overall, 7,653 articles were identified, of which 24 were included in this review and split into three key areas - HTA (10 studies), healthcare guidelines (4 studies), and food and dietary guidelines (10 studies). Methodological reviews discussed the pros and cons of different approaches to integrate environmental considerations into HTAs, including adjustments to conventional cost-utility analysis (CUA), cost-benefit analysis, and multicriteria decision analysis. The case studies illustrated the challenges of putting this into practice, such as lack of disaggregated data to evaluate the impact of single technologies and difficulty in conducting thorough life cycle assessments that consider the full environmental effects. Evidence was scant on the incorporation of environmental impacts in clinical practice and public health guidelines. Food and dietary guidelines used adapted CUA based on life cycle assessments, simulation modeling, and qualitative judgments made by expert panels. There is uncertainty on how HTA and guideline committees will handle trade-offs between health and environment, especially when balancing environmental harms that fall largely on society with health benefits for individuals. Further research is warranted to enable integration of environmental considerations into HTA and clinical and public health guidelines.

WtsWrng Interim Comparative Effectiveness Evaluation and Description of the Challenges to Develop, Assess, and Introduce This Novel Digital Application in a Traditional Health System

Science and technology have evolved quickly during the two decades of the 21st century, but healthcare systems are grounded in last century's structure and processes. Changes in the way health care is provided are demanded; digital transformation is a key driver making healthcare systems more accessible, agile, efficient, and citizen-centered. Nevertheless, the way healthcare systems function challenges the development (Innovation + Development and regulatory requirements), assessment (methodological guidance weaknesses), and adoption of digital applications (DAs). WtsWrng (WW), an innovative DA which uses images to interact with citizens for symptom triage and monitoring, is used as an example to show the challenges faced in its development and clinical validation and how these are being overcome. To prove WW's value from inception, novel approaches for evidence generation that allows for an agile and patient-centered development have been applied. Early scientific advice from NICE (UK) was sought for study design, an iterative development and interim analysis was performed, and different statistical parameters (Kappa, B statistic) were explored to face development and assessment challenges. WW triage accuracy at cutoff time ranged from 0.62 to 0.94 for the most frequent symptoms attending the Emergency Department (ED), with the observed concordance for the 12 most frequent diagnostics at hospital discharge fluctuating between 0.4 to 0.97; 8 of the diagnostics had a concordance greater than 0.8. This experience should provoke reflective thinking for DA developers, digital health scientists, regulators, health technology assessors, and payers.

Effective and Efficient Delivery of Genome-Based Testing-What Conditions Are Necessary for Health System Readiness?

Health systems internationally must prepare for a future of genetic/genomic testing to inform healthcare decision-making while creating research opportunities. High functioning testing services will require additional considerations and health system conditions beyond traditional diagnostic testing. Based on a literature review of good practices, key informant interviews, and expert discussion, this article attempts to synthesize what conditions are necessary, and what good practice may look like. It is intended to aid policymakers and others designing future systems of genome-based care and care prevention. These conditions include creating communities of practice and healthcare system networks; resource planning; across-region informatics; having a clear entry/exit point for innovation; evaluative function(s); concentrated or coordinated service models; mechanisms for awareness and care navigation; integrating innovation and healthcare delivery functions; and revisiting approaches to financing, education and training, regulation, and data privacy and security. The list of conditions we propose was developed with an emphasis on describing conditions that would be applicable to any healthcare system, regardless of capacity, organizational structure, financing, population characteristics, standardization of care processes, or underlying culture.

A systematic review of the early dialogue frameworks used within health technology assessment and their actual adoption from HTA agencies

Introduction

Early advice in the process of developing health technologies allows manufacturers to plan their production and transfer to health care systems more accurately. This review aims to describe frameworks used within HTA and their current use by HTA Agencies.

Material and methods

We carried out a systematic literature review in Pubmed, Embase, Scopus, and WoS, including all references published in Spanish and English. This was last updated in March 2022. We extracted all available information regarding the organizations involved, services offered, types of technology, collaborators involved, fees, output and impact. Websites of several HTA organizations and Google were also searched in order to update and complete the information obtained from this generic search.

Results

Five-hundred and forty one articles were identified and screened, of which 26 met the eligibility criteria and were selected. Seven of them were non-systematic reviews that described two or more HTA organizations. Ten studies were focused on the advice offered by individual organizations, and eight described the EMA and EUnetHTA parallel or joint advice. We found variations in the technology assessed, services offered, stage of development and costs for advisory services.

Conclusions

Early and scientific advice would help manufacturers focus their product development on what is needed for the management of specific diseases. Most of the examples or services found refer to drugs as well as to some medical devices and diagnostics. A common definition of the type of advice that could be offered for different health technologies by HTA bodies to ascertain health care systems and manufacturers' needs, in addition to the timeline in which that advice needs to be given, would help HTA bodies provide the right support at the right time.

Systematic review registration

https://www.crd.york.ac.uk/prospero/display_record.php?ID=CRD42020219401, PROSPERO CRD42020219401.

Assessing the Added Value of Vital Signs Extracted from Electronic Health Records in Healthcare Risk Adjustment Models

Purpose

Patient vital signs are related to specific health risks and outcomes but are underutilized in the prediction of health-care utilization and cost. To measure the added value of electronic health record (EHR) extracted Body Mass Index (BMI) and blood pressure (BP) values in improving healthcare risk and utilization predictions.

Patients and Methods

A sample of 12,820 adult outpatients from the Johns Hopkins Health System (JHHS) were identified between 2016 and 2017, having high data quality and recorded values for BMI and BP. We evaluated the added value of BMI and BP in predicting health-care utilization and cost through a retrospective cohort design. BMI, mean arterial pressure (MAP), systolic and diastolic BPs were summarized as annual aggregated values. Concurrent annual BMI and MAP changes were quantified as the difference between maximum and minimum recorded values. Model performance estimates consisted of repeated 10-fold cross validation, compared to base model point estimates for demographic and diagnostic, coded events: (1) patient age and sex, (2) age, sex, and the Charlson weighted index, (3) age, sex and the Johns Hopkins ACG system’s DxPM risk score.

Results

Both categorical BMI and BP were progressively indicative of disease comorbidity, but not uniformly related to health-care utilization or cost. Annual change in BMI and MAP improved predictions for most concurrent year outcomes when compared to base models.

Conclusion

When a healthcare system lacks relevant diagnostic or risk assessment information for a patient, vital signs may be useful for a simple estimation of disease risk, cost and utilization.

Lessons learned from an enterprise-wide clinical datathon

In 2020, Baylor College of Medicine held a datathon to inform potential users of a new data warehouse, allow users to address clinical questions, identify warehouse capabilities and limitations, foster collaborations, and engage trainees. Senior faculty selected proposals based on feasibility and impact. Selectees worked with Information Technology for 2 months and presented findings. A survey of participants showed diverse levels of experience, high perceived value of the datathon, high rates of collaboration, and significant increases in knowledge. A datathon can promote familiarity with a new data warehouse, guide data warehouse improvement, and promote collaboration.

Development and Assessment of an Integrated Anatomy Mobile App

INTRODUCTION

Curricular hours for anatomical sub-disciplines (gross anatomy, embryology, histology, and neuroanatomy) continue to decline, while medical schools are simultaneously transitioning to systems-based, vertically integrated curricula. This requires students to learn and integrate all basic science content for a learning block prior to the summative assessment. Currently, no educational technology resource exists that integrates the four anatomical sub-disciplines into a single resource to supplement integrated curricula. The objective of this study was to assess a novel integrated anatomical sciences mobile app for medical students.

MATERIALS AND METHODS

The 4natomy mobile app was developed to integrate the four sub-disciplines for a single topic, the spinal cord. The app was distributed to first-year medical students during the neurological disorders learning. Following the learning block, assessment of the student acceptance and experience with the app was conducted through a technology acceptance model (TAM) framework survey.

RESULTS

The results indicated that students found the app to be useful (p < 0.001) and easy to use (p < 0.05), predicting continued future usage of the app. Students requested expanded anatomy content for the entire learning block, as well as more clinical correlations, videos, and animations.

CONCLUSIONS

The integrated anatomy mobile app developed in this study was useful and easy to use, indicating continued use within an integrated medical curriculum. This was the first study to utilize the TAM as a conceptual framework for technology assessment in medical education, suggesting that future studies that develop new technologies should adapt the TAM for user testing. This article is protected by copyright. All rights reserved.

The Efficacy of Health Information Technology in Supporting Health Equity for Black and Hispanic Patients With Chronic Diseases: Systematic Review

Background

Racial inequity persists for chronic disease outcomes amid the proliferation of health information technology (HIT) designed to support patients in following recommended chronic disease self-management behaviors (ie, medication behavior, physical activity, and dietary behavior and attending follow-up appointments). Numerous interventions that use consumer-oriented HIT to support self-management have been evaluated, and some of the related literature has focused on racial minorities who experience disparate chronic disease outcomes. However, little is known about the efficacy of these interventions.

Objective

This study aims to conduct a systematic review of the literature that describes the efficacy of consumer-oriented HIT interventions designed to support self-management involving African American and Hispanic patients with chronic diseases.

Methods

We followed an a priori protocol using the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses)-Equity 2012 Extension guidelines for systematic reviews that focus on health equity. Themes of interest included the inclusion and exclusion criteria. We identified 7 electronic databases, created search strings, and conducted the searches. We initially screened results based on titles and abstracts and then performed full-text screening. We then resolved conflicts and extracted relevant data from the included articles.

Results

In total, there were 27 included articles. The mean sample size was 640 (SD 209.5), and 52% (14/27) of the articles focused on African American participants, 15% (4/27) of the articles focused on Hispanic participants, and 33% (9/27) included both. Most articles addressed 3 of the 4 self-management behaviors: medication (17/27, 63%), physical activity (17/27, 63%), and diet (16/27, 59%). Only 15% (4/27) of the studies focused on follow-up appointment attendance. All the articles investigated HIT for use at home, whereas 7% (2/27) included use in the hospital.

Conclusions

This study addresses a key gap in research that has not sufficiently examined what technology designs and capabilities may be effective for underserved populations in promoting health behavior in concordance with recommendations.

From Digital Health to Digital Well-being: Systematic Scoping Review

Background

Digital health refers to the proper use of technology for improving the health and well-being of people and enhancing the care of patients through the intelligent processing of clinical and genetic data. Despite increasing interest in well-being in both health care and technology, there is no clear understanding of what constitutes well-being, which leads to uncertainty in how to create well-being through digital health. In an effort to clarify this uncertainty, Brey developed a framework to define problems in technology for well-being using the following four categories: epistemological problem, scope problem, specification problem, and aggregation problem.

Objective

This systematic scoping review aims to gain insights into how to define and address well-being in digital health.

Methods

We followed the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews) checklist. Papers were identified from 6 databases and included if they addressed the design or evaluation of digital health and reported the enhancement of patient well-being as their purpose. These papers were divided into design and evaluation papers. We studied how the 4 problems in technology for well-being are considered per paper.

Results

A total of 117 studies were eligible for analysis (n=46, 39.3% design papers and n=71, 60.7% evaluation papers). For the epistemological problem, the thematic analysis resulted in various definitions of well-being, which were grouped into the following seven values: healthy body, functional me, healthy mind, happy me, social me, self-managing me, and external conditions. Design papers mostly considered well-being as healthy body and self-managing me, whereas evaluation papers considered the values of healthy mind and happy me. Users were rarely involved in defining well-being. For the scope problem, patients with chronic care needs were commonly considered as the main users. Design papers also regularly involved other users, such as caregivers and relatives. These users were often not involved in evaluation papers. For the specification problem, most design and evaluation papers focused on the provision of care support through a digital platform. Design papers used numerous design methods, whereas evaluation papers mostly considered pre-post measurements and randomized controlled trials. For the aggregation problem, value conflicts were rarely described.

Conclusions

Current practice has found pragmatic ways of circumventing or dealing with the problems of digital health for well-being. Major differences exist between the design and evaluation of digital health, particularly regarding their conceptualization of well-being and the types of users studied. In addition, we found that current methodologies for designing and evaluating digital health can be improved. For optimal digital health for well-being, multidisciplinary collaborations that move beyond the common dichotomy of design and evaluation are needed.

Technologies for Medication Adherence Monitoring and Technology Assessment Criteria: Narrative Review

BACKGROUND

Accurate measurement and monitoring of patient medication adherence is a global challenge because of the absence of gold standard methods for adherence measurement. Recent attention has been directed toward the adoption of technologies for medication adherence monitoring, as they provide the opportunity for continuous tracking of individual medication adherence behavior. However, current medication adherence monitoring technologies vary according to their technical features and data capture methods, leading to differences in their respective advantages and limitations. Overall, appropriate criteria to guide the assessment of medication adherence monitoring technologies for optimal adoption and use are lacking.

OBJECTIVE

This study aims to provide a narrative review of current medication adherence monitoring technologies and propose a set of technology assessment criteria to support technology development and adoption.

METHODS

A literature search was conducted on PubMed, Scopus, CINAHL, and ProQuest Technology Collection (2010-present) using the combination of keywords medication adherence, measurement technology, and monitoring technology. The selection focused on studies related to medication adherence monitoring technology and its development and use. The technological features, data capture methods, and potential advantages and limitations of the identified technology applications were extracted. Methods for using data for adherence monitoring were also identified. Common recurring elements were synthesized as potential technology assessment criteria.

RESULTS

Of the 3865 articles retrieved, 98 (2.54%) were included in the final review, which reported a variety of technology applications for monitoring medication adherence, including electronic pill bottles or boxes, ingestible sensors, electronic medication management systems, blister pack technology, patient self-report technology, video-based technology, and motion sensor technology. Technical features varied by technology type, with common expectations for using these technologies to accurately monitor medication adherence and increase adoption in patients' daily lives owing to their unobtrusiveness and convenience of use. Most technologies were able to provide real-time monitoring of medication-taking behaviors but relied on proxy measures of medication adherence. Successful implementation of these technologies in clinical settings has rarely been reported. In all, 28 technology assessment criteria were identified and organized into the following five categories: development information, technology features, adherence to data collection and management, feasibility and implementation, and acceptability and usability.

CONCLUSIONS

This narrative review summarizes the technical features, data capture methods, and various advantages and limitations of medication adherence monitoring technology reported in the literature and the proposed criteria for assessing medication adherence monitoring technologies. This collection of assessment criteria can be a useful tool to guide the development and selection of relevant technologies, facilitating the optimal adoption and effective use of technology to improve medication adherence outcomes. Future studies are needed to further validate the medication adherence monitoring technology assessment criteria and construct an appropriate technology assessment framework.

Test-Retest of a Novel Wii Board-Based Device to Assess Eccentric Knee Flexor Strength During the Nordic Hamstring Exercise

This study aimed to assess the test-retest reliability of a Wii board-based device to assess the eccentric knee strength. Healthy participants (n = 20, 22.7 [3.4] y, 1.71 [0.09] m, 69 [13] kg) performed 2 assessments-days 1 and 2-of the Nordic hamstring exercise (3 trials per day, 3 min of rest between trials, and 48 h between trials) on a padded board with an attached Wii Balance Board (WBB). A ratchet inelastic strap made the contact between the participant's distal aspect of both legs and the inverted upper surface of the WBB. The means among 3 trials were used to extract the absolute strength and the left and the right limb strengths. No between-session differences were found (P range = .691-.981). The intraclass correlation coefficient range showed excellent results (.905-.926), as the Cronbach α test (above .94). The correlation was high (r > .91; .820 < r2 < .862). The Bland-Altman analysis returned high levels of agreement. The standard error of measurement ranged from 5.56 to 11.07 N and the minimal detectable change from 15.42 to 30.68 N. The percentage of standard error of measurement values were 2.95%, 3.74%, 2.88%, respectively, for absolute strength, right limb strength, and left limb strength. The adapted system showed an excellent cost-benefit relationship with optimal test-retest reliability. The findings suggest that the adapted system, using the WBB, is a reliable method for measuring the eccentric knee strength.

Value of multi-slice spiral computerized tomography for diagnosis of synchronous colorectal carcinoma: a retrospective study

Objective

To compare the accuracy of multi-slice spiral computerized tomography (MSCT) with colonoscopy for diagnosing synchronous colorectal carcinoma (SCC).

Methods

We retrospectively analyzed all consecutive patients admitted to our institution with colorectal carcinoma between 19 September 2014 and 31 January 2020. Data on SCC patients who had undergone MSCT and colonoscopy were analyzed. Information on tumor location, tumor size, missed diagnosis by MSCT or colonoscopy, T stage, pathological type, and reasons for missed diagnosis was recorded and used to assess the diagnostic accuracies of MSCT and colonoscopy.

Results

Twenty-three cases met the inclusion criteria. MSCT plus colonoscopy had a significantly higher diagnostic accuracy (93.5%) than colonoscopy alone. There were significant differences in missed diagnosis rates of proximal cancer (34.8%) and distal cancer (4.3%) by colonoscopy. For MSCT, the missed diagnosis rate for tumors with a median long diameter of 1.25 cm (interquartile range 0.80, 1.50) was significantly lower than that for larger tumors (long diameter 4.00 cm; 3.00, 6.00).

Conclusions

MSCT is a valuable diagnostic tool for SCC that can effectively minimize the missed diagnosis rate of primary tumors when combined with colonoscopy.

Monitoring Adherence to Asthma Inhalers Using the InspirerMundi App: Analysis of Real-World, Medium-Term Feasibility Studies

Background: Poor medication adherence is a major challenge in asthma and objective assessment of inhaler adherence is needed. InspirerMundi app aims to monitor inhaler adherence while turning it into a positive experience through gamification and social support.

Objective: We assessed the medium-term feasibility of the InspirerMundi app to monitor inhaler adherence in real-world patients with persistent asthma (treated with daily inhaled medication). In addition, we attempted to identify the characteristics of the patients related to higher app use.

Methods: Two real-world multicenter observational studies, with one initial face-to-face visit and a 4-month telephone interview, were conducted in 29 secondary care centers from Portugal. During an initial face-to-face visit, patients were invited to use the app daily to register their asthma medication intakes. A scheduled intake was considered taken when patients took a photo of the medication (inhaler, blister, or others) using the image-based medication detection tool. Medication adherence was calculated as the number of doses taken as a percentage of the number scheduled. Interacting with the app ≥30 days was used as the cut-off for higher app use.

Results: A total of 114 patients {median 20 [percentile 25 to percentile 75 (P25–P75) 16–36] years, 62% adults} were invited, 107 (94%) installed the app and 83 (73%) completed the 4-month interview. Patients interacted with the app for a median of 18 [3–45] days, translated on a median use rate of 15 [3–38]%. Median inhaler adherence assessed through the app was 34 [4–73]% when considering all scheduled inhalations for the study period. Inhaler adherence assessed was not significantly correlated with self-reported estimates. Median adherence for oral and other medication was 41 [6–83]% and 43 [3–73]%, respectively. Patients with higher app use were slightly older (p = 0.012), more frequently taking medication for other health conditions (p = 0.040), and more frequently prescribed long-acting muscarinic antagonists (LAMA, p = 0.024). After 4 months, Control of Allergic Rhinitis and Asthma Test (CARAT) scores improved (p < 0.001), but no differences between patients interacting with the app for 30 days or less were seen.

Conclusions: The InspirerMundi app was feasible to monitor inhaler adherence in patients with persistent asthma. The persistent use of this mHealth technology varies widely. A better understanding of characteristics related to higher app use is still needed before effectiveness studies are undertaken.

Cost-effectiveness of check of medication appropriateness: methodological approach

Background Adverse drug events following inappropriate prescribing in the hospital cause a substantial and avoidable medical and economic burden to hospitals, payers and patients alike. A clinical rule-based, pharmacist-led medication-review service, the 'Check of Medication Appropriateness' (CMA) was implemented in the University Hospitals Leuven. The CMA is shown to be effective in reducing potentially inappropriate prescriptions. Aim This study investigated whether this centralised clinical pharmacy service is cost-effective. Method We performed a cost-effectiveness analysis of three clinical rules of the CMA, targeting adverse drug events at three levels of severity: A) persistent opioid-induced constipation, B) ketorolac-induced gastrointestinal bleeding and C) drug-induced Torsade de Pointes. A decision tree was developed for each clinical rule. Both intervention costs as well as total costs associated with the occurrence of an adverse drug event were considered. The outcomes were reported in the form of an incremental cost-effectiveness ratio, expressed as an incremental cost per adverse drug event avoided. Results Applying clinical rules to avoid persistent opioid-induced constipation and ketorolac-induced gastrointestinal bleeding were cost-saving. Implementation of a medication check to avoid drug-induced Torsade de Pointes costed €8,846 per Torsade de Pointes avoided. Conclusion Our study provides strong indications that the CMA is worth its investment for clinical rules targeting (very) common adverse drug events, that can be avoided with limited expenses. Further research is required to assess the full CMA. The proposed model may be useful to perform cost-effectiveness analyses of other centralised clinical pharmacy services targeting inappropriate prescribing, at the level of individual adverse drug events.

Validity and reliability of a smartphone goniometer application for measuring hip range of motions

BACKGROUND

Mobile applications which are designed to assess the range of motion (ROM) are widely used.

OBJECTIVE

The aim of this cross-sectional observational study was to determine the inter-observer and intra-observer reliability of a smartphone application "PT Goniometer" (PTG) and determine the correlation between PTG and universal goniometer (UG) regarding active ROMs of the hip in healthy participants.

METHODS

Thirty-four healthy young participants were included in the study. Two physiotherapists performed active hip flexion, abduction, internal rotation and external rotation ROM measurements of dominant legs of the participants by using PTG and UG. Intraclass correlation coefficients (ICC) were calculated to determine the intra-observer and inter-observer reliability. Level of correlations between PTG and UG were used to establish concurrent validity of PTG.

RESULTS

The PTG demonstrated excellent inter-observer and intra-observer reliability (ICC > 0.90) for all measured hip movements. The minimum detectable change (MDC95) was ranged from 3.29° to 5.1° for the intra-observer reliability, and from 2.55° to 3.21° for the inter-observer reliability. Additionally, the concurrent validity was found excellent (r = 0.91-0.93).

CONCLUSION

The results of the present study suggest that PTG is a valid and reliable mobile technology for measuring hip ROMs.

Optimizing the delivery of genetic and advanced diagnostic testing in the province of Ontario: challenges and implications for laboratory technology assessment and management in decentralized healthcare systems

AIMS

The Canadian province of Ontario provides full coverage for its residents (pop.14.8 M) for hospital-based diagnostic testing. Historical governance of the healthcare system and a legacy scheme of health technology assessment (HTA) and financing has led to a suboptimal approach of adopting advanced diagnostic technology (i.e. protein expression, cytogenetic, and molecular/genetic) for guiding therapeutic decisions. The aim of this research is to explore systemic barriers and provide guidance to improve patient and care provider experiences by reducing delays and inequity of access to testing, while benefitting laboratory innovators and maximizing system efficiency.

MATERIALS AND METHODS

A mixed-methods approach including literature review, semi-structured interviews, and a multi-stakeholder forum involving patient representatives (n = 1), laboratory leaders (n = 6), physicians (n = 5), Ministry personnel (n = 4), administrators (n = 3), extra-provincial experts, and researchers (n = 7), as well as pharmaceutical (n = 5) and diagnostic companies (n = 2). The forum considered evidence of good practices in adoption, implementation, and financing laboratory services and identified barriers as well as feasible options for improving advanced diagnostic testing in Ontario.

RESULTS

Overarching challenges identified included: barriers to define what is needed; need for a clear approach to adoption; and the need for more oversight and coordination. Recommendations to address these included a shift to an anticipatory system of test adoption, creating a fit-for-purpose system of health technology management that consolidates existing evaluation processes, and modernizing the governance and financing of testing so that it is managed at a care-delivery level.

CONCLUSIONS

The proposals for change in Ontario highlight the role that HTA, governance, and financing of health technology play along the continuum of a health technology life cycle within a healthcare system where decision-making is highly decentralized. Resource availability and capacity were not a concern - instead, solutions require higher levels of coordination and system integration along with innovative approaches to HTA.