The Biomarker Toolkit - an evidence-based guideline to predict cancer biomarker success and guide development

BACKGROUND

An increased number of resources are allocated on cancer biomarker discovery, but very few of these biomarkers are clinically adopted. To bridge the gap between Biomarker discovery and clinical use, we aim to generate the Biomarker Toolkit, a tool designed to identify clinically promising biomarkers and promote successful biomarker translation.

METHODS

All features associated with a clinically useful biomarker were identified using mixed-methodology, including systematic literature search, semi-structured interviews, and an online two-stage Delphi-Survey. Validation of the checklist was achieved by independent systematic literature searches using keywords/subheadings related to clinically and non-clinically utilised breast and colorectal cancer biomarkers. Composite aggregated scores were generated for each selected publication based on the presence/absence of an attribute listed in the Biomarker Toolkit checklist.

RESULTS

Systematic literature search identified 129 attributes associated with a clinically useful biomarker. These were grouped in four main categories including: rationale, clinical utility, analytical validity, and clinical validity. This checklist was subsequently developed using semi-structured interviews with biomarker experts (n=34); and 88.23% agreement was achieved regarding the identified attributes, via the Delphi survey (consensus level:75%, n=51). Quantitative validation was completed using clinically and non-clinically implemented breast and colorectal cancer biomarkers. Cox-regression analysis suggested that total score is a significant driver of biomarker success in both cancer types (BC: p>0.0001, 95.0% CI: 0.869-0.935, CRC: p>0.0001, 95.0% CI: 0.918-0.954).

CONCLUSIONS

This novel study generated a validated checklist with literature-reported attributes linked with successful biomarker implementation. Ultimately, the application of this toolkit can be used to detect biomarkers with the highest clinical potential and shape how biomarker studies are designed/performed.

Beyond accuracy: leveraging ASSURED criteria for field evaluation of point-of-care tests for food animal diseases

The growing availability of point-of-care tests (POCTs) for food-animal diseases offers opportunities for timely diagnosis, facilitating the efficient implementation of control measures. However, field assessment of new POCTs are yet to be standardized. This paper discusses the opportunity of expanding the current approach for the evaluation and validation of POCTs in food animal disease diagnosis, highlighting the limitations of traditional practice that primarily relies on estimating diagnostic accuracy (sensitivity and specificity). Here, the use of a protocol referred to as FIT-REASSURED, a modified framework combining the ASSURED and REASSURED criteria, is proposed to comprehensively assess POCTs. FIT-REASSURED encompasses key criteria such as fitness for purpose, real-time connectivity, ease of specimen collection, affordability, sensitivity, specificity, user-friendliness, rapidity and robustness, equipment-free operation, and deliverability. By incorporating these attributes, FIT-REASSURED provides a customizable approach to assess the accuracy, affordability, and utility of POCTs. Through collaborative efforts among stakeholders, the implementation of a standardized scorecard based on these FIT-REASSURED criteria can improve the reliability and practicality of POCTs in food-animal health.

Understanding public procurement within the health sector: a priority in a post-COVID-19 world

Every year, over 250,000 public authorities in the European Union (EU) spend about 14% of GDP on the purchase of services, works and supplies. Many are in the health sector, a sector in which public authorities are the main buyers in many countries. When these purchases exceed threshold values, EU public procurement rules apply. Public procurement is increasingly being promoted as a tool for improving efficiency and contributing to better health outcomes, and as a policy lever for achieving other government goals, such as innovation, the development of small and medium-sized enterprises, sustainable green growth and social objectives like public health and greater inclusiveness. In this paper, we describe the challenges that arise within health care systems with public procurement and identify potential solutions to them. We examined the tendering of pharmaceuticals, health technology, and e-health. In each case we identify a series of challenges relating to the complexity of the procurement process, imbalances in power on either side of transactions and the role of procurement in promoting broader public policy objectives. Finally, we recommend several actions that could stimulate better procurement, and suggest a few areas where further EU cooperation can be pursued.

Quality Assurance for Hepatitis C Virus Point-of-Care Diagnostics in Sub-Saharan Africa

As part of a multinational study to evaluate the Bioline Hepatitis C virus (HCV) point-of-care (POC) testing in sub-Saharan Africa (SSA), this narrative review summarises regulatory standards and quality indicators for validating and approving HCV clinical diagnostics. In addition, this review also provides a summary of their diagnostic evaluations using the REASSURED criteria as the benchmark and its implications on the WHO HCV elimination goals 2030.

Non-empirical ISO 9241-210:2019-based usability evaluation using fuzzy inference analyser: a special issue on interactive social robots

Purpose

The objective of this research was to develop a new and highly accurate approach based on a fuzzy inference system (FIS) for the evaluation of usability based on ISO 9241-210:2019. In this study, a fully automated method of usability evaluation is used for interactive systems with a special look at interactive social robots.

Design/methodology/approach

Fuzzy logic uses as an intelligent computing technique to deal with uncertainty and incomplete data. Here this system is implemented using MATLAB fuzzy toolbox. This system attempted to quantify four criteria that correlate highly with ISO 9241-210:2019 criteria for the evaluation of interactive systems with maximum usability. Also, the system was evaluated with standard cases of computer interactive systems usability evaluation. The system did not need to train various data and to check the rules. Just small data were used to fine-tune the fuzzy sets. The results were compared against experimental usability evaluation with the statistical analysis.

Findings

It is found that there was a high strong linear relation between the FIS usability assessment and System Usability Scale (SUS) based usability assessment, and authors’ new method provides reliable results in the estimation of the usability.

Research limitations/implications

In human-robot systems, human performance plays an important role in the performance of social interactive systems. In the present study, the proposed system has considered all the necessary criteria for designing an interactive system with a high level of user because it is based on ISO 9241-210:2019.

Practical implications

For future research, the system could be expanded with the training of historical data and the production of rules through integrating FIS and neural networks.

Originality/value

This system considered all essential criteria for designing an interactive system with a high level of usability because it is based on ISO 9241-210:2019. For future research, the system could be expanded with the training of historical data and the production of rules through integrating FIS and neural networks.

Field Experiences with Handheld Diagnostic Devices to Triage Children under Five Presenting with Severe Febrile Illness in a District Hospital in DR Congo

As part of a field study (NCT04473768) in children presenting with severe febrile illness to Kisantu hospital (DR Congo), we retrospectively compiled user experiences (not performance) with handheld diagnostic devices assisting triage: tympanic thermometer, pulse oximeter (measuring heart rate, respiratory rate and oxygen saturation), hemoglobinometer and glucometer. Guidance documents for product selection were generic and scattered. Stock rupture, market withdrawal and unaffordable prices interfered with procurement. Challenges at implementation included environmental temperature, capillary blood sampling (antisepsis, order of multiple tests, filling microcuvettes and glucose strips), calibration (environmental temperature, cold chain) and liability-oriented communication with a manufacturer. Instructions for use were readable and contained symbol keys; two devices had printed French-language instructions. Shortcomings were poor integration of figures with text and distinct procedures for the oximeter and its sensor. Usability interview revealed appreciations for quick results, visibility of the display and memory function (three devices) but also problems of capillary blood sample transfer, cleaning, too long of a time-to-results (respiratory rate) and size, fitting and disposal of thermometer probes. Pictorial error messages were preferred over alphanumeric error codes but interpretation of symbols was poor. Alarm sounds of the oximeter caused unrest in children and caretakers perceived the device as associated with poor prognosis.

Comparison of the QuikRead go® point-of-care faecal immunochemical test for haemoglobin with the FOB Gold Wide® laboratory analyser to diagnose colorectal cancer in symptomatic patients

OBJECTIVES

Faecal immunochemical testing for haemoglobin (FIT) is used to triage patients for colonic investigations. Point-of-care (POC) FIT devices on the market have limited data for their diagnostic accuracy for colorectal cancer (CRC). Here, a POC FIT device is compared with a laboratory-based FIT system using patient collected samples from the urgent referral pathway for suspected CRC.

METHODS

A prospective, observational cohort study. Patients collected two samples from the same stool. These were measured by POC QuikRead go^® (Aidian Oy, Espoo, Finland) and laboratory-based FOB Gold Wide^® (Sentinel Diagnostics, Italy). Faecal haemoglobin <10 μg haemoglobin/g of faeces was considered as negative. At this threshold, comparisons between the two systems were made by calculating percentage agreement and Cohen's kappa coefficient. Proportion of negative results were compared with Chi squared testing. Sensitivities for CRC were calculated.

RESULTS

A total of 629 included patients provided paired samples for FIT to compare the QuikRead go^® and FOB Gold Wide^®. The agreement around the negative threshold was 83.0% and Cohen's kappa coefficient was 0.54. The QuikRead go^® reported 440/629 (70.0% of samples) as negative compared to 523/629 (83.1%) for the FOB Gold Wide^®, this difference was significant (p-value<0.001). Sensitivities for CRC detection by the QuikRead go^® and FOB Gold Wide^® were 92.9% (95% confidence interval (CI): 68.5-98.7%) and 100% (CI: 78.5-100%) respectively.

CONCLUSIONS

Both systems were accurate in their ability to detect CRC. Whilst good agreement around the negative threshold was identified, more patients would be triaged to further colonic investigation if using the QuikRead go^®.

Diagnostic accuracy of point of care faecal immunochemical testing using a portable high-speed quantitative analyser for diagnosis in 2-week wait patients

AIM

Laboratory-based faecal immunochemical testing (FIT) is the gold standard for detecting the presence of blood in the stool. The aim was to perform a diagnostic accuracy study to confirm if a point of care (POC) analyser for FIT could be safely used as an adjunct in the triage and management of 2-week wait (TWW) colorectal patients.

METHODS

The Point of Care Faecal Immunochemical Testing (POC FIT) prospective observational cohort study was designed for TWW patients at a regional referral centre. Between July 2019 and March 2020, patients were invited to perform and bring a FIT sample to clinic. FIT was completed within the clinic appointment using a POC quantitative analyser that has a 2-min processing time (QuikRead go®). Patients and clinicians were blinded to results within the clinic appointment. The results were compared with subsequent diagnostic outcomes. Faecal haemoglobin of <10 µg haemoglobin/g of faeces was considered a negative result. Sensitivities for colorectal cancer (CRC) and combined serious bowel disease (SBD) were calculated using this pre-determined cut-off.

RESULTS

A total of 553 patients were included for analytical comparison with diagnostic outcomes. There were 14 (2.5%) patients with CRC and 52 (9.4%) with SBD. The sensitivities for CRC and SBD were 92.9% (95% CI 68.5%-98.7%) and 76.9% (95% CI 63.9%-86.3%) respectively. 379 (68.5%) patients had a negative FIT result (negative predictive value for CRC was 99.7%).

CONCLUSIONS

This POC FIT device is a useful adjunct to better manage TWW patients. The high observed sensitivity for CRC offers opportunities, within a single consultation, for improved triage and rationalization of investigation for those with bowel symptoms.

Qualitative analysis of stakeholder interviews to identify the barriers and facilitators to the adoption of point-of-care diagnostic tests in the UK

OBJECTIVES

This study investigated the barriers and facilitators to the adoption of point-of-care tests (POCTs).

DESIGN

Qualitative study incorporating a constant comparative analysis of stakeholder responses to a series of interviews undertaken to design the Point-of-Care Key Evidence Tool.

SETTING

The study was conducted in relation to POCTs used in all aspects of healthcare.

PARTICIPANTS

Forty-three stakeholders were interviewed including clinicians (incorporating laboratory staff and members of trust POCT committees), commissioners, industry, regulators and patients.

RESULTS

Thematic analysis highlighted 32 barriers in six themes and 28 facilitators in eight themes to the adoption of POCTs. Six themes were common to both barriers and facilitators (clinical, cultural, evidence, design and quality assurance, financial and organisational) and two themes contained facilitators alone (patient factors and other (non-financial) resource use).

CONCLUSIONS

Findings from this study demonstrate the complex motivations of stakeholders in the adoption of POCT. Most themes were common to both barriers and facilitators suggesting that good device design, stakeholder engagement and appropriate evidence provision can increase the likelihood of a POCT device adoption. However, it is important to realise that while the majority of identified barriers may be perceived or mitigated some may be absolute and if identified early in device development further investment should be carefully considered.

Rapid point-of-care testing for COVID-19: quality of supportive information for lateral flow serology assays

OBJECTIVE

There is a lack of evidence addressing several important human factors questions pertaining to the quality of supportive information provided by commercial manufacturers that can affect the adoption and use of lateral flow serology assays in practice. We aimed to: (1) identify and assess the quality of information that commercial manufacturers provided for their point-of-care tests (POCTs) and (2) examine the implications of these findings on real-world settings.

DESIGN

We used a content analysis methodology in two stages to systematically, code and analyse textual data from documents of commercial manufacturers. A deductive approach was applied using a coding guide based on the validated Point-of-Care Key Evidence Tool (POCKET) multidimensional checklist. An inductive approach was used to identify new patterns or themes generated from our textual analysis.

SETTING

Publicly available supportive information documents by commercial manufacturers for lateral flow serology, were identified and gathered from online searches.

PARTICIPANTS

Supportive information documents retrieved from online searches over 3 months (March 2020 to June 2020).

RESULTS

A total of 79 POCTs were identified that met the study inclusion criteria. Using the POCKET coding guide, we found that the quality of information varied significantly between the manufacturers and was often lacking in detail. Our inductive approach further examined these topics and found that several statements were vague and that significant variations in the level of details existed between manufacturers.

CONCLUSIONS

This study revealed significant concerns surrounding the supportive information reported by manufacturers for lateral flow serology assays. Information transparency was poor and human factor issues were not properly addressed to mitigate the risk of improper device use, although it should be noted that the results of our study are limited by the data that manufactures were prepared to disclose. Overall, commercial manufacturers should improve the quality and value of information presented in their supporting documentation.

Personalized Medicine for the Management of RDS in Preterm Neonates

Continuous positive airway pressure and surfactant represent the first- and second-line treatment for respiratory distress syndrome in preterm neonates, as European and American guidelines, since 2013 and 2014, respectively, started to recommend surfactant replacement only when continuous positive airway pressure fails. These recommendations, however, are not personalized to the individual physiopathology. Simple clinical algorithms may have improved the diffusion of neonatal care, but complex medical issues can hardly be addressed with simple solutions. The treatment of respiratory distress syndrome is a complex matter and can be only optimized with personalization. We performed a review of tools to individualize the management of respiratory distress syndrome based on physiopathology and actual patients' need, according to precision medicine principles. Advanced oxygenation metrics, lung ultrasound, electrical impedance tomography, and both quantitative and qualitative surfactant assays were examined. When these techniques were investigated with diagnostic accuracy studies, reliability measures have been meta-analysed. Amongst all these tools, quantitative lung ultrasound seems the more developed for the widespread use and has a higher diagnostic accuracy (meta-analytical AUC = 0.952 [95% CI: 0.951-0.953]). Surfactant adsorption (AUC = 0.840 [95% CI: 0.824-0.856]) and stable microbubble test (AUC = 0.800 [95% CI: 0.788-0.812]) also have good reliability, but need further industrial development. We advocate for a more accurate characterization and a personalized approach of respiratory distress syndrome. With the above-described currently available tools, it should be possible to personalize the treatment of respiratory distress syndrome according to physiopathol-ogy.

Overcoming Challenges with the Adoption of Point-of-Care Testing: From Technology Push and Clinical Needs to Value Propositions

Major technical challenges often prevent developers from producing new point-of-care technologies that deliver the required clinical performance in the intended settings of use. But even when devices meet clinical requirements, they can fail to be adopted and successfully implemented. Adoption barriers occur when decision makers do not understand the "value proposition" of new technologies. Current discussions of value in the context of point-of-care testing focus predominantly on the intended use and performance of the device from the manufacturer's point-of-view. However, the perspective of potential adopters in determining whether new devices provide value is also important, as is the opinion of all stakeholders who will be impacted. Incorporating value concepts into decisions made across the full development-to-adoption continuum can increase the likelihood that point-of-care testing will have the desired impact on health care delivery and patient outcomes. This article discusses how various approaches to technology development impact adoption and compares the characteristics of these approaches to emerging value concepts. It also provides an overview of value initiatives and tools that are being developed to support the evaluation of value propositions. These are presented for a range of technology adoption decision contexts, with particular applicability to point-of-care testing. Expanding the focus of research to address gaps in both the creation and evaluation of value propositions is imperative in order for value concepts to positively influence the adoption of point-of-care testing.

Point-by-Point Progress: Gonorrhea Point of Care Tests

INTRODUCTION

Point-of-care (POC) tests for Neisseria gonorrhoeae (Ng) are urgently needed to control the gonorrhea epidemic, so patients can receive immediate diagnoses and treatment. While the advent of nucleic acid amplification tests (NAATs) has improved the accuracy of Ng identification, very few POC assays are able to provide results of such tests at the clinical visit. Additionally, antimicrobial resistance (AMR) presents a unique treatment challenge for Ng.

AREAS COVERED

This review notes that older POC tests have lower sensitivity for Ng, compared to the currently-available NAATs, and are not adequate for the current demand for high sensitivity. Promising newer assays, which can be used at the POC are covered. This review also includes data about clinicians' and patients' acceptability and expectations of POC tests for Ng, testing of extragenital specimens, pooling studies, as well as their impact clinically, and use in low-resource settings.

EXPERT OPINION

The ability to use POC tests to identify and immediately treat Ng infections at the patient encounter offers many benefits and opportunities. POC tests for Ng are currently available, but not widely used especially in low-resource settings. Further development of POC tests with AMR testing capacity is needed to help guide antimicrobial stewardship.

The Lean and Agile Multi-dimensional Process (LAMP) - a new framework for rapid and iterative evidence generation to support health-care technology design and development

Introduction: Health technology assessments (HTA) are tools for policymaking and resource allocation. Early HTAs are increasingly used in design and development of new technologies. Conducting early HTAs is challenging, due to a lack of evidence and significant uncertainties in the technology and the market. A multi-disciplinary approach is considered essential. However, an operational framework that can enable the integration of multi-dimensional evidence into commercialization remains lacking.Areas covered: We developed the Lean and Agile Multi-dimensional Process (LAMP), an early HTA framework, for embedding commercial decision-making in structured evidence generation activities, divided into phases. Diverse evidence in unmet needs, user acceptance, cost-effectiveness, and market competitiveness are being generated in increasing depth. This supports the emergence of design and value propositions that align technology capabilities and clinical and user needs.Expert opinion: We have been applying LAMP to working with medical device and diagnostic industry in the UK. The framework can be adapted to suit different technologies, decision needs, time scales, and resources. LAMP offers a practical solution to the multi-disciplinary approach. Methodologists drive the process by performing evidence generation and synthesis as and by enabling interactions between manufacturers, designers, clinicians, and other key stakeholders.