A Federated Online Search Tool for Biospecimens (Sample Locator): Usability Study

Data Management in Biobanking: Strategies, Challenges, and Future Directions

Biobanking plays a pivotal role in biomedical research by providing standardized processing, precise storing, and management of biological sample collections along with the associated data. Effective data management is a prerequisite to ensure the integrity, quality, and accessibility of these resources. This review provides a current landscape of data management in biobanking, discussing key challenges, existing strategies, and potential future directions. We explore multiple aspects of data management, including data collection, storage, curation, sharing, and ethical considerations. By examining the evolving technologies and methodologies in biobanking, we aim to provide insights into addressing the complexities and maximizing the utility of biobank data for research and clinical applications.

The sample locator: A federated search tool for biosamples and associated data in Europe using HL7 FHIR

BACKGROUND

This study outlines the development of a highly interoperable federated IT infrastructure for academic biobanks located at the major university hospital sites across Germany. High-quality biosamples linked to clinical data, stored in biobanks are essential for biomedical research. We aimed to facilitate the findability of these biosamples and their associated data. Networks of biobanks provide access to even larger pools of samples and data even from rare diseases and small disease subgroups. The German Biobank Alliance (GBA) established in 2017 under the umbrella of the German Biobank Node (GBN), has taken on the mission of a federated data discovery service to make biosamples and associated data available to researchers across Germany and Europe.

METHODS

In this context, we identified the requirements of researchers seeking human biosamples from biobanks and the needs of biobanks for data sovereignty over their samples and data in conjunction with the sample donor's consent. Based on this, we developed a highly interoperable federated IT infrastructure using standards such as Fast Healthcare Interoperability Resources (HL7 FHIR) and Clinical Quality Language (CQL).

RESULTS

The infrastructure comprises two major components enabling federated real-time access to biosample metadata, allowing privacy-compliant queries and subsequent project requests. It has been in use since 2019, connecting 16 German academic biobanks, with additional European biobanks joining. In production since 2019 it has run 4941 queries over the span of one year on more than 900,000 biosamples collected from more than 170,000 donors.

CONCLUSION

This infrastructure enhances the visibility and accessibility of biosamples for research, addressing the growing demand for human biosamples and associated data in research. It also underscores the need for improvements in processes beyond IT infrastructure, aiming to advance biomedical research and similar infrastructure development in other fields.

Stakeholder engagement to ensure the sustainability of biobanks: a survey of potential users of biobank services

Biobanks are important infrastructures facilitating biomedical research. After a decade of rolling out such infrastructures, a shift in attention to the sustainability of biobanks could be observed in recent years. In this regard, an increase in the as yet relatively low utilisation rates of biobanks has been formulated as a goal. Higher utilisation rates can only be achieved if the perspectives of potential users of biobanks-particularly researchers not yet collaborating with biobanks-are adequately considered. To better understand their perspectives, a survey was conducted at ten different research institutions in Germany hosting a centralised biobank. The survey targeted potential users of biobank services, i.e. researchers working with biosamples. It addressed the general demand for biosamples, strategies for biosample acquisition/storage and reasons for/against collaborating with biobanks. In total, 354 researchers filled out the survey. Most interestingly, only a minority of researchers (12%) acquired their biosamples via biobanks. Of the respondents not collaborating with biobanks on sample acquisition, around half were not aware of the (services of the) respective local biobank. Those who actively decided against acquiring biosamples via a biobank provided different reasons. Most commonly, respondents stated that the biosamples required were not available, the costs were too high and information about the available biosamples was not readily accessible. Biobanks can draw many lessons from the results of the survey. Particularly, external communication and outreach should be improved. Additionally, biobanks might have to reassess whether their particular collection strategies are adequately aligned with local researchers' needs.

Empowering researchers to query medical data and biospecimens by ensuring appropriate usability: Evaluation study of the ABIDE_MI feasibility tool (Preprint)

BACKGROUND

The Aligning Biobanking and Data Integration Centers Efficiently project aims to harmonize technologies and governance structures of German university hospitals and their biobanks to facilitate searching for patient data and biospecimens. The central element will be a feasibility tool for researchers to query the availability of samples and data to determine the feasibility of their study project.

OBJECTIVE

The objectives of the study were as follows: an evaluation of the overall user interface usability of the feasibility tool, the identification of critical usability issues, comprehensibility of the underlying ontology operability, and analysis of user feedback on additional functionalities. From these, recommendations for quality-of-use optimization, focusing on more intuitive usability, were derived.

METHODS

To achieve the study goal, an exploratory usability test consisting of 2 main parts was conducted. In the first part, the thinking aloud method (test participants express their thoughts aloud throughout their use of the tool) was complemented by a quantitative questionnaire. In the second part, the interview method was combined with supplementary mock-ups to collect users' opinions on possible additional features.

RESULTS

The study cohort rated global usability of the feasibility tool based on the System Usability Scale with a good score of 81.25. The tasks assigned posed certain challenges. No participant was able to solve all tasks correctly. A detailed analysis showed that this was mostly because of minor issues. This impression was confirmed by the recorded statements, which described the tool as intuitive and user friendly. The feedback also provided useful insights regarding which critical usability problems occur and need to be addressed promptly.

CONCLUSIONS

The findings indicate that the prototype of the Aligning Biobanking and Data Integration Centers Efficiently feasibility tool is headed in the right direction. Nevertheless, we see potential for optimization primarily in the display of the search functions, the unambiguous distinguishability of criteria, and the visibility of their associated classification system. Overall, it can be stated that the combination of different tools used to evaluate the feasibility tool provided a comprehensive picture of its usability.

The journey to establishing an IT-infrastructure within the German Biobank Alliance

Background

Biobanks ensure the long-term storage and accessibility of biospecimens and corresponding data sets. Thus, they form the foundation for many research projects which may contribute to improving medical care. With the establishment of the German Biobank Node and Alliance, expertise in biobanking is bundled and strengthened. An important component within this research infrastructure is the set-up of an information technology (IT) network for allowing feasibility requests across individual biobanks.

Objective

We aim to describe relevant aspects that have shaped the journey to interconnect biobanks, to enhance their visibility within the research-community, to harmonize data, and to enable feasibility searches to support access to available data and biosamples.

Methods

To achieve this task, we resorted to a wide variety of methods: we ran a requirement analysis, decided on the mode of operation for the federated team of IT-developers and on the development approach itself, took related national and international initiatives into account, and concluded with evaluations of the developed software artefacts and the operation of the entire chain of applications.

Results

We drew an IT framework including all heterogeneous data aspects derived from our requirement analysis and developed a comprehensive IT infrastructure. The successful implementation benefited from a smooth interaction of a federated IT team distributed across all participating sites that was even able to manage a major technology change mid-project. Authentication and project management services from associated partners could be integrated and the graphic user interface for an intuitive search tool for biospecimens was designed iteratively. The developed code is open source to ensure sustainability and the local implementation is concluded and functioning. The evaluation of the components was positive.

Conclusions

The entire project had given ample opportunity for challenges, predictable and unpredictable—from the mode of operation to changing some of the initial ideas. We learned our lessons concerning personnel, budget planning and technical as well as manual monitoring as well as some requirements arising only during the process of the project. Nevertheless, we can here report a success story of a network infrastructure, highly agile and much easier in local installation than initially anticipated.

Evaluation of Three Feasibility Tools for Identifying Patient Data and Biospecimen Availability: Comparative Usability Study

BACKGROUND

To meet the growing importance of real-word data analysis, clinical data and biosamples must be timely made available. Feasibility platforms are often the first contact point for determining the availability of such data for specific research questions. Therefore, a user-friendly interface should be provided to enable access to this information easily. The German Medical Informatics Initiative also aims to establish such a platform for its infrastructure. Although some of these platforms are actively used, their tools still have limitations. Consequently, the Medical Informatics Initiative consortium MIRACUM (Medical Informatics in Research and Care in University Medicine) committed itself to analyzing the pros and cons of existing solutions and to designing an optimized graphical feasibility user interface.

OBJECTIVE

The aim of this study is to identify the system that is most user-friendly and thus forms the best basis for developing a harmonized tool. To achieve this goal, we carried out a comparative usability evaluation of existing tools used by researchers acting as end users.

METHODS

The evaluation included three preselected search tools and was conducted as a qualitative exploratory study with a randomized design over a period of 6 weeks. The tools in question were the MIRACUM i2b2 (Informatics for Integrating Biology and the Bedside) feasibility platform, OHDSI's (Observational Health Data Sciences and Informatics) ATLAS, and the Sample Locator of the German Biobank Alliance. The evaluation was conducted in the form of a web-based usability test (usability walkthrough combined with a web-based questionnaire) with participants aged between 26 and 63 years who work as medical doctors.

RESULTS

In total, 17 study participants evaluated the three tools. The overall evaluation of usability, which was based on the System Usability Scale, showed that the Sample Locator, with a mean System Usability Scale score of 77.03 (SD 20.62), was significantly superior to the other two tools (Wilcoxon test; Sample Locator vs i2b2: P=.047; Sample Locator vs ATLAS: P=.001). i2b2, with a score of 59.83 (SD 25.36), performed significantly better than ATLAS, which had a score of 27.81 (SD 21.79; Wilcoxon test; i2b2 vs ATLAS: P=.005). The analysis of the material generated by the usability walkthrough method confirmed these findings. ATLAS caused the most usability problems (n=66), followed by i2b2 (n=48) and the Sample Locator (n=22). Moreover, the Sample Locator achieved the highest ratings with respect to additional questions regarding satisfaction with the tools.

CONCLUSIONS

This study provides data to develop a suitable basis for the selection of a harmonized tool for feasibility studies via concrete evaluation and a comparison of the usability of three different types of query builders. The feedback obtained from the participants during the usability test made it possible to identify user problems and positive design aspects of the individual tools and compare them qualitatively.