Supporting rural public health practice to address local-level social determinants of health across Northwest states: Development of an interactive visualization dashboard

Design, Application, and Actionability of US Public Health Data Dashboards: Scoping Review

BACKGROUND

Data dashboards can be a powerful tool for ensuring access for public health decision makers to timely, relevant, and credible data. As their appeal and reach become ubiquitous, it is important to consider how they may be best integrated with public health data systems and the decision-making routines of users.

OBJECTIVE

This scoping review describes and analyzes the current state of knowledge regarding the design, application, and actionability of US national public health data dashboards to identify critical theoretical and empirical gaps in the literature and clarify definitions and operationalization of actionability as a critical property of dashboards.

METHODS

The review follows PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses Extension for Scoping Reviews) guidelines. A search was conducted for refereed journal articles, conference proceedings, and reports that describe the design, implementation, or evaluation of US national public health dashboards published between 2000 and 2023, using a validated search query across relevant databases (CINAHL, PubMed, MEDLINE, and Web of Science) and gray literature sources. Of 2544 documents retrieved, 89 (3.5%) met all inclusion criteria. An iterative process of testing and improving intercoder reliability was implemented to extract data.

RESULTS

The dashboards reviewed (N=89) target a broad range of public health topics but are primarily designed for epidemiological surveillance and monitoring (n=51, 57% of dashboards) and probing health disparities and social determinants of health (n=27, 30%). Thus, they are limited in their potential to guide users' policy and practice decisions. Nearly all dashboards are created, hosted, and funded by institutional entities, such as government agencies and universities, that hold influence over public health agendas and priorities. Intended users are primarily public health professionals (n=34, 38%), policy makers (n=30, 34%), and researchers or practitioners (n=28, 32%), but it is unclear whether the dashboards are tailored to users' data capacities or needs, although 30% of articles reference user-centered design. Usability indicators commonly referenced include website analytics (n=22, 25%), expert evaluation (n=19, 21%), and users' impact stories (n=14, 16%), but only 30% (n=26) of all articles report usability assessment. Usefulness is frequently inferred from presumed relevance to decision makers (n=17, 19%), anecdotal stakeholder feedback (n=16, 18%), and user engagement metrics (n=14, 16%) rather than via rigorous testing. Only 47% (n=42) of dashboards were still accessible or active at the time of review.

CONCLUSIONS

The findings reveal fragmentation and a lack of scientific rigor in current knowledge regarding the design, implementation, and utility of public health dashboards. Coherent theoretical accounts and direct empirical tests that link usability, usefulness, and use of these tools to users' decisions and actions are critically missing. A more complete explication and operationalization of actionability in this context has significant potential to fill this gap and advance future scholarship and practice.

Trends in and Effectiveness of Infographics for Health Communication: A Scoping Review

Health infographics are often used to improve knowledge or change behaviors. However, a systematic understanding of the current landscape and evidence of health infographics is lacking. The objective of this study was to explore trends in health-related infographics research and health infographic effectiveness. We conducted a scoping review of peer-reviewed publications describing health-related infographic development, using health and computer science databases. We extracted information from included articles to understand current trends in health-related infographics research and design elements that support infographic effectiveness. A total of 135 articles met our inclusion criteria. There was an increase in health infographics publications over time and definitions of infographics, when present, varied in scope and content. Out of 81 studies that evaluated the infographics' effectiveness in improving knowledge or changing attitudes or behaviors, 71 (87.7%) reported that infographics were effective. Infographics were often preferred over another medium (e.g. text). Overall, there is increasing interest in research regarding health-related infographics. While most effectiveness studies found that infographics helped improve knowledge or change behaviors, many studies lacked rigor in study design or reporting study methods. We did not find articles that focused on credibility or development of infographics tools - these are avenues for future research.

Development and usability of an EHR-driven hypertension disparities dashboard in primary care: A qualitative study

Hypertension disparities persist and remain high among racial and ethnic minority populations in the United States (US). Data-driven approaches based on electronic health records (EHRs) in primary care are seen as a strong opportunity to address this situation. This qualitative study evaluated the development, sustainability, and usability of an EHR-integrated hypertension disparities dashboard for health care professionals in primary care. Ten semi-structured interviews, exploring the approach and sustainability, as well as eight usability interviews, using the think aloud protocol were conducted with quality improvement managers, data analysts, program managers, evaluators, and primary care providers. For the results, dashboard development steps include having clear goals, defining a target audience, compiling data, and building multidisciplinary teams. For sustainability, the dashboard can enhance understanding of the social determinants of health or to inform QI projects. In terms of dashboard usability, positive aspects consisted of the inclusion of summary pages, patient's detail pages, and hover-over interface. Important design considerations were refining sorting functions, gender inclusivity, and increasing dashboard visibility. In sum, an EHR-driven dashboard can be a novel tool for addressing hypertension disparities in primary care. It offers a platform where clinicians can identify patients for culturally tailored interventions. Factors such as physician time constraints, data definitions, comprehensive patient demographic information, end-users, and future sustenance, should be considered before implementing a dashboard. Additional research is needed to identify practices for integrating a dashboard into clinical workflow for hypertension.

The Solutions in Health Analytics for Rural Equity Across the Northwest (SHARE-NW) Dashboard for Health Equity in Rural Public Health: Usability Evaluation

BACKGROUND

Given the dearth of resources to support rural public health practice, the solutions in health analytics for rural equity across the northwest dashboard (SHAREdash) was created to support rural county public health departments in northwestern United States with accessible and relevant data to identify and address health disparities in their jurisdictions. To ensure the development of useful dashboards, assessment of usability should occur at multiple stages throughout the system development life cycle. SHAREdash was refined via user-centered design methods, and upon completion, it is critical to evaluate the usability of SHAREdash.

OBJECTIVE

This study aims to evaluate the usability of SHAREdash based on the system development lifecycle stage 3 evaluation goals of efficiency, satisfaction, and validity.

METHODS

Public health professionals from rural health departments from Washington, Idaho, Oregon, and Alaska were enrolled in the usability study from January to April 2022. The web-based evaluation consisted of 2 think-aloud tasks and a semistructured qualitative interview. Think-aloud tasks assessed efficiency and effectiveness, and the interview investigated satisfaction and overall usability. Verbatim transcripts from the tasks and interviews were analyzed using directed content analysis.

RESULTS

Of the 9 participants, all were female and most worked at a local health department (7/9, 78%). A mean of 10.1 (SD 1.4) clicks for task 1 (could be completed in 7 clicks) and 11.4 (SD 2.0) clicks for task 2 (could be completed in 9 clicks) were recorded. For both tasks, most participants required no prompting-89% (n=8) participants for task 1 and 67% (n=6) participants for task 2, respectively. For effectiveness, all participants were able to complete each task accurately and comprehensively. Overall, the participants were highly satisfied with the dashboard with everyone remarking on the utility of using it to support their work, particularly to compare their jurisdiction to others. Finally, half of the participants stated that the ability to share the graphs from the dashboard would be "extremely useful" for their work. The only aspect of the dashboard cited as problematic is the amount of missing data that was present, which was a constraint of the data available about rural jurisdictions.

CONCLUSIONS

Think-aloud tasks showed that the SHAREdash allows users to complete tasks efficiently. Overall, participants reported being very satisfied with the dashboard and provided multiple ways they planned to use it to support their work. The main usability issue identified was the lack of available data indicating the importance of addressing the ongoing issues of missing and fragmented public health data, particularly for rural communities.

Dashboards to Support Implementation of the Quebec Alzheimer Plan: Evaluation Study With Regional and Professional Considerations

BACKGROUND

Health organizations face the critical task of executing and overseeing comprehensive health care. To address the challenges associated with this task, evidence-based dashboards have emerged as valuable tools. Since 2016, the regional health organizations of Quebec, Canada, have been responsible for ensuring implementation of the Quebec Alzheimer Plan (QAP), a provincial plan that aims to reinforce the capacity of primary care services to detect, diagnose, and treat persons with dementia. Despite the provincial scope of the QAP, the diverse material and human resources across regions introduce variability in the interest, utility, and specific needs associated with these dashboards.

OBJECTIVE

The aim of this study was to assess the interest and utility of dashboards to support the QAP implementation, as well as to determine the needs for improving these aspects according to the perspectives of various types of professionals involved across regions.

METHODS

An evaluative study using qualitative methods was conducted within a collaborative research approach involving different stakeholders, including the ministerial advisor and the four project managers responsible for supporting the implementation of the QAP, as well as researchers/scientific advisors. To support these organizations, we developed tailored, 2-page paper dashboards, detailing quantitative data on the prevalence of dementia, the use of health services by persons with dementia, and achievements and challenges of the QAP implementation in each organization's jurisdiction. We then conducted 23 focus groups with the managers and leading clinicians involved in the implementation of the QAP of each regional health organization. Real-time notes were taken using a structured observation grid. Content analysis was conducted according to different regions (organizations with university mandates or nearby organizations, labeled "university/peripheral"; organizations for which only part of the territory is in rural areas, labeled "mixed"; and organizations in remote or isolated areas, labeled "remote/isolated") and according to different types of participants (managers, leading clinicians, and other participants).

RESULTS

Participants from organizations in all regions expressed interest in these dashboards and found them useful in several ways. However, they highlighted the need for indicators on orphan patients and other health care providers. Differences between regions were observed, particularly in the interest in continuity of care in university/peripheral regions and the need for diagnostic tools adapted to the culture in remote/isolated regions.

CONCLUSIONS

These dashboards support the implementation of an Alzheimer Plan and contribute to the emergence of a learning health care system culture. This project allows each region to increase its monitoring capacity for the implementation of the QAP and facilitates reflection among individuals locally carrying out the implementation. The perspectives expressed will guide the preparation of the next iteration of the dashboards.

Disparity drivers, potential solutions, and the role of a health equity dashboard in the neonatal intensive care unit: a qualitative study

OBJECTIVE

Racial/ethnic disparities are well-described in the neonatal intensive care unit (NICU). We explored expert opinion on their etiology, potential solutions, and the ability of health equity dashboards to meaningfully capture NICU disparities.

STUDY DESIGN

We conducted 12 qualitative semi-structured interviews, purposively selecting a diverse group of neonatal experts. We used grounded theory to develop codes, shape interviews, and conduct analysis.

RESULT

We identified three sources of disparity: interpersonal bias, care process and institutional barriers, and social determinants of health, particularly as they affect parental engagement in the NICU. Proposed solutions included racial/cultural concordance, bolstering hospital-based resources, and policy interventions. Health equity dashboards were viewed as useful but limited, because clinical metrics do not account for many of the aforementioned sources of disparities.

CONCLUSION

Equity dashboards serve as a motivational starting point for quality improvement; future iterations may require novel, qualitative data sources to identify underlying etiologies of NICU disparities.

Designing an infographic webtool for public health

OBJECTIVE

To create and evaluate a public health informatics tool, Florence, for communicating information to the public.

MATERIALS AND METHODS

This user-centered design study included 3 phases: (1) an interview and survey study with public health practitioners to assess needs for creating infographics; (2) the application of assessment findings and public health-motivated design guidelines to the design and development of a public health-specific infographic design tool; and (3) a feasibility and usability study to evaluate the feasibility and usability of the tool.

RESULTS

In phase 1, participants noted the importance of tailoring infographics to an audience and wanted flexible tools along with design guidance to help make fewer design decisions. In phase 2, we developed a prototype tool with: (1) layout and functionality familiar to PH users, (2) quick and intuitive ways to add and modify data in visualizations, and (3) health-focused visual elements. In phase 3, participants found Florence to be usable, providing an intuitive and straightforward experience, and that the focus on public health was useful.

DISCUSSION

Based on needs assessments and existing literature, we created Florence along with public health practitioners to address their domain specific needs, ultimately leading to a tool that participants in our study deemed useful. Future research can build on our work to develop user-centered tools to meet their needs.

CONCLUSION

Infographics are important for public health communication. Creating user-centered solutions to address the unique needs of public health can support communication efforts.

Regional-level Indicators for Chronic Diseases of People with Disabilities: Findings from a Modified Delphi Study

Maintaining health cannot be achieved individually; it is influenced by social, legal, and institutional factors surrounding the individuals. This study aimed to identify regional-level factors that may influence the occurrence of chronic diseases among people with disabilities. To achieve this, we conducted a Delphi survey with experts to identify a set of regional indicators required for studying the health status of people with disabilities, particularly for predicting the occurrence of chronic diseases. Through the process of the Delphi survey, 24 indicators were finally selected. The major categories of the indicators were demographic factors (4 indicators), health behaviors (6 indicators), healthcare resources and utilization (11 indicators), and local community policies (3 indicators). Each category and subcategory of indicators plays a crucial role in understanding and improving the health and well-being of people with disabilities at the regional level. By addressing these factors comprehensively, policymakers and healthcare providers can develop more effective and targeted interventions, ultimately fostering a more inclusive and supportive environment for people with disabilities. The findings underscore the importance of a holistic approach to health assessment and the need for continued monitoring and evaluation to inform policy and practice.

Disparity dashboards: an evaluation of the literature and framework for health equity improvement

The growing recognition of differences in health outcomes across populations has led to a slow but increasing shift towards transparent reporting of patient outcomes. In addition, pay-for-equity initiatives, such as those proposed by the Centers for Medicare and Medicaid, will require the reporting of health outcomes across subgroups over time. Dashboards offer one means of visualising data in the health-care context that can highlight essential disparities in clinical outcomes, guide targeted quality-improvement efforts, and ultimately improve health equity. In this Viewpoint, we evaluate all studies that have reported the successful development of a disparity dashboard and share the data collected and unintended consequences reported. We propose a framework for systematic equality improvement through incentivisation of the collecting and reporting of health data and through implementation of reward systems to reduce health disparities.

Rural Public Health Data Challenges During the COVID-19 Pandemic: The Case for Building Better Systems Ahead of a Public Health Crisis

CONTEXT

Rural public health personnel serve communities that have been particularly susceptible to COVID-19 and yet faced the pandemic with far less well-resourced capacity than their urban counterparts. A critical aspect of addressing local health inequities is access to high-quality population data and the capacity to effectively use data to support decision making. However, much of the data required to investigate inequities are not readily available to rural local health departments and the tools and training to analyze data are often lacking.

PROGRAM

The purpose of our effort was to explore rural data challenges related to COVID-19 and provide recommendations for improving rural data access and capacity ahead of future crises.

IMPLEMENTATION

We gathered qualitative data in 2 phases, more than 8 months apart, from rural public health practice personnel. Initial data were gathered in October-November 2020 regarding rural public health data needs during the COVID-19 pandemic and then to later identify whether the same findings held true in July 2021 or whether access to and capacity to use data to address the pandemic and related inequities improved as the pandemic progressed.

EVALUATION

In our 4-state exploration focused on access and use of data among rural public health systems to promote health equity in the Northwest United States, we found tremendous and ongoing unmet data needs, challenges with communicating data, and a lack of capacity to meet this public health crisis.

DISCUSSION

Recommendations for addressing these challenges include increasing dedicated resources specifically to rural public health systems, improving data access and infrastructure, and providing dedicated data-related workforce development.

Disparities and Equity Dashboards in the Neonatal Intensive Care Unit: A Qualitative Study of Expert Perspectives

Objective

Racial/ethnic disparities are well-described in the neonatal intensive care unit (NICU). We explore expert opinion on their root causes, potential solutions, and the ability of health equity dashboards to meaningfully address NICU disparities.

Study Design

We conducted 12 qualitative semi-structured interviews, purposively selecting a diverse group of neonatal experts. We used grounded theory to develop codes, shape interviews, and conduct analysis.

Result

Participants identified three sources of disparity: interpersonal bias, care process barriers, and social determinants of health, particularly as they affect parental engagement in the NICU. Proposed solutions included racial/cultural concordance, bolstering hospital-based resources, and policy interventions. Health equity dashboards were viewed as useful but limited because clinical metrics do not account for many of the aforementioned sources of disparities.

Conclusion

Equity dashboards serve as a motivational starting point for quality improvement; future iterations may require novel, qualitative data sources to identify underlying etiologies of NICU disparities.

Grouping Public Health Skills to Facilitate Workforce Development: A Factor Analysis of PH WINS

OBJECTIVES

This study examined whether distinct factors exist among public health skills, measured through the Public Health Workforce Interests and Needs Survey (PH WINS). Understanding how workforce training needs group is important for developing targeted and appropriate public health workforce training sessions.

DESIGN

Exploratory factor analysis was used to examine public health skills among tier 1 staff (nonmanagers) and a combined group of tier 2 and 3 staff (managers and executives).

SETTING

Data for this study come from the 2017 PH WINS, which assessed public health workforce perceptions of training needs, workplace environment, job satisfaction, perceptions about national trends, and demographics. The analysis included 22 items.

PARTICIPANTS

All public health staff in participating agencies were eligible to complete the survey. The national data set included participants from 47 state health agencies, 26 large local health departments (LHDs), and 71 mid-sized LHDs across all 10 Health and Human Services regions in the United States (including LHDs from all states). The analytic sample was n = 9630 in tier 1, n = 4829 in tier 2, and n = 714 in tier 3 staff.

MAIN OUTCOME MEASURE

Three factors were identified within the skills portion of PH WINS, using exploratory factor analysis. To interpret retained factors, the following parameters were used: factor loadings greater than 0.4, factor cross-loadings less than 0.4 or higher than loadings on other factors, and communalities greater than 0.5.

RESULTS

Factors included (1) data and systems thinking, (2) planning and management, and (3) community collaboration, with slight variation in item loadings between tier 1 and tier 2 and 3 staff analyses.

CONCLUSION

This study was the first known factor analysis of the training needs and workforce skills portion of PH WINS in the published literature. This study advances our conceptualization of public health workforce skills and has the potential to shape future critical workforce training development.

A Uniform Chart of Accounts: Strengthening Public Health Practice and Research Through Standardized Financial Data

CONTEXT

The COVID-19 pandemic made the long-standing need for a national uniform financial reporting standard for governmental public health agencies clear, as little information was available to quantify state and local public health agencies' financial needs during the pandemic response. Such a uniform system would also inform resource allocation to underresourced communities and for specific services, while filling other gaps in practice, research, and policy making. This article describes lessons learned and recommendations for ensuring broad adoption of a national Uniform Chart of Accounts (UCOA) for public health departments.

PROGRAM

Leveraging previous efforts, the UCOA for public health systems was developed through collaboration with public health leaders. The UCOA allows state and local public health agencies to report spending on activities and funding sources, along with practice-defined program areas and capabilities.

IMPLEMENTATION

To date, 78 jurisdictions have utilized the UCOA to crosswalk financial information at the program level, enabling comparisons with peers.

EVALUATION

Jurisdictions participating in the UCOA report perceptions of substantial up-front time investment to crosswalk their charts of accounts to the UCOA standard but derive a sense of valuable potential for benchmarking against peers, ability to engage in resource allocation, use of data for accountability, and general net positive value of engagement with the UCOA.

IMPLICATIONS FOR POLICY AND PRACTICE

The UCOA is considered a need among practice partners. Implementing the UCOA at scale will require government involvement, a reporting requirement and/or incentives, technical assistance, financial support for agencies to participate, and a means of visualizing the data.

The DASH model: Data for addressing social determinants of health in local health departments

Recent frameworks, models, and reports highlight the critical need to address social determinants of health for achieving health equity in the United States and around the globe. In the United States, data play an important role in better understanding community-level and population-level disparities particularly for local health departments. However, data-driven decision-making-the use of data for public health activities such as program implementation, policy development, and resource allocation-is often presented theoretically or through case studies in the literature. We sought to develop a preliminary model that identifies the factors that contribute to data-driven decision-making in US local health departments and describe relationships between them. Guided by implementation science literature, we examined organizational-level capacity and individual-level factors contributing to using data for decision-making related to social determinants of health and the reduction of county-level disparities. This model has the potential to improve implementation of public health interventions and programs aimed at upstream structural factors, by elucidating the factors critical to incorporating data in decision-making.