Strengths, weaknesses, opportunities, and threats for the nation's public health information systems infrastructure: synthesis of discussions from the 2022 ACMI Symposium

OBJECTIVE

The annual American College of Medical Informatics (ACMI) symposium focused discussion on the national public health information systems (PHIS) infrastructure to support public health goals. The objective of this article is to present the strengths, weaknesses, threats, and opportunities (SWOT) identified by public health and informatics leaders in attendance.

MATERIALS AND METHODS

The Symposium provided a venue for experts in biomedical informatics and public health to brainstorm, identify, and discuss top PHIS challenges. Two conceptual frameworks, SWOT and the Informatics Stack, guided discussion and were used to organize factors and themes identified through a qualitative approach.

RESULTS

A total of 57 unique factors related to the current PHIS were identified, including 9 strengths, 22 weaknesses, 14 opportunities, and 14 threats, which were consolidated into 22 themes according to the Stack. Most themes (68%) clustered at the top of the Stack. Three overarching opportunities were especially prominent: (1) addressing the needs for sustainable funding, (2) leveraging existing infrastructure and processes for information exchange and system development that meets public health goals, and (3) preparing the public health workforce to benefit from available resources.

DISCUSSION

The PHIS is unarguably overdue for a strategically designed, technology-enabled, information infrastructure for delivering day-to-day essential public health services and to respond effectively to public health emergencies.

CONCLUSION

Most of the themes identified concerned context, people, and processes rather than technical elements. We recommend that public health leadership consider the possible actions and leverage informatics expertise as we collectively prepare for the future.

Enhancing the nation's public health information infrastructure: a report from the ACMI symposium

The COVID-19 pandemic exposed multiple weaknesses in the nation's public health system. Therefore, the American College of Medical Informatics selected "Rebuilding the Nation's Public Health Informatics Infrastructure" as the theme for its annual symposium. Experts in biomedical informatics and public health discussed strategies to strengthen the US public health information infrastructure through policy, education, research, and development. This article summarizes policy recommendations for the biomedical informatics community postpandemic. First, the nation must perceive the health data infrastructure to be a matter of national security. The nation must further invest significantly more in its health data infrastructure. Investments should include the education and training of the public health workforce as informaticians in this domain are currently limited. Finally, investments should strengthen and expand health data utilities that increasingly play a critical role in exchanging information across public health and healthcare organizations.

National health information technology priorities for research: A policy and development agenda

The growth of digitized health data presents exciting opportunities to leverage the health information technology (IT) infrastructure for advancing biomedical and health services research. However, challenges impede use of those resources effectively and at scale to improve outcomes. The Office of the National Coordinator for Health Information Technology (ONC) led a collaborative effort to identify challenges, priorities, and actions to leverage health IT and electronic health data for research. Specifically, ONC led a review of relevant literature and programs, key informant interviews, and a stakeholder workshop to identify electronic health data and health IT infrastructure gaps. This effort resulted in the National Health IT Priorities for Research: A Policy and Development Agenda, which articulates an optimized health information ecosystem for scientific discovery. This article outlines 9 priorities and recommended actions to be implemented in collaboration with the research and informatics communities for realizing this vision.

Using telephony data to facilitate discovery of clinical workflows

BACKGROUND

Discovery of clinical workflows to target for redesign using methods such as Lean and Six Sigma is difficult. VoIP telephone call pattern analysis may complement direct observation and EMR-based tools in understanding clinical workflows at the enterprise level by allowing visualization of institutional telecommunications activity.

OBJECTIVE

To build an analytic framework mapping repetitive and high-volume telephone call patterns in a large medical center to their associated clinical units using an enterprise unified communications server log file and to support visualization of specific call patterns using graphical networks.

METHODS

Consecutive call detail records from the medical center's unified communications server were parsed to cross-correlate telephone call patterns and map associated phone numbers to a cost center dictionary. Hashed data structures were built to allow construction of edge and node files representing high volume call patterns for display with an open source graph network tool.

RESULTS

Summary statistics for an analysis of exactly one week's call detail records at a large academic medical center showed that 912,386 calls were placed with a total duration of 23,186 hours. Approximately half of all calling called number pairs had an average call duration under 60 seconds and of these the average call duration was 27 seconds.

CONCLUSIONS

Cross-correlation of phone calls identified by clinical cost center can be used to generate graphical displays of clinical enterprise communications. Many calls are short. The compact data transfers within short calls may serve as automation or re-design targets. The large absolute amount of time medical center employees were engaged in VoIP telecommunications suggests that analysis of telephone call patterns may offer additional insights into core clinical workflows.

Reduction in Clinical Variance Using Targeted Design Changes in Computerized Provider Order Entry (CPOE) Order Sets: Impact on Hospitalized Children with Acute Asthma Exacerbation

OBJECTIVES

Unwarranted variance in healthcare has been associated with prolonged length of stay, diminished health and increased cost. Practice variance in the management of asthma can be significant and few investigators have evaluated strategies to reduce this variance. We hypothesized that selective redesign of order sets using different ways to frame the order and physician decision-making in a computerized provider order entry system could increase adherence to evidence-based care and reduce population-specific variance.

PATIENTS AND METHODS

The study focused on the use of an evidence-based asthma exacerbation order set in the electronic health record (EHR) before and after order set redesign. In the Baseline period, the EHR was queried for frequency of use of an asthma exacerbation order set and its individual orders. Important individual orders with suboptimal use were targeted for redesign. Data from a Post-Intervention period were then analyzed.

RESULTS

In the Baseline period there were 245 patient visits in which the acute asthma exacerbation order set was selected. The utilization frequency of most orders in the order set during this period exceeded 90%. Three care items were targeted for intervention due to suboptimal utilization: admission weight, activity center use and peak flow measurements. In the Post-Intervention period there were 213 patient visits. Order set redesign using different default order content resulted in significant improvement in the utilization of orders for all 3 items: admission weight (79.2% to 94.8% utilization, p<0.001), activity center (84.1% to 95.3% utilization, p<0.001) and peak flow (18.8% to 55.9% utilization, p<0.001). Utilization of peak flow orders for children ≥8 years of age increased from 42.7% to 94.1% (p<0.001).

CONCLUSIONS

Details of order set design greatly influence clinician prescribing behavior. Queries of the EHR reveal variance associated with ordering frequencies. Targeting and changing order set design elements in a CPOE system results in improved selection of evidence-based care.

Design and use of a joint order vocabulary knowledge representation tier in a multi-tier CPOE architecture

Two major barriers to adoption of computerized physician order entry (CPOE) systems are the initial physician effort to learn the system and ongoing time costs to use the system. These barriers stem from the CPOE system's need to reformulate physician orders into services that can be electronically communicated to ancillary clinical systems such as pharmacy, nursing, lab or radiology as well as to billing systems. Typical CPOE systems use significant custom user interface programming to match the terms used by physicians to order services as well as the aggregation of those orders into order sets with the underlying orderable services. We describe the design and implementation of a commercial CPOE system that has a formal separate intermediate mapping layer to match physician screen vocabulary and ordering behaviors to underlying services, both individually and in groups, supported by powerful search tools.

Determinants of patient satisfaction and willingness to return with emergency care

STUDY OBJECTIVE

To identify emergency department process of care measures that are significantly associated with satisfaction and willingness to return.

METHODS

Patient satisfaction and willingness to return at 5 urban, teaching hospital EDs were assessed. Baseline questionnaire, chart review, and 10-day follow-up telephone interviews were performed, and 38 process of care measures and 30 patient characteristic were collected for each respondent. Overall satisfaction was modeled with ordinal logistic regression. Willingness to return was modeled with logistic regression.

RESULTS

During a 1-month study period, 2,899 (84% of eligible) on-site questionnaires were completed. Telephone interviews were completed by 2,333 patients (80% of patients who completed a questionnaire). Patient-reported problems that were highly correlated with satisfaction included help not received when needed (odds ratio [OR] 0.345; 95% confidence interval [CI] 0.261 to 0.456), poor explanation of causes of problem (OR 0.434; 95% CI 0.345 to 0.546), not told about potential wait time (OR 0.479; 95% CI 0.399 to 0.577), not told when to resume normal activities (OR 0.691; 95% CI 0.531 to 0.901), poor explanation of test results (OR 0.647; 95% CI 0.495 to 0.845), and not told when to return to the ED (OR 0.656; 95% CI 0. 494 to 0.871). Other process of care measures correlated with satisfaction include nonacute triage status (OR 0.701, 95% CI 0.578 to 0.851) and number of treatments in the ED (OR 1.164 per treatment; 95% CI 1.073 to 1.263). Patient characteristics that significantly predicted less satisfaction included younger age and black race. Determinants of willingness to return include poor explanation of causes of problem (OR 0.328; 95% CI 0.217 to 0.495), unable to leave a message for family (OR 0.391; 95% CI 0.226 to 0. 677), not told about potential wait time (OR 0.561; 95% CI 0.381 to 0.825), poor explanation of test results (OR 0.541; 95% CI 0.347 to 0.846), and help not received when needed (OR 0.537; 95% CI 0.340 to 0.846). Patients with a chief complaint of hand laceration were less willing to return compared with a reference population of patients with abdominal pain. Willingness to return is strongly predicted by overall satisfaction (OR 2.601; 95% CI 2.292 to 2.951).

CONCLUSION

These data identify specific process of care measures that are determinants of patient satisfaction and willingness to return. Efforts to increase patient satisfaction and willingness to return should focus on improving ED performance on these identified process measures.

Benchmarking and quality improvement: the Harvard Emergency Department Quality Study

PURPOSE

To determine whether feedback of comparative information was associated with improvement in medical record and patient-based measures of quality in emergency departments.

SUBJECTS AND METHODS

During 1-month study periods in 1993 and 1995, all medical records for patients who presented to five Harvard teaching hospital emergency departments with one of six selected chief complaints (abdominal pain, shortness of breath, chest pain, hand laceration, head trauma, or vaginal bleeding) were reviewed for the percent compliance with process-of-care guidelines. Patient-reported problems and patient ratings of satisfaction with emergency department care were collected from eligible patients using patient questionnaires. After reviewing benchmark information, emergency department directors designed quality improvement interventions to improve compliance with the process-of-care guidelines and improve patient-reported quality measures.

RESULTS

In the preintervention period, 4,876 medical records were reviewed (99% of those eligible), 2,327 patients completed on-site questionnaires (84% of those eligible), and 1,386 patients completed 10-day follow-up questionnaires (80% of a random sample of eligible participants). In the postintervention period, 6,005 medical records were reviewed (99% of those eligible), 2,899 patients completed on-site questionnaires (84% of those eligible), and 2,326 patients completed 10-day follow-up questionnaires (80% of all baseline participants). In multivariate analyses, adjusting for age, urgency, chief complaint, and site, compliance with process-of-care guidelines increased from 55.9% (preintervention) to 60.4% (postintervention, P = 0.0001). We also found a 4% decrease (from 24% to 20%) in the rate of patient-reported problems with emergency department care (P = 0.0001). There were no significant improvements in patient ratings of satisfaction.

CONCLUSION

Feedback of benchmark information and subsequent quality improvement efforts led to small, although significant, improvement in compliance with process-of-care guidelines and patient-reported measures of quality. The measures that relied on patient reports of problems with care, rather than patient ratings of satisfaction with care, seemed to be more responsive to change. These results support the value of benchmarking and collaboration.

The effect of supervision of residents on quality of care in five university-affiliated emergency departments

PURPOSE

To assess the impact of direct supervision of resident physicians by attending physicians on quality of care in emergency departments.

METHOD

In 1993, compliance with process-of-care guidelines was measured for 3,667 patients cared for by residents in five emergency departments in Boston and Cambridge, Massachusetts. Those patients presented with abdominal pain, asthma/COPD, chest pain, hand laceration, head trauma, or vaginal bleeding. A follow-up survey to assess patient satisfaction and reported problems with care was completed by 1,094 randomly sampled patients.

RESULTS

In multivariate analysis, residents directly supervised by attending physicians had significantly (p < .0001) higher adjusted mean percentage compliance with guidelines (64%) than did residents alone (55%). Better compliance was also associated with higher level of training of the resident and greater patient urgency. There was no significant difference between supervised and unsupervised residents in either adjusted patient satisfaction or reported problems with care.

CONCLUSIONS

Direct supervision of residents in emergency departments is significantly associated with better compliance with guidelines, regardless of level of training. However, direct supervision was not shown to influence patients' experience with care.

Patient-specific predictors of ambulance use

STUDY OBJECTIVE

To determine patient-specific socioeconomic and health status characteristics for patients arriving by ambulance at an emergency department.

METHODS

Ambulance use among adult ED patients presenting with abdominal pain, chest pain, head trauma, or shortness of breath was studied at five urban teaching hospitals in the north-eastern United States. Cross-sectional analysis within a prospective cohort study of 4,979 consecutive patients was performed using an interval sequence subset of 2,315 patients (84% of those eligible) to whom questionnaires were administered. Ambulance use (21% of surveyed patients; 26% of all patients) was analyzed with logistic regression.

RESULTS

Predictors of ambulance use included age greater than 65 years (odds ratio [OR], 1.95; 95% confidence interval [CI], 1.34 to 2.82); clinical severity (OR, 3.11; 95% CI, 2.27 to 4.25); poverty (OR, 1.40; 95% CI, 1.08 to 1.83); physical function (OR, 1.05; 95% CI, 1.02 to 1.09 for each point of worsening function on a 12-point physical function scale); and various types of health insurance coverage. Race, sex, education, Medicaid coverage, frequency of ED use, living arrangements, and primary physician availability were not predictive in multivariate analysis of surveyed patients.

CONCLUSION

Ambulance use varies by age, clinical severity, income, patient-specific characteristics of physical function, and type of health insurance. Medicaid coverage and frequent ED use are not predictive of increased ambulance use.

Designing an emergency medicine physician workstation to support risk management in decision making

The practice of emergency medicine requires rapid decision making. The speed of decision making in the face of limited information contributes to the high risk of medical malpractice suits. We explore design approaches to an emergency physician electronic medical record product, EMstation, that may reduce the risk of adverse medical events by providing cues and tools while the patient may still be in the emergency department. EMstation is an Emergency Medicine Physician Workstation base on a Microsoft Windows 3.1 user interface. Because adaptation and adaptability to physician needs are critical to user acceptance, design to workflow, multisite end user customization, and integrated database support are used to support risk management documentation in EMstation. This article describes techniques that can be incorporated into electronic medical products which may prevent adverse medical events.

Aspects of risk management support for an Emergency Medicine Physician Workstation

Emergency departments are high risk sites for malpractice events. EMstation™ is an Emergency Medicine Physician Workstation that incorporates tools to reduce malpractice risk in near real time (at the time of documentation). Based on a Microsoft Windows 3.1 interface, physicians are led through color-coded templates addressing known failure modes in emergency medicine. Risk management opportunities available at the time of charting when the patient is often still in the department allowing real time risk reduction are explored.

Temporal representation of clinical algorithms using expert-system and database tools

The HyperLipid Advisory System combines a rule-based implementation of a clinical algorithm (the NIH Cholesterol Education Program Expert Panel recommendations) with a temporal representation that facilitates reasoning over time while maintaining efficient storage in a standard database. The temporal representation consists of objects that model point events such as visits and interval events such as specific therapies. These objects are combined into abstractions called phases, which correspond to higher level clinical concepts such as a diet or drug treatment. The time-oriented data objects are referenced in the rules using a custom-tailored operator query language. Between user sessions relevant clinical data are stored in external files. When the advisory system is reconsulted, this information is retrieved and mapped back into an object-oriented format. Use of a commercially available expert-system shell for such tasks allows algorithm implementation in standard personal computing environments.