Development and evaluation of an information system for quality assurance

A systematic review of the cost of data collection for performance monitoring in hospitals

BACKGROUND

Key performance indicators (KPIs) are used to identify where organisational performance is meeting desired standards and where performance requires improvement. Valid and reliable KPIs depend on the availability of high-quality data, specifically the relevant minimum data set ((MDS) the core data identified as the minimum required to measure performance for a KPI) elements. However, the feasibility of collecting the relevant MDS elements is always a limitation of performance monitoring using KPIs. Preferably, data should be integrated into service delivery, and, where additional data are required that are not currently collected as part of routine service delivery, there should be an economic evaluation to determine the cost of data collection. The aim of this systematic review was to synthesise the evidence base concerning the costs of data collection in hospitals for performance monitoring using KPI, and to identify hospital data collection systems that have proven to be cost minimising.

METHODS

We searched MEDLINE (1946 to May week 4 2014), Embase (1974 to May week 2 2014), and CINAHL (1937 to date). The database searches were supplemented by searching for grey literature through the OpenGrey database. Data was extracted, tabulated, and summarised as part of a narrative synthesis.

RESULTS

The searches yielded a total of 1,135 publications. After assessing each identified study against specific inclusion exclusion criteria only eight studies were deemed as relevant for this review. The studies attempt to evaluate different types of data collection interventions including the installation of information communication technology (ICT), improvements to current ICT systems, and how different analysis techniques may be used to monitor performance. The evaluation methods used to measure the costs and benefits of data collection interventions are inconsistent across the identified literature. Overall, the results weakly indicate that collection of hospital data and improvements in data recording can be cost-saving.

CONCLUSIONS

Given the limitations of this systematic review, it is difficult to conclude whether improvements in data collection systems can save money, increase quality of care, and assist performance monitoring of hospitals. With that said, the results are positive and suggest that data collection improvements may lead to cost savings and aid quality of care.

SYSTEMATIC REVIEW REGISTRATION

PROSPERO CRD42014007450 .

Fit to care? A comparison of informal caregivers of first-generation Black Caribbeans and White dependants with advanced progressive disease in the UK

The present survey aimed to describe and compare the main needs and problems experienced by informal caregivers of Black Caribbean and White native-born patients in their last year of life. Out of the 106 Black Caribbean and 110 White patients identified as dying during the survey period, 50 interviews per ethnic group were conducted, a response rate of 47% and 45%. Out of these, 31 respondents representing Black Caribbean and 28 representing White dependants said that they bore the brunt of caregiving. Compared with those who cared for White dependants, those who cared for Black Caribbean dependants were more likely to be women (84% versus 46%, chi2 = 9.21, 1 d.f., asymptotic P = 0.002) and younger than 55 years of age (73% versus 37%, chi2 = 7.60, 1 d.f., asymptotic P = 0.006). The personal-care tasks which caregivers assisted their dependants with were similar, as were the informal resources they drew on. Many caregivers reported restrictions in their daily lives; this was more pronounced for those who cared for Black Caribbean dependants (chi2 = 6.40, 2 d.f., asymptotic P = 0.041, exact P = 0.039). Research is required to provide a qualitative narrative of the meaning caregivers from different communities ascribe to caring, and the formal and informal resources which they need to support them.

The effectiveness of very short scales for depression screening in elderly medical patients

OBJECTIVE

To compare very short scales for screening for depression with longer, widely used scales.

METHODS

Eighty-seven patients over the age of 60 who were admitted to rehabilitation wards or were attending a day rehabilitation facility at a British teaching hospital were screened for depression using the 1-item mental health inventory, and the 4-item, 15-item and 30-item geriatric depression scales. The sensitivity, specificity, and areas under receiver operating characteristic curves were compared, with the diagnostic criteria for research of ICD-10 providing the criterion diagnosis of depressive episode.

RESULTS

All the scales had comparable sensitivity (82.4-100%), specificity (60.0-71.4%), and positive predictive values (33.3-42.9%). Comparison of receiver operating characteristic curves for each scale showed no statistically significant difference between them (range 0.80-0.88).

CONCLUSIONS

The very short scales performed just as well as the widely used longer screening scales in this population. They are worthy of further examination in elderly populations at risk of depression, and may be particularly suitable for older adults due to their brevity and ease of use.

How can usability measurement affect the re-engineering process of clinical software procedures?

As a consequence of the dramatic improvements achieved in information technology standards in terms of single hardware and software components, efforts in the evaluation processes have been focused on the assessment of critical human factors, such as work-flow organisation, man-machine interaction and, in general, quality of use, or usability. This trend is particularly valid when applied to medical informatics, since the human component is the basis of the information processing system in health care context. With the aim to establish an action-research project on the evaluation and assessment of clinical software procedures which constitute an integrated hospital information system, the authors adopted this strategy and considered the measurement of perceived usability as one of the main goals of the project itself: the paper reports the results of this experience.