Evaluation of performance and perceived utility of mental healthcare indicators in routine health information systems in five low- and middle-income countries

Scaling up mental health care and psychosocial support in low-resource settings: a roadmap to impact

AIMS

Despite recent global attention to mental health and psychosocial support services and a growing body of evidence-support interventions, few mental health services have been established at a regional or national scale in low- and middle-income countries (LMIC). There are myriad challenges and barriers ranging from testing interventions that do not target priority needs of populations or policymakers to interventions that cannot achieve adequate coverage to decrease the treatment gap in LMIC.

METHOD

We propose a 'roadmap to impact' process that guides planning for interventions to move from the research space to the implementation space.

RESULTS

We establish four criteria and nine associated indicators that can be evaluated in low-resource settings to foster the greatest likelihood of successfully scaling mental health and psychosocial interventions. The criteria are relevance (indicators: population need, cultural and contextual fit), effectiveness (change in mental health outcome, change in hypothesised mechanism of action), quality (adherence, competence, attendance) and feasibility (coverage, cost). In the research space, relevance and effectiveness need to be established before moving into the implementation space. In the implementation space, ongoing monitoring of quality and feasibility is required to achieve and maintain a positive public health impact. Ultimately, a database or repository needs to be developed with these criteria and indicators to help researchers establish and monitor minimum benchmarks for the indicators, and for policymakers and practitioners to be able to select what interventions will be most likely to succeed in their settings.

CONCLUSION

A practicable roadmap with a sequence of measurable indicators is an important step to delivering interventions at scale and reducing the mental health treatment gap around the world.

BJPsych Open fifth anniversary editorial: history, accomplishments, trajectory and passion

BJPsych Open has come of age. This editorial celebrates the journal's fifth anniversary by reviewing the history of BJPsych Open, what we have accomplished, where we strive to go (our planned trajectory) and the passion of being an Editor-in-Chief.

Measuring what matters - information systems for management of chronic disease in primary healthcare settings in low and middle-income countries: challenges and opportunities

Effective health information systems are essential to the delivery of high-quality community-based care for chronic disease which will be needed to address the changing healthcare needs of populations in low and middle-income country settings. Health management information systems (health service data collected at facility level) and electronic health records (data organised by individual patients) may support the measurement-based, collaborative approach that is central to the chronic care model, which has been adopted as the basis for task-shared models of care for mental health and non-communicable disease. We used the performance of routine information systems management to guide our commentary on the evidence-base about information systems to support chronic care. We found that, despite an appetite for using the information to support decision-making around service planning, this rarely happens in practice, reasons include that data is not perceived to be of good quality or fit for purpose. There is often a mismatch between technology design and the availability of specialised knowledge and infrastructure. However, when data collection is designed in collaboration with local stakeholders, there is some evidence of success, demonstrated by completion and accuracy of data forms. Whilst there are global targets for the development of health information systems and progress on these is undoubtedly being made, indicators for chronic disease are seldom prioritised by national governments and there is insufficient decentralisation to facilitate local data-driven decision-making. Our recommendations for future research and development, therefore, focus upon the need to integrate context into the design of information systems: through building strong multisectoral partnerships, ensuring newly developed indicators are well aligned to service models and using technology that is a good fit with local infrastructure. This approach will be necessary if information systems are to deliver on their potential to drive improvements in care for chronic disease.

Evaluation of a new set of indicators for mental health care implemented in Madhya Pradesh, India: a mixed methods study

BACKGROUND

Mental health information systems are, in general, inadequate and unreliable in India. We have developed key mental health indicators for measuring mental health service coverage in primary care. This study aims to evaluate the use of these new indicators in seven health care facilities in Sehore District of Madhya Pradesh in India.

METHODS

The study employed a mixed methods approach. We conducted: a qualitative study (n = 26) with health workers, Health Management Information Systems (HMIS) staff, project coordinators and supervisors; a review of case records (n = 61 at time 1 and n = 74 at time 2); and a structured questionnaire (n = 26) with health workers. The performance, user-friendliness, appropriateness, perceived utility and sustainability of the use of new mental health indicators was assessed.

RESULTS

High levels of completion, and correctness of completion, of the new mental health indicators were found for the case records. The simplicity of the forms, as well as technical support from the project team, contributed to acceptability and feasibility of implementation. Perceived sustainability of the new forms was, however, affected by the overstretched primary care staff. Further work is needed to support the integration of mental health with routine HMIS.

CONCLUSION

This study demonstrated that the implementation of key mental health service delivery indicators in Sehore District primary care facilities was feasible. Technical assistance was imperative in maintaining the performance of the indicators over the two studied time points. The integration of mental health indicators in routine health information systems, and political buy-in, are needed to monitor and sustain community mental health programmes in India.

Meeting the mental health needs of low- and middle-income countries: the start of a long journey

SUMMARY

Mental health is increasingly recognised as an important component of global health. In recognition of this fact, the European Union funded the Emerald programme (Emerging Mental Health Systems in Low- and Middle-Income Countries). The aims were to improve mental health in the following six low- and middle-income countries (LMICs): Ethiopia, India, Nepal, Nigeria, South Africa and Uganda. The Emerald programme offers valuable insights into addressing the mental health needs of LMICs. It provides a framework and practical tools. However, it will be important to evaluate longer-term effects including improvements in mental health outcomes, as well as the applicability to LMICs beyond existing participant countries. Importantly, this must be coupled with efforts to improve health worker retention in LMICs.

Effective methods for knowledge transfer to strengthen mental health systems in low- and middle-income countries

BACKGROUND

The Emerald project's focus is on how to strengthen mental health systems in six low- and middle-income countries (LMICs) (Ethiopia, India, Nepal, Nigeria, South Africa and Uganda). This was done by generating evidence and capacity to enhance health system performance in delivering mental healthcare.A common problem in scaling-up interventions and strengthening mental health programmes in LMICs is how to transfer research evidence, such as the data collected in the Emerald project, into practice.

AIMS

To describe how core elements of Emerald were implemented and aligned with the ultimate goal of strengthening mental health systems, as well as their short-term impact on practices, policies and programmes in the six partner countries.

METHOD

We focused on the involvement of policy planners, managers, patients and carers.

RESULTS

Over 5 years of collaboration, the Emerald consortium has provided evidence and tools for the improvement of mental healthcare in the six LMICs involved in the project. We found that the knowledge transfer efforts had an impact on mental health service delivery and policy planning at the sites and countries involved in the project.

CONCLUSIONS

This approach may be valid beyond the mental health context, and may be effective for any initiative that aims at implementing evidence-based health policies for health system strengthening.

Strengthening mental health systems in low- and middle-income countries: recommendations from the Emerald programme

BACKGROUND

There is a large treatment gap for mental, neurological or substance use (MNS) disorders. The 'Emerging mental health systems in low- and middle-income countries (LMICs)' (Emerald) research programme attempted to identify strategies to work towards reducing this gap through the strengthening of mental health systems.

AIMS

To provide a set of proposed recommendations for mental health system strengthening in LMICs.

METHOD

The Emerald programme was implemented in six LMICs in Africa and Asia (Ethiopia, India, Nepal, Nigeria, South Africa and Uganda) over a 5-year period (2012-2017), and aimed to improve mental health outcomes in the six countries by building capacity and generating evidence to enhance health system strengthening.

RESULTS

The proposed recommendations align closely with the World Health Organization's key health system strengthening 'building blocks' of governance, financing, human resource development, service provision and information systems; knowledge transfer is included as an additional cross-cutting component. Specific recommendations are made in the paper for each of these building blocks based on the body of data that were collected and analysed during Emerald.

CONCLUSIONS

These recommendations are relevant not only to the six countries in which their evidential basis was generated, but to other LMICs as well; they may also be generalisable to other non-communicable diseases beyond MNS disorders.

DECLARATION OF INTEREST

None.

Experience of implementing new mental health indicators within information systems in six low- and middle-income countries

BACKGROUND

Successful scale-up of integrated primary mental healthcare requires routine monitoring of key programme performance indicators. A consensus set of mental health indicators has been proposed but evidence on their use in routine settings is lacking.

AIMS

To assess the acceptability, feasibility, perceived costs and sustainability of implementing indicators relating to integrated mental health service coverage in six South Asian (India, Nepal) and sub-Saharan African countries (Ethiopia, Nigeria, South Africa, Uganda).

METHOD

A qualitative study using semi-structured key informant interviews (n = 128) was conducted. The 'Performance of Routine Information Systems' framework served as the basis for a coding framework covering three main categories related to the performance of new tools introduced to collect data on mental health indicators: (1) technical; (2) organisation; and (3) behavioural determinants.

RESULTS

Most mental health indicators were deemed relevant and potentially useful for improving care, and therefore acceptable to end users. Exceptions were indicators on functionality, cost and severity. The simplicity of the data-capturing formats contributed to the feasibility of using forms to generate data on mental health indicators. Health workers reported increasing confidence in their capacity to record the mental health data and minimal additional cost to initiate mental health reporting. However, overstretched primary care staff and the time-consuming reporting process affected perceived sustainability.

CONCLUSIONS

Use of the newly developed, contextually appropriate mental health indicators in health facilities providing primary care services was seen largely to be feasible in the six Emerald countries, mainly because of the simplicity of the forms and continued support in the design and implementation stage. However, approaches to implementation of new forms generating data on mental health indicators need to be customised to the specific health system context of different countries. Further work is needed to identify ways to utilise mental health data to monitor and improve the quality of mental health services.

DECLARATION OF INTEREST

None.

Health system strengthening for mental health in low- and middle-income countries: introduction to the Emerald programme

This paper gives an overview of the Emerald (Emerging mental health systems in low- and middle-income countries) programme and introduces the subsequent seven papers in this BJPsych Open thematic series. The aims of the Emerald research programme were to improve mental health outcomes in six low- and middle-income countries (LMICs), namely Ethiopia, India, Nepal, Nigeria, South Africa and Uganda, by building capacity and by generating evidence to enhance health system strengthening in these six countries. The longer-term aim is to improve mental healthcare, and so contribute to a reduction in the large treatment gap that exists for mental disorders. This series includes papers describing the following components of the Emerald programme: (a) capacity building; (b) mental health financing; (c) integrated care (d) mental health information systems; and (e) knowledge transfer. We also include a cross-cutting paper with recommendations from the Emerald programme as a whole. The inclusion of clear mental-health-related targets and indicators within the United Nations Sustainable Development Goals now intensifies the need for strong evidence about both how to provide effective treatments, and how to deliver these treatments within robust health systems.