Evaluating integrated surveillance of antimicrobial resistance: experiences from use of three evaluation tools

Different sampling strategies for optimal detection of the overall genetic diversity of methicillin-resistant Staphylococcus aureus

Surveillance schemes for methicillin-resistant Staphylococcus aureus (MRSA) are widely established at the national and international levels. Due to the simple standardization of the protocol, mainly isolates from bloodstream infections are used. However, the limitations of this simple surveillance system are well described. We conducted a comprehensive analysis of MRSA isolates in a large Slovenian region over 5 years to identify the optimal sample group for assessing the overall MRSA diversity. At the same time, this study provides to date non-available molecular characterization of Slovenian MRSA isolates. A total of 306 MRSA isolates from various sources were sequenced and phenotypically tested for resistance. The isolates exhibited significant molecular diversity, encompassing 30 multi locus sequence type (MLST) sequence types (STs), 39 ST-SCCmec genetic lineages, 49 spa types, and 29 antibiotic resistance profiles. Furthermore, the isolate pool comprised 57 resistance genes, representing 22 resistance mechanisms, and 96 virulence genes. While bloodstream isolates, commonly used in surveillance, provided insights into frequently detected clones, they overlooked majority of clones and important virulence and resistance genes. Blood culture isolates detected 21.3% spa types, 24.1% resistance phenotypes, and 28.2% MLST-SCCmec profiles. In contrast, strains from soft tissues demonstrated superior genomic diversity capture, with 65.3% spa types, 58.6% resistance phenotypes, and 71.8% MLST-SCCmec profiles. These strains also encompassed 100.0% of virulence and 82.5% of resistance genes, making them better candidates for inclusion in surveillance programs. This study highlights the limitations of relying solely on bloodstream isolates in MRSA surveillance and suggests incorporating strains from soft tissues to obtain a more comprehensive understanding of the epidemiology of MRSA.IMPORTANCEIn this study, we investigated the diversity of methicillin-resistant Staphylococcus aureus (MRSA), a bacterium that can cause infections that are difficult to treat due to its resistance to antimicrobial agents. Currently, surveillance programs for MRSA mainly rely on isolates from bloodstream infections, employing a standardized protocol. However, this study highlights the limitations of this approach and introduces a more comprehensive method. The main goal was to determine which group of samples is best suited to understand the overall diversity of MRSA and to provide, for the first time, molecular characterization of Slovenian MRSA isolates. Our results suggest that including MRSA strains from soft tissue infections rather than just blood infections provides a more accurate and comprehensive view of bacterial diversity and characteristics. This insight is valuable for improving the effectiveness of surveillance programs and for developing strategies to better manage MRSA infections.

Assessment of the Implementation of Pakistan's National Action Plan on Antimicrobial Resistance in the Agriculture and Food Sectors

The agriculture and food (agrifood) sectors play key roles in the emergence, spread, and containment of antimicrobial resistance (AMR). Pakistan's first National Action Plan (NAP) on AMR was developed to guide One Health interventions to combat AMR through 2017-2022. To improve subsequent iterations, we assessed the implementation of Pakistan's NAP in the agrifood sectors (NAPag) in October 2022, using the Progressive Management Pathway on AMR tool developed by the Food and Agriculture Organization of the United Nations (FAO). The assessment tool addressed four crucial focus areas of the NAPag: governance, awareness, evidence, and practices. Each focus area contains multiple topics, which involve four sequential stages of activities to progressively achieve systematic management of AMR risk in the agrifood sectors. High-level representatives of the NAPag stakeholders provided information for the assessment through pre-event documentary review and workshop discussions. The assessment results showed that Pakistan's NAPag had an overall moderate coverage (59%) of the anticipated activities. Gaps were particularly notable in strengthening governance, good practices, and interventions in non-livestock sectors. Furthermore, only 12% of the evaluated activities were fully executed and documented, consistently remaining at the planning and piloting stages in the livestock sector across all the examined topics. Insufficient attention to non-livestock sectors, inadequate regulation and enforcement capacity, and resource constraints have hindered scalable and sustainable interventions under the current plan. This assessment provides valuable insights to strengthen the inclusiveness and contribution of the agrifood sectors in the next NAP iteration. In the short-to-medium term, strategic prioritization is necessary to optimize the use of limited resources and target the most critical gaps, such as improving awareness among key stakeholders and fortifying regulations for prudent antimicrobial use. In the long term, integration of AMR into the country's broader health, development, and agricultural transformation agendas will be needed to generate sustainable benefits.

Development of a cross-sectoral antimicrobial resistance capability assessment framework

Antimicrobial resistance (AMR) is an urgent and growing global health concern, and a clear understanding of existing capacities to address AMR, particularly in low-income and middle-income countries (LMICs), is needed to inform national priorities, investment targets and development activities. Across LMICs, there are limited data regarding existing mechanisms to address AMR, including national AMR policies, current infection prevention and antimicrobial prescribing practices, antimicrobial use in animals, and microbiological testing capacity for AMR. Despite the development of numerous individual tools designed to inform policy formulation and implementation or surveillance interventions to address AMR, there is an unmet need for easy-to-use instruments that together provide a detailed overview of AMR policy, practice and capacity. This paper describes the development of a framework comprising five assessment tools which provide a detailed assessment of country capacity to address AMR within both the human and animal health sectors. The framework is flexible to meet the needs of implementers, as tools can be used separately to assess the capacity of individual institutions or as a whole to align priority-setting and capacity-building with AMR National Action Plans (NAPs) or national policies. Development of the tools was conducted by a multidisciplinary team across three phases: (1) review of existing tools; (2) adaptation of existing tools; and (3) piloting, refinement and finalisation. The framework may be best used by projects which aim to build capacity and foster cross-sectoral collaborations towards the surveillance of AMR, and by LMICs wishing to conduct their own assessments to better understand capacity and capabilities to inform future investments or the implementation of NAPs for AMR.

Evaluating the OH-EpiCap tool using the Danish integrated surveillance program for AMU and AMR as a case study

Antimicrobial resistance (AMR) is considered a One Health (OH) challenge, ideally demanding concerted efforts from the animal, human and environmental side. DANMAP, the Danish Integrated Antimicrobial Resistance Monitoring and Research Program, is monitoring AMR and antimicrobial use in animals and humans. OH-EpiCap is an evaluation tool, developed to address essential elements in OH surveillance systems, such as the dimensions of the organization, operational activities and the impact of the surveillance activities. We aimed to evaluate DANMAP using OH-EpiCap and hereby assessed the suitability of OH-EpiCap to evaluate integrated AMR surveillance systems. During the evaluation, the strengths and weaknesses of DANMAP concerning the "OH-ness" of the program were discussed. Furthermore, possible adaptations of the standard operating procedures and governance structure were addressed. Attention was paid to the ability and easiness of DANMAP to cope with current and future challenges connected to integrated AMR surveillance. It was concluded that DANMAP has a strong OH approach covering relevant aspects for humans and animals, whereas environmental aspects are missing. OH-EpiCap proved to be straightforward to use and provided valuable insights. The authors recommend OH-EpiCap to be used by health authorities and stakeholders. It is not suitable for the technical evaluation of a surveillance program.

Users' perception of the OH-EpiCap evaluation tool based on its application to nine national antimicrobial resistance surveillance systems

Introduction

Antimicrobial resistance (AMR) is a One Health (OH) challenge. To achieve or maintain an effective and efficient AMR surveillance system, it is crucial to evaluate its performance in meeting the proposed objectives, while complying with resource restrictions. The OH-EpiCap tool was created to evaluate the degree of compliance of hazard surveillance activities with essential OH concepts across the following dimensions: organization, operational activities, and impact of the surveillance system. We present feedback on the application of the OH-EpiCap tool from a user's perspective, based on the use of the tool to evaluate nine national AMR surveillance systems, each with different contexts and objectives.

Methods

The OH-EpiCap was assessed using the updated CoEvalAMR methodology. This methodology allows the evaluation of the content themes and functional aspects of the tool and captures the user's subjective experiences via a strengths, weaknesses, opportunities, and threats (SWOT) approach.

Results and Discussion

The results of the evaluation of the OH-EpiCap are presented and discussed. The OH-EpiCap is an easy-to-use tool, which can facilitate a fast macro-overview of the application of the OH concept to AMR surveillance. When used by specialists in the matter, an evaluation using OH-EpiCap can serve as a basis for the discussion of possible adaptations of AMR surveillance activities or targeting areas that may be further investigated using other evaluation tools.

Evaluation of the Antimicrobial Resistance Surveillance System in Sentinel Sites in Cameroon

Background The purpose of antimicrobial resistance (AMR) surveillance is to guide clinical decision-making, characterize trends in resistance infections, and provide epidemiological data to study the impact of AMR on health and the effectiveness of control measures in health facilities and the community. To do this, regular and relevant assessments of standardized AMR surveillance systems are essential to prioritize threats and improve their performance and cost-effectiveness. The scarcity of data and the absence of a local and national strategy on the surveillance of antibiotic resistance in Sub-Saharan Africa and even more so in Cameroon do not allow an effective response to be carried out against the scourge. This gap led us to conduct a study on the evaluation of the attributes of the antibiotic resistance surveillance system in Cameroon. Methodology We conducted a descriptive, cross-sectional study over a period of one year from January to December 2021. The study was conducted in the sentinel sites of surveillance in Cameroon, namely, those of the Centre, South-West, Littoral, and North regions. Using structured questionnaires and a pre-established and pre-tested interview guide, we collected data that allowed us to assess a surveillance system's quantitative and qualitative attributes according to the CDC guidelines. Scores were assigned based on the different questionnaires to assess the attributes of the AMR surveillance system. Results Of the evaluated attributes, it appears that although the system is useful (88.9%, i.e., a score of 2), and has good completeness of data transmission (98.9%, i.e., a score of 3), it is not simple (64.3%, i.e., a score of 1), not stable (58.6%, i.e., a score of 1), not acceptable (58.6%, i.e., a score of 1), and presents poor data quality (11.05%, a score of 1). Conclusions The AMR surveillance system in Cameroon is useful with good completeness. However, many other attributes have poor performance, indicating the importance of improving the antimicrobial surveillance system.

OH-EpiCap: a semi-quantitative tool for the evaluation of One Health epidemiological surveillance capacities and capabilities

Although international health agencies encourage the development of One Health (OH) surveillance, many systems remain mostly compartmentalized, with limited collaborations among sectors and disciplines. In the framework of the OH European Joint Programme "MATRIX" project, a generic evaluation tool called OH-EpiCap has been developed to enable individual institutes/governments to characterize, assess and monitor their own OH epidemiological surveillance capacities and capabilities. The tool is organized around three dimensions: organization, operational activities, and impact of the OH surveillance system; each dimension is then divided into four targets, each including four indicators. A semi-quantitative questionnaire enables the scoring of each indicator, with four levels according to the degree of satisfaction in the studied OH surveillance system. The evaluation is conducted by a panel of surveillance representatives (during a half-day workshop or with a back-and-forth process to reach a consensus). An R Shiny-based web application facilitates implementation of the evaluation and visualization of the results, and includes a benchmarking option. The tool was piloted on several foodborne hazards (i.e., Salmonella, Campylobacter, Listeria), emerging threats (e.g., antimicrobial resistance) and other zoonotic hazards (psittacosis) in multiple European countries in 2022. These case studies showed that the OH-EpiCap tool supports the tracing of strengths and weaknesses in epidemiological capacities and the identification of concrete and direct actions to improve collaborative activities at all steps of surveillance. It appears complementary to the existing EU-LabCap tool, designed to assess the capacity and capability of European microbiology laboratories. In addition, it provides opportunity to reinforce trust between surveillance stakeholders from across the system and to build a good foundation for a professional network for further collaboration.

Capturing systematically users' experience of evaluation tools for integrated AMU and AMR surveillance

Tackling antimicrobial resistance (AMR) is a goal for many countries. Integrated surveillance of antimicrobial use (AMU) and resistance is a prerequisite for effective risk mitigation. Regular evaluation of any surveillance is needed to ensure its effectiveness and efficiency. The question is how to evaluate specifically integrated surveillance for AMU and AMR. In an international network called CoEvalAMR, we have developed guidelines for selection of the most appropriate tools for such an evaluation. Moreover, we have assessed different evaluation tools as examples using a country case format and a methodology with a focus on the user's experience. This paper describes the updated methodology, which consists of a brief introduction to the case and to the tool separately. Moreover, there are 12 functional aspects and nine content themes which should be scored using a 4-tiered scale. Additionally, four Strengths, Weaknesses, Opportunities, Threats (SWOT) questions should be addressed. Results are illustrated using radar diagrams. An example of application of the updated methodology is given using the ECoSur evaluation tool. No tool can cover all evaluation aspects comprehensively in a user-friendly manner, so the choice of tool must be based upon the specific evaluation purpose. Moreover, adequate resources, time and training are needed to obtain useful outputs from the evaluation. Our updated methodology can be used by tool users to share their experience with available tools, and hereby assist other users in identifying the most suited tool for their evaluation purpose. Additionally, tool developers can get valuable information for further improvements of their tool.

A systematic approach toward progressive improvement of national antimicrobial resistance surveillance systems in food and agriculture sectors

The first Food and Agriculture Organization of the United Nations (FAO) Action Plan on antimicrobial resistance (AMR), published in 2016, identified the need to develop capacity for AMR surveillance and monitoring in food and agriculture sectors. As part of this effort, FAO has developed the "Assessment Tool for Laboratories and AMR Surveillance Systems" (FAO-ATLASS) to assist countries in systematically assessing their AMR surveillance system in food and agriculture. FAO-ATLASS includes two different modules for surveillance and laboratory assessment. Each module includes two questionnaires that collect either qualitative or semi-quantitative data to describe and score the performance of national AMR surveillance system data production network, data collection and analysis, governance, communication and overall sustainability in a standardized manner. Based on information captured in the questionnaire by trained assessors (1) tables and figures describing the outputs of the surveillance system are automatically generated (2) a Progressive Improvement Pathway (PIP) stage, ranging from "1-limited" to "5-sustainable", is assigned to each laboratory assessed in the country, each area of the surveillance system and also to the overarching national AMR surveillance system. FAO-ATLASS allows national authorities to implement a strategic stepwise approach to improving their AMR surveillance systems via the FAO-ATLASS PIP system and provides an evidence base for actions and advocacy. The implementation of FAO-ATLASS at regional and global levels can contribute to harmonize and better coordinate strategies aimed at implementing an integrated AMR surveillance system under the One Health approach.

Use of a new antimicrobial consumption monitoring system (Vet-AMNet): Application to Dutch dairy sector over a 9-year period

Introduction

The urgency of preventing the increase of antimicrobial resistance has been emphasized by international authorities such as the World Health Organization, European Medicines Agency, and World Organization for Animal Health. Monitoring systems capable of reporting antimicrobial consumption data are regarded as a crucial pillar of this fight. The Vet-AMNet system was developed to collect and analyze national antimicrobial consumption data in Portuguese dairy farms to support the veterinary authority in stewardship actions and to assist both veterinarians and farmers in daily decisions related to antimicrobials.

Methods

To evaluate the robustness of the system and other identified critical success factors, it was used to analyze antimicrobial consumption data available from the Dutch dairy cow sector over the period from 2012 to 2020. The data previously used for publications by the Netherlands Veterinary Medicines Institute (SDa) were imported and pre-processed by the Vet-AMNet system according to the SDa's standard operating procedure and the Dutch metrics to measure antimicrobial consumption were calculated.

Results

By comparing the outputs with the figures generated by the system established in the Netherlands, the Portuguese system was validated. Antimicrobial consumption data from the Dutch dairy sector during the 9-year period will be presented in unpublished graphs and tables, where each molecule's pharmaceutical formulation, pharmacotherapeutic group and line of choice will be related and discussed, illustrating the evolution of sectorial antimicrobial consumption against a background of a strong national antimicrobial policy initiated by public-private cooperation and supported by legislation.

Qualitative Risk Assessment for Antimicrobial Resistance among Humans from Salmon Fillet Consumption Due to the High Use of Antibiotics against Bacterial Infections in Farmed Salmon

Background: Worldwide, aquaculture is considered as a hotspot environment for antimicrobial resistance (AMR) due to the intense use of antibiotics in its productive systems. Chile is the second largest producer of farmed salmon worldwide, and tons of antibiotics are used to control bacterial diseases, such as Salmon Rickettsial Syndrome (SRS) and Bacterial Kidney Disease (BKD). However, studies determining the risk of consuming salmon fillets that have been treated with antibiotics during the salmon production are limited. Consulting leading experts in the field could provide a knowledge base to identify and address this question and research gaps. Methods: Multisectoral risk perception of AMR through salmon fillet consumption was evaluated by eliciting expert data obtained through discussions during a workshop and from questionnaires given to experts from academia (n = 15, 63%), the public sector (n = 5, 21%), and the salmon industry (n = 4, 17%). Results: The qualitative risk analysis suggested an overall ‘low’ probability of AMR acquisition by consumption of salmon fillet that had been treated during the production cycle. The risk perception varied slightly between production stages in freshwater and seawater. In consensus with all sectors, this overall ‘low’, but existing, risk was probably associated with bacterial infections and the use of antibiotics. Conclusions: As it is essential to reduce the use of antibiotics in the Chilean salmon industry, this intersectoral approach and consensual results could favor effective implementation of targeted initiatives for the control and prevention of major bacterial diseases.

Antibiotic Resistance: One Health One World Outlook

Antibiotic resistance (ABR) is a growing public health concern worldwide, and it is now regarded as a critical One Health issue. One Health's interconnected domains contribute to the emergence, evolution, and spread of antibiotic-resistant microorganisms on a local and global scale, which is a significant risk factor for global health. The persistence and spread of resistant microbial species, and the association of determinants at the human-animal-environment interface can alter microbial genomes, resulting in resistant superbugs in various niches. ABR is motivated by a well-established link between three domains: human, animal, and environmental health. As a result, addressing ABR through the One Health approach makes sense. Several countries have implemented national action plans based on the One Health approach to combat antibiotic-resistant microbes, following the Tripartite's Commitment Food and Agriculture Organization (FAO)-World Organization for Animal Health (OIE)-World Health Organization (WHO) guidelines. The ABR has been identified as a global health concern, and efforts are being made to mitigate this global health threat. To summarize, global interdisciplinary and unified approaches based on One Health principles are required to limit the ABR dissemination cycle, raise awareness and education about antibiotic use, and promote policy, advocacy, and antimicrobial stewardship.

Evaluating Integrated Surveillance for Antimicrobial Use and Resistance in England: A Qualitative Study

Integrated surveillance systems for antimicrobial use (AMU) and antimicrobial resistance (AMR) require regular evaluation to ensure the effectiveness and efficiency of the system. An important step in the evaluation is to choose an appropriate tool for the purpose of the evaluation. The “Integrated Surveillance System Evaluation” (ISSE) framework is a conceptual framework that was developed to evaluate One Health (OH) integration in surveillance system for AMU/AMR. This study aimed to evaluate the performance and value of integrated surveillance system for AMU/AMR in England by applying the ISSE framework, which was used to develop data collection protocols and define the study design. A qualitative study using semi-structured interviews was conducted to collect the data and analyse it thematically. Eighteen stakeholders from human, animal, food and environment sectors that are involved in AMU/AMR surveillance were interviewed. Four main themes emerged from the analysis: (1) Cross-sectoral integration in the surveillance system for AMU/AMR; (2) Production of OH outputs and outcomes; (3) Drivers and barriers to cross-sectoral collaboration; and 4) Need for more cross-sectoral collaboration. The findings showed that there were links between integrated surveillance information, decision making and interventions. However, there were only few OH examples, such as the UK AMR contingency plan, where the potential of cross-sectoral collaboration was fully exploited. A lot of the benefits described were related to the generation of information and increase in knowledge and understanding without links to how the information generated was used. While these intangible benefits have a value on their own, being able to link surveillance information and mitigation measures would help to enhance the value of integrated surveillance. In terms of improvement, the main areas identified were the development of more harmonised methods for data collection and analysis, provision of resources dedicated to cross-sectoral collaboration, improved coordination, and collection of surveillance data from the environment and from companion animals. By identifying links between OH surveillance information produced and various outputs and outcomes; this study helped to understand the wider benefits of integrated surveillance for AMU/AMR in England and provided insights on how the system could be improved and efficiency increased.

Surveillance strategies using routine microbiology for antimicrobial resistance in low- and middle-income countries

BACKGROUND

Routine microbiology results are a valuable source of antimicrobial resistance (AMR) surveillance data in low- and middle-income countries (LMICs) as well as in high-income countries. Different approaches and strategies are used to generate AMR surveillance data.

OBJECTIVES

We aimed to review strategies for AMR surveillance using routine microbiology results in LMICs and to highlight areas that need support to generate high-quality AMR data.

SOURCES

We searched PubMed for papers that used routine microbiology to describe the epidemiology of AMR and drug-resistant infections in LMICs. We also included papers that, from our perspective, were critical in highlighting the biases and challenges or employed specific strategies to overcome these in reporting AMR surveillance in LMICs.

CONTENT

Topics covered included strategies of identifying AMR cases (including case-finding based on isolates from routine diagnostic specimens and case-based surveillance of clinical syndromes), of collecting data (including cohort, point-prevalence survey, and case-control), of sampling AMR cases (including lot quality assurance surveys), and of processing and analysing data for AMR surveillance in LMICs.

IMPLICATIONS

The various AMR surveillance strategies warrant a thorough understanding of their limitations and potential biases to ensure maximum utilization and interpretation of local routine microbiology data across time and space. For instance, surveillance using case-finding based on results from clinical diagnostic specimens is relatively easy to implement and sustain in LMIC settings, but the estimates of incidence and proportion of AMR is at risk of biases due to underuse of microbiology. Case-based surveillance of clinical syndromes generates informative statistics that can be translated to clinical practices but needs financial and technical support as well as locally tailored trainings to sustain. Innovative AMR surveillance strategies that can easily be implemented and sustained with minimal costs will be useful for improving AMR data availability and quality in LMICs.

One Health Evaluation of Antimicrobial Use and Resistance Surveillance: A Novel Tool for Evaluating Integrated, One Health Antimicrobial Resistance and Antimicrobial Use Surveillance Programs

We describe the development, application and utility of our novel, One Health Evaluation of Antimicrobial Use and Resistance Surveillance (OHE-AMURS) tool that we created to evaluate progress toward integrated, One Health surveillance of antimicrobial resistance (AMR) and antimicrobial use (AMU) as a complex system in Canada. We conducted a qualitative inquiry into the current state of policy and programs for integrated AMR/AMU surveillance using explicit and tacit knowledge. To assess the "messy" state of public health surveillance program development, we synthesized recommendations from previous reports by the National Collaborating Centre for Infectious Diseases and the Canadian Council of Chief Veterinary Officers; conducted an environmental scan to find all federal, provincial, and territorial AMR/AMU surveillance programs in Canada; and conducted semi-structured interviews with Canadian subject matter experts. To integrate evidence from these different sources we adapted two published tools to create a new evaluation matrix, deriving 36 components of the ideal integrated AMR/AMU surveillance system. Our two-way matrix tool allowed us to examine seven common, foundational elements of sustainable programs for each component, and assign a stage of development/sustainability ranking for each component according to the matrix definitions. Our adaptable novel tool allowed for granular and repeatable assessment of the many components of a complex surveillance system. The assessment proved robust and exacting to ensure transparency in our methods and results. The matrix allows flexible assignment of program components based on program principles, and stages can be adapted to evaluate any aspect of an AMR/AMU surveillance or other multi-faceted, multi-jurisdictional system. Future refinement should include an assessment of the scope of surveillance components.

Assessment of Evaluation Tools for Integrated Surveillance of Antimicrobial Use and Resistance Based on Selected Case Studies

Regular evaluation of integrated surveillance for antimicrobial use (AMU) and resistance (AMR) in animals, humans, and the environment is needed to ensure system effectiveness, but the question is how. In this study, six different evaluation tools were assessed after being applied to AMU and AMR surveillance in eight countries: (1) ATLASS: the Assessment Tool for Laboratories and AMR Surveillance Systems developed by the Food and Agriculture Organization (FAO) of the United Nations, (2) ECoSur: Evaluation of Collaboration for Surveillance tool, (3) ISSEP: Integrated Surveillance System Evaluation Project, (4) NEOH: developed by the EU COST Action "Network for Evaluation of One Health," (5) PMP-AMR: The Progressive Management Pathway tool on AMR developed by the FAO, and (6) SURVTOOLS: developed in the FP7-EU project "RISKSUR." Each tool was scored using (i) 11 pre-defined functional aspects (e.g., workability concerning the need for data, time, and people); (ii) a strengths, weaknesses, opportunities, and threats (SWOT)-like approach of user experiences (e.g., things that I liked or that the tool covered well); and (iii) eight predefined content themes related to scope (e.g., development purpose and collaboration). PMP-AMR, ATLASS, ECoSur, and NEOH are evaluation tools that provide a scoring system to obtain semi-quantitative results, whereas ISSEP and SURVTOOLS will result in a plan for how to conduct evaluation(s). ISSEP, ECoSur, NEOH, and SURVTOOLS allow for in-depth analyses and therefore require more complex data, information, and specific training of evaluator(s). PMP-AMR, ATLASS, and ISSEP were developed specifically for AMR-related activities-only ISSEP included production of a direct measure for "integration" and "impact on decision making." NEOH and ISSEP were perceived as the best tools for evaluation of One Health (OH) aspects, and ECoSur as best for evaluation of the quality of collaboration. PMP-AMR and ATLASS seemed to be the most user-friendly tools, particularly designed for risk managers. ATLASS was the only tool focusing specifically on laboratory activities. Our experience is that adequate resources are needed to perform evaluation(s). In most cases, evaluation would require involvement of several assessors and/or stakeholders, taking from weeks to months to complete. This study can help direct future evaluators of integrated AMU and AMR surveillance toward the most adequate tool for their specific evaluation purpose.

Evaluating the Integration of One Health in Surveillance Systems for Antimicrobial Use and Resistance: A Conceptual Framework

It is now widely acknowledged that surveillance of antimicrobial resistance (AMR) must adopt a "One Health" (OH) approach to successfully address the significant threats this global public health issue poses to humans, animals, and the environment. While many protocols exist for the evaluation of surveillance, the specific aspect of the integration of a OH approach into surveillance systems for AMR and antimicrobial Use (AMU), suffers from a lack of common and accepted guidelines and metrics for its monitoring and evaluation functions. This article presents a conceptual framework to evaluate the integration of OH in surveillance systems for AMR and AMU, named the Integrated Surveillance System Evaluation framework (ISSE framework). The ISSE framework aims to assist stakeholders and researchers who design an overall evaluation plan to select the relevant evaluation questions and tools. The framework was developed in partnership with the Canadian Integrated Program for Antimicrobial Resistance Surveillance (CIPARS). It consists of five evaluation components, which consider the capacity of the system to: [1] integrate a OH approach, [2] produce OH information and expertise, [3] generate actionable knowledge, [4] influence decision-making, and [5] positively impact outcomes. For each component, a set of evaluation questions is defined, and links to other available evaluation tools are shown. The ISSE framework helps evaluators to systematically assess the different OH aspects of a surveillance system, to gain comprehensive information on the performance and value of these integrated efforts, and to use the evaluation results to refine and improve the surveillance of AMR and AMU globally.