1
|
Tarazona JV, de Alba-Gonzalez M, Bedos C, Benoit P, Bertrand C, Crouzet O, Dagès C, Dorne JLC, Fernandez-Agudo A, Focks A, Gonzalez-Caballero MDC, Kroll A, Liess M, Loureiro S, Ortiz-Santaliestra ME, Rasmussen JJ, Royauté R, Rundlöf M, Schäfer RB, Short S, Siddique A, Sousa JP, Spurgeon D, Staub PF, Topping CJ, Voltz M, Axelman J, Aldrich A, Duquesne S, Mazerolles V, Devos Y. A conceptual framework for landscape-based environmental risk assessment (ERA) of pesticides. ENVIRONMENT INTERNATIONAL 2024; 191:108999. [PMID: 39276592 DOI: 10.1016/j.envint.2024.108999] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/18/2024] [Revised: 08/02/2024] [Accepted: 09/03/2024] [Indexed: 09/17/2024]
Abstract
While pesticide use is subject to strict regulatory oversight worldwide, it remains a main concern for environmental protection, including biodiversity conservation. This is partly due to the current regulatory approach that relies on separate assessments for each single pesticide, crop use, and non-target organism group at local scales. Such assessments tend to overlook the combined effects of overall pesticide usage at larger spatial scales. Integrative landscape-based approaches are emerging, enabling the consideration of agricultural management, the environmental characteristics, and the combined effects of pesticides applied in a same or in different crops within an area. These developments offer the opportunity to deliver informative risk predictions relevant for different decision contexts including their connection to larger spatial scales and to combine environmental risks of pesticides, with those from other environmental stressors. We discuss the needs, challenges, opportunities and available tools for implementing landscape-based approaches for prospective and retrospective pesticide Environmental Risk Assessments (ERA). A set of "building blocks" that emerged from the discussions have been integrated into a conceptual framework. The framework includes elements to facilitate its implementation, in particular: flexibility to address the needs of relevant users and stakeholders; means to address the inherent complexity of environmental systems; connections to make use of and integrate data derived from monitoring programs; and options for validation and approaches to facilitate future use in a regulatory context. The conceptual model can be applied to existing ERA methodologies, facilitating its comparability, and highlighting interoperability drivers at landscape level. The benefits of landscape-based pesticide ERA extend beyond regulation. Linking and validating risk predictions with relevant environmental impacts under a solid science-based approach will support the setting of protection goals and the formulation of sustainable agricultural strategies. Moreover, landscape ERA offers a communication tool on realistic pesticide impacts in a multistressors environment for stakeholders and citizens.
Collapse
Affiliation(s)
- Jose V Tarazona
- Spanish National Environmental Health Center, Instituto de Salud Carlos III, Madrid, Spain.
| | | | - Carole Bedos
- French Research Institute for Agriculture, Food and Environment (INRAE), Functional Ecology and Ecotoxicology of Agroecosystems, ECOSYS, Palaiseau, France
| | - Pierre Benoit
- French Research Institute for Agriculture, Food and Environment (INRAE), Functional Ecology and Ecotoxicology of Agroecosystems, ECOSYS, Palaiseau, France
| | - Colette Bertrand
- French Research Institute for Agriculture, Food and Environment (INRAE), Functional Ecology and Ecotoxicology of Agroecosystems, ECOSYS, Palaiseau, France
| | - Olivier Crouzet
- French Agency for Biodiversity (OFB), Direction de la Recherche et de l'Appui Scientifique (DRAS), Vincennes, France
| | - Cécile Dagès
- French Research Institute for Agriculture, Food and Environment (INRAE), Soil-Agrosystem-Hydrosystem Interaction Lab (LISAH) Montpellier Cedex, France.
| | | | - Ana Fernandez-Agudo
- Spanish National Environmental Health Center, Instituto de Salud Carlos III, Madrid, Spain.
| | - Andreas Focks
- Research Center Environmental Systems Research, Osnabrück University, Osnabrück, Germany
| | | | - Alexandra Kroll
- Swiss Centre for Applied Ecotoxicology (Ecotox Centre), Dübendorf, Switzerland
| | - Matthias Liess
- Helmholtz Centre for Environmental Research (UFZ), System-Ecotoxicology, Leipzig, Germany; RWTH Aachen University, Institute for Environmental Research, Aachen, Germany
| | - Susana Loureiro
- Centre for Environmental and Marine Studies & Department of Biology, University of Aveiro, Aveiro, Portugal
| | | | | | - Raphaël Royauté
- French Research Institute for Agriculture, Food and Environment (INRAE), Functional Ecology and Ecotoxicology of Agroecosystems, ECOSYS, Palaiseau, France
| | - Maj Rundlöf
- Department of Biology, Lund University, Lund, Sweden
| | - Ralf B Schäfer
- Faculty of Biology, University of Duisburg-Essen, 45141, Essen, Germany; Research Centre One Health Ruhr, Research Alliance Ruhr, Germany
| | | | - Ayesha Siddique
- Helmholtz Centre for Environmental Research (UFZ), System-Ecotoxicology, Leipzig, Germany
| | - José Paulo Sousa
- Centre for Functional Ecology (CFE), TERRA Associate Laboratory, Department of Life Sciences, University of Coimbra, Coimbra, Portugal
| | | | - Pierre-François Staub
- French Agency for Biodiversity (OFB), Direction de la Recherche et de l'Appui Scientifique (DRAS), Vincennes, France
| | - Chris J Topping
- Social-Ecological Systems Simulation Centre, Department of Ecoscience, Aarhus University, Aarhus, Denmark
| | - Marc Voltz
- French Research Institute for Agriculture, Food and Environment (INRAE), Soil-Agrosystem-Hydrosystem Interaction Lab (LISAH) Montpellier Cedex, France.
| | | | | | | | - Vanessa Mazerolles
- Regulated Products Assessment Directorate, Anses (French Agency for Food, Environmental and Occupational Health & Safety), Maisons-Alfort, France
| | - Yann Devos
- European Food Safety Authority (EFSA), Parma, Italy
| |
Collapse
|
2
|
Bertrand C, Aviron S, Pelosi C, Faburé J, Le Perchec S, Mamy L, Rault M. Effects of plant protection products on ecosystem functions provided by terrestrial invertebrates. ENVIRONMENTAL SCIENCE AND POLLUTION RESEARCH INTERNATIONAL 2024:10.1007/s11356-024-34534-w. [PMID: 39141266 DOI: 10.1007/s11356-024-34534-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/19/2023] [Accepted: 07/24/2024] [Indexed: 08/15/2024]
Abstract
Plant protection products (PPP) are extensively used to protect plants against harmful organisms, but they also have unintended effects on non-target organisms, especially terrestrial invertebrates. The impact of PPP on ecosystem functions provided by these non-target invertebrates remains, however, unclear. The objectives of this article were to review PPP impacts on the ecosystem functions provided by pollinators, predators and parasitoids, and soil organisms, and to identify the factors that aggravate or mitigate PPP effects. The literature highlights that PPP alter several ecosystem functions: provision and maintenance of biodiversity, pollination, biotic interactions and habitat completeness in terrestrial ecosystems, and organic matter and soil structure dynamics. However, there are still a few studies dealing with ecosystem functions, with sometimes contradictory results, and consequences on agricultural provisioning services remain unclear. The model organisms used to assess PPP ecotoxicological effects are still limited, and should be expanded to better cover the wide functional diversity of terrestrial invertebrates. Data are lacking on PPP sublethal, transgenerational, and "cocktail" effects, and on their multitrophic consequences. In empirical assessments, studies on PPP unintended effects should consider agricultural-pedoclimatic contexts because they influence the responses of non-target organisms and associated ecosystem functions to PPP. Modeling might be a promising way to account for the complex interactions among PPP mixtures, biodiversity, and ecosystem functioning.
Collapse
Affiliation(s)
- Colette Bertrand
- Université Paris-Saclay, INRAE, AgroParisTech, UMR ECOSYS, 91120, Palaiseau, France
| | - Stéphanie Aviron
- INRAE, Institut Agro Rennes-Angers, ESA, UMR 0980 BAGAP, 35042, Rennes, France
| | - Céline Pelosi
- UMR EMMAH, INRAE, Avignon Université, 84000, Avignon, France
| | - Juliette Faburé
- Université Paris-Saclay, INRAE, AgroParisTech, UMR ECOSYS, 91120, Palaiseau, France
| | | | - Laure Mamy
- Université Paris-Saclay, INRAE, AgroParisTech, UMR ECOSYS, 91120, Palaiseau, France
| | - Magali Rault
- Univ Avignon, Aix Marseille Univ, CNRS, IMBE, Pôle Agrosciences, 301 Rue Baruch de Spinoza, BP 21239, 84916, Avignon, IRD, France.
| |
Collapse
|
3
|
Topping CJ. The Animal Landscape and Man Simulation System (ALMaSS): a history, design, and philosophy. RESEARCH IDEAS AND OUTCOMES 2022. [DOI: 10.3897/rio.8.e89919] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022] Open
Abstract
This article is the first article in the new topical RIO journal collection for ALMaSS. This editorial introduces ALMaSS, its history, component parts and philosophy, and forms a first access point for those interested in knowing more. It is written from my own personal perspective as the instigator and main developer for the system, effectively as the ‘father’ of ALMaSS.
Collapse
|
4
|
Bakker L, Werf W, Bianchi FJJA. Sweep netting samples, but not sticky trap samples, indicate beneficial arthropod abundance is negatively associated with landscape wide insecticide use. J Appl Ecol 2022. [DOI: 10.1111/1365-2664.14106] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
Affiliation(s)
- Lieneke Bakker
- Farming Systems Ecology Group Wageningen University and Research (WUR) Wageningen The Netherlands
| | - Wopke Werf
- Centre for Crop Systems Analysis Wageningen University and Research (WUR) Wageningen The Netherlands
| | - Felix J. J. A. Bianchi
- Farming Systems Ecology Group Wageningen University and Research (WUR) Wageningen The Netherlands
| |
Collapse
|
5
|
Lewis G, Dinter A, Elston C, Marx MT, Mayer CJ, Neumann P, Pilling E, Braaker S. The Role of Source-Sink Dynamics in the Assessment of Risk to Nontarget Arthropods from the Use of Plant Protection Products. ENVIRONMENTAL TOXICOLOGY AND CHEMISTRY 2021; 40:2667-2679. [PMID: 34111321 PMCID: PMC9291833 DOI: 10.1002/etc.5137] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/18/2021] [Revised: 02/14/2021] [Accepted: 06/04/2021] [Indexed: 06/12/2023]
Abstract
The concept of source-sink dynamics as a potentially important component of metapopulation dynamics was introduced in the 1980s. The objective of the present review was to review the considerable body of work that has been developed, to consider its theoretical implications as well as to understand how source-sink dynamics may manifest under field conditions in the specific case of nontarget arthropods in the agricultural environment. Our review concludes that metapopulation dynamics based on field observations are often far more complex than existing theoretical source-sink models would indicate, because they are dependent on numerous population processes and influencing factors. The difficulty in identifying and measuring these factors likely explains why empirical studies assessing source-sink dynamics are scarce. Furthermore, we highlight the importance of considering the spatial and temporal heterogeneity of agricultural landscapes when assessing the population dynamics of nontarget arthropods in the context of the risk from the use of plant protection products. A need is identified to further develop and thoroughly validate predictive population models, which can incorporate all factors relevant to a specific system. Once reliable predictive models for a number of representative nontarget arthropod species are available, they could provide a meaningful tool for refined risk evaluations (higher tier level risk assessment), addressing specific concerns identified at the initial evaluation stages (lower tier level risk assessment). Environ Toxicol Chem 2021;40:2667-2679. © 2021 ERM, FMC, Syngenta, Bayer AG, BASF SE, Corteva agriscience. Environmental Toxicology and Chemistry published by Wiley Periodicals LLC on behalf of SETAC.
Collapse
Affiliation(s)
| | | | | | | | | | | | - Ed Pilling
- Corteva AgrisciencesAbingdonOxfordshireUnited Kingdom
| | | |
Collapse
|
6
|
Grant TJ, Krishnan N, Bradbury SP. Conservation risks and benefits of establishing monarch butterfly (Danaus plexippus) breeding habitats close to maize and soybean fields in the north central United States: A landscape-scale analysis of the impact of foliar insecticide on nonmigratory monarch butterfly populations. INTEGRATED ENVIRONMENTAL ASSESSMENT AND MANAGEMENT 2021; 17:989-1002. [PMID: 33629511 DOI: 10.1002/ieam.4402] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/13/2020] [Revised: 12/30/2020] [Accepted: 02/22/2021] [Indexed: 06/12/2023]
Abstract
Establishing habitat in agricultural landscapes of the north central United States is critical to reversing the decline of North America's eastern monarch butterfly (Danaus plexippus) population. Insecticide use could create population sinks and threaten recovery. Discouraging habitat establishment within a 38-m zone around crop fields is a suggested risk mitigation measure. In Story County, Iowa, United States, this mitigation would discourage habitat establishment in 84% of roadsides and 38% of noncrop land. It is unclear if the conservation benefits from establishing habitat close to crop fields outweigh suppression of population growth owing to insecticide exposure. Consequently, monarch conservation plans require spatially and temporally explicit landscape-scale assessments. Using an agent-based model that incorporates female monarch movement and egg laying, the number and location of eggs laid in Story County were simulated for four habitat scenarios: current condition, maximum new establishment, moderate establishment, and moderate establishment only outside a 38-m no-plant zone around crop fields. A demographic model incorporated mortality from natural causes and insecticide exposure to simulate adult monarch production over 10 years. Assuming no insecticide exposure, simulated adult production increased 24.7% and 9.3%, respectively, with maximum and moderate habitat establishment and no planting restrictions. A 3.5% increase was simulated assuming moderate habitat establishment with a 38-m planting restriction. Impacts on adult production were simulated for six representative insecticides registered for soybean aphid (Aphis glycines) management. Depending on the frequency of insecticide applications over a 10-year period, simulated production increased 8.2%-9.3%, assuming moderate habitat establishment with no planting restrictions. Results suggest that the benefits of establishing habitat close to crop fields outweigh the adverse effects of insecticide spray drift; that is, metapopulation extirpation is not a concern for monarchs. These findings are only applicable to species that move at spatial scales greater than the scale of potential spray-drift impacts. Integr Environ Assess Manag 2021;17:989-1002. © 2021 The Authors. Integrated Environmental Assessment and Management published by Wiley Periodicals LLC on behalf of Society of Environmental Toxicology & Chemistry (SETAC).
Collapse
Affiliation(s)
- Tyler J Grant
- Department of Natural Resource Ecology and Management, Iowa State University, Ames, Iowa, USA
| | - Niranjana Krishnan
- Toxicology Program and Department of Entomology, Iowa State University, Ames, Iowa, USA
| | - Steven P Bradbury
- Department of Natural Resource Ecology and Management, Iowa State University, Ames, Iowa, USA
- Toxicology Program and Department of Entomology, Iowa State University, Ames, Iowa, USA
| |
Collapse
|
7
|
Ziółkowska E, Topping CJ, Bednarska AJ, Laskowski R. Supporting non-target arthropods in agroecosystems: Modelling effects of insecticides and landscape structure on carabids in agricultural landscapes. THE SCIENCE OF THE TOTAL ENVIRONMENT 2021; 774:145746. [PMID: 33610978 DOI: 10.1016/j.scitotenv.2021.145746] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/10/2020] [Revised: 02/04/2021] [Accepted: 02/05/2021] [Indexed: 06/12/2023]
Abstract
Intensification of agricultural practices is one of the most important drivers of the dramatic decline of arthropod species. We do not know, however, the relative contribution to decline of different anthropogenic stressors that are part of this process. We used high-resolution dynamic landscape models and advanced spatially-explicit population modelling to estimate the relative importance of insecticide use and landscape structure for population dynamics of a widespread carabid beetle Bembidion lampros. The effects of in-crop mitigation measures through the application of insecticides with reduced lethality, and off-crop mitigation measures by increasing abundance of grassy field margins, were evaluated for the beetle along the gradient of landscape heterogeneity. Reducing the insecticide-driven lethality (from 90 to 10%) had larger positive impacts on beetle density and occupancy than increasing the abundance of field margins in a landscape. The effects of increasing field margins depended on their width and overall abundance in the landscape, but only field margins 4 m wide, applied to at least 40% of fields, resulted in an increase in beetle population density comparable to the scenario with the smallest reduction of insecticide-driven lethality we considered. Our findings suggest the importance of field margins rather as a supporting not stand-alone mitigation measure, as they generally improved effects of reduction of insecticide-driven lethality. Therefore, adding sufficiently broad off-field habitats should help to maintain viable beetle populations in agricultural landscapes even with moderate use of insecticides. In general, the less persistent the insecticides are in the environment, the larger positive impacts of applied mitigation measures on beetle populations were found. We also showed that the effectiveness of applied mitigation measures strongly depends on landscape and farmland heterogeneity. Thus, to achieve the same management or mitigation target in different landscapes might require different strategies.
Collapse
Affiliation(s)
- Elżbieta Ziółkowska
- Institute of Environmental Sciences, Jagiellonian University in Kraków, Gronostajowa 7, 30-387 Kraków, Poland.
| | | | - Agnieszka J Bednarska
- Institute of Nature Conservation Polish Academy of Sciences, Adama Mickiewicza 33, 31-120 Kraków, Poland.
| | - Ryszard Laskowski
- Institute of Environmental Sciences, Jagiellonian University in Kraków, Gronostajowa 7, 30-387 Kraków, Poland.
| |
Collapse
|
8
|
More S, Bampidis V, Benford D, Bragard C, Halldorsson T, Hernández‐Jerez A, Bennekou SH, Koutsoumanis K, Machera K, Naegeli H, Nielsen SS, Schlatter J, Schrenk D, Silano V, Turck D, Younes M, Arnold G, Dorne J, Maggiore A, Pagani S, Szentes C, Terry S, Tosi S, Vrbos D, Zamariola G, Rortais A. A systems-based approach to the environmental risk assessment of multiple stressors in honey bees. EFSA J 2021; 19:e06607. [PMID: 34025804 PMCID: PMC8135085 DOI: 10.2903/j.efsa.2021.6607] [Citation(s) in RCA: 13] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/21/2022] Open
Abstract
The European Parliament requested EFSA to develop a holistic risk assessment of multiple stressors in honey bees. To this end, a systems-based approach that is composed of two core components: a monitoring system and a modelling system are put forward with honey bees taken as a showcase. Key developments in the current scientific opinion (including systematic data collection from sentinel beehives and an agent-based simulation) have the potential to substantially contribute to future development of environmental risk assessments of multiple stressors at larger spatial and temporal scales. For the monitoring, sentinel hives would be placed across representative climatic zones and landscapes in the EU and connected to a platform for data storage and analysis. Data on bee health status, chemical residues and the immediate or broader landscape around the hives would be collected in a harmonised and standardised manner, and would be used to inform stakeholders, and the modelling system, ApisRAM, which simulates as accurately as possible a honey bee colony. ApisRAM would be calibrated and continuously updated with incoming monitoring data and emerging scientific knowledge from research. It will be a supportive tool for beekeeping, farming, research, risk assessment and risk management, and it will benefit the wider society. A societal outlook on the proposed approach is included and this was conducted with targeted social science research with 64 beekeepers from eight EU Member States and with members of the EU Bee Partnership. Gaps and opportunities are identified to further implement the approach. Conclusions and recommendations are made on a way forward, both for the application of the approach and its use in a broader context.
Collapse
|
9
|
Topping CJ, Aldrich A, Berny P. Overhaul environmental risk assessment for pesticides. Science 2020; 367:360-363. [PMID: 31974232 DOI: 10.1126/science.aay1144] [Citation(s) in RCA: 133] [Impact Index Per Article: 33.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/02/2022]
Affiliation(s)
- C J Topping
- Department of Bioscience, Aarhus University, Kalø, Denmark.
| | - A Aldrich
- Department of Ecotoxicology, Agroscope, Wädenswil, Switzerland
| | - P Berny
- Department of Toxicology, Vetagro Sup Campus Vétérinaire, Marcy l'étoile, France
| |
Collapse
|
10
|
Uhl P, Brühl CA. The Impact of Pesticides on Flower-Visiting Insects: A Review with Regard to European Risk Assessment. ENVIRONMENTAL TOXICOLOGY AND CHEMISTRY 2019; 38:2355-2370. [PMID: 31408220 DOI: 10.1002/etc.4572] [Citation(s) in RCA: 36] [Impact Index Per Article: 7.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/24/2019] [Revised: 05/22/2019] [Accepted: 08/08/2019] [Indexed: 05/28/2023]
Abstract
Flower-visiting insects (FVIs) are an ecologically diverse group of mobile, flying species that should be protected from pesticide effects according to European policy. However, there is an ongoing decline of FVI species, partly caused by agricultural pesticide applications. Therefore, the risk assessment framework needs to be improved. We synthesized the peer-reviewed literature on FVI groups and their ecology, habitat, exposure to pesticides, and subsequent effects. The results show that FVIs are far more diverse than previously thought. Their habitat, the entire agricultural landscape, is potentially contaminated with pesticides through multiple pathways. Pesticide exposure of FVIs at environmentally realistic levels can cause population-relevant adverse effects. This knowledge was used to critically evaluate the European regulatory framework of exposure and effect assessment. The current risk assessment should be amended to incorporate specific ecological properties of FVIs, that is, traits. We present data-driven tools to improve future risk assessments by making use of trait information. There are major knowledge gaps concerning the general investigation of groups other than bees, the collection of comprehensive data on FVI groups and their ecology, linking habitat to FVI exposure, and study of previously neglected complex population effects. This is necessary to improve our understanding of FVIs and facilitate the development of a more protective FVI risk assessment. Environ Toxicol Chem 2019;38:2355-2370. © 2019 The Authors. Environmental Toxicology and Chemistry published by Wiley Periodicals, Inc. on behalf of SETAC.
Collapse
Affiliation(s)
- Philipp Uhl
- iES Landau, Institute for Environmental Sciences, University of Koblenz-Landau, Landau, Germany
| | - Carsten A Brühl
- iES Landau, Institute for Environmental Sciences, University of Koblenz-Landau, Landau, Germany
| |
Collapse
|
11
|
Faber JH, Marshall S, Van den Brink PJ, Maltby L. Priorities and opportunities in the application of the ecosystem services concept in risk assessment for chemicals in the environment. THE SCIENCE OF THE TOTAL ENVIRONMENT 2019; 651:1067-1077. [PMID: 30266052 DOI: 10.1016/j.scitotenv.2018.09.209] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/25/2018] [Revised: 09/14/2018] [Accepted: 09/16/2018] [Indexed: 05/20/2023]
Abstract
The ecosystem services approach has gained broad interest in regulatory and policy circles for use in ecological risk assessment. Whilst identifying several challenges, scientific experts from European regulatory authorities, the chemical industry and academia considered the approach applicable to all chemical sectors and potentially contributing to greater ecological relevance for setting and assessing environmental protection goals compared to current European regulatory frameworks for chemicals. These challenges were addressed in workshops to develop a common understanding across stakeholders on how the ecosystem services concept might be used in chemical risk assessment and what would need to be done to implement it. This paper describes the consensus outcome of those discussions. Knowledge gaps and research needs were identified and prioritised, exploring the use of novel approaches from ecology, ecotoxicology and ecological modelling. Where applicable, distinction is made between prospective and retrospective ecological risk assessment. For prospective risk assessment the development of environmental scenarios accounting for chemical exposure and ecological conditions was designated as a top priority. For retrospective risk assessment the top priority research need was development of reference conditions for key ecosystem services and guidance for their derivation. Both prospective and retrospective risk assessment would benefit from guidance on the taxa and measurement endpoints relevant to specific ecosystem services and from improved understanding of the relationships between measurement endpoints from standard toxicity tests and the ecosystem services of interest (i.e. assessment endpoints). The development of mechanistic models, which could serve as ecological production functions, was identified as a priority. A conceptual framework for future chemical risk assessment based on an ecosystem services approach is presented.
Collapse
Affiliation(s)
- Jack H Faber
- Wageningen Environmental Research, P.O. Box 47, 6700 AA Wageningen, the Netherlands.
| | - Stuart Marshall
- Unilever, Safety and Environmental Assurance Centre, Colworth Science Park, Sharnbrook MK44 1LQ, UK
| | - Paul J Van den Brink
- Wageningen Environmental Research, P.O. Box 47, 6700 AA Wageningen, the Netherlands; Aquatic Ecology and Water Quality Management Group, Wageningen University, P.O. Box 47, 6700 AA Wageningen, the Netherlands
| | - Lorraine Maltby
- Department of Animal and Plant Sciences, The University of Sheffield, Western Bank, Sheffield S10 2TN, UK
| |
Collapse
|
12
|
Mougin C, Gouy V, Bretagnolle V, Berthou J, Andrieux P, Ansart P, Benoit M, Coeurdassier M, Comte I, Dagès C, Denaix L, Dousset S, Ducreux L, Gaba S, Gilbert D, Imfeld G, Liger L, Molénat J, Payraudeau S, Samouelian A, Schott C, Tallec G, Vivien E, Voltz M. RECOTOX, a French initiative in ecotoxicology-toxicology to monitor, understand and mitigate the ecotoxicological impacts of pollutants in socioagroecosystems. ENVIRONMENTAL SCIENCE AND POLLUTION RESEARCH INTERNATIONAL 2018; 25:33882-33894. [PMID: 30022390 PMCID: PMC6245006 DOI: 10.1007/s11356-018-2716-5] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/22/2018] [Accepted: 07/04/2018] [Indexed: 05/11/2023]
Abstract
RECOTOX is a cross-cutting initiative promoting an integrated research to respond to the challenges of monitoring, understanding, and mitigating environmental and health impacts of pesticides in agroecosystems. The added value of RECOTOX is to develop a common culture around spatial ecotoxicology including the whole chain of pressure-exposure-impact, while strengthening an integrated network of in natura specifically equipped sites. In particular, it promotes transversal approaches at relevant socioecological system scales, to capitalize knowledge, expertise, and ongoing research in ecotoxicology and, to a lesser extent, environmental toxicology. Thus, it will open existing research infrastructures in environmental sciences to research programs in ecotoxicology of pesticides.
Collapse
Affiliation(s)
- Christian Mougin
- UMR ECOSYS, INRA, AgroParisTech, Université Paris-Saclay, 78026, Versailles, France.
| | | | - Vincent Bretagnolle
- UMR 7372 CEBC, CNRS & Université de La Rochelle, 79360, Villiers en Bois, France
| | - Julie Berthou
- UMR ECOSYS, INRA, AgroParisTech, Université Paris-Saclay, 78026, Versailles, France
| | | | | | | | - Michaël Coeurdassier
- UMR Chrono-Environnement, Université Bourgogne Franche-Comté, CNRS, INRA, 25000, Besançon, France
| | | | - Cécile Dagès
- UMR LISAH, Univ. Montpellier, INRA, IRD, Montpellier SupAgro, 34060, Montpellier, France
| | - Laurence Denaix
- UMR ISPA, INRA, Bordeaux Sciences Agro, 33882, Villenave d'Ornon, France
| | - Sylvie Dousset
- UMR LIEC, CNRS, Université de Lorraine, 54506, Vandoeuvre les Nancy, France
| | | | - Sabrina Gaba
- USC 1339, Centre d'Etudes Biologiques de Chizé, INRA, F-79360, Villiers-en-Bois, France
| | - Daniel Gilbert
- UMR Chrono-Environnement, Université Bourgogne Franche-Comté, CNRS, INRA, 25000, Besançon, France
| | - Gwenaël Imfeld
- UMR LHyGeS, CNRS, ENGEES, Université de Strasbourg, 67084, Strasbourg, France
| | - Lucie Liger
- UR RiverLy, Irstea, 69626, Villeurbanne, France
| | - Jérôme Molénat
- UMR LISAH, Univ. Montpellier, INRA, IRD, Montpellier SupAgro, 34060, Montpellier, France
| | - Sylvain Payraudeau
- UMR LHyGeS, CNRS, ENGEES, Université de Strasbourg, 67084, Strasbourg, France
| | - Anatja Samouelian
- UMR LISAH, Univ. Montpellier, INRA, IRD, Montpellier SupAgro, 34060, Montpellier, France
| | | | | | - Emma Vivien
- UMR ISPA, INRA, Bordeaux Sciences Agro, 33882, Villenave d'Ornon, France
| | - Marc Voltz
- UMR LISAH, Univ. Montpellier, INRA, IRD, Montpellier SupAgro, 34060, Montpellier, France
| |
Collapse
|
13
|
Brock T, Bigler F, Frampton G, Hogstrand C, Luttik R, Martin-Laurent F, Topping CJ, van der Werf W, Rortais A. Ecological Recovery and Resilience in Environmental Risk Assessments at the European Food Safety Authority. INTEGRATED ENVIRONMENTAL ASSESSMENT AND MANAGEMENT 2018; 14:586-591. [PMID: 30489025 DOI: 10.1002/ieam.4079] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/27/2018] [Revised: 04/27/2018] [Accepted: 06/18/2018] [Indexed: 05/20/2023]
Abstract
A conceptual framework was developed by a working group of the Scientific Committee of the European Food Safety Authority (EFSA) to guide risk assessors and risk managers on when and how to integrate ecological recovery and resilience assessments into environmental risk assessments (ERA). In this commentary we advocate that a systems approach is required to integrate the diversity of ecosystem services (ES) providing units, environmental factors, scales, and stressor-related responses necessary to address the context dependency of recovery and resilience in agricultural landscapes. A future challenge in the resilience assessment remains to identify the relevant bundles of ecosystem services provided by different types of agroecosystem that need to be assessed in concert. Integr Environ Assess Manag 2018;14:586-591. © 2018 The Authors. Integrated Environmental Assessment and Management published by Wiley Periodicals, Inc. on behalf of Society of Environmental Toxicology & Chemistry (SETAC).
Collapse
Affiliation(s)
- Theo Brock
- Working group on the overarching elements of environmental risk assessment (recovery) of the Scientific Committee of the European Food Safety Authority
- Wageningen Environmental Research, Wageningen University and Research, The Netherlands
| | - Franz Bigler
- Working group on the overarching elements of environmental risk assessment (recovery) of the Scientific Committee of the European Food Safety Authority
- Würenlos, Switzerland
| | - Geoff Frampton
- Working group on the overarching elements of environmental risk assessment (recovery) of the Scientific Committee of the European Food Safety Authority
- Southampton Health Technology Assessments Centre (SHTAC), Faculty of Medicine, University of Southampton, United Kingdom
| | - Christer Hogstrand
- Working group on the overarching elements of environmental risk assessment (recovery) of the Scientific Committee of the European Food Safety Authority
- Departments of Biochemistry and Nutritional Sciences, King's College London, United Kingdom
| | - Robert Luttik
- Working group on the overarching elements of environmental risk assessment (recovery) of the Scientific Committee of the European Food Safety Authority
- Independent Consultant, Hvidovre, Denmark
| | - Fabrice Martin-Laurent
- Working group on the overarching elements of environmental risk assessment (recovery) of the Scientific Committee of the European Food Safety Authority
- Agroécologie, AgroSup Dijon, INRA, University of Bourgogne Franche-Comté, France
| | - Christopher John Topping
- Working group on the overarching elements of environmental risk assessment (recovery) of the Scientific Committee of the European Food Safety Authority
- Department of Bioscience, Aarhus University, Denmark
| | - Wopke van der Werf
- Working group on the overarching elements of environmental risk assessment (recovery) of the Scientific Committee of the European Food Safety Authority
- Plant Sciences, Wageningen University, The Netherlands
| | - Agnes Rortais
- Working group on the overarching elements of environmental risk assessment (recovery) of the Scientific Committee of the European Food Safety Authority
- European Food Safety Authority, Parma, Italy
| |
Collapse
|
14
|
Ockleford C, Adriaanse P, Berny P, Brock T, Duquesne S, Grilli S, Hernandez-Jerez AF, Bennekou SH, Klein M, Kuhl T, Laskowski R, Machera K, Pelkonen O, Pieper S, Stemmer M, Sundh I, Teodorovic I, Tiktak A, Topping CJ, Wolterink G, Aldrich A, Berg C, Ortiz-Santaliestra M, Weir S, Streissl F, Smith RH. Scientific Opinion on the state of the science on pesticide risk assessment for amphibians and reptiles. EFSA J 2018; 16:e05125. [PMID: 32625798 PMCID: PMC7009658 DOI: 10.2903/j.efsa.2018.5125] [Citation(s) in RCA: 15] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/16/2022] Open
Abstract
Following a request from EFSA, the Panel on Plant Protection Products and their Residues developed an opinion on the science to support the potential development of a risk assessment scheme of plant protection products for amphibians and reptiles. The coverage of the risk to amphibians and reptiles by current risk assessments for other vertebrate groups was investigated. Available test methods and exposure models were reviewed with regard to their applicability to amphibians and reptiles. Proposals were made for specific protection goals aiming to protect important ecosystem services and taking into consideration the regulatory framework and existing protection goals for other vertebrates. Uncertainties, knowledge gaps and research needs were highlighted.
Collapse
|
15
|
Ockleford C, Adriaanse P, Berny P, Brock T, Duquesne S, Grilli S, Hernandez-Jerez AF, Bennekou SH, Klein M, Kuhl T, Laskowski R, Machera K, Pelkonen O, Pieper S, Stemmer M, Sundh I, Teodorovic I, Tiktak A, Topping CJ, Wolterink G, Craig P, de Jong F, Manachini B, Sousa P, Swarowsky K, Auteri D, Arena M, Rob S. Scientific Opinion addressing the state of the science on risk assessment of plant protection products for in-soil organisms. EFSA J 2017; 15:e04690. [PMID: 32625401 PMCID: PMC7009882 DOI: 10.2903/j.efsa.2017.4690] [Citation(s) in RCA: 52] [Impact Index Per Article: 7.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/12/2022] Open
Abstract
Following a request from EFSA, the Panel on Plant Protection Products and their Residues developed an opinion on the science behind the risk assessment of plant protection products for in-soil organisms. The current risk assessment scheme is reviewed, taking into account new regulatory frameworks and scientific developments. Proposals are made for specific protection goals for in-soil organisms being key drivers for relevant ecosystem services in agricultural landscapes such as nutrient cycling, soil structure, pest control and biodiversity. Considering the time-scales and biological processes related to the dispersal of the majority of in-soil organisms compared to terrestrial non-target arthropods living above soil, the Panel proposes that in-soil environmental risk assessments are made at in- and off-field scale considering field boundary levels. A new testing strategy which takes into account the relevant exposure routes for in-soil organisms and the potential direct and indirect effects is proposed. In order to address species recovery and long-term impacts of PPPs, the use of population models is also proposed.
Collapse
|
16
|
Rohr JR, Salice CJ, Nisbet RM. The pros and cons of ecological risk assessment based on data from different levels of biological organization. Crit Rev Toxicol 2016; 46:756-84. [PMID: 27340745 PMCID: PMC5141515 DOI: 10.1080/10408444.2016.1190685] [Citation(s) in RCA: 52] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2016] [Revised: 05/12/2016] [Accepted: 05/13/2016] [Indexed: 01/15/2023]
Abstract
Ecological risk assessment (ERA) is the process used to evaluate the safety of manufactured chemicals to the environment. Here we review the pros and cons of ERA across levels of biological organization, including suborganismal (e.g., biomarkers), individual, population, community, ecosystem and landscapes levels. Our review revealed that level of biological organization is often related negatively with ease at assessing cause-effect relationships, ease of high-throughput screening of large numbers of chemicals (it is especially easier for suborganismal endpoints), and uncertainty of the ERA because low levels of biological organization tend to have a large distance between their measurement (what is quantified) and assessment endpoints (what is to be protected). In contrast, level of biological organization is often related positively with sensitivity to important negative and positive feedbacks and context dependencies within biological systems, and ease at capturing recovery from adverse contaminant effects. Some endpoints did not show obvious trends across levels of biological organization, such as the use of vertebrate animals in chemical testing and ease at screening large numbers of species, and other factors lacked sufficient data across levels of biological organization, such as repeatability, variability, cost per study and cost per species of effects assessment, the latter of which might be a more defensible way to compare costs of ERAs than cost per study. To compensate for weaknesses of ERA at any particular level of biological organization, we also review mathematical modeling approaches commonly used to extrapolate effects across levels of organization. Finally, we provide recommendations for next generation ERA, submitting that if there is an ideal level of biological organization to conduct ERA, it will only emerge if ERA is approached simultaneously from the bottom of biological organization up as well as from the top down, all while employing mathematical modeling approaches where possible to enhance ERA. Because top-down ERA is unconventional, we also offer some suggestions for how it might be implemented efficaciously. We hope this review helps researchers in the field of ERA fill key information gaps and helps risk assessors identify the best levels of biological organization to conduct ERAs with differing goals.
Collapse
Affiliation(s)
| | | | - Roger M. Nisbet
- University of California at Santa Barbara, Santa Barbara, CA 93106-9620
| |
Collapse
|
17
|
Rico A, Van den Brink PJ, Gylstra R, Focks A, Brock TC. Developing ecological scenarios for the prospective aquatic risk assessment of pesticides. INTEGRATED ENVIRONMENTAL ASSESSMENT AND MANAGEMENT 2016; 12:510-21. [PMID: 26437690 DOI: 10.1002/ieam.1718] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/05/2015] [Revised: 08/04/2015] [Accepted: 09/29/2015] [Indexed: 05/03/2023]
Abstract
The prospective aquatic environmental risk assessment (ERA) of pesticides is generally based on the comparison of predicted environmental concentrations in edge-of-field surface waters with regulatory acceptable concentrations derived from laboratory and/or model ecosystem experiments with aquatic organisms. New improvements in mechanistic effect modeling have allowed a better characterization of the ecological risks of pesticides through the incorporation of biological trait information and landscape parameters to assess individual, population and/or community-level effects and recovery. Similarly to exposure models, ecological models require scenarios that describe the environmental context in which they are applied. In this article, we propose a conceptual framework for the development of ecological scenarios that, when merged with exposure scenarios, will constitute environmental scenarios for prospective aquatic ERA. These "unified" environmental scenarios are defined as the combination of the biotic and abiotic parameters that are required to characterize exposure, (direct and indirect) effects, and recovery of aquatic nontarget species under realistic worst-case conditions. Ideally, environmental scenarios aim to avoid a potential mismatch between the parameter values and the spatial-temporal scales currently used in aquatic exposure and effect modeling. This requires a deeper understanding of the ecological entities we intend to protect, which can be preliminarily addressed by the formulation of ecological scenarios. In this article we present a methodological approach for the development of ecological scenarios and illustrate this approach by a case-study for Dutch agricultural ditches and the example focal species Sialis lutaria. Finally, we discuss the applicability of ecological scenarios in ERA and propose research needs and recommendations for their development and integration with exposure scenarios. Integr Environ Assess Manag 2016;12:510-521. © 2015 SETAC.
Collapse
Affiliation(s)
- Andreu Rico
- Alterra, Wageningen University and Research Centre, Wageningen, the Netherlands
| | - Paul J Van den Brink
- Alterra, Wageningen University and Research Centre, Wageningen, the Netherlands
- Department of Aquatic Ecology and Water Quality Management, Wageningen University and Research Centre, Wageningen, the Netherlands
| | | | - Andreas Focks
- Alterra, Wageningen University and Research Centre, Wageningen, the Netherlands
| | - Theo Cm Brock
- Alterra, Wageningen University and Research Centre, Wageningen, the Netherlands
| |
Collapse
|
18
|
|
19
|
|
20
|
Hommen U, Forbes V, Grimm V, Preuss TG, Thorbek P, Ducrot V. How to use mechanistic effect models in environmental risk assessment of pesticides: Case studies and recommendations from the SETAC workshop MODELINK. INTEGRATED ENVIRONMENTAL ASSESSMENT AND MANAGEMENT 2016; 12:21-31. [PMID: 26437629 DOI: 10.1002/ieam.1704] [Citation(s) in RCA: 29] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/16/2015] [Accepted: 06/23/2015] [Indexed: 06/05/2023]
Abstract
Mechanistic effect models (MEMs) are useful tools for ecological risk assessment of chemicals to complement experimentation. However, currently no recommendations exist for how to use them in risk assessments. Therefore, the Society of Environmental Toxicology and Chemistry (SETAC) MODELINK workshop aimed at providing guidance for when and how to apply MEMs in regulatory risk assessments. The workshop focused on risk assessment of plant protection products under Regulation (EC) No 1107/2009 using MEMs at the organism and population levels. Realistic applications of MEMs were demonstrated in 6 case studies covering assessments for plants, invertebrates, and vertebrates in aquatic and terrestrial habitats. From the case studies and their evaluation, 12 recommendations on the future use of MEMs were formulated, addressing the issues of how to translate specific protection goals into workable questions, how to select species and scenarios to be modeled, and where and how to fit MEMs into current and future risk assessment schemes. The most important recommendations are that protection goals should be made more quantitative; the species to be modeled must be vulnerable not only regarding toxic effects but also regarding their life history and dispersal traits; the models should be as realistic as possible for a specific risk assessment question, and the level of conservatism required for a specific risk assessment should be reached by designing appropriately conservative environmental and exposure scenarios; scenarios should include different regions of the European Union (EU) and different crops; in the long run, generic MEMs covering relevant species based on representative scenarios should be developed, which will require EU-level joint initiatives of all stakeholders involved. The main conclusion from the MODELINK workshop is that the considerable effort required for making MEMs an integral part of environmental risk assessment of pesticides is worthwhile, because it will make risk assessments not only more ecologically relevant and less uncertain but also more comprehensive, coherent, and cost effective.
Collapse
Affiliation(s)
- Udo Hommen
- Fraunhofer Institute for Molecular Biology and Applied Ecology IME, Schmallenberg, Germany
| | - Valery Forbes
- School of Biological Sciences, University of Nebraska, Lincoln, Nebraska, USA
- Present address: College of Biological Sciences, University of Minnesota, St. Paul, Minnesota, USA
| | - Volker Grimm
- Helmholtz Centre for Environmental Research-UFZ, Leipzig, Germany
| | - Thomas G Preuss
- RWTH Aachen University, Institute of Environmental Research, Aachen, Germany
- Present address: Bayer CropScience AG, Monheim am Rhein, Germany
| | - Pernille Thorbek
- Syngenta Limited, Product Safety, Jealott's Hill International Research Centre, United Kingdom
| | - Virginie Ducrot
- INRA, Rennes, France
- Present address: Bayer CropScience AG, Monheim am Rhein, Germany
| |
Collapse
|
21
|
Stark JD, Vargas RI, Banks JE. Incorporating variability in point estimates in risk assessment: Bridging the gap between LC50 and population endpoints. ENVIRONMENTAL TOXICOLOGY AND CHEMISTRY 2015; 34:1683-1688. [PMID: 25760716 DOI: 10.1002/etc.2978] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/24/2014] [Revised: 01/11/2015] [Accepted: 03/05/2015] [Indexed: 06/04/2023]
Abstract
Historically, point estimates such as the median lethal concentration (LC50) have been instrumental in assessing risks associated with toxicants to rare or economically important species. In recent years, growing awareness of the shortcomings of this approach has led to an increased focus on analyses using population endpoints. However, risk assessment of pesticides still relies heavily on large amounts of LC50 data amassed over decades in the laboratory. Despite the fact that these data are generally well replicated, little or no attention has been given to the sometime high levels of variability associated with the generation of point estimates. This is especially important in agroecosystems where arthropod predator-prey interactions are often disrupted by the use of pesticides. Using laboratory derived data of 4 economically important species (2 fruit fly pest species and 2 braconid parasitoid species) and matrix based population models, the authors demonstrate in the present study a method for bridging traditional point estimate risk assessments with population outcomes. The results illustrate that even closely related species can show strikingly divergent responses to the same exposures to pesticides. Furthermore, the authors show that using different values within the 95% confidence intervals of LC50 values can result in very different population outcomes, ranging from quick recovery to extinction for both pest and parasitoid species. The authors discuss the implications of these results and emphasize the need to incorporate variability and uncertainty in point estimates for use in risk assessment.
Collapse
Affiliation(s)
- John D Stark
- Ecotoxicology Program, Department of Entomology, Washington State University, Puyallup, Washington, USA
| | - Roger I Vargas
- US Pacific Basin Agricultural Research Center, US Department of Agriculture-Agricultural Research Service, Hilo, Hawaii, USA
| | - John E Banks
- Environmental Science, School of Interdisciplinary Arts & Sciences, University of Washington, Tacoma, Washington, USA
| |
Collapse
|
22
|
Galic N, Forbes V. Ecological models in ecotoxicology and ecological risk assessment: an introduction to the special section. ENVIRONMENTAL TOXICOLOGY AND CHEMISTRY 2014; 33:1446-1448. [PMID: 24939604 DOI: 10.1002/etc.2607] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/04/2014] [Accepted: 04/04/2014] [Indexed: 06/03/2023]
Affiliation(s)
- Nika Galic
- School of Biological Sciences, University of Nebraska-Lincoln, Lincoln, Nebraska, USA
| | | |
Collapse
|
23
|
Wendt-Rasch L, Poulsen V, Duquesne S. In response: regulatory risk assessment and landscape ecotoxicology--a governmental perspective. ENVIRONMENTAL TOXICOLOGY AND CHEMISTRY 2014; 33:1196-1197. [PMID: 24838920 DOI: 10.1002/etc.2571] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/03/2023]
|