Deliberating Performance Targets: Follow-on workshop discussing PM10, NO2, CO, and SO2 air sensor targets

The use of air sensor technology is increasing worldwide for a variety of applications, however, with significant variability in data quality. The United States Environmental Protection Agency held a workshop in July 2019 to deliberate possible performance targets for air sensors measuring particles with aerodynamic diameters of 10 μm or less (PM10), nitrogen dioxide (NO2), carbon monoxide (CO), and sulfur dioxide (SO2). These performance targets were discussed from the perspective of non-regulatory applications and with the sensors operating primarily in a stationary mode in outdoor environments. Attendees included representatives from multiple levels of government organizations, sensor developers, environmental nonprofits, international organizations, and academia. The workshop addressed the current lack of sensor technology requirements, discussed fit-for-purpose data quality needs, and debated transparency issues. This paper highlights the purpose and key outcomes of the workshop. While more information on performance and applications of sensors is available than in past years, the performance metrics, or parameters used to describe data quality, vary among the studies reports and there is a need for more clear and consistent approaches for evaluating sensor performance. Organizations worldwide are increasingly considering, or are in the process of developing, sensor performance targets and testing protocols. Workshop participants suggested that these new guidelines are highly desirable, would help improve data quality, and would give users more confidence in their data. Given the wide variety of uses for sensors and user backgrounds, as well as varied sensor design features (e.g., communication approaches, data tools, processing/adjustment algorithms and calibration procedures), the need for transparency was a key workshop theme. Suggestions for increasing transparency included documenting and sharing testing and performance data, detailing best practices, and sharing data processing and correction approaches.

Deliberating performance targets workshop: Potential paths for emerging PM2.5 and O3 air sensor progress

The United States Environmental Protection Agency held an international two-day workshop in June 2018 to deliberate possible performance targets for non-regulatory fine particulate matter (PM_2.5) and ozone (O₃) air sensors. The need for a workshop arose from the lack of any market-wide manufacturer requirement for Ozone documented sensor performance evaluations, the lack of any independent third party or government-based sensor performance certification program, and uncertainty among all users as to the general usability of air sensor data. A multi-sector subject matter expert panel was assembled to facilitate an open discussion on these issues with multiple stakeholders. This summary provides an overview of the workshop purpose, key findings from the deliberations, and considerations for future actions specific to sensors. Important findings concerning PM_2.5 and O₃ sensors included the lack of consistent performance indicators and statistical metrics as well as highly variable data quality requirements depending on the intended use. While the workshop did not attempt to yield consensus on any topic, a key message was that a number of possible future actions would be beneficial to all stakeholders regarding sensor technologies. These included documentation of best practices, sharing quality assurance results along with sensor data, and the development of a common performance target lexicon, performance targets, and test protocols.