Introduction
Protecting populations from exposure to poor air quality (AQ) is one of the greatest public health challenges affecting all nations on earth (WHO, 2014). For the past half century, developed countries have made an effort to measure concentrations of major pollutants known to degrade health or damage plants and physical structures. Generally, the focus has been on the most populated areas, with an intent to assess daily, monthly, or annual concentrations on a regional basis. While greater spatial and temporal resolution has been desired, the costs of purchasing and operating instruments sufficiently robust, accurate, and free of interferences to generate reliable data has been prohibitive – an instrument to assess a single pollutant at ambient levels can cost many tens to hundreds of thousands of US dollars.
In this situation it is therefore easy to understand the motivation to develop inexpensive, rapid-response air quality monitoring devices that can be deployed in large numbers around point sources or throughout specific neighborhoods to create the desired high spatial and temporal resolution AQ data grid (Snyder et al., 2013; Kumar et al., 2015; McKercher et al., 2017). Indeed, within the past decade, many researchers, entrepreneurs, and manufacturers have pursued the development, deployment, and evaluation of lower-cost devices that measure air pollution (Mead et al., 2013; Williams et al., 2014b; Masson et al., 2015; Jiao et al., 2016; Lewis et al., 2016; Castell et al., 2017; Hagan et al., 2017; Mueller et al., 2017; Zimmerman et al., 2017).
While electrochemical (EC) sensors have formed the basis for workplace and hazardous leak detection applications for many decades (Stetter and Li, 2008), their transition from workplace to ambient air is accompanied by much lower target concentration ranges over which the sensors must accurately measure the analyte species of interest (Borrego et al., 2016). Coincident with the need to resolve much lower concentrations is the need to fully understand and model the influence of non-analyte interferences resulting from changing temperature (), relative humidity (RH), pressure (), or other gas molecules that may compete with the oxidation–reduction reactions occurring at the working electrode (WE) of a given EC sensor (Mueller et al., 2017). Unless great care is taken when measuring ambient air pollutants, interferences may result in reported pollutant concentrations that are orders of magnitude greater than the true values. At the core of this quantification challenge is the fact that electrochemical sensors rely on resolving very small changes in current (A) and, in turn, reliably converting that raw sensor signal into a concentration. The path from raw sensor output to concentration requires (1) a mechanical design that provides consistent, empirically validated sampling of the ambient air, (2) low-noise electrical circuitry (potentiostats) to amplify and resolve small changes in current, (3) electronic filters to remove electrical transients (e.g., radiofrequency interference), and (4) a method for converting raw signal to concentration that takes into account calibration and interference data.
In order to calibrate and characterize interferences, laboratory and field-based co-location experiments must be carried out spanning the full range of pollutant concentrations and ambient sampling conditions that may be encountered in an actual stand-alone deployment. Deploying lower-cost AQ-sensor systems in the absence of such calibration significantly undermines the credibility of the data. Indeed, reports have appeared recently raising concerns about the reliability of data produced from inexpensive monitoring devices containing EC sensors (Lewis and Edwards, 2016).
This paper describes results obtained from a newly developed, integrated lower-cost EC-sensor system, ARISense, which has been developed at Aerodyne Research, Inc., for simultaneous, real-time measurement of a wide range of ambient-level atmospheric pollutants and accompanying meteorological metrics. Air quality monitoring systems can be roughly divided into three cost tiers: (1) high-cost and high-accuracy systems costing USD 10 000–100 000 per pollutant species, such as those used at regulatory monitoring stations; (2) lower-cost systems costing USD 1000–10 000 per integrated sensor node, such as ARISense, AQMesh, or the Real-time Affordable Multi-Pollutant (RAMP) package recently developed by Carnegie Mellon University and SenSevere (Zimmerman et al., 2017); and (3) low-cost systems (costing USD 10–100 s per device) designed for the consumer market that typically only measure a single pollutant and generally suffer from poor data quality (EPA, 2017). The goal of second tier systems is to provide data quality approaching tier 1 at a small fraction of the cost. In this paper, we describe the mechanical and electronic design of the ARISense system and demonstrate a field-based calibration technique that combines co-located measurements with a high-dimensional model representation (HDMR) of the interferences. Our results show that lower-cost EC-sensor systems can provide reliable measurements of air pollution under real-world ambient concentrations.
Mechanical drawings (wires excluded) showing the main components of the ARISense system. Each system includes an anemometer (A) mounted to the back bracket of the NEMA enclosure providing a description of the wind fields in the immediate proximity to the gas and particle sampling inlets of the system. Mounting brackets for wall or pole-mount configurations attach at position (B). Expanded view of the internal components reveals the optical particle counter (C), gas sampling manifold (D) with embedded electrochemical and NDIR and RH/ sensors, transformer/power PCB (E), main controller PCB (side view) (F), communication PCB for ethernet connectivity (G), gas sampling inlet and exhaust rain hoods (H, I), RJ11 and RJ45 connections for anemometer data and CAT-5 connectivity (J, K), microphone assembly (L), weather tight AC power input (M), and solar sensor assembly for light intensity measurement (N). The 3-D-printed parts include the gas sampling manifold, rain hoods, exhaust and microphone mounting bracket, solar sensor interface, and PCB mounting scaffold. As described in the text, the gas and particle sampling inlets are separate, with the OPC-N2 sampling through the bottom face of the enclosure to protect from liquid water penetration.
[Figure omitted. See PDF]
Experimental
ARISense
The ARISense system used in the present study (version 1.0) measures ambient levels of five gaseous pollutants (CO, NO, NO, O, and CO, atmospheric aerosol particles (0.4–17 m in diameter), and related meteorological and environmental parameters (temperature, pressure, relative humidity, wind speed and direction, solar irradiance, and noise). Mechanical drawings of the ARISense system are shown in Fig. 1. Each system is housed in a NEMA (National Electrical Manufacturers Association) weather-proof enclosure (Polycase, PN: YH-080804; 21.8 cm L 13 cm D 21.8 cm H) weighing approximately 2.7 kg fully integrated. ARISense v1.0 is powered off of 120–240V AC and designed for stationary fixed-site monitoring.
ARISense v1.0 contained the following EC sensors (purchased from Alphasense Ltd., UK): carbon monoxide (CO-B4), nitric oxide (NO-B4), nitrogen dioxide (NO2-B43F), and total oxidants (Ox-B421). (More recent versions of ARISense have been upgraded to model Ox-B431.) The integrated system also includes a nondispersive infrared (NDIR) carbon dioxide (CO sensor (Alphasense pyroelectric IRC-A1) and an optical particle counter (OPC) for measurement of particulate matter size distributions (number-count; 0.4 17 m over 16 size bins; Alphasense OPC-N2). The following environmental and meteorological measurements are also included: relative humidity and temperature sensor (Sensirion AG, PN: SHT21), barometric pressure and temperature sensor (BOSCH, PN: BMP180), solar intensity sensor (OSRAM Opto Semiconductors, PN: BPW 34), and a microphone for audible noise detection (CUI, Inc., PN: CMC-5044PF-A). An anemometer (Davis Instruments, Vantage Pro 6410) for wind speed and direction was mounted to the top of the ARISense NEMA enclosure, measuring conditions 60 cm above the sampling inlets (see Fig. 1).
ARISense electronics were designed to integrate all sensor measurements into
a unified data acquisition framework and provide user access and control over
the system' s configuration and operation. EC-sensor signals were collected
and processed by custom-built electronics designed to minimize noise and
amplify raw signals (i.e., potentiostat circuitry). Connectivity for v1.0
systems was enabled via hard-line CAT-5 ethernet connections (Lantronix
XPort Pro). Data were saved at user-defined sampling intervals (5–60 s) onto a
local USB drive and (if internet-connected) to the ARISense database
(
The ARISense system has two sampling inlets, one for measuring gas-phase pollutants and the other dedicated to the measurement of particulate matter. In both cases, the air flow is driven by small DC-powered fans embedded at the downstream end of the sample flow path, minimizing the loss of sticky or reactive gas molecules (NO, O or particles due to surface reactivity or deposition. The gas sample flow includes both an intake and an exhaust port in the NEMA enclosure, protected from water penetration via 3-D-printed rain hoods (Formlabs; Form 2, stereolithography 3-D printer) mounted to the exterior of the case (see components H and I in Fig. 1). The gas sampling flow manifold and internal printed circuit board (PCB) mounting brackets were also 3-D printed. Laboratory tests reveal that the 3-D-printed material is inert to NO and O and does not result in significant losses of either species when sampling ambient-level concentrations. The gas sampling manifold provides a consistent, compact interface for the four electrochemical sensors as well as the CO sensor. The manifold includes an embedded RH/ sensor positioned adjacent to the electrochemical cells which is used to model the temperature and relative humidity-derived interference effects on the raw sensor response. Given the active flow of the gas sampling inlet and minimal residence time ( 1 s) of the sample air within the manifold, the RH and measurements recorded by the ARISense system closely track changes in ambient RH and conditions. Over the co-location period described here, temperature measurements inside the flow manifold were within 20 % of the ambient values at all times. Note that the CO measurements are not discussed in this paper, which focuses on the four species measured by the electrochemical sensors, but will be addressed in a future paper.
The particle inlet is on the bottom face of the NEMA enclosure (Fig. 1, component C). Given the body of evidence implicating PM concentrations in adverse health outcomes (Lim et al., 2012), recent years have seen substantial growth in the development, evaluation, and deployment of low-cost OPCs (Holstius et al., 2014; Williams et al., 2014a; Han et al., 2017; Zikova et al., 2017). The principal measurement challenge of these devices is the minimum size detection limit, often 0.5 m (for devices that cost USD 250 to 800) or 1.0 m (cost USD 15 to 200). Unfortunately, given these size detection limits, such low-cost OPCs are inadequate when the accumulation mode aerosol size distribution peaks at 0.25 m, which is typical in most urban locations. Low-cost OPC size detection limits also make near-field particulate combustion emission characterization (i.e., near roadways) very challenging since the combustion mode of particles is typically < 0.1 m. A detailed assessment of the ARISense particulate measurements in laboratory and field experiments will be provided in a subsequent paper.
This paper presents results for the four electrochemical sensors in a single ARISense system. Note that nominally identical electrochemical sensors can have widely different sensitivities and exhibit variable environmental interference effects. As a result, the specific calibration models described in this paper cannot be broadly applied to all ARISense systems. Until the reproducibility of electrochemical sensor manufacturing improves, system-specific HDMR models will need to be developed for each individual ARISense system to maintain robust sensor quantification metrics.
Map showing the locations of the two ARISense systems (yellow circles) and the four Boston metropolitan area DEP monitoring stations (red circles). The two ARISense systems were co-located with reference stations at the Harrison Avenue site (in Dudley Square, Roxbury) and Von Hillern Street site ( 35 feet from I-93 north) in Dorchester. The data presented in this paper were obtained from the Dudley Square location, an urban neighborhood site, primarily impacted by local combustion sources and vehicles operating on secondary routes in close proximity to the area. Green markers are shown to indicate the positions of four additional sensor nodes deployed as part of the Dorchester Air Quality Sensor System (DAQSS) project, which predated the development of ARISense.
[Figure omitted. See PDF]
Measurement site
Two ARISense systems (indicated with yellow circles in Fig. 2) were deployed south of Boston, MA, from July to November 2016. This initial deployment of the ARISense systems was in conjunction with an existing four-node network (the Dorchester Air Quality Sensor System, DAQSS, project) established in January of 2016. The DAQSS node locations are indicated with green markers on the map. The neighborhoods of Roxbury and Dorchester are among Boston's largest and most economically diverse, including low-income residential areas interspersed with light and heavy industry, as well as the Interstate 93 (I-93) corridor which runs along the eastern edge of Dorchester. Given their location and activities therein, Dorchester and Roxbury experience a high frequency of automobile, commercial truck, and heavy duty diesel traffic, much of which is constrained to stop-and-go driving patterns on congested, narrow streets, in close proximity to housing and pedestrians. The original DAQSS deployment and initial ARISense proof-of-concept efforts were motivated by the need to assess the viability of lower-cost AQ-sensor systems in communities suffering from environmental health knowledge gaps, such as the unexplained doubling of the adult asthma rate in north Dorchester between 2001 and 2010 (Backus et al., 2012).
In order to validate our measurements, each ARISense system was co-located with a Massachusetts Department of Environmental Protection (MassDEP) air quality monitoring station (indicated with red circles on the map) for the duration of the present study. This paper presents ARISense and MassDEP reference data for the Roxbury site (left-hand yellow circle in Fig. 2) located adjacent to Harrison Avenue in Dudley Square (latitude 42.3295, longitude 71.082619). Forthcoming papers will present results from the DAQSS project and the I-93 ARISense node location, covering lower-cost AQ-sensor results over longer deployment timescales (18–24 months) and across multiple types of microenvironments in Roxbury and Dorchester.
Reference data
The MassDEP Roxbury air monitoring site (ID: 25-025-0042), established in December 1998, hosts continuous and semi-continuous gas and particle measurements. The reference measurements used in this study include ozone (O; Teledyne Model T400 Photometric Ozone Analyzer; limit of detection [LOD] < 0.6 ppb [parts per billion by volume]; root mean square “zero” noise [RMS < 0.3 ppb), carbon monoxide (CO; Teledyne Model 300EU Carbon Monoxide Analyzer; LOD < 20 ppb; RMS 10 ppb), and nitrogen oxides (NO, NO, NO; Teledyne Model T200 Nitrogen Oxide Analyzer; LOD 0.4 ppb; RMS < 0.2 ppb). The reference NO/NO measurement is based on chemiluminescence. This method relies on converting NO molecules to NO via exposure to O. Operationally, there are two measurements channels, one for NO alone and one for total NO. In the NO channel, a catalytic–reactive converter is used to convert any existing NO molecules to NO, prior to exposure to O. NO concentrations are determined by taking the difference between NO and NO. Additional on-site reference measurements include a meteorological tower (relative humidity, temperature, pressure, wind direction, wind speed, solar intensity; Met One), PM (BAM, Beta Attenuation Mass Monitor), PM, black carbon, and several offline gravimetric filter samplers including PM speciation. Given its level of instrumentation, the Roxbury location is considered an NCore site within the MassDEP network of monitoring stations across the state and provides critical data comparisons for determining the viability of lower-cost AQ-sensor systems. For the current study, MassDEP provided real-time (1 min average) pollutant concentration data files from its reference gas analyzers to permit data comparisons with the ARISense EC-sensor response under rapidly changing conditions of temperature, humidity, and ambient gas concentrations.
ARISense calibration
Calibration is a critical issue for trusting the output of EC sensors. Recent papers (Lewis et al., 2016; Castell et al., 2017) have highlighted that the lack of rigorous calibration protocols for lower-cost AQ-sensors results in significant potential error when the sensor system is deployed in ambient conditions. For example, Mead et al. (2013) modeled the temperature-dependent baseline drift of an Alphasense NO sensor using an exponential curve fit through 24 h of ambient data. Their analysis revealed that temperature-derived baseline drift could exceed a 600 ppb bias if unaccounted for in their calibration (sampling between 20 and 28 C). Considering that the ambient NO concentration range encountered in the current study was 0–200 ppb with sensor temperatures varying from 5–45 C (5 min averages), modeling the NO-B4 sensor temperature-derived interference is crucial to obtaining useful measurements from the sensor. As Mead et al. (2013) point out, when measuring gas concentrations at the ppb level, temperature and humidity interference effects have a first-order impact on quantification, whereas drift in sensitivity over time has second-order effects (much smaller in magnitude than temperature or humidity influence). Both first and second-order effects need to be correctly parameterized in order to apply lower-cost sensors to long-term ( 18–36 months) ambient outdoor air quality measurements.
Alphasense provides some guidance to customers regarding calibration and temperature compensation of electrochemical sensor response (Alphasense Application Note no. AAN 803-03, December 2014). This document highlights the utility of including a fourth electrode in their B4-series electrochemical sensors such as were used in this study. The purpose of this fourth electrode (called the auxiliary electrode, AUX) is to provide a real-time correction for environmentally derived interferences at the working electrode. The AUX electrode is comprised of an identical catalyst to that of the WE and is designed to mimic the WE's response to environmental changes such as temperature, pressure, and humidity. Since the AUX electrode is fully submerged in the electrolyte and directly below the WE, the AUX signal is theoretically “blind” to the target analyte gas species which readily oxidize or reduce at the WE surface (which is exposed to the air on one side and the electrolyte layer on the other). In an ideal world, a simple subtraction of the current generated at the AUX electrode from the current generated by the WE would provide a signal that is linearly proportional to the target analyte over the full concentration range of interest. Unfortunately, we have found that in practice the AUX electrodes in most sensors are not able to track the changes in the corresponding WE over the nominal operational temperatures of the system. Specifically, at sensor temperatures > 25 C, the AUX electrode response lags behind that of the working electrode and, in some cases (CO-B4, for example), the WE and AUX electrode currents diverge as temperature increases (i.e., the WE current decreases with increasing temperature, while the AUX electrode current increases with increasing temperature). In this case, recording just the differential current without correction leads to an increasingly negative concentration error for CO at sensor temperatures above 25 C. Alphasense provides users with a table in which, for each sensor model, the user can identify a correction constant to use to compensate for observed behavior at specified temperature ranges. At temperatures 20 C the Alphasense documentation shows that differential measurements remain fairly stable in comparison to the higher temperature conditions. The Alphasense approach to temperature compensation also requires the use of four static constants for each individual EC sensor – subtracting specific electronic and zero currents from both the WE and AUX electrodes, prior to calculating the difference. While there are some advantages to the additional information provided by the AUX electrode, at temperatures higher than 25 C, the disparate response between the two electrodes can complicate quantification steps considerably.
In practice, we have found that the manufacturer's recommended WE and AUX electrode corrections do not lead to pollutant concentration values of acceptable accuracy for ambient air analysis. In addition, the EC-sensor response is impacted by other environmental conditions besides temperature, such as relative humidity and the concentrations of other gas-phase species. At the low concentrations present in the atmosphere (10–1000 s ppb), characterizing the full (multidimensional) interference response is critical to achieving reliable measurements. In this work we demonstrate the use of a multidimensional mathematical modeling approach (HDMR) that has the ability to adequately identify and quantify the complex EC-sensor response to multiple environmental variables and interfering gas species simultaneously.
High-dimensional model representation (HDMR)
The ARISense system uses high-dimensional model representation techniques to convert the raw sensor outputs into units of concentration (ppb). HDMR is a numerical method consisting of a general set of quantitative model assessments and analyses for capturing input–output system behavior without reliance on a physics-based model or the sensor manufacturer's empirical correction procedure. When applied to a set of experimental data (with sufficient variability), it can produce a mathematical model relating user-defined input variables to output variables of interest; the resulting model can capture the interdependencies of the variables and provide a mathematical description of the system that is otherwise difficult or impossible to describe with a physics-based model. The HDMR model can be used to identify and quantify which variables and variable interactions have the most impact on data reduction, relative to an identified output (i.e., reference concentration). In collaboration with the research group of Herschel Rabitz of Princeton University, Aerodyne has implemented HDMR methods in a software tool called ExploreHD, providing graphical and command line user interfaces to HDMR algorithms.
The details of the HDMR algorithms used here are discussed in detail elsewhere (Li and Rabitz, 2010; Sipilä et al., 2010; Li and Rabitz, 2012; Li et al., 2012). One of the key underlying tenets of the HDMR framework is that many input–output relationships for complex physical systems can be captured adequately by low-order combinations of input variables, even in systems with high dimensionality in input variables. Each component function provides an additive contribution to the overall model prediction. The modeling process involves three steps. In the first step, the user specifies a maximum variable interaction order (for example, a second-order HDMR model would allow component functions involving combinations of two input variables), and the HDMR algorithm considers orthogonal component functions (in this case, cubic polynomials) involving all possible variable combinations up to the maximum specified order. In the second step, a statistical analysis (using test) is performed to identify the input variables and combinations of input variables that contribute significantly to variation in the output of interest. In the final step, coefficients for component basis functions are calculated through a least squares analysis that minimizes the deviation between the HDMR model prediction and the training data. The coefficients and the associated orthogonal basis functions determined through the above analysis together define an HDMR model for the input–output relationship under consideration.
In the current study, the HDMR approach uses the raw EC-sensor output and environmental variables to model the multidimensional relationship between sensor output and the reference concentration. We used approximately 25 % of the dataset to train the model. Sensor interference can be a product of the combined influences of temperature, humidity, pressure, non-analyte gas species, etc. The structure of the computational model accounts for both absolute (i.e., highest to lowest concentrations) and transient (, or derivative) changes in the sampling conditions encountered by the sensor system. By spanning three seasons in the Northeastern United States, a wide range of environmental conditions was captured within the training window for the model. This emphasizes the advantage (i.e., variability in sampling conditions) and disadvantage (extended time span) of a field-based co-location approach to sensor calibration. The HDMR models developed in the current work were second order (examining all possible input parameter pairs) with orthogonal polynomial component functions allowed up to a degree of three (cubic) in each input variable.
The metrics used to evaluate the model are the slope and intercept of a linear least squares regression of the model output with the reference measurements, the coefficient of determination of the linear fit (, the root mean square error (RMSE), the mean absolute error (MAE), and the mean bias error (MBE). The equations for these metrics are given in Table S1 in the Supplement, and model-to-measurement results are summarized in Tables 2 and 3.
An example of how the HDMR model is developed for the NO-B4 sensor is provided in the Supplement. The left column of Table S2 lists all available input parameters, and the other columns denote which parameters were included in the input matrix for each model run. The bottom rows list the RMSE, MAE, and MBE for each model run for both the training data (model generation) and test data (model evaluation).
The data presented in this paper were recorded over a 4.5-month sampling interval (7 July 2016–23 November 2016). All four electrochemical sensors used in this study were first removed from their packaging on 9 May 2016. That means that from the date of unpackaging, the sensors had aged 6.5 months by 23 November. The manufacturer quoted lifetime for degradation of the signal to 50 % is 36 months for the CO sensor and 24 months for the NO, NO, and O sensors. Given that these lifetimes are significantly longer than the deployment timescale analyzed here, we did not include a time-dependent sensitivity term in the input matrix of our HDMR model runs. The results presented here therefore assume that the sensitivity of each of the electrochemical sensors did not appreciably drift over the 4.5-month deployment. In subsequent studies we will analyze sensor response over longer deployment timescales (18 to 24 months) to investigate the importance of including a time-based parameter to track and correct for drift in sensor response with time.
Results and discussion
ARISense meteorological and environmental data
Continuous 5 min average non-pollutant data acquired with the ARISense system are shown in Fig. S2 in the Supplement, tracking ambient variability in temperature, pressure, humidity, solar intensity, ambient noise, wind speed, and wind direction at the Roxbury DEP monitoring site. The total sampling time span covers the transition from mid-summer through late fall in the northeastern United States (July through November), with meteorological conditions changing from warmer and more humid to cooler and less humid. The ARISense system ran continuously throughout the sampling interval with the exception of a 1-week period during which the node was physically removed from the site for a separate experiment. The directionality of the wind fields at this site is predominantly from the N to NW (red-maroon) with occasional NE flow (blue-purple). Temperature and humidity measurements shown reflect the conditions within the gas sampling flow cell of the integrated system, characterizing the environmental conditions at the surface of the electrochemical sensors. Such environmental measurements are critically important for reconciling the interference effects of ambient conditions, especially humidity (water concentration) and temperature, on the raw signal from each electrochemical cell.
(a) Relative humidity (dashed blue line) and dew point temperature (solid blue line), (b–e) raw differential sensor output (dashed line), reference measurement (thick red line), and model output (thin line) for a 3-day period during the test part of the 4.5-month deployment. Temperature is indicated with the grey shaded area.
[Figure omitted. See PDF]
ARISense electrochemical sensor data
Figure 3 shows the time series for a 72 h period for the relative humidity; dew point temperature (panel a, solid and dashed lines, respectively); temperature (grey shaded area); and raw differential sensor output (dashed line), reference measurement (thick red dashed line), and model output (thin solid line) for the four electrochemical sensors (panels b–e). The raw differential sensor output is displayed as a voltage (mV) which is linearly proportional to the difference in current generated within the electrochemical cell at each electrode (WE and AUX). The correlation plots between the raw EC-sensor output and the reference measurements are shown in Fig. 4a to d, with each data point colored by flow-cell temperature. The intercept, slope, and for the linear regression indicated with a red line in Fig. 4 are listed in Table 1.
Performance metrics for raw sensor output versus reference measurements.
Sensor | intercept | Slope | ||
---|---|---|---|---|
(mV ppb) | ||||
CO-B4 | 29 507 | 3.26 | 0.25 | 0.78 |
NO-B4 | 33 310 | 6.32 | 0.30 | 0.21 |
NO-B43F | 33 363 | 27.4 | 0.29 | 0.18 |
O-B421 | 34 077 | 131 | 0.48 | 0.12 |
Correlation plots for all electrochemical sensors versus reference measurements for (a–d) raw sensor differential voltage signals, (e–h) model output concentrations for the training data ( 25 % of data), and (i–l) model output concentrations for test data (remaining 75 % of data). All data shown are 5 min average values with each data point colored by flow-cell temperature. The linear regression fit line (solid red line) is shown in all panels, and a line (dashed black line) is shown in panels (e)–(l).
[Figure omitted. See PDF]
The raw differential signals obtained from the CO-B4 sensor track reasonably well with the CO concentrations measured by the co-located DEP monitor (Figs. 3b and 4a), demonstrating the relatively small influence of ambient temperature, humidity, or other chemical species on this EC sensor. The NO sensor raw output also tracks reasonably well with the reference measurements (Figs. 3c and 4b) except at temperatures over 25 C when the EC sensor overestimates NO by a factor of 2 to 3 compared to lower temperatures. This demonstrates that the temperature dependences of the working and auxiliary electrodes in this NO sensor do not track one another at sample temperatures > 25 C, and that additional temperature correction is necessary to obtain reasonable NO concentrations from the raw sensor outputs.
The NO and O raw sensor outputs do not track as well with the reference measurements ( < 0.2 in Fig. 4c and d). The differential NO2-B43F sensor response (Figs. 3d and 4c) indicates a strong temperature dependence that is not compensated for by the auxiliary electrode, suggesting that additional temperature compensation algorithms could improve the result. The differential signal from the Ox-B421 electrode shows poor correlation with the reference data overall (Fig. 4d). There is some temperature dependence, but the additional variation suggests that other factors play an important role. The Ox-B421 sensor is comprised of the same catalyst (working and auxiliary electrode material) as the NO2-B43Fs and is therefore sensitive to NO in addition to O. The key difference between these two sensors is the presence of an O-scrubbing filter upstream of the working electrode in the NO2-B43F sensor package. Laboratory results indicate that the Ox-B421 sensor is 2 more sensitive to NO than to O molecules.
As Fig. 3 shows, the magnitude of the interference signal due to temperature alone (for NO, NO, and O can easily mask real variation in pollutant concentrations. The raw signal behavior observed for each sensor type is different, underscoring the necessity of species-specific HDMR models to reconcile each sensor type's characteristic interferences. In addition, substantial ( 2–3 ) differences (in sensitivity and baseline) exist for batches of nominally identical sensors measuring the same concentration. Therefore, the HDMR models built for a given integrated system are specific to a given set of sensors and must be generated for each system separately to achieve reliable concentration data. Within the framework of an individual ARISense system, four distinct HDMR models are built, one for each EC-derived pollutant species of interest.
Performance metrics for model output versus reference measurements for training data.
Sensor | intercept | Slope | RMSE | MAE | MBE | f | ||
---|---|---|---|---|---|---|---|---|
(ppb) | (ppb) | (ppb) | (ppb) | (%) | ||||
CO-B4 | 7974 | 9.19 | 0.96 | 0.96 | 25.4 | 16.7 | 0.02 | 27.0 % |
NO-B4 | 7974 | 0.46 | 0.94 | 0.94 | 3.37 | 2.17 | 0.01 | 23.9 % |
NO-B43F | 7874 | 0.80 | 0.94 | 0.94 | 2.29 | 1.73 | 0.05 | 23.6 % |
O-B421 | 9071 | 8.34 | 0.65 | 0.65 | 8.24 | 6.22 | 0.03 | 26.6 % |
Time series of 5 min averages of the model output (sensor) and reference gas concentrations. Grey shaded areas indicate time periods over which the model was trained. A unique set of input parameters was used to train the HDMR model for each of the different electrochemical cells. Approximately 25 % of the data were used for training and the remaining 75 % was used to test the models.
[Figure omitted. See PDF]
HDMR analysis
The training data for the HDMR model were chosen to provide comprehensive coverage of environmental variability spanning the July–November sampling interval. It was important to include (1) sensor responses to the range of gas concentrations encountered in ambient air (near-zero to high concentration transient spikes), (2) the range of temperatures and various rates of change in temperature, and (3) the range of measured water content of the sample air in the flow cell. The goal was to include a wide enough range of training data to avoid extrapolation errors when applying the model to the test dataset (all ambient co-location data not included in the training dataset). Figure S3 shows the distributions of temperature, reference measurement, dew point temperature, and relative humidity for the training data for the CO-B4 HDMR model, overlaid with corresponding distributions of the test data. We did not attempt to minimize the amount of ambient data used for training or vary the timing of the training data with respect to the test data. Approximately 25 % of the full time series was used to generate the model (Table 2 and indicated with grey bars in Fig. 5). The exact fraction of data used for training was slightly different for each sensor due to differing calibration schedules for the reference measurements (which automatically excludes sensor data from the training or test datasets). For each sensor, the set of inputs included in the input data matrix was optimized as described in Sect. 2.5 and the Supplement.
Correlation plots of model-derived pollutant concentrations and reference concentrations for the training data are shown in the middle panels (e–h) of Fig. 4. The linear regression fit (solid red line) and a line (dashed black line) are shown for all species, and all data points are colored by flow-cell temperature. The performance metrics are presented in Table 2. The lack of a temperature-dependent rainbow in the scatter plots shown in Fig. 4e–h (with the exception of O, for which ambient concentrations are expected to be temperature dependent) indicates that the model has effectively compensated for the variable temperature-dependent response of the working and auxiliary electrodes within each cell. The remaining scatter in the correlation plots is random noise attributed to the electrodes themselves and the ARISense electronics. The high correlation coefficients ( 0.94–0.96) for CO, NO, and NO indicate that, when trained appropriately, the HDMR model provides improved compensation for the environmental interferences that complicate interpretation of raw EC-sensor outputs. The much lower correlation coefficient ( 0.65) for O suggests that additional parameters may be needed to fully explain the behavior of this EC sensor. The updated version of the Ox-B4 sensor (Ox-B431) may also improve the ability of HDMR to effectively model the O interferences.
Performance metrics for model output versus reference measurements for test data (5 min average temporal resolution).
Sensor | intercept | Slope | RMSE | MAE | MBE | ||
---|---|---|---|---|---|---|---|
(ppb) | (ppb) | (ppb) | (ppb) | ||||
CO-B4 | 21 533 | 3.98 | 0.94 | 0.88 | 39.2 | 24.8 | 10.4 |
NO-B4 | 25 356 | 1.29 | 0.94 | 0.84 | 4.52 | 2.83 | 0.97 |
NO-B43F | 25 489 | 3.26 | 0.81 | 0.69 | 4.56 | 3.45 | 1.20 |
O-B421 | 25 006 | 13.1 | 0.47 | 0.39 | 9.71 | 7.34 | 0.78 |
The HDMR models were then used to analyze the remaining 75 % of the data (the test set). The correlation plots for the model output versus the reference measurement for the test data are shown in Fig. 4i–l and the performance metrics are presented in Table 3. Figure 5 shows the time series for the 5 min averages of the modeled (sensor) and reference gas concentrations, with the training data intervals indicated with grey bars. The high correlation coefficient for CO and NO ( > 0.8) and moderate correlation coefficient for NO ( 0.69) indicate the strength of the model at capturing the ambient variability in pollutant concentrations encountered at the site, despite wide variations in ambient temperature and humidity over the changing seasons.
The higher scatter in the O correlation plot, and correspondingly low 0.39, might be due to the fact that O is obtained by training the Ox-B421 sensor output to reference O alone; the sensitivity ratio for NO vs. O of the Ox-B421 means that the variability in ambient NO concentrations adds considerable noise to the Ox-B421 sensor signal. The input matrix for the Ox-B421 HDMR model includes the raw data captured with the NO2-B43F sensor, but the inclusion of this additional information only marginally improves the reduction of the Ox-B421 data to O concentration. This may be due to a different time response of the O sensor used in this study compared to the NO sensor.
Comparisons to published results utilizing integrated multi-pollutant systems comprised of Alphasense electrochemical sensors.
Studies | Temporal | Slope | RMSE | MAE | MBE | ||
---|---|---|---|---|---|---|---|
resolution (min) | (ppb) | (ppb) | (ppb) | ||||
CO sensor | |||||||
Jiao et al. (2016) | 60 | 2640–2664 | < 0.001 | 0.63–0.68 | NR | NR | NR |
Castell et al. (2017) | 15 | 6912 | NR | 0.36 | 170.99 | NR | 147.21 |
Zimmerman et al. (2017) | 15 | 3936 | 0.86 | 0.91 | NR | 38 | 0.1 |
This work (CO-B4) | 5 | 21 533 | 0.94 | 0.88 | 32.9 | 24.8 | 10.4 |
NO sensor | |||||||
Jiao et al. (2016) | 60 | 2640–2664 | 0.883–0.892 | 0.77–0.87 | NR | NR | NR |
Castell et al. (2017) | 15 | 6912 | NR | 0.74 | 16.35 | NR | 0.54 |
This work (NO-B4) | 5 | 25 356 | 0.94 | 0.84 | 4.52 | 2.83 | 0.97 |
NO2 sensor | |||||||
Jiao et al. (2016) | 60 | 2640–2664 | NR | 0.02–0.10 | NR | NR | NR |
Castell et al. (2017) | 15 | 6912 | NR | 0.24 | 30.27 | NR | 13.30 |
Zimmerman et al. (2017) | 15 | 2304 | 0.64 | 0.67 | NR | 3.48 | 0.4 |
This work (NO2-B43F) | 5 | 25 489 | 0.81 | 0.69 | 4.56 | 3.45 | 1.20 |
Ox sensor | |||||||
Jiao et al. (2016) | 60 | 2640–2664 | NR | 0.15–0.20 | NR | NR | NR |
Castell et al. (2017) | 15 | 6912 | NR | 0.29 | 22.20 | NR | 6.76 |
Zimmerman et al. (2017) | 15 | 3648 | 0.82 | 0.86 | NR | 3.36 | 0.14 |
This work (Ox-B421) | 5 | 25 006 | 0.47 | 0.39 | 9.71 | 7.34 | 0.78 |
NR not reported in paper. calculated assuming 100 % duty cycle over specified days of co-location for each study. Results obtained from two AQMesh integrated sensor systems (gen. 3) deployed in Decatur, Georgia, US. Statistical metrics correspond to average of 24 co-located AQMesh systems deployed in Kirkeveien, Norway. Average test results from 19 Real-time Affordable Multi-Pollutant (RAMP) systems co-located in Pittsburgh, Pennsylvania, US. Single ARISense system deployed in Dorchester, Massachusetts, US. Ox-B431 sensor.
It should be noted that the Ox-B421 sensor is not the latest version released by Alphasense and improvements may be realized with the design of their most recent model (Ox-B431). The results of Zimmerman et al. (2017) for the Ox-B431 sensor have a much better 0.86 (see Table 4), while their results are comparable to ours for the CO and NO sensors. These considerations highlight the iterative and rapidly evolving nature of lower-cost AQ-sensor components. Lower-cost air-quality-sensor quantification will likely improve over the coming years through advances at both the component manufacturer level (e.g., Alphasense Ltd. improving materials chemistry and the catalyst and sensor design) and system integrator level (e.g., Aerodyne Research, Inc., further developing ARISense HDMR interference modeling through laboratory and field-based measurements).
Examination of the model output for 72 h of the test data in Fig. 3 gives additional clues for improving the model. In Fig. 3d at 19:00 on 2 November 2016, the model NO exceeds the reference NO by a factor of 2 during a period of rapidly decreasing temperature and increasing RH. This underscores that the rate of change of input parameters may be important in the model, in addition to the absolute values. Figure 3e also suggests that the HDMR model for O struggles during times of rapidly changing temperature, particularly when the O concentration is low (< 3 ppb). Future development of HDMR models to support ARISense quantification will include derivatives of influential variables as explicit inputs and model optimization for low concentrations (< 5 ppb) for species such as NO and O.
Table 4 presents a comparison of evaluation statistics for this work and three other recent studies that evaluated Alphasense electrochemical sensors through extended co-located field measurements. One important distinction among the papers summarized in the table is that our work and the work of Zimmerman et al. (2017) are obtained from an AQ system integrator perspective (building and evaluating interference models), whereas the work of Jiao et al. (2016) and Castell et al. (2017) are end-user evaluations, reliant on the manufacturer's calibrated outputs. The duration of each co-location, temporal resolution of the reported sensor measurements, and variability in pollutant concentrations (and environmental conditions) at each site strongly influence the performance metrics of the electrochemical sensors. Results from the ARISense HDMR model at 5 min resolution show significant improvement relative to Jiao et al. (2016) and Castell et al. (2017) for all measured species and comparable metrics to Zimmerman et al. (2017) for CO and NO. As discussed previously, the HDMR model output for the Ox-B421 sensor underperforms the Zimmerman et al. (2017) Ox-B431 model.
While Figures 4 and 5 illustrate that the system is capable of determining valid gas-phase concentrations across a wide range of environmental variability in temperature, RH, and absolute concentrations, it does not speak to the longer-term stability of the sensors (e.g., how much does the baseline and sensitivity of each electrochemical sensor change with time). However, it should be noted that sensor aging cannot have had a major impact on the data reported here or it would have been impossible for the HDMR model to converge this well without including electrode age as one of the input variables. For the models developed in this work, each data point for each variable had equal weight, whether it was at the beginning, middle, or end of the 4.5-month deployment. It is to be expected that aging of EC sensors will change their sensitivities, due to electrolyte evaporation or dilution, entrapment of contaminants, and repeated exposure to wide swings in or RH. It will be important to establish the time span over which a given set of EC sensors (and the HDMR model of that sensor set) can be expected to return reliable pollutant concentration values, using a longer duration (18–24 months) ambient dataset; such a study is in progress.
Conclusion
This study demonstrates that lower-cost air-quality-sensor systems can adequately characterize ambient urban pollution concentrations on rapid (5 min) timescales, underscoring the potential of integrated sensor systems to add a highly resolved local AQ data layer to existing pollution monitoring infrastructure. The ARISense system is a first step toward understanding the extent to which quantification efforts can yield useful results from such systems. Training electrochemical sensor measurements of CO, NO, NO, and O with a high-dimensional model representation method provided 5 min average RMSE values of 39.2, 4.52, 4.56, and 9.71 ppb for CO, NO, NO, and O, respectively. Results indicate that HDMR can effectively model interference effects derived from the variable ambient gas concentrations in an urban setting and changing environmental conditions encountered over three seasons in the Northeastern United States (temperature 23.4 8.5 C, spanning 4.1 to 45.2 C; and relative humidity 50.1 15.3 %, spanning 9.8–79.9 %).
Referring back to the map displayed in Fig. 2, it is striking to consider that only four official monitoring stations exist within the Boston metropolitan area (population 700 000). With regard to the Roxbury DEP site 1 min average reference data, it is important to note that 1 min data files are not typically reported or accessible from regional air quality monitoring sites. Instead, pollutant concentrations are usually reported on 1, 8, or 24 h averages in accordance with the operational constraints of the measurement device and relevant air quality regulations being enforced. This sampling paradigm is consistent with the regional focus of federal and state monitoring goals, and financial constraints imposed due to the expense of the instrumentation and operating costs of a given AQ monitoring station. But as one considers the pollutant sources that contribute to their local area, disproportionate pollution impacts emerge in some neighborhoods more than others. Across urban landscapes, air pollution is inherently heterogeneous – subject to sharp concentration gradients over fast (sub-minute) and short (100s of meters) scales. In order to establish a more rigorous assessment of such disparate impacts, distributed sensor networks are needed to achieve high enough spatial resolution to inform intra-neighborhood differences in air quality. Through such advances, researchers, regulators, and community members can improve their understanding of the pollutant sources that dictate their local AQ. As sensor technologies (and calibration–modeling efforts) continue to improve, the local AQ data layer could play a key role toward empowering environmental justice advocates to initiate change and improve environmental public health.
It cannot be overstated that EC-sensor systems such as ARISense can return reliable data only if calibrated over the full range of pollutant concentrations and meteorological parameters that will be encountered when they are deployed. In the present study, co-location of the ARISense system with the MassDEP reference monitors, coupled with variability of natural processes and anthropogenic activities, supplied the necessary range of conditions over the 4.5-month span of the study. In the future, we expect to compress that training period, using a controlled-environment laboratory chamber and mixes of calibration gases representative of the pollutants encountered under ambient conditions. This compression of the training period is especially important when addressing the challenges of sensor-to-sensor variability, finite (< 24–36 months) sensor lifetime, and premature damage or failures that will require rapid replacement and retraining of integrated systems.
The data are available upon request to Eben S. Cross ([email protected]).
The Supplement related to this article is available online at
Eben S. Cross, Leah R. Williams, David K. Lewis, Gregory R. Magoon, Timothy B. Onasch, Douglas R. Worsnop, and John T. Jayne are employees of Aerodyne Research, Inc., which is developing and commercializing the ARISense system used in this study.
Acknowledgements
The authors would like to thank the staff at the Massachusetts Department of Environmental Protection for their support, including access to the DEP monitoring stations and raw 1 min data from the reference gas analyzers used in the current study. We are especially grateful to John Lane, Leslie Collyer, Emmy Andersen, Patrick Shea, and Thomas McGrath at MassDEP. ARISense builds upon the DAQSS network; Eben S. Cross acknowledges David Hagan for his support of the DAQSS project (electronics, backend development, and system integration) and for helpful discussions regarding advanced modeling approaches to sensor quantification. Eben S. Cross thanks Ann Backus and Gary Adamkiewicz for their collaboration on the DAQSS project (NIEHS grant P30 ES000002 via the Community Outreach and Engagement Core, COEC, of the HSPH NIEHS Center for Environmental Health). ESC also thanks Stephen Prescott for his assistance with the ARISense mechanical–electrical assembly, Xavier Cabral for his contributions to the initial electrical design, and Conor Mackinson and Wade Robinson for their mechanical design contributions to the ARISense package. The authors also thank the reviewers for their insightful comments which helped improve the final manuscript. Edited by: Gavin Phillips Reviewed by: three anonymous referees
You have requested "on-the-fly" machine translation of selected content from our databases. This functionality is provided solely for your convenience and is in no way intended to replace human translation. Show full disclaimer
Neither ProQuest nor its licensors make any representations or warranties with respect to the translations. The translations are automatically generated "AS IS" and "AS AVAILABLE" and are not retained in our systems. PROQUEST AND ITS LICENSORS SPECIFICALLY DISCLAIM ANY AND ALL EXPRESS OR IMPLIED WARRANTIES, INCLUDING WITHOUT LIMITATION, ANY WARRANTIES FOR AVAILABILITY, ACCURACY, TIMELINESS, COMPLETENESS, NON-INFRINGMENT, MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE. Your use of the translations is subject to all use restrictions contained in your Electronic Products License Agreement and by using the translation functionality you agree to forgo any and all claims against ProQuest or its licensors for your use of the translation functionality and any output derived there from. Hide full disclaimer
© 2017. This work is published under https://creativecommons.org/licenses/by/3.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.
Abstract
The environments in which we live, work, and play are subject to enormous variability in air pollutant concentrations. To adequately characterize air quality (AQ), measurements must be fast (real time), scalable, and reliable (with known accuracy, precision, and stability over time). Lower-cost air-quality-sensor technologies offer new opportunities for fast and distributed measurements, but a persistent characterization gap remains when it comes to evaluating sensor performance under realistic environmental sampling conditions. This limits our ability to inform the public about pollution sources and inspire policy makers to address environmental justice issues related to air quality. In this paper, initial results obtained with a recently developed lower-cost air-quality-sensor system are reported. In this project, data were acquired with the ARISense integrated sensor package over a 4.5-month time interval during which the sensor system was co-located with a state-operated (Massachusetts, USA) air quality monitoring station equipped with reference instrumentation measuring the same pollutant species. This paper focuses on validating electrochemical (EC) sensor measurements of CO, NO, NO
You have requested "on-the-fly" machine translation of selected content from our databases. This functionality is provided solely for your convenience and is in no way intended to replace human translation. Show full disclaimer
Neither ProQuest nor its licensors make any representations or warranties with respect to the translations. The translations are automatically generated "AS IS" and "AS AVAILABLE" and are not retained in our systems. PROQUEST AND ITS LICENSORS SPECIFICALLY DISCLAIM ANY AND ALL EXPRESS OR IMPLIED WARRANTIES, INCLUDING WITHOUT LIMITATION, ANY WARRANTIES FOR AVAILABILITY, ACCURACY, TIMELINESS, COMPLETENESS, NON-INFRINGMENT, MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE. Your use of the translations is subject to all use restrictions contained in your Electronic Products License Agreement and by using the translation functionality you agree to forgo any and all claims against ProQuest or its licensors for your use of the translation functionality and any output derived there from. Hide full disclaimer
Details

1 Center for Aerosol and Cloud Chemistry, Aerodyne Research, Inc., Billerica, MA 01821, USA
2 Center for Aerosol and Cloud Chemistry, Aerodyne Research, Inc., Billerica, MA 01821, USA; Department of Chemistry, Connecticut College, New London, CT 06320, USA
3 Massachusetts Institute of Technology, Cambridge, MA 02139, USA