Evaluating the U.S. Air Quality Index as a risk communication tool: Comparing associations of index values with respiratory morbidity among adults in California

Abstract

Background

The Air Quality Index (AQI) in the United States is widely used to communicate daily air quality information to the public. While use of the AQI has led to reported changes in individual behaviors, such behavior modifications will only mitigate adverse health effects if AQI values are indicative of public health risks. Few studies have assessed the capability of the AQI to accurately predict respiratory morbidity risks.

Methods and findings

In three major regions of California, Poisson generalized linear models were used to assess seasonal associations between 1,373,165 respiratory emergency department visits and short-term exposure to multiple metrics between 2012–2014, including: daily concentrations of NO2, O3, and PM2.5; the daily reported AQI; and a newly constructed health-based air quality index. AQI values were positively associated (average risk ratio = 1.03, 95% CI 1.02–1.04) during the cooler months of the year (November-February) in all three regions when the AQI was very highly correlated with PM2.5 (R2 ≥ 0.89). During the warm season (March-October) in the San Joaquin Valley region, neither AQI values nor the individual underlying air pollutants were associated with respiratory morbidity. Additionally, AQI values were not positively associated with respiratory morbidity in the Southern California region during the warm season, despite strong associations of the individual underlying air pollutants with respiratory morbidity; in contrast, health-based index values were observed to be significantly associated with respiratory morbidity as part of an applied policy analysis in this region, with a combined risk ratio of 1.02 (95% CI: 1.01–1.03).

Conclusions

In regions where individual air pollutants are associated with respiratory morbidity, and during seasons with relatively simple air mixtures, the AQI can effectively serve as a risk communication tool for respiratory health risks. However, the predictive ability of the AQI and any other index is contingent upon the monitored values being representative of actual population exposures. Other approaches, such as health-based indices, may be needed in order to effectively communicate health risks of air pollution in regions and seasons with more complex air mixtures.

About the Authors:

Kevin R. Cromar

Roles Conceptualization, Formal analysis, Investigation, Methodology, Project administration, Supervision, Validation, Writing – review & editing

* E-mail: [email protected]

Affiliations Marron Institute of Urban Management, New York University, New York, New York, United States of America, New York University School of Medicine, New York, New York, United States of America

ORCID logo https://orcid.org/0000-0002-7745-2780

Marya Ghazipura

Roles Formal analysis, Investigation, Visualization, Writing – review & editing

Affiliation: New York University School of Medicine, New York, New York, United States of America

ORCID logo https://orcid.org/0000-0003-4328-6822

Laura A. Gladson

Roles Visualization, Writing – original draft, Writing – review & editing

Affiliation: Marron Institute of Urban Management, New York University, New York, New York, United States of America

ORCID logo https://orcid.org/0000-0002-0406-9684

Lars Perlmutt

Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Writing – review & editing

Affiliation: Marron Institute of Urban Management, New York University, New York, New York, United States of America

Introduction

Since 1980, air pollution concentrations in the United States have steadily decreased [1], but thousands of excess deaths and tens of thousands of excess morbidities are still attributed to exposure each year. In California alone, an estimated 3,100 excess deaths and 7,731 excess morbidity cases are attributable annually to air pollution exceeding recommended standards [2]. Health risks associated with short-term exposure to outdoor air pollution are reported to the public by the U.S. Environmental Protection Agency (EPA) through the Air Quality Index (AQI), which has been used as a model for many other air quality indices around the world [3–5].

Each city in the United States with a population over 350,000 is required to report the AQI to the public using a federally prescribed method, including detailed guidance on how to calculate and communicate risk associated with index values [6]. The AQI uses a simple aggregation method to determine local air quality: while all five criteria pollutants are considered, only the single pollutant with the highest concentration relative to its national standard is used to calculate the daily index value. As such, the AQI essentially functions as a regulatory-based, single-pollutant index calibrated to the National Ambient Air Quality Standards (NAAQS). These standards are reviewed by the EPA every five years [7], and although not required [8], the index values have been updated with each NAAQS revision.

The AQI was designed to provide a uniform and simple method of reporting air pollution concentrations that exceed federal regulatory levels. The AQI also provides a ready-made platform to alert the public to extreme pollution episodes. The existing literature shows evidence of avoidance behavior in response to air quality alerts among both susceptible populations and individuals with no underlying health conditions [9–13]. However, the AQI was not specifically designed to act as a risk communication tool for acute health risks, even though it has been appropriated for this purpose. Only the single pollutant with the highest NAAQS-related concentration determines the AQI daily value; thus, the potential additive or mixed effects of multiple pollutants on air quality are ignored [5, 14–16]. Since index levels are linked to health advisories, actual health risk may be understated or misrepresented using the existing AQI framework.

Alternatives to the AQI, and similarly constructed air pollution indices, have been developed in order to address the limitations of its inherent single-pollutant model [3–5, 17, 18]. The most mature efforts in this regard has been the development and implementation of an air quality health index (AQHI) in Canada [19]. In contrast to the U.S.-based AQI, in which index values reflect local air quality conditions, health-based index values go a step further in an effort to report the daily index values as a function of health risk. Health-based indices exist in several global nations, primarily modeled after the Canadian AQHI. The AQHI addresses many of the concerns surrounding the AQI, particularly by accounting for the multi-pollutant effects of air pollution when calculating health risk [19]. Health-based indices have been evaluated in Canada and China, where AQHI reports were found to generally reflect true health outcomes in study regions compared to existing single-pollutant, concentration-based models [14, 16, 20–22].

Despite the fact the AQI was not explicitly designed to function as a risk communication tool, it is possible that it may be able to functionally fulfill this objective. The present study tests the efficacy of the existing AQI in reflecting health risks by investigating associations between population-level health outcomes with index values. Specifically, associations between respiratory morbidity (emergency department (ED) visits) and daily AQI values and health-based index values were evaluated for California from 2012–2014. Due to its relatively poor air quality in the United States and its demographic and geographical diversity, California serves as an excellent case study for this analysis. Additionally, due to the aforementioned high excess morbidity and mortality attributable to air pollution, California is one of the regions in the United States that would most immediately benefit from a better understanding of the strengths and limitations of the AQI as a risk communication tool. However, the intent of this analysis is not to propose changes to California’s air quality reporting, but to use this location to test whether the current AQI is a generally reliable tool for reporting real health risks.

Materials and methods

ED data was accessed via California’s Office of Statewide Health Planning and Development (data can be requested at https://oshpd.ca.gov/data-and-reports/research-data-request-information/). The study population was derived from adults over 18 years of age in 25 California counties, yielding a capture population of 32,708,938 residents constituting 86.9% of the state’s total population. All respiratory ED visits from 2012–2014 were gathered from this population and coded according to the 9th version of the International Classification of Diseases (ICD-9; World Health Organization, Geneva). Respiratory visits were defined as asthma (493), upper respiratory infection (465), pneumonia (480–486), and chronic obstructive pulmonary disease (490–496) (all 2-digit extensions were used). While the standards determining the AQI include mortality and cardiovascular disease in addition to respiratory morbidity, we chose to focus on respiratory health risks since these outcomes are most commonly used by the public in considering how to respond to health index reports [23].

Daily pollutant concentrations based on NAAQS averaging times (1-hour maximum for nitrogen dioxide [NO2], 8-hour maximum for ground-level ozone [O3], and 24-hour average for fine particulate matter [PM2.5]) and daily AQI values (retrospective, not forecast) were obtained from EPA Air Data at the county-level [24]. In counties with multiple monitors, the daily maximum and daily average from monitors with a threshold of 75% of available days per season was obtained. Meteorological data was collected for each county from January 2012 to December 2014, including daily temperature and relative humidity.

The daily health-based index used in this study was constructed using the quantitative approach used to develop the AQHI in Canada by Stieb et al. 2005 [15], and is meant to be a generic index that uses additive effects of nationally representative coefficients for PM2.5, O3, and NO2. These index values represent the additive excess risk of each individual pollutant on respiratory morbidity. The methods and individual studies used in the random effects meta-analysis to derive the coefficients for each pollutant are contained in S1 Appendix and S1 Table, respectively.

Time-series analysis using a quasi-Poisson generalized linear model (GLM) was used to determine the association between respiratory morbidity and index values. The quasi-likelihood estimation was used to account for overdispersion. Decisions in regard to model selection were made a priori based on epidemiology studies looking at the short-term effects of outdoor air pollution. The full GLM model incorporated the daily count of total respiratory ED visits, the daily pollutant concentration, and the daily AQI or health-based index value. Linear terms were used for day of the week, and non-linear adjustments were made using natural splines to control for long-term trends, seasonality, relative humidity, same day temperature, and the temperature at the average of lag days 1 to 3. Similar to the methods reported in other studies, the Akaike information criterion was used to select the optimal number of degrees of freedom (df), or knots, in the model [25–27]. Separate seasonal analyses were completed for the cooler months (November-February) and the warmer months (March-October). Analyses completed during the cool and warm seasons used 8 df and 16 df per season per year, respectively, to account for long-term trends and seasonality. This model was validated by comparing observed vs. fitted adjusted R2 values for each predictor variable by location and season (see S4 Table).

The associations between AQI values and pollutant concentrations with respiratory ED visits were assessed by relative risk (RR) and 95% confidence interval (CI) per inter-quartile range (IQR) increase in index values. County-level associations with AQI values or individual pollutant concentrations in both the warm and cool season were pooled using a random-effects model to account for heterogeneity between county estimates. Associations between newly constructed health-based index values were only completed for regions where AQI values were not significantly associated with population health risk. Primary results are reported for a 4-day average lag structure from lag days 0 through 3; results for all individual lag days investigated in the analysis are shown in S3 Table. Using county-level US Census data from 2012–2014 [28] a subsequent post-hoc analysis was conducted to determine if socioeconomic status impacted our results (results shown in S5 Table).

Results

The study counties were grouped into three distinct regions based in part on geographic proximity, but primarily on similarity in air pollution profiles observed throughout the study period. Additionally, only counties that had both health information and monitor data for the three study pollutants were included, and as such represent areas where AQI values are fully informed by these criteria air pollutants. Fig 1 depicts a map of each region and their associated counties (see S2 Table for a breakdown of health events and pollutant concentrations for individual counties).

[Figure omitted. See PDF.]

Fig 1. Map of regions and associated counties included in the study.

https://doi.org/10.1371/journal.pone.0242031.g001

Demographics of respiratory ED visitors across all three years are presented in Table 1. Overall, 51.4% of visitors were over 40 years old and 60.4% were female. Race and ethnicity among visitors was 38% white, 35.7% Hispanic, 16.2% black, 4.3% Asian or Pacific Islander, and 0.3% Native American, Eskimo, or Aleut.

[Figure omitted. See PDF.]

Table 1. Demographics of study population observed from 2012–2014 in three regions of California.

https://doi.org/10.1371/journal.pone.0242031.t001

From 2012–2014, there were a total of 1,373,165 respiratory ED visits across the three study regions: Southern California (Ventura, Santa Barbara, San Louis Obispo, San Diego, San Bernardino, Riverside, Orange, Los Angeles, and Imperial counties) had 839,222 ED visits; San Joaquin Valley (Tulare, Stanislaus, San Joaquin, Merced, Madera, Kings, Kern, and Fresno counties) had 233,715 ED visits; and San Francisco Bay Area (Sonoma, Solano, Santa Clara, San Mateo, Napa, Monterey [not geographically in the San Francisco Bay area but its air quality profile matches the rest of the listed counties], Contra Costa, and Alameda counties) had 300,228 ED visits. As a result of the higher number of respiratory ED visits per day during the cooler season, the total number of counts was roughly equal between the two seasons, despite different numbers of days in each period, as shown in Table 2.

[Figure omitted. See PDF.]

Table 2. Median and inter-quartile range for pollutant concentrations (24-hour PM2.5, 8-hour O3, and 1-hour NO2) and daily Air Quality Index, by region and season from 2012–2014.

https://doi.org/10.1371/journal.pone.0242031.t002

Spearman correlations between AQI values, individual pollutant concentrations, and weather variables are shown by region and season in Table 3. Very high positive correlations (0.89 to 0.98) were observed for PM2.5 and AQI values in all three regions during the cooler months of the year; during the warmer months, there were only moderate correlations observed for PM2.5 and AQI values (0.58 to 0.71), in addition to moderate to high positive correlations for O3 and AQI values (0.66 to 0.89).

[Figure omitted. See PDF.]

Table 3. Spearman correlations by season and region for air pollutants and meteorological variables, from 2012–2014.

https://doi.org/10.1371/journal.pone.0242031.t003

Individual pollutant results

Fig 2 illustrates the association of individual air pollutants (PM2.5, NO2, and O3) with respiratory ED visits by season and region. The associations depicted in this figure are based on the IQR of the underlying pollutants, shown in Table 2. Of particular note is the lack of significant positive associations between the three individual pollutants and respiratory ED visits from March to October in the San Joaquin Valley region, even though positive significant associations were observed in this region during the cooler months. Also of note is the significant positive associations with morbidity risk for the individual pollutants in the Southern California region during the warmer months despite there being no significant association with AQI values during this same time period and region.

[Figure omitted. See PDF.]

Fig 2. Relative risks of respiratory ED visits for AQI values and individual air pollutants for 2012–2014, by region.

Relative risks are presented per IQR increase in AQI values and pollutant concentrations and are shown for the four-day moving average of lag days 0 through 3. Abbreviations: AQI, air quality index; CI, confidence interval; IQR, inter-quartile range; NO2, nitrogen dioxide; O3, ozone; RR, relative risk; PM2.5, fine particulate matter.

https://doi.org/10.1371/journal.pone.0242031.g002

AQI results

While there is some inter-county variation in observed associations, our pooled analysis found that the daily levels of the AQI are significantly associated with respiratory ED visits for all three study regions in the cooler months (November to February), as shown in Fig 3. An interquartile increase in AQI values was associated with a 4% increase in respiratory morbidity risk in San Joaquin Valley (RR: 1.04, 95% CI: 1.02–1.07 and San Francisco Bay Area (RR: 1.04, 95% CI: 1.02, 1.05), and with a 2% increase in respiratory morbidity in Southern California (RR: 1.02, 95% CI: 1.01, 1.03). More important than the magnitude of the relative risks is the observed positive associations of AQI values and population-level respiratory morbidity.

[Figure omitted. See PDF.]

Fig 3. Relative risks of respiratory ED visits for inter-quartile change in AQI values during the cooler months (November to February) versus the warmer months (March to October) from 2012–2014, by county and region.

Associations are shown for a four-day moving average of lag days 0 through 3. Abbreviations: AQI, air quality index; CI, confidence interval; RR, relative risk.

https://doi.org/10.1371/journal.pone.0242031.g003

During the warmer months of the year (March to October), AQI values were significantly associated with respiratory ED visits in the San Francisco Bay region with a combined RR of 1.02 (95% CI: 1.01–1.03). All individual counties in this region showed positive associations, although not all positive associations were statistically significant at the county level.

However, unlike the San Francisco Bay Area, AQI values were not significantly associated with respiratory ED visits in either the San Joaquin Valley or the Southern California regions during the warm season. In Southern California, a significant positive association was only observed in San Diego County, offset by the significant negative association observed in Riverside County (RR: 0.98, 95% CI: 0.96–0.99) during the same time period. In the San Joaquin Valley region, none of the individual counties demonstrated a positive significant association between AQI and respiratory ED visits during the warmer months, and one county (Madera County) demonstrated significant negative associations (RR: 0.95, 95% CI: 0.90–0.99).

Health-based index results

Due to the observed positive association of individual pollutants, but not AQI values, with respiratory morbidity in Southern California, an exploratory analysis was conducted to determine whether a health-based index combining the excess risk of three individual pollutants (PM2.5, O3, and NO2) would better predict population-level health risks in the region. In order to complete an applied policy analysis, the evaluation focused specifically on four counties comprising the Southcoast Air Quality Management District (Los Angeles, Orange, Riverside, and San Bernardino) in the Southern California region. Local air quality agencies are best suited for making specific decisions regarding risk communication, and therefore these four counties were selected for analysis in an effort to demonstrate how these types of assessments can be directly relevant to the management level where such decisions are made.

As shown in Fig 4, the observed associations for both AQI values and health-based index values are nearly identical during the cooler months in the Southcoast Air Quality Management District, with significant associations observed in three of the four investigated counties for both indices. However, during the warmer season, the health-based index values were significantly associated with respiratory morbidity in 3 of the 4 counties during the warmer months, while the AQI was not positively associated with respiratory morbidity in any of the four counties and was even observed to be significantly, negatively associated with respiratory morbidity in one county. The pooled estimate of the association between the heath-based index and respiratory ED visits stays consistently significant throughout the year, with a combined RR of 1.02 (95% CI: 1.01, 1.04) during the cooler season and a combined RR of 1.02 (95% CI: 1.01, 1.03) during the warmer season. No such positive association was observed for the AQI, which had a combined RR of 1.00 (95% CI: 0.98, 1.01).

[Figure omitted. See PDF.]

Fig 4. Results of an applied policy analysis showing relative risks of respiratory ED visits for health-based index vs. AQI in the Southcoast Air Quality Management District in Southern California from 2012–2014.

Relative risks are presented per IQR increase of the index value. Abbreviations: AQI, air quality index; IQR, inter-quartile range; RR, relative risk.

https://doi.org/10.1371/journal.pone.0242031.g004

Discussion

Even in circumstances when the AQI’s underlying pollutants are associated with respiratory health risks, there is no guarantee the index itself will be. Very few studies have assessed this association between AQI values and health outcomes in the US. In a review by Chen and Copes 2013 [29], only two studies were found meeting these criteria and few new studies of this nature have been identified since the time of the review. And while the studies available investigated the relationship between the AQI and specific health outcomes in their cohorts of interest, both used the AQI as a representation of true pollution rather than looking at whether AQI values are associated with population-level respiratory health outcomes, as done in the present analysis. This also does not include studies that use AQI categories to report results while directly assessing the associations of AQI values with adverse health outcomes [30]. However, the results of these other studies still offer insight into the conditions necessary for an effective AQI.

In one study, Balluz et al. 2007 [31] assessed ischemic heart disease data from the Behavioral Risk Factor Surveillance System (BRFSS) and the association with annual PM2.5 AQI values from the EPA’s Air Quality System (AQS) database across 51 U.S. counties. Adjusting for covariates, they found that counties with higher PM2.5-driven index values were significantly associated with ischemic heart disease across the country. In this study, associations did not vary significantly across different annual quarters. In contrast, investigating a narrower cohort, Letz and Quinn 2005 [32] did not observe significant associations between AQI levels and morbidity. Specifically, they found that among basic military trainees in San Antonio, Texas, the number of daily ED visits for asthma during the ozone season was not associated with either PM2.5- or O3-determined AQI levels. This suggests regional and seasonal variability could play a role in the AQI’s association with health risk.

In the present analysis, AQI values were found to be positively associated with respiratory risk across a large number of study counties, particularly during the cooler months of the year. This outcome suggests that in addition to its intended design to communicate extreme air quality events to the public, the AQI can function as a daily risk communication tool to inform behavior modification decisions—but only at certain times and locations.

Results show that in California, the AQI was most effective at predicting respiratory risk when index values are most highly correlated with PM2.5 (see Table 3). In all three regions, the correlations between AQI values and PM2.5 concentrations are over 0.89 during the cooler months of the year. Thus, during this season, the AQI essentially represents the population level health risks of daily PM2.5 concentrations which was observed to be positively associated with health outcomes in all three regions.

It is unsurprising to see that AQI values are not reflective of population-level morbidity in the San Joaquin region during the warmer months of the year given that none of the individual pollutants used to calculate the AQI were observed to have significant positive associations. This result does not necessarily mean that air pollution is not an important risk factor for respiratory health in this region, but more likely suggests that pollution levels measured at central site monitors are not reflecting the individual exposures responsible for excess morbidity. Improved air pollution monitoring, which better reflects population-level exposures, may be needed in these and other similar locations before effective risk communication is possible. This could include increasing the density of monitors, improving the placement of monitors, or in using alterative modern techniques that may better reflect distribution of the spatial distribution of pollutants [33].

While a positive association between at least some of the individual air pollutants and health outcomes is an essential condition for the AQI to reflect population-level health risks, this condition alone does not guarantee that AQI values will be significantly associated with health outcomes. For instance, during the warmer season, both Southern California and San Francisco Bay showed positive significant associations between respiratory ED visits and the individual pollutants PM2.5 and NO2; yet only daily AQI values in the San Francisco Bay region were significantly associated with respiratory ED visits (Fig 2). There are several potential characteristics of the study regions that may be important factors contributing to this result including: the high correlation of AQI values and O3 in the Southern California region (Table 3) and the higher concentrations and variability of multiple pollutants in Southern California as compared to the San Francisco Bay area (Table 2). A broader investigation involving a larger number of locations will be needed to definitively determine whether it is the unequal health risks of various pollutants on a per unit basis [34], the inability of the AQI to account for the combined health risks of multiple pollutants [35], or some other yet to be identified reason that best explains why the AQI values are not associated with population-level risks in times and locations in which positive associations are observed for the underlying pollutants.

The health-based index used in this study was created to determine if a multi-pollutant index constructed based on health studies, rather than regulatory levels, could better predict health risks in situations where AQI values are not associated with population-level health outcomes as part of an applied policy analysis. Results from an analysis of the four Southcoast Air Quality Management District counties showed that these generic health-based index values not only predicted health risks during the cooler months in a similar manner to AQI values, but also consistently predicted respiratory morbidity during the warmer months when the AQI could not (Fig 4).

The generic health-based index used in this analysis was based on coefficients derived from a meta-analysis of nationally representative studies as opposed to creating a region-specific health index using coefficients derived specifically from this region. Even though a tailor-made index using region-specific coefficients may provide even better results, the goal of this study was not to create an optimal index, but rather to assess whether a multi-pollutant, health-based approach could generally remedy the risk communication limitations of the AQI. Additional analysis would need to be completed before considering alternative index formulations in other locations, and it shouldn’t be assumed that just because a health-based index was observed to be better approach in one area that it will be the correct approach elsewhere.

The findings of this study have important implications for both practitioners and patients. The U.S. EPA recommends that medical pratitioners advise patients to use the AQI to inform behavior modification decisions [36] despite a lack of scientific evidence that typically accompanies clinical practice recommendations [15, 37]. The results of this study demonstrate that while AQI values are associated with population-level health risks in some locations for part of the year, the index may not reliably function as a risk communication tool when the monitored concentrations of the underlying pollutants are not associated with population-level health risks (as was the case in the San Joaquin Region during the warmer months of the year in this study). In these circumstances, it is advisable to consider efforts to improve exposure estimates used in generating index values to better reflect population-level exposures. Should well-executed exposure assessments still produce poor associations between pollutant concentrations and AQI values, it is possible that these associations simply do not hold true under the given situation. Alternatively, in circumstances where the underlying pollutants are associated with health outcomes but AQI values are not (such as Southern California during the warmer months of the year) it may be advisable to consider alternative approaches to the AQI such as a health-based index. Overall, the inconsistent ability of the AQI to reliably reflect daily health risks may explain why patients in some locales have reported relying on personal observations of outdoor conditions as much as air quality indices to inform behavior modification decisions [38].

This analysis was unable to assess differential impacts among various subpopulations. In addition to any increased susceptibility to the adverse effects of outdoor air pollution among individuals with low socio-economic indicators [39] there are also important equity issues as it relates to the ability to access and respond to risk information presented via the AQI [40]. Even in circumstances in which the AQI is predictive of health risks among susceptible individuals, if those same individuals are unable of these advisories or based on personal circumstances cannot modify their behaviors in ways to minimize their exposures to outdoor pollution, then the index may have limited functionality to protect health. Additionally, this study had insufficient power to subset results according to different AQI value groupings, and as such its associations with health outcomes at very low or very high pollution levels remains unclear. However, the authors were primarily concerned with characterizing the efficacy of the AQI at the most common, moderate levels, which has been well defined in this analysis.

Further efforts to evaluate and improve risk communication indices are warranted given the potential health benefits of individual behavior modification to reduce exposure to outdoor air pollution. Regardless of which index design is used to communicate monitored and predicted air pollution concentrations to the general public, the utilized approach should be tested and evaluated to ensure that it is reflective of the relevant health outcomes of interest.

Conclusion

The use of air quality indices to communicate health risks associated with air pollution exposure is widespread in the United States and abroad, with vulnerable populations becoming increasingly reliant on these reports to avoid harmful pollution exposure. While the AQI was not specifically designed to function as a risk communication tool, it may be generally able to fulfill that objective as long as AQI values are highly correlated with a single pollutant (particularly PM2.5). However, in locations and during times with more complex air mixtures, AQI values may not fully capture population-level respiratory health risks, even when positive associations are observed for the underlying pollutants. In these and similar circumstances, it may be advisable for local air quality agencies to explore alternative risk communication approaches so that the public receives accurate health information.

Supporting information

[Figure omitted. See PDF.]

S1 Appendix. Methods used to derive the coefficients used in the development of a generic, health-based index.

https://doi.org/10.1371/journal.pone.0242031.s001

(DOCX)

S1 Table. Summary of studies used in meta-analysis to derive beta values and corresponding risk ratios for the health-based index.

Final coefficients used in the creation of the health-based index were derived using random effects pooling.

https://doi.org/10.1371/journal.pone.0242031.s002

(DOCX)

S2 Table. Total population numbers, counts of respiratory ED visits, and mean (standard deviation) of daily AQI, 1-hour NO2, 8-hour ozone, and 24-hour PM2.5 concentrations, by season and county, between 2012–2014.

Pollution units are ppb for NO2 and O3 and μg/m3 for PM2.5.

https://doi.org/10.1371/journal.pone.0242031.s003

(DOCX)

S3 Table. Relative risks of respiratory ED visits for ambient air pollutants at individual lag days 0–5, by season and region, from 2012–2014.

Relative risks are presented per interquartile increase in pollutant concentrations.

https://doi.org/10.1371/journal.pone.0242031.s004

(DOCX)

S4 Table. Adjusted R2 values comparing observed vs. fitted values for each predictor variable by location and season.

https://doi.org/10.1371/journal.pone.0242031.s005

(DOCX)

S5 Table. Post-hoc analysis of the impact of socioeconomic status on the relative risks of ED admission from increases in AQI and health-based index values.

https://doi.org/10.1371/journal.pone.0242031.s006

(DOCX)

Citation: Cromar KR, Ghazipura M, Gladson LA, Perlmutt L (2020) Evaluating the U.S. Air Quality Index as a risk communication tool: Comparing associations of index values with respiratory morbidity among adults in California. PLoS ONE 15(11): e0242031. https://doi.org/10.1371/journal.pone.0242031

References

1. U.S. EPA. Air Quality-National Summary; 2017. Available from: http://www.epa.gov/airdata/index.html

2. Cromar KR, Gladson LA, Ghazipura M, Ewart G. Estimated excess morbidity and mortality associated with air pollution above American Thoracic Society–recommended standards, 2013–2015. Annals of the American Thoracic Society. 2018.

3. Cairncross E, John J, Zunckel M. A novel air pollution index based on the relative risk of daily mortality associated with short-term exposure to common air pollutants. Atmospheric Environment. 2007;41(38):8442–54.

4. Cheng WL, Chen YS, Zhang J, Lyons TJ, Pai JL, Chang SH. Comparison of the Revised Air Quality Index with the PSI and AQI indices. The Science of the total environment. 2007;382(2–3):191–8. pmid:17540435

5. Kyrkilis G, Chaloulakou A, Kassomenos PA. Development of an aggregate Air Quality Index for an urban Mediterranean agglomeration: relation to potential health effects. Environment international. 2007;33(5):670–6. pmid:17328954

6. 40 U.S. Code § 58.50 (G)(58), (2002).

7. U.S. Federal Registar. Clean Air Act. Section 109(D)(1). 42 U.S. Code § 7411. 1990.

8. U.S. Federal Register. Air Quality Index Reporting: Final Rule. 1999;64(149).

9. McDermott M, Srivastava R, Croskell S. Awareness of and compliance with air pollution advisories: a comparison of parents of asthmatics with other parents. The Journal of asthma: official journal of the Association for the Care of Asthma. 2006;43(3):235–9. pmid:16754528

10. Neidell M. Air quality warnings and outdoor activities: evidence from Southern California using a regression discontinuity design. Journal of epidemiology and community health. 2010;64(10):921–6. pmid:19822555

11. Ward A, Beatty T. Who Responds to Air Quality Alerts? Environ Resource Econ. 2016;65(2):487–511.

12. Wells EM, Dearborn DG, Jackson LW. Activity change in response to bad air quality, National Health and Nutrition Examination Survey, 2007–2010. PloS one. 2012;7(11):e50526. pmid:23226304

13. Wen XJ, Balluz L, Mokdad A. Association between media alerts of air quality index and change of outdoor activity among adult asthma in six states, BRFSS, 2005. Journal of community health. 2009;34(1):40–6. pmid:18821001

14. Stieb DM, Burnett RT, Smith-Doiron M, Brion O, Shin HH, Economou V. A new multipollutant, no-threshold air quality health index based on short-term associations observed in daily time-series analyses. Journal of the Air & Waste Management Association (1995). 2008;58(3):435–50. pmid:18376646

15. Stieb DM, Doiron MS, Blagden P, Burnett RT. Estimating the public health burden attributable to air pollution: an illustration using the development of an alternative air quality index. Journal of toxicology and environmental health Part A. 2005;68(13–14):1275–88. pmid:16024502

16. Wong T, Tam W, Yu I, Lau A, Pang S, Wong A. Developing a risk-based air quality health index. Atmospheric Environment. 2013;76:52–8.

17. Ruggieri M, Plaia A. An aggregate AQI: Comparing different standardizations and introducing a variability index. The Science of the total environment. 2012;420:263–72. pmid:22325987

18. Sicard P, Lesne O, Alexandre N, Mangin A, Collomp R. Air quality trends and potential health effects–Development of an aggregate risk index. Atmospheric Environment. 2011;45(5):1145–53.

19. Robichaud A, Ménard R, Zaïtseva Y, Anselmo D. Multi-pollutant surface objective analyses and mapping of air quality health index over North America. Air Qual Atmos Health. 2016;9(7):743–59. pmid:27785157

20. Chen R, Wang X, Meng X, Hua J, Zhou Z, Chen B, et al. Communicating air pollution-related health risks to the public: an application of the Air Quality Health Index in Shanghai, China. Environment international. 2013;51:168–73. pmid:23246721

21. Li X, Xiao J, Lin H, Liu T, Qian Z, Zeng W, et al. The construction and validity analysis of AQHI based on mortality risk: A case study in Guangzhou, China. Environmental pollution (Barking, Essex: 1987). 2017;220(Pt A):487–94. pmid:27707554

22. To T, Shen S, Atenafu EG, Guan J, McLimont S, Stocks B, et al. The air quality health index and asthma morbidity: a population-based study. Environmental health perspectives. 2013;121(1):46–52. pmid:23060364

23. Carlsten C, Salvi S, Wong GWK, Chung KF. Personal strategies to minimise effects of air pollution on respiratory health: Advice for providers, patients and the public. European Respiratory Journal. 2020;55:1902056. pmid:32241830

24. U.S. EPA. Air Data: Air Quality Data Collected at Outdoor Monitors Across the US; 2017. Available from: https://www.epa.gov/outdoor-air-quality-data

25. Fang X, Li R, Kan H, Bottai M, Fang F, Cao Y. Bayesian model averaging method for evaluating associations between air pollution and respiratory mortality: a time-series study. BMJ Open. 2016;6(8):e011487. pmid:27531727

26. Glatting G, Kletting P, Reske SN, Hohl K, Ring C. Choosing the optimal fit function: comparison of the Akaike information criterion and the F-test. Med Phys. 2007;34(11):4285–92. pmid:18072493

27. Yang L, Qin G, Zhao N, Wang C, Song G. Using a generalized additive model with autoregressive terms to study the effects of daily temperature on mortality. BMC Med Res Methodol. 2012;12:165. pmid:23110601

28. US Census Bureau. Small Area Income and Poverty Estimates (SAIPE): US Department of Commerce; 2020. Available from: https://www.census.gov/data-tools/demo/saipe/#/?map_geoSelector=aa_c&s_state=06&map_yearSelector=2013&s_year=2014,2013,2012

29. Chen H, Copes R. Review of Air Quality Index and Air Quality Health Index. Public Health Ontario; 2013.

30. Rice MB, Ljungman PL, Wilker EH, Gold DR, Schwartz JD, Koutrakis P, et al. Short-Term Exposure to Air Pollution and Lung Function in the Framingham Heart Study. American journal of respiratory and critical care medicine. 2013;188(11):1351–7. pmid:24200465

31. Balluz L, Wen XJ, Town M, Shire JD, Qualter J, Mokdad A. Ischemic heart disease and ambient air pollution of particulate matter 2.5 in 51 counties in the U.S. Public health reports (Washington, DC: 1974). 2007;122:626–33.

32. Letz AG, Quinn JM. Relationship of basic military trainee emergency department visits for asthma and San Antonio air quality. Allergy and asthma proceedings. 2005;26(6):463–7. pmid:16541970

33. Cromar KR, Duncan BN, Bartonova A, Benedict K, Brauer M, Habre R, et al. Air Pollution Monitoring for Health Research and Patient Care. An Official American Thoracic Society Workshop Report. Annals of the American Thoracic Society. 2019;16(10):1207–14. pmid:31573344

34. Lars DP, Kevin RC. Evaluation of the Air Quality Index as a Risk Communication Tool. Journal of Environmental Health. 2019;81(6):8–15.

35. Perlmutt LD, Cromar KR. Comparing associations of respiratory risk for the EPA Air Quality Index and health-based air quality indices. Atmospheric Environment. 2019;202:1–7.

36. U.S. EPA. Particle Pollution and Your Patients' Health: Patient Exposure and the Air Quality Index; 2017. Available from: https://www.epa.gov/pmcourse/patient-exposure-and-air-quality-index

37. American Thoracic Society. American Thoracic Society Clinical Practice Guideline Development Manual; 2018. Available from: http://www.thoracic.org/statements/document-development/resources/guideline-development-manual.pdf

38. Borbet T, Gladson L, Cromar K. Assessing air quality index awareness and use in Mexico City. BMC Public Health. 2018;18(1). pmid:29688852

39. Pratt GC, Vadali ML, Kvale DL, Ellickson KM. Traffic, Air Pollution, Minority and Socio-Economic Status: Addressing Inequities in Exposure and Risk. International journal of environmental research and public health. 2015;12(5):5355–72. pmid:25996888

40. Wang L, Zhong B, Vardoulakis S, Zhang F, Pilot E, Li Y, et al. Air Quality Strategies on Public Health and Health Equity in Europe-A Systematic Review. International Journal of Environmental Research and Public Health. 2016;13(12):1196. pmid:27918457