Systematic review and meta-analysis of cohort studies of long term outdoor nitrogen dioxide exposure and mortality

Abstract

Affiliations School of Epidemiology and Public Health, University of Ottawa, Ottawa, Ontario, Canada, Water and Air Quality Bureau, Health Canada, Ottawa, Ontario, Canada Hwashin H. Shin Roles Conceptualization, Methodology, Writing – review & editing ¶‡ CZ, DS, RH, NL, CM, EL and HHS also contributed equally to this work. Affiliations Environmental Health Science and Research Bureau, Health Canada, Ottawa, Ontario, Canada, Department of Mathematics and Statistics, Queen’s University, Kingston, Ontario, Canada Introduction Traditional cohort studies involving recruitment of individual participants and long term follow-up over many years have been foundational in linking long term air pollution exposure to mortality [1, 2]. Nitrogen dioxide (NO2) is a commonly employed marker of traffic-related urban air pollution [9, 10], although it also more broadly reflects any combustion in air, from sources such as industry and fossil fuel powered electric power generating stations [11, 12]. Bibliographic data, study location and timing, population age group(s), sample size, cause of death (including the International Classification of Diseases (ICD) code(s) if available), method of exposure assessment, pollutant (including name, units, descriptive statistics), type of regression model, effect measure and standard error or confidence interval, model covariates (potential confounders) and their specification were extracted from all studies meeting inclusion criteria.

About the Authors:

David M. Stieb

Contributed equally to this work with: David M. Stieb, Rania Berjawi, Monica Emode

Roles Conceptualization, Data curation, Formal analysis, Funding acquisition, Methodology, Project administration, Supervision, Validation, Visualization, Writing – original draft, Writing – review & editing

* E-mail: [email protected]

Affiliations Environmental Health Science and Research Bureau, Health Canada, Ottawa, Ontario, Canada, School of Epidemiology and Public Health, University of Ottawa, Ottawa, Ontario, Canada

ORCID logo https://orcid.org/0000-0002-7418-1479

Rania Berjawi

Contributed equally to this work with: David M. Stieb, Rania Berjawi, Monica Emode

Roles Data curation, Formal analysis, Validation, Writing – review & editing

Affiliation: School of Epidemiology and Public Health, University of Ottawa, Ottawa, Ontario, Canada

Monica Emode

Contributed equally to this work with: David M. Stieb, Rania Berjawi, Monica Emode

Roles Data curation, Formal analysis, Validation, Writing – review & editing

Affiliation: School of Population and Public Health, University of British Columbia, Vancouver, British Columbia, Canada

Carine Zheng

Roles Conceptualization, Data curation, Methodology, Writing – review & editing

Current address: Center for Income and Socio-Economic Wellbeing, Statistics Canada, Ottawa, Ontario, Canada

¶‡ CZ, DS, RH, NL, CM, EL and HHS also contributed equally to this work.

Affiliation: School of Epidemiology and Public Health, University of Ottawa, Ottawa, Ontario, Canada

Dina Salama

Roles Conceptualization, Data curation, Methodology, Writing – review & editing

Current address: Department of Family Medicine, University of British Columbia, Vancouver, Canada

¶‡ CZ, DS, RH, NL, CM, EL and HHS also contributed equally to this work.

Affiliation: School of Epidemiology and Public Health, University of Ottawa, Ottawa, Ontario, Canada

Robyn Hocking

Roles Conceptualization, Data curation, Methodology, Writing – review & editing

¶‡ CZ, DS, RH, NL, CM, EL and HHS also contributed equally to this work.

Affiliation: Learning, Knowledge and Library Services, Health Canada, Ottawa, Ontario, Canada

Ninon Lyrette

Roles Conceptualization, Methodology, Project administration, Writing – review & editing

Current address: Chemicals and Environmental Health Management Bureau, Health Canada, Ottawa, Ontario, Canada

¶‡ CZ, DS, RH, NL, CM, EL and HHS also contributed equally to this work.

Affiliation: Water and Air Quality Bureau, Health Canada, Ottawa, Ontario, Canada

Carlyn Matz

Roles Conceptualization, Data curation, Methodology, Writing – review & editing

¶‡ CZ, DS, RH, NL, CM, EL and HHS also contributed equally to this work.

Affiliation: Water and Air Quality Bureau, Health Canada, Ottawa, Ontario, Canada

Eric Lavigne

Roles Conceptualization, Methodology, Writing – review & editing

¶‡ CZ, DS, RH, NL, CM, EL and HHS also contributed equally to this work.

Affiliations School of Epidemiology and Public Health, University of Ottawa, Ottawa, Ontario, Canada, Water and Air Quality Bureau, Health Canada, Ottawa, Ontario, Canada

Hwashin H. Shin

Roles Conceptualization, Methodology, Writing – review & editing

¶‡ CZ, DS, RH, NL, CM, EL and HHS also contributed equally to this work.

Affiliations Environmental Health Science and Research Bureau, Health Canada, Ottawa, Ontario, Canada, Department of Mathematics and Statistics, Queen’s University, Kingston, Ontario, Canada

Introduction

Traditional cohort studies involving recruitment of individual participants and long term follow-up over many years have been foundational in linking long term air pollution exposure to mortality [1, 2]. However, these studies are time-consuming and expensive, and may not be representative of the general population depending on recruitment procedures and response rates. More recently, large “synthetic” cohorts have been established by linking administrative or health survey data with address and mortality data [3–5]. Compared to traditional cohort studies, these newer cohort studies have the advantages of being less expensive and time-consuming, more statistically powerful and more representative of the general population. However, they potentially lack data on important covariates such as smoking, which could confound the association between air pollution and mortality. Both types of cohort studies have benefited from innovations in exposure assessment, including utilization of remote sensing, chemical/meteorological and dispersion models, as well as land use regression models [6–8]. These innovations have revolutionized exposure assessment, reducing reliance on sparse networks of ground monitors and increasing both geographic coverage and spatial resolution of estimated exposures.

With increasing exposure assessment capabilities, interest has grown in specific air pollution sources, including traffic. Nitrogen dioxide (NO2) is a commonly employed marker of traffic-related urban air pollution [9, 10], although it also more broadly reflects any combustion in air, from sources such as industry and fossil fuel powered electric power generating stations [11, 12]. Ambient concentrations of NO2 have declined considerably over the last 15–20 years in North America, Europe, Japan and South Korea, but concentrations are increasing in other areas (e.g. China, North Korea and Taiwan) [13]. Numerous studies have evaluated health effects of NO2 on diverse body systems. However, whether long term NO2 exposure is causally related to mortality remains an unresolved question. A particular complicating factor is whether NO2 itself is to blame, or whether it is simply acting as a marker for specific air pollution sources i.e. emissions from vehicles, or more generally as a marker for spatial variation in the urban air pollution mixture [9]. Carbon monoxide and certain chemical components of fine particulate matter, also primarily originating from vehicle emissions, are key potential confounders, given their well-established pathophysiological mechanisms of action [14]. Effects of NO2 could also be confounded by other concomitant traffic-related exposures such as noise or stress [15].

The aforementioned combination of methodological developments has led to rapid growth in the number and geographic diversity of cohort studies, and makes it timely to synthesize the available evidence. Five previous systematic reviews/ meta-analyses have evaluated the association of long term NO2 exposure and mortality [16–20]. However, only one of these reviews conducted an assessment of risk of bias over multiple domains, none provided pooled estimates from paired single and multi-pollutant models from the same primary studies, and only studies published up to 2018 were included. Our objective is therefore to determine whether long term exposure to outdoor NO2 is associated with all-cause or cause-specific mortality based on an up to date synthesis of the available evidence.

Methods

The protocol is registered with PROSPERO (CRD42018084497) (S1 File) [21].

Literature searches

MEDLINE, Embase, CENTRAL, Global Health and Toxline databases were searched using terms developed by a librarian (S1 Table). The search strategy underwent Peer Review of Electronic Search Strategies (PRESS) [22]. Searches were last updated February 25, 2020. Inclusion criteria were as follows: Participants/population: Humans; Intervention(s), exposure(s): Exposure to outdoor NO2 (and other oxides of nitrogen); Comparator(s)/control: Lower levels of exposure; Main outcomes: Mortality from all/ natural causes or specific causes; Study design: cohort. Publications in abstract form only were excluded. Publications in English or French were included and there were no restrictions on publication date. Effect measures considered were: mortality effects reported as regression coefficients, hazard ratios (HR) or relative risks associated with exposures over a period of years, expressed per specified increment in exposure. The present review is one part of a series of reviews of effects of NO2, all of which were included in the original search. Other reviews pertain to non-asthma respiratory morbidity and ischemic heart disease morbidity related to short term exposure [21]. Studies were selected for the present review if reported outcomes matched the inclusion criteria specified above.

Screening, data extraction and risk of bias assessment

Screening and data extraction were completed independently by two reviewers in DistillerSR. Conflicts between reviewers were resolved through consensus and/or involvement of a third reviewer. All studies retrieved from literature searches were screened for relevance based on title and abstract according to the above inclusion criteria. Where relevance could not be determined based on abstract and title, the full text was reviewed. Manual searches were also completed of reference lists of all relevant studies. Bibliographic data, study location and timing, population age group(s), sample size, cause of death (including the International Classification of Diseases (ICD) code(s) if available), method of exposure assessment, pollutant (including name, units, descriptive statistics), type of regression model, effect measure and standard error or confidence interval, model covariates (potential confounders) and their specification were extracted from all studies meeting inclusion criteria. When single pollutant results were presented for multiple exposure periods, we extracted the most highly statistically significant result (regardless of the direction of the association), or that reported by the authors as their primary finding. Results from multi-pollutant models that resulted in the greatest reduction in magnitude of effect compared to single pollutant results were selected in order to bracket the magnitude of effect from each study. Our objective in this regard was not to assess the magnitude of the association with NO2 in the presence of a single co-pollutant common to all studies, but rather to determine the maximum potential for confounding of the association of mortality with NO2 by any co-pollutant(s). Results expressed per pollutant increment expressed in μg/m3 were converted to parts per billion [23], and those based on nitrogen oxides (NOx) were converted by multiplying the log(HR) by 2.31 (the average ratio of log(HR) based on NO2 to log(HR) based on NOx in four studies based on 25 cohorts [24–27]). Where required data were not provided, authors were contacted by e-mail. In some instances Engauge Digitizer [28] was employed to extract numeric results presented only in graph form. The Navigation Guide systematic review methodology [29] was employed to evaluate risk of bias at the study level according to the following domains: selection bias, exposure assessment, confounding, outcome assessment, completeness of outcome data, selective outcome reporting, conflict of interest (including sources of funding) and other sources of bias. Criteria are detailed in S1 Fig. In the confounding domain, we considered age, sex, smoking and socioeconomic status as critical potential confounders. As a sensitivity analysis, we treated body mass index (BMI) rather than smoking as a critical confounder, as specified in the World Health Organization (WHO) risk of bias criteria [30]. Assessment of risk of bias was completed independently by two reviewers and conflicts between reviewers were resolved through consensus and/or involvement of a third reviewer.

Data analysis

Pooling of HRs across studies was conducted using random effects models computed using Restricted Maximum Likelihood (REML) estimation, with sensitivity analyses employing Dersimonian and Laird and Empirical Bayes estimators [31]. Heterogeneity among included studies was assessed using Cochran’s Q and I2 measures, and sources of heterogeneity were evaluated using meta-regression [31]. Sensitivity of pooled estimates to individual studies was examined using Leave One Out analysis and publication bias was evaluated using Funnel plots, Begg’s and Egger’s tests, and trim and fill [31]. Subgroup analyses were conducted by cause of death, region, risk of bias characterization (pre-specified in protocol) and single vs. multi-pollutant models. Analysis was conducted in R version 3.6.0 [32] using the metafor package [31].

Overall rating of quality and strength of evidence

We applied the Navigation Guide methodology [33] and the causality determination framework used by the US EPA and Health Canada [12] (S2 and S3 Tables) to judge the overall quality and strength of the evidence, and likelihood of a causal relationship. Following the Navigation Guide methodology, given the observational nature of the evidence, the starting point for rating overall quality was “moderate,” which was downgraded or upgraded to “low” or “high” based on the criteria summarized in S2 Table [33]. Identification of multiple upgrading or downgrading factors does not necessarily mean that overall quality is upgraded or downgraded multiple levels. Rather, the overall degree of upgrading or downgrading is based on reviewer judgement of the overall importance and impact of all factors considered [33]. The Navigation Guide characterizes strength of evidence of toxicity as “sufficient”, “limited”, “inadequate” or “indicative of a lack of toxicity” (S2 Table), based on the overall quality of the evidence, the direction of effect, confidence in the effect and any other factors identified as germane by the reviewers [33]. Given the parallels with the USEPA/Health Canada causality determination criteria (S3 Table), while we did not conduct a systematic review of other lines of evidence, we drew upon summaries of other lines of evidence from a recent assessment document [11], supplemented by findings from more recent mechanistic studies, in order to characterize the likelihood of a causal relationship.

Results

A Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) diagram summarizing disposition of studies identified in literature searches is shown in Fig 1. As indicated earlier, the present review is one part of a series of reviews of effects of NO2 on multiple outcomes, all of which were included in the original search, which is reflected in numeric results reported in Fig 1. Seventy-nine studies were included in our final analysis based on 47 cohorts, plus one set of pooled analyses of multiple European cohorts. Study characteristics are summarized in S4 Table. Approximately the same proportion of studies was conducted in North America (n = 32, 41%) and Europe (n = 35, 44%), while a smaller proportion (n = 12, 15%) was conducted elsewhere. Cohorts were mostly drawn from the general population, with the exception of six cohorts based on mortality follow-up after diagnosis of hypertension [34–38], myocardial infarction [39–41], stroke [42, 43], or lung cancer [26, 44]. Cohort sizes ranged from 1,800 to 14.1 million participants. Fifty-one studies (65%) employed modelling while 28 (35%) employed ground monitoring as the source of exposure data, and almost all, n = 74 (94%), employed NO2 as the exposure metric, while only 5 (6%) employed NOx. The most frequently examined causes of death were all/natural cause (non-accidental), (n = 56, 71%), cardiovascular (n = 37, 47%), respiratory (n = 35, 44%), lung cancer (n = 32, 41%), ischemic heart disease (n = 27, 34%), and cerebrovascular (n = 26, 33%). Thirty-eight studies (48%) were mostly conducted post 2000 (majority of study duration after 2000).

[Figure omitted. See PDF.]

Fig 1. Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) flow diagram.

https://doi.org/10.1371/journal.pone.0246451.g001

Risk of bias ratings for individual studies are shown in S2 Fig and reasons for assigned ratings of risk of bias greater than low risk (or unable to assess) for individual studies are provided in S5 Table. The greatest variability in ratings occurred in the exposure assessment and confounding domains, while ratings in the other six domains (selection bias, outcome assessment, completeness of outcome data, selective outcome reporting, conflict of interest, other sources of bias) were generally low or probably low risk of bias. Forty-six studies (58.2%) were rated probably high or high risk of bias or unable to assess in the exposure assessment domain (although bias would be expected to be non-differential) because exposure was based on an area-level average, did not account for change of address, relied on a single monitor, there was evidence of a mediocre correlation of modelled or measured values with ground measurements in the target community, or there was insufficient information. Twelve studies (15.2%) were rated probably high or high risk of bias in the confounding domain because of lack of adjustment for one or more key potential confounders (age, sex, smoking, socio-economic status). An additional eight studies did not adjust for BMI or account for obesity as a potential confounder through other covariates such as comorbidity or analysis of associations with exposure in complementary data.

Effect estimates and pooled effect estimates

All effect estimates from individual studies, including from single and multi-pollutant models, and by population and outcome subgroup are provided in forest plots by region in S3 Fig. Of these, we excluded estimates from pooling if they were superseded by other studies encompassing the same geographic area or time period, e.g. in subsequent multi-city studies or those spanning a longer study duration, results were provided only from multi-pollutant models, or there were too few studies of the outcome, leaving 53 studies included in the meta-analysis (see S4 Table). Pooled estimates based on single pollutant model results by cause of death are summarized in Table 1. Pooled estimates were largest for respiratory and cerebrovascular causes of death, similar for cardiovascular and ischemic heart disease, and smallest for all/natural cause and lung cancer. All pooled estimates were characterized by a high degree of heterogeneity.

[Figure omitted. See PDF.]

Table 1. Pooled estimates by cause of death and sensitivity analyses.

https://doi.org/10.1371/journal.pone.0246451.t001

Meta-regression and sensitivity analysis

Meta-regression revealed that the magnitude of the log HR for cardiovascular, respiratory and ischemic heart disease mortality was significantly larger for studies conducted outside North America and Europe (p = 0.002, 0.025, 0.021 respectively). For lung cancer mortality, standard deviation (p = 0.0009) and range (p = 0.006) of NO2 exposure were significantly positively associated with log HR. Probably high or high risk of bias in the confounding domain was significantly positively associated with log HR for all/ natural cause (p = 0.040), respiratory (p = 0.006) and cerebrovascular (p = 0.036) mortality. In a sensitivity analysis, treating BMI rather than smoking as a critical potential confounder, as specified in the WHO risk of bias criteria, probably high or high risk of bias in the confounding domain was not associated with log HR. Risk of bias in the exposure assessment domain, study interquartile range NO2 and timing of study primarily before or after 2000 were not significant predictors of the log HR. Residual heterogeneity remained high (I2 >80%) even after accounting for significant predictor variables.

Based on meta-regression findings, studies with probably high or high risk of bias in the confounding domain (n = 12) were excluded, resulting in substantially smaller pooled HRs for cardiovascular, respiratory and cerebrovascular mortality (Table 1). Pooled estimates were significantly smaller for cerebrovascular mortality (p = 0.031) and significantly larger for ischemic heart disease mortality (p = 0.002), than for all/ natural cause mortality. Fig 2 presents a forest plot of HRs from individual studies and pooled estimates for all/ natural cause mortality, after exclusion of studies with probably high or high risk of bias in the confounding domain. The pooled estimate for North America was smaller than those for Europe and other countries, and heterogeneity among primary studies was lower for North American studies. Forest plots for other causes of death are provided in S4 Fig. Applying the WHO risk of bias criteria (treating BMI rather than smoking as a critical potential confounder) resulted in a somewhat larger pooled estimate for all/natural cause mortality, considerably larger pooled estimates for cardiovascular and cerebrovascular mortality, together with much greater heterogeneity for the latter, and a somewhat smaller pooled estimate with narrower confidence intervals and considerably less heterogeneity for respiratory mortality (Table 1).

[Figure omitted. See PDF.]

Fig 2. Hazard ratios from single pollutant models from individual cohort studies and pooled estimates by region, for all/ natural cause mortality (AC/NC).

https://doi.org/10.1371/journal.pone.0246451.g002

Results were generally insensitive to the exclusion of studies employing NOx as the exposure metric [45–47], with the exception of all/natural cause mortality, for which the pooled estimate was somewhat smaller (Table 1). Findings were also insensitive to excluding cohorts of individuals with pre-existing disease [36, 39, 41, 42] (pooled estimate of HR for all/natural cause mortality 1.050, 95% CI 1.022–1.078). Pooled estimates were not sensitive to employing alternative estimators except that confidence intervals tended to be slightly narrower based on Dersimonian and Laird, and slightly wider based on Empirical Bayes (S1 Text). In leave one out analyses, heterogeneity among respiratory and ischemic heart disease studies was sensitive to exclusion of results from Katanoda et al. [48] and Turner et al. [49] respectively (S6 Table). Egger’s test revealed significant funnel plot asymmetry for all/ natural cause (p = 0.0022) and lung cancer (p = 0.031) mortality, while Begg’s test indicated significant funnel plot asymmetry only for lung cancer mortality (p = 0.022). Trim and fill analysis estimated that there were 4 missing studies with log HR below the pooled estimate for lung cancer mortality (S5 Fig), reducing the pooled estimate slightly to 1.066 (95%CI 1.024–1.110).

Effects of co-pollutants, noise and green space

A forest plot of nine paired estimates of associations with all/ natural cause mortality from single and multi-pollutant models from the same study, after exclusion of studies with probably high or high risk of bias in the confounding domain, is shown in Fig 3. The pooled estimate from single pollutant models was higher than that from multi-pollutant models with 1–4 co-pollutants, and the confidence interval for the multi-pollutant pooled estimate included 1, indicating no association. However, the difference between pooled estimates for single and multi-pollutant models was not significant (p = 0.13). Fewer paired estimates from single and multi-pollutant models were available for other causes of death. Pooled estimates from multi-pollutant models were consistently smaller in magnitude than those from single pollutant models, and the pooled estimates based on multi-pollutant models included 1, indicating no association, with the exception of ischemic heart disease mortality which was based on only three studies (Table 2).

[Figure omitted. See PDF.]

Fig 3. Hazard ratios from individual cohort studies and pooled estimates from single and multi-pollutant models for all/ natural cause mortality (AC/NC).

https://doi.org/10.1371/journal.pone.0246451.g003

[Figure omitted. See PDF.]

Table 2. Pooled estimates from single and multi-pollutant models by cause of death.

https://doi.org/10.1371/journal.pone.0246451.t002

Few studies have jointly examined effects of NO2 and noise. Sørensen et al. found that NO2 exhibited a significant positive association with fatal stroke when modelled jointly with traffic noise [50], while in the same cohort, Hvidtfeldt et al. found that NO2 remained significantly associated with natural cause mortality after adjustment for traffic noise, although the magnitude of the association was reduced, and NO2 was no longer significantly associated with cardiovascular mortality after adjustment for traffic noise [51]. Héritier et al. [52] also reported that the association of NO2 with myocardial infarction mortality was no longer significant after adjustment for traffic, rail and aircraft noise. Klompmaker et al. found no association between NO2, PM2.5, greenness or traffic noise and mortality [53], and Tonne et al. observed a negligible change in the association between NO2 and mortality with additional adjustment for traffic noise [40]. Nieuwenhuijsen et al. [54] found that the association of NO2 with mortality was reduced in magnitude in models with noise and/or green space.

Shape of exposure-response relationship

Twenty-nine studies evaluated the shape of the exposure-response relationship between NO2 or NOx and mortality by examining the association by pollutant quantile [24, 41, 44, 47, 55–57], plotting the association using a non-linear function of pollutant concentration and/or testing the significance of the difference between linear and non-linear models [5, 25, 27, 45, 46, 50, 51, 53, 57–69], or plotting associations by city [48]. Of these, 19 studies found a linear association [27, 41, 44, 50, 51, 53, 55–57, 60, 63–65, 67–69], in some instances only in subsets of the data by cause of death [5, 45, 46], and five studies concluded that the association was supralinear [25, 45, 47, 59, 66]. Three found evidence of a threshold [48, 61, 62], but only one study identified specific numeric values, ranging from 20–40 μg/m3, depending on age and cause of death [62]. Two studies reported no association, based on analysis by quantiles [24], and using a non-linear function of NO2 [58]. While there was some variation in findings by cause of death in individual studies, overall there was evidence of an exposure-response relationship across all six causes of death.

Discussion

Based on an analysis of 53 cohort studies, pooled estimates of associations indicated that long term exposure to outdoor NO2 was significantly associated with mortality from all/ natural causes, cardiovascular disease, lung cancer, respiratory disease, and ischemic heart disease. There was a consistently high degree of heterogeneity among results from primary studies, which was only partially accounted for in meta-regression. The magnitude of the observed association was larger in studies with probably high or high risk of bias in the confounding domain, and pooled estimates were substantially smaller for cardiovascular, respiratory and cerebrovascular mortality when these studies were excluded. Heterogeneity based on I2 was reduced substantially for cerebrovascular and respiratory mortality after excluding these studies, which we believe is related to the combination of a smaller number of studies and exclusion of studies reporting associations of a magnitude that differed substantially from the remaining studies. We also found that pooled estimates were sensitive to which covariates were considered critical potential confounders; pooled estimates for cardiovascular and cerebrovascular mortality were considerably larger when BMI rather than smoking was treated as a critical potential confounder, as specified in the WHO risk of bias criteria. We did not find an association between log HR and risk of bias in the exposure assessment domain, although one would expect that greater exposure measurement error (likely non-differential) would tend to bias associations towards the null, depending on the type of error [70–73]. Indeed, Crouse et al. reported that the magnitude of the association was larger when change of residential address was accounted for [59]. There was evidence of publication bias based on tests of funnel plot asymmetry for all/ natural cause and lung cancer mortality, but application of trim and fill revealed only small reductions in pooled estimates of association. The pooled estimate for all/natural cause mortality based on single pollutant models was larger than that based on multi-pollutant models, and confidence intervals on the multi-pollutant pooled estimate overlapped 1 or no association. Of the approximately one-third of studies that examined the shape of the exposure response relationship, most concluded that it was linear.

There have been five previous systematic reviews/meta-analyses of the association between long term NO2 exposure and mortality in cohort studies. Pooled estimates from these studies are summarized in Table 3 in comparison with the present study, by cause of death. With the exception of the recent paper by Huangfu and Atkinson [20], for all four categories of cause of death, pooled estimates from the present study were based on approximately twice as many primary studies as the most recent previous systematic review. Pooled estimates varied most for cardiovascular and respiratory mortality, while they were relatively consistent in magnitude for all/natural cause and lung cancer mortality. Our pooled estimate was the largest for respiratory mortality based on all studies, but consistent with lower pooled estimates from other studies after excluding those with probably high or high risk of bias in the confounding domain. Heterogeneity among results from primary studies was uniformly high in earlier meta-analyses, with the exception of one pooled estimate for respiratory mortality based on only 8 primary studies. Only Huangfu and Atkinson [20], conducted an assessment of risk of bias over multiple domains, but neither they nor the other systematic reviews provided pooled estimates from paired single and multi-pollutant models from the same primary studies. In subgroup analyses, Atkinson et al. found that pooled estimates of associations with all/ natural cause, cardiovascular and lung cancer mortality based on cohorts restricted to older age groups were larger than those based on all ages [19]. Additionally, those based on models adjusting for key confounders (BMI, smoking) were smaller than those without these adjustments (natural cause, cardiovascular, respiratory and lung cancer mortality), similar to our findings; and those for natural cause and cardiovascular mortality based on residential exposure estimates were larger than those based on area level exposures [19]. In Faustini et al’s systematic review, the effects of excluding studies based on individuals with pre-existing disease, older age groups, or with area level exposure characterization were inconsistent [17]. Hamra et al. found little impact of method of exposure characterization or presence or absence of adjustment for selected confounders (with the exception of studies including adjustment for occupation, which generated a smaller pooled estimate) [18]. Huangfu and Atkinson also found little impact of adjustment for selected confounders [20]. They concluded that the certainty of evidence was moderate for all-cause, respiratory and acute lower respiratory infection mortality, and high for chronic obstructive pulmonary disease mortality [20].

[Figure omitted. See PDF.]

Table 3. Comparison of pooled estimates from current study and previous meta-analyses.

https://doi.org/10.1371/journal.pone.0246451.t003

Other lines of evidence

The 2016 US Environmental Protection Agency (EPA) Integrated Science Assessment on oxides of nitrogen concluded that toxicological evidence suggested there were several possible mechanisms through which long term exposure to NO2 could contribute to adverse respiratory and cardiovascular effects, including pulmonary inflammation, oxidative stress, pulmonary injury, changes in lung morphology, impaired respiratory immune defences, atherosclerosis, autonomic dysfunction, and changes in lipid metabolism [11]. Examples of findings from relevant studies include the modulation of alveolar macrophage activity in rats in association with NO2 exposure [74], and increased mortality from respiratory infection in mice in two older studies of NO2 exposure [75, 76]. With respect to cardiovascular effects, in one study, long term exposure to NO2 was associated with reduced heart rate variability, but only in women [77]. In a Spanish cross sectional study, long term NO2 exposure was associated with increased blood pressure [78] and subclinical atherosclerosis [79]. A more recent study in Germany found that those with higher long term NO2 exposure had significantly higher odds of elevated ankle-brachial index, reflective of arterial stiffening, although the magnitude of the association was reduced in a joint model with PM2.5 absorbance (a proxy for elemental carbon) [80]. Overall, however, the evidence base was considered limited, associations were inconsistent, and it was difficult to separate effects of NO2 from those of co-pollutants [11]. With respect to short term exposure to NO2 and mortality, a recent systematic review concluded that there was a high degree of certainty of the evidence linking 24 hour average exposure and mortality [81]. While there may be a degree of overlap in the effects captured by studies of short term and long term exposure, the overall health impact captured by each type of design is not identical [82], and certainty of evidence regarding effects of short term exposure does not necessarily imply certainty regarding effects of long term exposure.

Overall rating of quality and strength of evidence

In their 2016 Science Assessments, both the US EPA and Health Canada concluded that the evidence was suggestive of, but not sufficient to infer, a causal relationship between long term NO2 exposure and mortality, based on a smaller number of studies, and fewer studies examining the impact of adjustment for co-pollutants than considered here, as well as limited and inconsistent supporting mechanistic evidence from human and animal studies [11, 12]. Applying the Navigation Guide methodology [33] and the causality determination framework used by the US EPA and Health Canada [12] to our current findings, several factors are considered downgrading factors in interpreting the overall quality of evidence. These include the significant heterogeneity among studies even after accounting for sources of heterogeneity, and the relatively large proportion of studies rated as probably high or high risk of exposure assessment bias (57.1%) (even though presence of this bias was not associated with magnitude of association in meta-regression). There was also evidence of publication bias, particularly for lung cancer mortality, but it did not have a substantial impact on pooled estimates of association. Risk of bias from residual confounding was evaluated both in relation to inclusion of critical potential confounders in statistical models, as well as impacts of co-pollutants and other co-exposures on the magnitude of associations. Pooled estimates indicated that NO2 remained significantly associated with all/natural cause, cardiovascular, lung cancer, respiratory and ischemic heart disease mortality after exclusion of 12 studies with probably high or high risk of bias in the confounding domain. However, after excluding these studies, only 9 studies of all/natural cause mortality provided estimates based on both single and multi-pollutant models, and the pooled estimate indicated that NO2 was no longer significantly associated with mortality after adjusting for co-pollutants. Fewer paired estimates from single and multi-pollutant models were available for other causes of death. Pooled estimates from multi-pollutant models were consistently smaller in magnitude than those from single pollutant models, and the pooled estimates based on multi-pollutant models included 1, indicating no association, with the exception of ischemic heart disease mortality, which was based on only three studies. Multi-pollutant models should be interpreted with caution in that the sensitivity of the effect of one pollutant to inclusion of other pollutants in a joint model is affected by factors such as the correlation among pollutants and their relative degree of exposure measurement error [83]. There is nonetheless evidence of confounding by co-pollutants of the association of long term NO2 exposure with mortality. Few studies jointly modelled NO2 with traffic noise. In a recent review, Tétrault et al. concluded that cardiovascular effects of long term air pollution exposure were probably independent of noise, but this was based on only nine studies, including only one study of air pollution and mortality [15]. One study found that that the association of NO2 with mortality was reduced in magnitude in models with both noise and/or green space [54]. Specifically with respect to cerebrovascular mortality, imprecision is also considered a downgrading factor, as the 95% CI on the pooled estimate overlapped the null. In contrast to these downgrading factors, characterization of the exposure-response relationship as linear, supralinear, or linear with a threshold in 27 of the 29 studies in which this was evaluated, is considered an upgrading factor applicable to all six causes of death. Huangfu and Atkinson also downgraded the evidence in relation to heterogeneity for all cause and respiratory mortality, and upgraded it in relation to evidence of an exposure-response relationship [20]. Based on these considerations, we conclude that for all causes of death other than cerebrovascular disease, the overall quality of the evidence from cohort studies is moderate, the strength of evidence of toxicity is limited, and the overall evidence continues to be suggestive of, but not sufficient to infer, a causal relationship between long term NO2 exposure and mortality. In the case of cerebrovascular disease mortality, owing to the smaller number of primary studies and the non-significant smaller magnitude association based on the pooled estimate, we conclude that the overall quality of the evidence from cohort studies is low, the strength of evidence is inadequate, and the overall evidence is inadequate to infer a causal relationship. Upgrading to a conclusion that there is sufficient evidence for a causal relationship would require more conclusive evidence ruling out potential confounders as well as consistent supporting animal toxicological and human clinical evidence. Future studies could address uncertainties related to confounding by co-pollutants by more consistently examining their correlations and effects in multi-pollutant models, in particular adjusting for other traffic-related pollutants and concomitant exposures like noise, green space and stress. Only about one third of the studies we reviewed addressed the shape of the concentration-response relationship, therefore examination of this issue in future studies would also be informative. While the evidence reviewed does not support the unequivocal conclusion that long term exposure to outdoor NO2 causes an increased risk of death, identifying the true causal agent is of major importance to public health. Vehicle emissions are one of the main sources of NO2, but vehicle emissions, and secondary pollutants arising from vehicle emissions also include numerous other potentially toxic pollutants such as carbon monoxide, particulate matter, benzene, formaldehyde, acetaldehyde, 1,3-butadiene, ozone, nitrates and organic and inorganic acids [10]. If the true causal agent is not NO2, control measures which specifically reduce NO2 will not reduce mortality risks. Conversely, identification and control of the true causal agent will have considerable public health benefits.

Conclusions

We conducted a synthesis of the evidence from 79 cohort studies examining the association between long term NO2 exposure and natural cause and cause-specific mortality, including sensitivity analyses based on pooling method, leave one out analysis and trim and fill, meta-regression to examine sources of heterogeneity, and analysis of single vs. multi-pollutant models. We concluded that for all causes of death other than cerebrovascular disease, the overall quality of the evidence is moderate and the strength of evidence of toxicity was categorized as limited, while for cerebrovascular disease the overall quality of the evidence is low, and strength of evidence was rated inadequate. Important uncertainties remain, including potential confounding by co-pollutants or other concomitant exposures, and limited supporting mechanistic evidence. Identification and control of the true causal agent linking long term NO2 exposure and mortality, whether NO2 itself or another correlated exposure, will have considerable public health benefits.

Supporting information

S1 Fig. Risk of bias criteria.

https://doi.org/10.1371/journal.pone.0246451.s001

(PDF)

S2 Fig. Risk of bias ratings for individual studies.

https://doi.org/10.1371/journal.pone.0246451.s002

(PDF)

S3 Fig. Forest plots by region.

https://doi.org/10.1371/journal.pone.0246451.s003

(PDF)

S4 Fig. Hazard ratios from single pollutant models from individual cohort studies and pooled estimates by region (specific causes of death).

https://doi.org/10.1371/journal.pone.0246451.s004

(PDF)

S5 Fig. Funnel plot of log(hazard ratio) vs. standard error, lung cancer mortality.

https://doi.org/10.1371/journal.pone.0246451.s005

(PDF)

S1 File. Review protocol.

https://doi.org/10.1371/journal.pone.0246451.s006

(PDF)

S2 File. Data.

https://doi.org/10.1371/journal.pone.0246451.s007

(CSV)

S3 File. PRISMA 2009 checklist.

https://doi.org/10.1371/journal.pone.0246451.s008

(PDF)

S1 Table. Details of search strategies.

https://doi.org/10.1371/journal.pone.0246451.s009

(PDF)

S2 Table. Navigation guide criteria for overall quality and strength of evidence.

https://doi.org/10.1371/journal.pone.0246451.s010

(PDF)

S3 Table. USEPA/Health Canada criteria for evaluating likelihood of causal relationship.

https://doi.org/10.1371/journal.pone.0246451.s011

(PDF)

S4 Table. Characteristics of primary studies.

https://doi.org/10.1371/journal.pone.0246451.s012

(PDF)

S5 Table. Reasons for assigned ratings of risk of bias greater than low risk (or unable to assess).

https://doi.org/10.1371/journal.pone.0246451.s013

(PDF)

S6 Table. Leave one out analyses.

https://doi.org/10.1371/journal.pone.0246451.s014

(PDF)

S1 Text. Sensitivity to estimator.

https://doi.org/10.1371/journal.pone.0246451.s015

(PDF)

Acknowledgments

We thank Lisa Glandon, MIS (Health Library, Health Canada) for peer review of the MEDLINE search strategy as well as Tania Onica and Barry Jessiman (Health Canada) for helpful comments. We also thank Drs. Wenqi Gan, Hsien-Ho Lin and Fred Lipfert for their responses to requests for additional information on their studies.

Citation: Stieb DM, Berjawi R, Emode M, Zheng C, Salama D, Hocking R, et al. (2021) Systematic review and meta-analysis of cohort studies of long term outdoor nitrogen dioxide exposure and mortality. PLoS ONE 16(2): e0246451. https://doi.org/10.1371/journal.pone.0246451

References

1. Dockery DW, Pope CA 3rd, Xu X, Spengler JD, Ware JH, Fay ME, et al. An association between air pollution and mortality in six U.S. cities. N Engl J Med. 1993;329: 1753–1759. pmid:8179653

2. Pope CA 3rd, Thun MJ, Namboodiri MM, Dockery DW, Evans JS, Speizer FE, et al. Particulate air pollution as a predictor of mortality in a prospective study of U.S. adults. Am J Respir Crit Care Med. 1995;151: 669–674. pmid:7881654

3. Crouse DL, Peters PA, van Donkelaar A, Goldberg MS, Villeneuve PJ, Brion O, et al. Risk of nonaccidental and cardiovascular mortality in relation to long-term exposure to low concentrations of fine particulate matter: A Canadian national-level cohort study. Environ Health Perspect. 2012;120: 708–714. pmid:22313724

4. Eum K-D, Kazemiparkouhi F, Wang B, Manjourides J, Pun V, Pavlu V, et al. Long-term NO2 exposures and cause-specific mortality in American older adults. Environ Int. 2019;124: 10–15. pmid:30639903

5. Fischer PH, Marra M, Ameling CB, Hoek G, Beelen R, de Hoogh K, et al. Air Pollution and Mortality in Seven Million Adults: The Dutch Environmental Longitudinal Study (DUELS). Environ Health Perspect. 2015;123: 697–704. pmid:25760672

6. Van Donkelaar A, Martin RV, Spurr RJD, Burnett RT. High-Resolution Satellite-Derived PM2.5 from Optimal Estimation and Geographically Weighted Regression over North America. Environ Sci Technol. 2015;49: 10482–10491. pmid:26261937

7. Hystad P, Setton E, Cervantes A, Poplawski K, Deschenes S, Brauer M, et al. Creating national air pollution models for population exposure assessment in Canada. Environ Health Perspect. 2011;119: 1123–1129. pmid:21454147

8. Robichaud A, Ménard R, Zaïtseva Y, Anselmo D. Multi-pollutant surface objective analyses and mapping of air quality health index over North America. Air Qual Atmosphere Health. 2016;9: 743–759. pmid:27785157

9. Levy I, Mihele C, Lu G, Narayan J, Brook JR. Evaluating Multipollutant Exposure and Urban Air Quality: Pollutant Interrelationships, Neighborhood Variability, and Nitrogen Dioxide as a Proxy Pollutant. Environ Health Perspect. 2014;122: 65–72. pmid:24225648

10. HEI Panel on the Health Effects, of Traffic-Related Air Pollution. Traffic-Related Air Pollution: A Critical Review of the Literature on Emissions, Exposure, and Health Effects. Boston, Massachusetts: Health Effects Institute; 2010.

11. USEPA. Integrated Science Assessment for Oxides of Nitrogen—Health Criteria. Research Triangle Park, North Carolina: US EPA; 2016. Report No.: EPA/600/R-15/068.

12. Health Canada. Human Health Risk Assessment for Ambient Nitrogen Dioxide. Ottawa, Canada: Health Canada; 2016.

13. Geddes JA, Martin RV, Boys BL, van Donkelaar A. Long-Term Trends Worldwide in Ambient NO 2 Concentrations Inferred from Satellite Observations. Environ Health Perspect. 2016;124: 281–289. pmid:26241114

14. Brook RD, Rajagopalan S, Pope CA, Brook JR, Bhatnagar A, Diez-Roux AV, et al. Particulate Matter Air Pollution and Cardiovascular Disease: An Update to the Scientific Statement From the American Heart Association. Circulation. 2010;121: 2331–2378. pmid:20458016

15. Tétreault L-F, Perron S, Smargiassi A. Cardiovascular health, traffic-related air pollution and noise: are associations mutually confounded? A systematic review. Int J Public Health. 2013;58: 649–666. pmid:23887610

16. Hoek G, Krishnan RM, Beelen R, Peters A, Ostro B, Brunekreef B, et al. Long-term air pollution exposure and cardio- respiratory mortality: a review. Environ Health. 2013;12: 43. pmid:23714370

17. Faustini A, Rapp R, Forastiere F. Nitrogen dioxide and mortality: review and meta-analysis of long-term studies. Eur Respir J. 2014;44: 744–753. pmid:24558178

18. Hamra GB, Laden F, Cohen AJ, Raaschou-Nielsen O, Brauer M, Loomis D. Lung Cancer and Exposure to Nitrogen Dioxide and Traffic: A Systematic Review and Meta-Analysis. Environ Health Perspect. 2015;123: 1107–1112. pmid:25870974

19. Atkinson R, Butland B, Anderson H, Maynard R. Long-term Concentrations of Nitrogen Dioxide and Mortality: A Meta-analysis of Cohort Studies. Epidemiology. 2018;29: 460–472. pmid:29746370

20. Huangfu P, Atkinson R. Long-term exposure to NO2 and O3 and all-cause and respiratory mortality: A systematic review and meta-analysis. Environ Int. 2020;144: 105998. pmid:33032072

21. Stieb D, Lyrette N, Lavigne E, Hocking R, Zheng C, Salama D, et al. Systematic review and meta-analysis of effects of outdoor nitrogen dioxide: short term exposure and cardio-respiratory morbidity and long term exposure and mortality. In: PROSPERO International prospective register of systematic reviews [Internet]. 19 Feb 2018 [cited 16 Aug 2019]. Available: https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=84497

22. McGowan J, Sampson M, Salzwedel DM, Cogo E, Foerster V, Lefebvre C. PRESS Peer Review of Electronic Search Strategies: 2015 Guideline Statement. J Clin Epidemiol. 2016;75: 40–46. pmid:27005575

23. Canada Health. Investigating human exposure to contaminants in the environment: a handbook for exposure calculations. Ottawa: Health Canada; 1995. Available: http://publications.gc.ca/Collection/H49-96-1-1995E-1.pdf

24. Dehbi H-M, Blangiardo M, Gulliver J, Fecht D, de Hoogh K, Al-Kanaani Z, et al. Air pollution and cardiovascular mortality with over 25 years follow-up: A combined analysis of two British cohorts. Environ Int. 2017;99: 275–281. pmid:27939045

25. Dirgawati M, Hinwood A, Nedkoff L, Hankey GJ, Yeap BB, Flicker L, et al. Long-term Exposure to Low Air Pollutant Concentrations and the Relationship with All-Cause Mortality and Stroke in Older Men: Epidemiology. 2019;30: S82–S89. pmid:31181010

26. Sifaki-Pistolla D, Lionis C, Koinis F, Georgoulias V, Tzanakis N. Lung cancer and annual mean exposure to outdoor air pollution in Crete, Greece: Eur J Cancer Prev. 2017;26: S208–S214. pmid:28746162

27. Beelen R, Raaschou-Nielsen O, Stafoggia M, Andersen ZJ, Weinmayr G, Hoffmann B, et al. Effects of long-term exposure to air pollution on natural-cause mortality: an analysis of 22 European cohorts within the multicentre ESCAPE project. The Lancet. 2014;383: 785–795. pmid:24332274

28. Mitchell M, Muftakhidinov B, Winchen T. Engauge Digitizer Software. Available: http://markummitchell.github.io/engauge-digitizer

29. Lam J, Sutton P, Kalkbrenner A, Windham G, Halladay A, Koustas E, et al. A Systematic Review and Meta-Analysis of Multiple Airborne Pollutants and Autism Spectrum Disorder. PLOS ONE. 2016;11: e0161851. pmid:27653281

30. WHO Global Air Quality Guidelines Working Group on Risk of Bias Assessment. Risk of Bias Assessment Instrument for Systematic Reviews Informing WHO Global Air Quality Guidelines. WHO Regional Office for Europe; 2020.

31. Viechtbauer W. Conducting Meta-Analyses in R with the metafor Package. J Stat Softw. 2010;36: 1–48.

32. R Core Team. R: A language and environment for statistical computing. In: R Foundation for Statistical Computing [Internet]. 2019 [cited 28 Oct 2019]. Available: https://www.R-project.org/.

33. Lam J, Sutton P, McPartland J, Davidson L, Daniels N, Sen S, et al. Applying the Navigation Guide Systematic Review Methodology Case Study #5 Association between Developmental Exposures to PBDEs and Human Neurodevelopment: A Systematic Review of the Evidence Protocol April 2015. [cited 18 Aug 2019]. Available: http://www.crd.york.ac.uk/PROSPEROFILES/17890_PROTOCOL_20150322.pdf

34. Lipfert FW, Baty JD, Miller JP, Wyzga RE. PM 2.5 Constituents and Related Air Quality Variables As Predictors of Survival in a Cohort of U.S. Military Veterans. Inhal Toxicol. 2006;18: 645–657. pmid:16864555

35. Lipfert FW, Wyzga RE, Baty JD, Miller JP. Traffic density as a surrogate measure of environmental exposures in studies of air pollution health effects: Long-term mortality in a cohort of US veterans. Atmos Environ. 2006;40: 154–169.

36. Lipfert FW, Wyzga RE. Environmental predictors of survival in a cohort of U.S. military veterans: A multi-level spatio-temporal analysis stratified by race. Environ Res. 2019; 108842. pmid:31818475

37. Lipfert FW, Wyzga RE, Baty JD, Miller JP. Air Pollution and Survival within the Washington University–EPRI Veterans Cohort: Risks Based on Modeled Estimates of Ambient Levels of Hazardous and Criteria Air Pollutants. J Air Waste Manag Assoc. 2009;59: 473–489. pmid:19418821

38. Lipfert FW, Wyzga RE. Revisiting the Veterans Cohort Mortality Study: New results and synthesis. J Air Waste Manag Assoc. 2018;68: 1248–1268. pmid:30024836

39. Tonne C, Wilkinson P. Long-term exposure to air pollution is associated with survival following acute coronary syndrome. Eur Heart J. 2013;34: 1306–1311. pmid:23423735

40. Tonne C, Halonen JI, Beevers SD, Dajnak D, Gulliver J, Kelly FJ, et al. Long-term traffic air and noise pollution in relation to mortality and hospital readmission among myocardial infarction survivors. Int J Hyg Environ Health. 2016;219: 72–78. pmid:26454658

41. Rosenlund M, Picciotto S, Forastiere F, Stafoggia M, Perucci CA. Traffic-Related Air Pollution in Relation to Incidence and Prognosis of Coronary Heart Disease. Epidemiology. 2008;19: 121–128. pmid:18091421

42. Maheswaran R, Pearson T, Smeeton NC, Beevers SD, Campbell MJ, Wolfe CD. Impact of Outdoor Air Pollution on Survival After Stroke: Population-Based Cohort Study. Stroke. 2010;41: 869–877. pmid:20339125

43. Desikan A, Crichton S, Hoang U, Barratt B, Beevers SD, Kelly FJ, et al. Effect of Exhaust- and Nonexhaust-Related Components of Particulate Matter on Long-Term Survival After Stroke. Stroke. 2016;47: 2916–2922. pmid:27811334

44. Eckel SP, Cockburn M, Shu Y-H, Deng H, Lurmann FW, Liu L, et al. Air pollution affects lung cancer survival. Thorax. 2016;71: 891–898. pmid:27491839

45. Stockfelt L, Andersson EM, Molnár P, Rosengren A, Wilhelmsen L, Sallsten G, et al. Long term effects of residential NOx exposure on total and cause-specific mortality and incidence of myocardial infarction in a Swedish cohort. Environ Res. 2015;142: 197–206. pmid:26163761

46. Nafstad P, Håheim LL, Wisløff T, Gram F, Oftedal B, Holme I, et al. Urban air pollution and mortality in a cohort of Norwegian men. Environ Health Perspect. 2004;112: 610–615. pmid:15064169

47. Cao J, Yang C, Li J, Chen R, Chen B, Gu D, et al. Association between long-term exposure to outdoor air pollution and mortality in China: A cohort study. J Hazard Mater. 2011;186: 1594–1600. pmid:21194838

48. Katanoda K, Sobue T, Satoh H, Tajima K, Suzuki T, Nakatsuka H, et al. An Association Between Long-Term Exposure to Ambient Air Pollution and Mortality From Lung Cancer and Respiratory Diseases in Japan. J Epidemiol. 2011;21: 132–143. pmid:21325732

49. Turner MC, Jerrett M, Pope CA, Krewski D, Gapstur SM, Diver WR, et al. Long-Term Ozone Exposure and Mortality in a Large Prospective Study. Am J Respir Crit Care Med. 2016;193: 1134–1142. pmid:26680605

50. Sørensen M, Lühdorf P, Ketzel M, Andersen ZJ, Tjønneland A, Overvad K, et al. Combined effects of road traffic noise and ambient air pollution in relation to risk for stroke? Environ Res. 2014;133: 49–55. pmid:24906068

51. Hvidtfeldt UA, Sørensen M, Geels C, Ketzel M, Khan J, Tjønneland A, et al. Long-term residential exposure to PM2.5, PM10, black carbon, NO2, and ozone and mortality in a Danish cohort. Environ Int. 2019;123: 265–272. pmid:30551059

52. Héritier H, Vienneau D, Foraster M, Eze IC, Schaffner E, de Hoogh K, et al. A systematic analysis of mutual effects of transportation noise and air pollution exposure on myocardial infarction mortality: a nationwide cohort study in Switzerland. Eur Heart J. 2019;40: 598–603. pmid:30357335

53. Klompmaker JO, Hoek G, Bloemsma LD, Marra M, Wijga AH, van den Brink C, et al. Surrounding green, air pollution, traffic noise exposure and non-accidental and cause-specific mortality. Environ Int. 2020;134: 105341. pmid:31783239

54. Nieuwenhuijsen M, Gascon M, Martinez D, Ponjoan A, Blanch J, Garcia-Gil M, et al. Air Pollution, Noise, Blue Space, and Green Space and Premature Mortality in Barcelona: A Mega Cohort. Int J Environ Res Public Health. 2018;15: 2405. pmid:30380717

55. Gan WQ, Koehoorn M, Davies HW, Demers PA, Tamburic L, Brauer M. Long-Term Exposure to Traffic-Related Air Pollution and the Risk of Coronary Heart Disease Hospitalization and Mortality. Environ Health Perspect. 2011;119: 501–507. pmid:21081301

56. Cesaroni G, Porta D, Badaloni C, Stafoggia M, Eeftens M, Meliefste K, et al. Nitrogen dioxide levels estimated from land use regression models several years apart and association with mortality in a large cohort study. Environ Health. 2012;11: 48. pmid:22808928

57. Cesaroni G, Badaloni C, Gariazzo C, Stafoggia M, Sozzi R, Davoli M, et al. Long-Term Exposure to Urban Air Pollution and Mortality in a Cohort of More than a Million Adults in Rome. Environ Health Perspect. 2013;121: 324–331. pmid:23308401

58. Gan WQ, FitzGerald JM, Carlsten C, Sadatsafavi M, Brauer M. Associations of Ambient Air Pollution with Chronic Obstructive Pulmonary Disease Hospitalization and Mortality. Am J Respir Crit Care Med. 2013;187: 721–727. pmid:23392442

59. Crouse DL, Peters PA, Hystad P, Brook JR, van Donkelaar A, Martin RV, et al. Ambient PM2.5, O3, and NO2 exposures and associations with mortality over 16 years of follow-up in the canadian census health and environment cohort (CanCHEC). Environ Health Perspect. 2015;123: 1180–1186. pmid:26528712

60. Raaschou-Nielsen O, Andersen ZJ, Jensen SS, Ketzel M, Sørensen M, Hansen J, et al. Traffic air pollution and mortality from cardiovascular disease and all causes: a Danish cohort study. Environ Health. 2012;11: 60. pmid:22950554

61. Kim H, Kim J, Kim S, Kang S, Kim H, Kim H, et al. Cardiovascular Effects of Long‐Term Exposure to Air Pollution: A Population‐Based Study With 900 845 Person‐Years of Follow‐up. J Am Heart Assoc. 2017;6. pmid:29118034

62. Næss Ø, Nafstad P, Aamodt G, Claussen B, Rosland P. Relation between Concentration of Air Pollution and Cause-Specific Mortality: Four-Year Exposures to Nitrogen Dioxide and Particulate Matter Pollutants in 470 Neighborhoods in Oslo, Norway. Am J Epidemiol. 2007;165: 435–443. pmid:17135427

63. Chen H, Goldberg MS, Burnett RT, Jerrett M, Wheeler AJ, Villeneuve PJ. Long-term exposure to traffic-related air pollution and cardiovascular mortality. Epidemiology. 2013;24: 35–43. pmid:23222554

64. Lim CC, Hayes RB, Ahn J, Shao Y, Silverman DT, Jones RR, et al. Mediterranean Diet and the Association Between Air Pollution and Cardiovascular Disease Mortality Risk. Circulation. 2019;139: 1766–1775. pmid:30700142

65. Lim CC, Hayes RB, Ahn J, Shao Y, Silverman DT, Jones RR, et al. Association between long-term exposure to ambient air pollution and diabetes mortality in the US. Environ Res. 2018;165: 330–336. pmid:29778967

66. Raaschou-Nielsen O, Sørensen M, Ketzel M, Hertel O, Loft S, Tjønneland A, et al. Long-term exposure to traffic-related air pollution and diabetes-associated mortality: a cohort study. Diabetologia. 2012;56: 36–46. pmid:22918192

67. Andersen ZJ, Kristiansen LC, Andersen KK, Olsen TS, Hvidberg M, Jensen SS, et al. Stroke and Long-Term Exposure to Outdoor Air Pollution From Nitrogen Dioxide: A Cohort Study. Stroke. 2012;43: 320–325. pmid:22052517

68. Yang Y, Tang R, Qiu H, Lai P-C, Wong P, Thach T-Q, et al. Long term exposure to air pollution and mortality in an elderly cohort in Hong Kong. Environ Int. 2018;117: 99–106. pmid:29730535

69. Jerrett M, Burnett RT, Beckerman BS, Turner MC, Krewski D, Thurston G, et al. Spatial Analysis of Air Pollution and Mortality in California. Am J Respir Crit Care Med. 2013;188: 593–599. pmid:23805824

70. Setton E, Marshall JD, Brauer M, Lundquist KR, Hystad P, Keller P, et al. The impact of daily mobility on exposure to traffic-related air pollution and health effect estimates. J Expo Sci Environ Epidemiol. 2011;21: 42–48. pmid:20588325

71. Armstrong BG. Effect of measurement error on epidemiological studies of environmental and occupational exposures. Occup Environ Med. 1998;55: 651–656. pmid:9930084

72. Armstrong BG. The effects of measurement errors on relative risk regressions. Am J Epidemiol. 1990;132: 1176–1184. pmid:2260550

73. Richmond-Bryant J, Long TC. Influence of exposure measurement errors on results from epidemiologic studies of different designs. J Expo Sci Environ Epidemiol. 2019. pmid:31477780

74. Kumae T, Arakawa H. Comparison of effects of in vivo nitrogen dioxide exposure starting from different periods on alveolar macrophage activity, assessed by a chemiluminescence technique in Brown-Norway rats. Luminescence. 2006;21: 226–232. pmid:16791821

75. Miller FJ, Graham JA, Raub JA, Ming JW, Ménache MG, House DE, et al. Evaluating the toxicity of urban patterns of oxidant gases. II. Effects in mice from chronic exposure to nitrogen dioxide. J Toxicol Environ Health. 1987;21: 99–112. pmid:3573077

76. Ehrlich R. Interaction between environmental pollutants and respiratory infections. Environ Health Perspect. 1980;35: 89–99. pmid:6997030

77. Dietrich DF, Gemperli A, Gaspoz J-M, Schindler C, Liu L-JS, Gold DR, et al. Differences in Heart Rate Variability Associated with Long-Term Exposure to NO 2. Environ Health Perspect. 2008;116: 1357–1361. pmid:18941578

78. Foraster M, Basagaña X, Aguilera I, Rivera M, Agis D, Bouso L, et al. Association of Long-Term Exposure to Traffic-Related Air Pollution with Blood Pressure and Hypertension in an Adult Population–Based Cohort in Spain (the REGICOR Study). Environ Health Perspect. 2014;122: 404–411. pmid:24531056

79. Rivera M, Basagaña X, Aguilera I, Foraster M, Agis D, de Groot E, et al. Association between Long-Term Exposure to Traffic-Related Air Pollution and Subclinical Atherosclerosis: The REGICOR Study. Environ Health Perspect. 2013;121: 223–230. pmid:23384708

80. Zhang S, Wolf K, Breitner S, Kronenberg F, Stafoggia M, Peters A, et al. Long-term effects of air pollution on ankle-brachial index. Environ Int. 2018;118: 17–25. pmid:29787898

81. Orellano P, Reynoso J, Quaranta N, Bardach A, Ciapponi A. Short-term exposure to particulate matter (PM10 and PM2.5), nitrogen dioxide (NO2), and ozone (O3) and all-cause and cause-specific mortality: Systematic review and meta-analysis. Environ Int. 2020;142: 105876. pmid:32590284

82. Eftim S, Dominici F. Multisite Time-Series Studies Versus Cohort Studies: Methods, Findings, and Policy Implications. J Toxicol Environ Health A. 2005;68: 1191–1205. pmid:16024498

83. Billionnet C, Sherrill D, Annesi-Maesano I. Estimating the Health Effects of Exposure to Multi-Pollutant Mixture. Ann Epidemiol. 2012;22: 126–141. pmid:22226033