Introduction
Nitrogen dioxide () and nitrogen oxides in general are central to atmospheric chemistry in both the troposphere and stratosphere (Finlayson-Pitts and Pitts, 1999; Seinfeld and Pandis, 2016). In the stratosphere, nitrogen oxides are a key player in ozone () depletion chemistry. In the troposphere, photolysis of is responsible for the production of whose buildup is associated with negative human health, ecosystem, and radiative forcing impacts. Emissions of nitrogen oxides are also linked to the production of secondary inorganic aerosol with impacts on both health and global climate. Observations of in the atmosphere are therefore critical given its roles in air quality and atmospheric chemistry.
Satellite remote sensing of from instruments in low Earth orbit (LEO) has offered extraordinary insight into global nitrogen oxide processes. Among many applications, observations from GOME (1996–2003), SCIAMACHY (2002–2011), OMI (2004–), and GOME-2 (2007–) have contributed to understanding global and regional patterns in nitrogen oxide emissions (e.g., Beirle et al., 2003; Duncan et al., 2013; Jaegle et al., 2005; Konovalov et al., 2008; Lamsal et al., 2011; Martin et al., 2003; Miyazaki et al., 2017; Richter et al., 2005; Russell et al., 2012), evaluating ground-level air quality in the absence of traditional monitoring data (e.g., Bechle et al., 2013; Boersma et al., 2009; Geddes et al., 2016; Lamsal et al., 2008; McLinden et al., 2012), and constraining nitrogen oxide deposition out of the atmosphere (e.g., Geddes and Martin, 2017; Jia et al., 2016; Nowlan et al., 2014). A key step in these applications is the separation of stratospheric and tropospheric from the total column derived from the satellite observation, a process that can introduce substantial uncertainty the final tropospheric column estimates (Beirle et al., 2016; Boersma et al., 2004; Bucsela et al., 2013; Martin et al., 2002).
Separating the stratospheric and tropospheric contributions to the total column has been performed using a number of approaches, varying in complexity and in the assumptions that are made. The simplest approach is the Pacific reference sector method (Beirle et al., 2003; Martin et al., 2002; Richter and Burrows, 2002) in which stratospheric is treated as longitudinally homogeneous so that stratospheric in any location can be estimated by using the measured over the remote Pacific at the same latitude. Tropospheric in the reference sector might either be ignored altogether (e.g., Richter and Burrows, 2002) or accounted for using a model estimate (e.g., Martin et al., 2002). While the treatment of zonal invariance is reasonable for low- to mid-latitudes, stratospheric dynamics (especially in the vicinity of polar vortices) raise concerns at higher latitudes of relevance for planned geostationary missions.
Image processing and spatial filtering techniques are an extension of the reference sector method (Bucsela et al., 2006, 2013; Leue et al., 2001; Valks et al., 2011; Velders et al., 2001; Wenig et al., 2004), whereby stratospheric is estimated by interpolating between regions that are classified as having negligible tropospheric . This might be accomplished for example by using only cloudy scenes over the oceans (e.g., Leue et al., 2001), or by applying a pollution “mask” given prior estimates of tropospheric (e.g., Bucsela et al., 2006; Valks et al., 2011). Bucsela et al. (2013) proposed a masking scheme that combines a prior estimate of tropospheric with radiative transfer calculations to allow polluted pixels to remain if the scene is cloudy (obscuring lower tropospheric ), and exclude unpolluted regions where tropospheric signal may still be significant due to high tropospheric air mass factors. An elegant variation of this spatial filtering approach is the STRatospheric Estimation Algorithm from Mainz (STREAM), developed by Beirle et al. (2016). Instead of binary masks based on arbitrary thresholds, STREAM applies a weighted convolution scheme where cloudy observations are given a high weight and polluted observations (based on a prior estimate) are given low weight. These spatial filtering approaches developed exclusively for global observational coverage from LEO offer valuable guidance on the development of geostationary stratosphere–troposphere separation algorithms.
Nadir observations are also used in assimilation approaches where model predictions of the stratospheric column density are adjusted towards the observed column density. For example, stratosphere–troposphere separation in the Dutch algorithm is achieved by assimilating observed columns with model column predictions from the TM4 chemical transport model forced by European Centre for Medium-Range Weather Forecasts (ECMWF) meteorological data (Boersma et al., 2007; Dirksen et al., 2011). In that approach, modeled profiles are convolved into line-of-sight (“slant”) columns using averaging kernels, and the difference between modeled and observed slant column densities are used to force the modeled columns to an “analyzed” state. Using the most recent observations available, the “analyzed” state can be used in a forecast model run to predict the stratospheric field for near-real time retrievals (Boersma et al., 2007).
In some cases, independent stratospheric observations may be used in the separation of stratospheric and tropospheric . For example, the SCIAMACHY instrument made almost coincident nadir and limb measurements (Bovensmann et al., 1999) and this matching was exploited in algorithms by Beirle et al. (2010) and Hilboll et al. (2013). Even non-coincident limb–nadir matching has been exploited for stratosphere–troposphere separation, as in the case of OSIRIS and OMI (Adams et al., 2016). Sussmann et al. (2005) demonstrate how simultaneous ground-based measurements (especially at mountain sites) could be applied for stratosphere–troposphere separation algorithm validation.
To date, all of the above approaches to stratosphere–troposphere separation have been developed using the large coverage of observations provided by instruments in LEO. Questions remain about how well the separation can be performed without the global context and where clean tropospheric background signals are limited. Stratosphere–troposphere separation algorithms need to be evaluated and refined for the restricted field of regard of future geostationary instruments such as TEMPO (Zoogman et al., 2017), Sentinel-4 (Courrege-Lacoste et al., 2017), and GEMS (Lasnik et al., 2014).
TEMPO (“Tropospheric Emissions: Monitoring of Pollution”), launching between 2019–2021, will provide space-based measurements in geostationary orbit with a field of regard over North America from southern Canada to Mexico City and the Bahamas (Zoogman et al., 2017). The spectrometer has spectral ranges of 290–490 (at 0.57 resolution) and 540–740 (at 0.2 resolution), allowing retrieval of tropospheric composition with fine spatial resolution (up to 2.1 north– east–west instantaneous field of view). Scanning occurs from east to west, with hourly revisits. Among its standard products available at roughly spatial resolution will be hourly column abundance. Here, we develop a standard stratosphere–troposphere separation algorithm for the observations of from TEMPO, and examine in detail the potential information penalty associated with the limited TEMPO field of regard compared to an identical global algorithm.
Satellite observations
To develop and test our algorithm, we use data from two LEO instruments, with afternoon and morning overpasses. We use column densities derived from OMI on board the Aura satellite launched in 2004. OMI is a nadir-viewing spectrometer in LEO crossing the equator around 13:30 local time, with a variable horizontal resolution of at nadir. Line-of-slight (“slant”) columns are retrieved from spectral fitting of back-scattered and reflected solar radiation within the 405–465 wavelength range, and corrected for instrumental artifacts (Bucsela et al., 2013). We use the Version 3.0 Standard Product retrieval (SPv3) from NASA (Krotkov et al., 2017, publicly available at
We also make use of column densities derived from GOME-2, on board the MetOp-A satellite launched in 2006. GOME-2 is another nadir-viewing spectrometer in LEO, crossing the equator around 09:30 local time with a constant horizontal resolution of in its default swath. Spectral fitting is performed within the 420–450 wavelength range. Here we use the TM4NO2A retrieval (Boersma et al., 2004) version 2.3 data product from KNMI (available from
We restrict all data to solar zenith angles smaller than 80 to avoid exceedingly long path lengths.
Estimating stratospheric over the TEMPO field of regard
Here we describe our approach to estimate the stratospheric column in TEMPO observations. As a foundation for our method, we begin with the approach used in the current operational algorithm for OMI (Bucsela et al., 2013). This algorithm has demonstrated high quality performance against validation data sets (Ialongo et al., 2016; Lamsal et al., 2014; Bucsela et al., 2013), is computationally fast, and is suitable for near-real-time retrievals. Our own implementation of this algorithm reproduces the operational global stratospheric product well ( and a slope of 1.01). As described below, we build on this algorithm for TEMPO by modifying certain smoothing and filtering steps, using a satellite-derived prior estimate of tropospheric , incorporating observations surrounding the TEMPO field of regard from independent LEO instruments, and by considering partial fields of regard relevant to TEMPO.
Calculation of the stratospheric estimate on 15 July 2007, using OMI observations from within the anticipated TEMPO field of regard: (a) slant columns on a grid. (b) Initial stratospheric estimate () resulting from Eqs. (1) and (2). (c) Masked using a threshold of to remove large tropospheric influence. (d) Adding context outside of the TEMPO field of regard by using independent low-Earth-orbit observations from GOME-2 that have been corrected for time of day. (e) Stratospheric estimate with masked areas interpolated. (f) Stratospheric estimate after final hot spot removal and smoothing.
[Figure omitted. See PDF]
Figure 1 shows the stepwise implementation of our TEMPO stratosphere–troposphere separation algorithm for an example day in July. As a surrogate for TEMPO observations, we begin by restricting the OMI total slant column observations to the anticipated TEMPO field of regard below a solar zenith angle threshold of 80 (Fig. 1a). The expected coverage of TEMPO extends from as far south as Mexico City, northward to include southern Canada (covering as far north as the oil sands region in Alberta for example). The pattern along the orbit tracks in Fig. 1a results from the changing OMI viewing zenith angle (with higher slant columns for larger viewing angles). Although we begin our implementation with the OMI observations gridded to , the TEMPO algorithm would be performed on the individual TEMPO pixels. In other words, here we are treating our gridded OMI observations as TEMPO pixels.
An initial estimate of the stratospheric vertical column () can be obtained by where is the total slant column density, is the stratospheric air mass factor, and accounts for small contributions from the troposphere (Bucsela et al., 2013). Bucsela et al. (2013) estimated the tropospheric contribution using model values. To provide a more accurate constraint on tropospheric contributions, we use the monthly mean tropospheric columns derived from independent GOME-2 observations as an initial a priori tropospheric estimate. The GOME-2 observations were filtered using recommended quality flags and retaining pixels with cloud radiance fraction less than 0.5, then gridded to the same resolution as our OMI grid. This concept enables the use of spatial information observed from satellite, and could be readily adapted to use TROPOMI observations at finer resolution. Ideally, an independent LEO tropospheric estimate for as close to the TEMPO observation time would be used. Nonetheless, diurnal variability in tropospheric columns outside of source regions tends to be small (Boersma et al., 2008), and in our case source regions are masked out in a later step. The use of a satellite-derived a priori reduces the use of chemical transport model information in the stratosphere–troposphere separation algorithm (although we revert to a model estimate if quality controlled satellite coverage is not available, e.g., due to systematically high cloud fractions). We transform this satellite-derived a priori tropospheric vertical column () into slant column space using the tropospheric air mass factors () provided with the OMI data: Figure 1b shows our initial estimate of stratospheric vertical columns over the TEMPO domain resulting from the combination of Eqs. (1) and (2). We already see that this stratospheric estimate varies predominately as a function of latitude, although anomalously low values are seen over some urban centers (e.g., around Los Angeles, Chicago, and New York) where the a priori tropospheric slant column is large.
To exclude locations where this initial stratospheric vertical column estimate is likely biased, we make use of the masking approach from Bucsela et al. (2013). This is based on eliminating pixels where tropospheric contamination is high (or where the initial stratospheric vertical column estimate would exceed the actual stratospheric vertical column by some reasonable value) by requiring: On a typical day in July, this means that contamination from the troposphere would be less than % percent of the stratospheric estimate (which generally ranges from 2– over the TEMPO field of regard). Figure 1c shows the result of this masking step. The threshold removes all the urban regions with anomalously low values in Fig. 1b, in addition to many other areas. Sensitivity tests show that the final stratospheric estimate varies by less than 5 % for changes in this threshold between or , consistent with the generally small sensitivity found by Bucsela et al. (2013). On this example day (and for the month of July on average) the masking threshold of removes 55 % of the original data within the TEMPO field of regard. We find coverage is best over Canada and over the Pacific Ocean, with less coverage over the rest of the continent and the Atlantic Ocean. The original global algorithm removes % of the available global data on average for days in July, since tropospheric columns are generally lower elsewhere in the world.
Since is calculated based on radiative transfer calculations () in addition to the a priori tropospheric vertical column (Eq. 2), this masking approach in principle allows for polluted pixels to remain if the lower tropospheric signal is sufficiently suppressed by clouds resulting in a low tropospheric air mass factor (or conversely excludes pixels with a considerable tropospheric signal due to high surface reflectivity). We investigated the use of explicitly cloudy scenes (cloud radiance fraction ), which could suppress the signal from below. Mid-level clouds (600–400 ) are the least likely to contain significant mixed in from the surface, or lightning associated with higher clouds. We find that most ( %) of the pixels that meet these criteria are already retained by our original masking algorithm. Incorporating the remaining cloudy pixels to the masked data increases data coverage by less than 1 %. Given the uncertainties in retrieving cloud properties, uncertainties in cloudy air mass factors, and the minimal added value of this dataset, we disregard adding the remaining cloudy pixels to our algorithm.
In Bucsela et al. (2013), the remaining unmasked data are binned and un-filled bins are interpolated using 2-dimensional averaging with a latitude moving window. In our case, this step necessarily precludes information from outside the TEMPO field of regard over the mostly pristine oceans from being used in the 2-D averaging. As we will show, this leads to biases near the field of regard edges when compared to a global algorithm, since the averaging window is disproportionately impacted by observations with continental influence. We reduce this bias by incorporating independent global observations from LEO that can provide context outside of the TEMPO field of regard. This approach exploits the independent LEO observations that are expected throughout the lifespan of TEMPO (e.g., GOME-2, TROPOMI).
Here, we employ GOME-2 observations as an independent dataset to estimate stratospheric at GOME-2 overpass time outside the TEMPO field of regard by using an identical algorithm on this global data. We empirically transform the GOME-2 stratospheric estimate to the TEMPO observation time (here, the OMI overpass time), using the climatological 30-day running mean local ratio of GOME-2 to OMI stratospheric . A similar observational or model climatology could readily be constructed with TEMPO data after launch based on the available LEO observations at the time. Figure 1d shows the outcome of this approach. The GOME-2 observations outside of the TEMPO field of regard retain the same magnitude and latitudinal gradient as the available observations within the TEMPO field of regard, suggesting that the additional context from an independent LEO instrument can be useful even when they are from a different time of day.
Before interpolating the unfilled bins, we apply a boxcar filter using a moving window as follows. First, our boxcar filter returns a smoothed array using the following algorithm: where where is the smoothing width (in our case, defined in two dimensions by both a length and width), is the th point in the smoothed data, and is the th point in the original data. For data points where the neighborhood includes points outside the array, the nearest edge points are used to compute the smoothed result. The variance of the original data is also calculated using a similar algorithm. Any value that lies outside of the moving window average by standard deviations is removed. While the Bucsela et al. (2013) algorithm uses the same window size in a boxcar filtering step, it is performed later and only remove values above the mean (“hotspots”). Here, we perform this boxcar filter in both directions (above and below the mean) to remove anomalously low values that might result from a biased a priori tropospheric estimate that was not accounted for in the masking step (avoiding negative stratospheric values being retained in subsequent steps), and to remove anomalously high values that might result from transient pollution events that were likewise missed in the masking step. We perform this boxcar filter twice to strictly remove outliers from regions with noisy data.
Missing bins are then interpolated using a latitude moving window. We tested smaller window sizes and found that they could introduce unphysical variability, and/or leave missing data. Figure 1e shows how all the missing data over the TEMPO domain are successfully filled using this window size. A few remaining “hot spots” are accounted for in a third pass of the boxcar filter.
Calculation of the stratospheric estimate on 15 January 2007, using OMI observations from within the anticipated TEMPO field of regard: (a) slant columns on a grid. (b) Initial stratospheric estimate () resulting from Eqs. (1) and (2). (c) Masked using a threshold of to remove large tropospheric influence. (d) Adding context outside of the TEMPO field of regard by using independent low-Earth-orbit observations from GOME-2 that have been corrected for time of day. (e) Stratospheric estimate with masked areas interpolated. (f) Stratospheric estimate after final hot spot removal and smoothing.
[Figure omitted. See PDF]
To obtain our final stratospheric column estimate, we apply a final simple smoothing step with a window, as in Bucsela et al. (2013). The smaller box-car window size in this step recognizes, and allows for, some regional scale variability in the stratosphere. Figure 1f shows the final stratospheric column estimate over the TEMPO field of regard. Variation is primarily a function of latitude, from around at the lowest latitudes in the field of regard ( latitude) to around at the highest latitudes ( latitude). It is also apparent that this spatial filtering algorithm allows for important regional scale variability to be retained in the stratospheric estimate.
In an effort to evaluate our new TEMPO algorithm with an independent estimate, we compare our stratospheric vertical column with the stratospheric vertical column included in the OMI SPv3 retrieval. Despite using different prior tropospheric estimates, incorporating observations from GOME-2 outside the field of regard during interpolation, and employing different box-car filtering steps, our algorithm is highly consistent with the results from the global NASA standard OMI product over the TEMPO field of regard (, ). Overall, we calculate a mean bias in our new TEMPO algorithm compared to the NASA standard product of only (a normalized mean bias of %).
Figure 2 shows the results of the same algorithm from an example day in January. The shape of the expected TEMPO domain is impacted by large solar zenith angles at the highest latitudes (we again use a solar zenith angle cut-off of 80). Tropospheric enhancements feature more prominently in the total slant column (Fig. 2a) than in July since stratospheric columns are lower in the winter, and tropospheric columns are higher. Figure 2b shows the initial stratospheric estimate ( from Eq. (1), again using the monthly mean GOME-2 tropospheric column as an a priori estimate (Eq. 2). Figure 2c shows the result of applying the masking threshold (Eq. 3). We find this threshold removes 51 % of the available data on average for this month ( % of the available data are removed in the global algorithm in January). Over the TEMPO domain we find that a slightly smaller fraction pixels are removed in January compared to July because, despite having generally higher tropospheric column densities, tropospheric air mass factors across the northeast are extremely low at this time of year (discussed below). The low values are primarily due to increased wintertime cloudiness. In this case, the masking threshold did not remove a strong enhancement over the center of the continent. This highlights some criticism by Beirle et al. (2016) of spatial filtering algorithms that rely strongly on a priori climatologies wherein transient tropospheric events could be misinterpreted as stratospheric. We find that varying the magnitude of the threshold (Eq. 3) does not successfully correct for this, since our masking approach is based on a monthly mean and does not identify transient events, but this feature is diminished in subsequent steps. Figure 2d shows the estimated stratospheric outside of the TEMPO field of regard from the independent GOME-2 observations. Again, these LEO observations provide powerful context despite being from a different time of day. Figure 2e shows the result of the first two passes of the boxcar filter, and interpolating unfilled bins using the latitude moving window.
Calculation of the stratospheric estimate on 15 July 2007, using OMI observations from within the anticipated TEMPO field of regard at 11:30 UTC (06:30 Eastern Standard Time): (a) slant columns on a grid. (b) Initial stratospheric estimate () resulting from Eqs. (1) and (2). (c) Masked using a threshold of to remove large tropospheric influence. (d) Adding context outside of the TEMPO field of regard by using independent low-Earth-orbit observations from GOME-2 that have been corrected for time of day. (e) Stratospheric estimate with masked areas interpolated and smoothed. (f) Stratospheric estimate after final hot spot removal smoothing.
[Figure omitted. See PDF]
Figure 2f shows the final stratospheric estimate after the final pass of the statistical test and smoothing. The large enhancement of over the continent has been substantially dampened by our statistical filtering. The variability in the stratospheric column is again generally latitudinal as expected, with values above at the low latitudes, and below at the high latitudes.
The full TEMPO domain will have simultaneous sunlit coverage from about 14:00 to 23:00 UTC in July, and for only a few hours in January, based on a solar zenith angle threshold of . Of concern is the lack of coverage over the west coast in the morning, and over the east coast in the evening, where sunlit observations will not be available. Under these circumstances, the stratospheric separation algorithm is challenged by even narrower spatial domains. We evaluate these cases by repeating the calculations at specific times of day.
Figure 3 shows how the TEMPO algorithm would operate for 11:30 Coordinated Universal Time (UTC), 06:30 Eastern Standard Time (EST), on the example day in July. Daylight observations over eastern North America are available by this time, without coverage over the rest of the continent. All the algorithm steps are identical to those in Figs. 1 and 2 other than treatment of this partial coverage (additional near-real-time considerations are discussed in Sect. 5). Figure 3a shows the OMI total slant columns. By 06:30 EST TEMPO observes only eastern North America. The availability of observations increases in width northward because of the TEMPO viewing geometry. Figure 3b and c show the initial stratospheric estimate (according to Eq. 1) and the masked stratospheric estimate (according to Eq. 3) respectively. Figure 3d shows the independent LEO observations from GOME-2 outside of the TEMPO field of regard. The observations are binned, pass the statistical filtering steps, and interpolated in Fig. 3e. The final stratospheric estimate is shown in Fig. 3f. Comparing this final stratospheric estimate with the estimate in Fig. 1f (where coverage over the whole continent is assumed to be available), we see the reduced coverage has negligible impact the final stratospheric estimate, and identical spatial features are preserved ().
Calculation of the stratospheric estimate on 15 January 2007, using OMI observations from within the anticipated TEMPO field of regard at 23:30 UTC (15:30 Pacific Standard Time): (a) slant columns at resolution. (b) Initial stratospheric estimate () resulting from Eq. (2). (c) Masked using a threshold of to remove large tropospheric influence. (d) Adding context outside of the available TEMPO field of regard by using independent low-Earth-orbit observations from GOME-2 that have been corrected for time of day. (e) Stratospheric estimate with masked areas interpolated and smoothed. (f) Final stratospheric estimate after hot spot removal and smoothing.
[Figure omitted. See PDF]
Likewise, Fig. 4 shows how the algorithm would operate on the example day in January at 23:30 UTC, or 15:30 Pacific Standard Time (PST). In addition to the loss of observations in the east due to the time of day, larger solar zenith angles in the north at this time of year further diminish coverage. Again, the subsequent steps are otherwise identical to those in Figs. 1 through 3. Figure 4a shows the OMI total slant columns. Observations are available over parts of the Pacific Northwest, with coverage widening southward so that observations are available from California to the western edge of Texas, and over western parts of Mexico. Figure 4b and c show the initial stratospheric estimate (according to Eq. 1) and the masked stratospheric estimate (according to Eq. 3) respectively. Figure 4d shows how the independent LEO observations from again GOME-2 provide coverage outside of the TEMPO field of regard. After binning and interpolation (Fig. 4e) followed by hot spot removal and smoothing, the final TEMPO stratospheric estimate is shown in Fig. 4f. Comparing this stratospheric estimate with Fig. 2f (where coverage over the whole continent is assumed to be available) demonstrates again how the reduced coverage has negligible impact the final stratospheric estimate, and identical spatial features are preserved ().
Next, we examine in detail the potential information penalty associated with the limited TEMPO field of regard compared to a global implementation of our algorithm, and demonstrate quantitatively that our approach can produce a tropospheric estimate that is consistent with a global algorithm, regardless of the time of day.
Stratosphere–troposphere separation over the TEMPO field of regard
The final step in the algorithm is the subtraction of the stratospheric estimate from the total slant column to obtain the tropospheric column by For this calculation we use the stratospheric and tropospheric air mass factors provided with the OMI data product (the operational TEMPO algorithm would use TEMPO air mass factors).
Stratospheric (a) and tropospheric (b) air mass factors for 15 January 2007.
[Figure omitted. See PDF]
The difference between two tropospheric column retrievals ( and ) that result from two different stratospheric estimates ( and ), but identical slant columns and air mass factors, is directly proportional to the ratio of the tropospheric to stratospheric air mass factors: This means that differences (or errors) in stratospheric estimates are magnified in the tropospheric column depending on the local air mass factors. This issue is particularly important over the eastern US in the winter, where tropospheric air mass factors can be very low (), and stratospheric air mass factors can be high () depending on viewing geometry. Figure 5 shows the stratospheric and tropospheric air mass factors for 15 January 2007. Over areas of the eastern US, where clouds prevail, the tropospheric air mass factors are exceedingly small (), which gives rise to extremely large ratios (). In other words, residuals between two stratospheric algorithms can become magnified by more than two orders of magnitude in the troposphere.
Stratospheric (a, c, e) and final tropospheric retrievals (b, d, f) resulting from our stratosphere–troposphere separation algorithms for 15 July 2007. Panels (a, b) show the results using our proposed TEMPO algorithm. Panels (c, d) show the results using global observations (results have been clipped to the TEMPO field of regard for comparison). Panels (e, f) show the absolute differences between the TEMPO and global algorithm results.
[Figure omitted. See PDF]
The impact of errors in the tropospheric column due to this issue can be minimized by excluding observations with high stratospheric to tropospheric air mass factor ratios. This is also based on the logic that such values indicate tropospheric is making a small contribution to the measured signal (and as a result, the tropospheric retrieval should have high uncertainty). For this reason, we restrict all tropospheric estimates to where the local stratospheric to tropospheric air mass factor ratios are less than 5.
Figure 6 shows the stratospheric and tropospheric columns estimated for 15 July 2007. Panels (a, b) display the stratospheric and tropospheric columns as derived from our TEMPO algorithm that employs the OMI data as a surrogate for TEMPO observations, with adjacent GOME-2 data provided context outside the field of regard. Panels (c, d) display the stratospheric and tropospheric columns derived from implementing our algorithm globally with OMI data alone (the results are restricted to the TEMPO field of regard in the figure to facilitate comparison). Panels (e, f) shows the differences between our TEMPO algorithm and the global algorithm. We find excellent spatial agreement in the tropospheric estimate between the two algorithms (, ). More than 95 % of the pixels have differences that are smaller than .
We further evaluate the performance of our algorithm by comparing the tropospheric column distribution along the western-most edge (1 deep) of the TEMPO field of regard with the tropospheric tropospheric column distribution included in the independent NASA SPv3 retrieval. In this relatively remote region of the field of regard, we find a similar mean and standard deviation in column density ( in our TEMPO algorithm and in the NASA SPv3). The fraction of negative columns that are observed in our algorithm is consistent with the fraction of negative columns that occurs at the same location from the standard product ( %).
Stratospheric (a, c, e) and final tropospheric retrievals (b, d, f) resulting from our algorithms for 15 January 2007. Panels (a, b) show the results using our proposed TEMPO algorithm. Panels (c, d) show the results using global observations (results have been clipped to the TEMPO field of regard for comparison). Panels (e, f) show the absolute differences between the TEMPO and global algorithm results.
[Figure omitted. See PDF]
Panels (a, b) show mean July and January tropospheric column densities resulting from our TEMPO algorithm. Panels (c, d) show absolute difference in mean July and January tropospheric between the TEMPO algorithm and the global algorithm.
[Figure omitted. See PDF]
Figure 7 compares the stratospheric and tropospheric column estimates from the TEMPO and global algorithms for 15 January 2007. The loss of coverage in the troposphere (mostly over the eastern US) is a result of the air mass factor issue discussed above, leading to tropospheric retrievals with low information content. The spatial agreement in the tropospheric estimates that remain is excellent across the domain ( ). The magnitude of the differences in the stratospheric columns become larger in the troposphere, exceeding near the edges. Nonetheless, % of the pixels are consistent with the global version of the algorithm to within .
Figure 8 shows the monthly mean tropospheric columns resulting from our TEMPO stratosphere–troposphere separation algorithm for both July and January, and the difference vs. results from the global algorithm. We find that our TEMPO algorithm produces monthly mean results with negligible difference compared to the global algorithm, even at the field of regard edges. The correlation between the two algorithms is excellent ( and for July, and for January). For July, more than 99 % of the pixels have differences that are smaller than . For January, more than 90 % of the pixels have differences that are smaller than , and more than 99 % of the pixels have differences that are smaller than . In other words, our TEMPO-specific algorithm performs almost identically to the LEO algorithm that uses all available global data. There are some random errors near the field of regard edges on individual days (Figs. 6 and 7), but these nearly disappear in the monthly average (Fig. 8).
Panels (a, b) show mean July tropospheric column densities at 11:30 UTC (a, c) and 02:00 UTC (b, d) resulting from our TEMPO STS algorithm. Panels (c, d) show absolute difference in the tropospheric column between the TEMPO algorithm and the global STS algorithm.
[Figure omitted. See PDF]
Panels (a, b) show mean January tropospheric column densities at 14:00 UTC (a, c) and 23:30 UTC (b, d) resulting from our TEMPO STS algorithm. (c, d) show absolute difference in the tropospheric column between the TEMPO algorithm and the global STS algorithm.
[Figure omitted. See PDF]
Figure 9 shows the July monthly mean tropospheric columns resulting from retrievals at 11:30 UTC (east coast summer morning) and at 02:00 UTC (west coast summer evening). The east coast morning retrieval example exhibits small positive biases over some the Great Lakes region compared to the global algorithm, but overall the spatial agreement remains excellent ( and ). More than 90 % of the pixels have differences that are smaller than , and more than 98 % of the pixels have differences that are smaller than . The west coast summer evening example also exhibits excellent performance overall ( and ). In this case, more than 98 % of the pixels have differences that are smaller than .
Figure 10 shows the January monthly mean tropospheric columns resulting from retrievals at 14:00 UTC (east coast winter morning) and 23:30 UTC (west coast winter evening). The bottom panels in Fig. 10 show the difference between the results from our TEMPO algorithm and the results from the global algorithm. In the east coast winter case, spatial agreement is still very good in general (), but we find noticeable degradation in the absolute performance over the continent compared to the global algorithm resulting from this partial field of view (). The west coast winter evening retrieval performs better overall (, ). Although the algorithm performs poorest in the east coast winter morning case, % of the tropospheric pixels still have differences that are less than , a commonly accepted estimate of the stratospheric uncertainty resulting from stratosphere–troposphere separation in retrieval algorithms (Boersma et al., 2004). Moreover, 2 h later at 16:00 UTC when the field of regard has expanded across the Great Lakes region, into the middle of North America, and covers most of Mexico, this issue disappears (, ). In other words, as spatial coverage expands, the absolute constraint on stratospheric becomes more robust.
This highlights the challenge of accurate wintertime tropospheric retrievals (especially over eastern North America) when pollution is primarily in a shallow boundary layer close to the surface where satellite remote sensing sensitivity is lowest. The partial TEMPO field of regard in this case exacerbates the problem, but the challenge is not unique to TEMPO retrievals.
Finally, we further test the performance of this algorithm at other times of day by repeating the same steps as above, but using GOME-2 observations as a surrogate for TEMPO. For this, we swap all instances of the OMI observations (overpass time :30) with GOME-2 observations (overpass time :30), and vice versa. In other words, the GOME-2 observations are restricted to the anticipated field of regard, and we use a monthly from OMI as our a priori tropospheric column and the daily observations from OMI as supporting global observations outside the TEMPO field of regard. We find the performance at this morning overpass time is as good as the mid-afternoon overpass time (, for July; and , for January), providing more evidence that our approach works equally well at different times of day.
Panels (a, b) show mean July and January tropospheric column densities resulting from our TEMPO STS algorithm without using independent low-Earth-orbit observations for context outside the TEMPO field of regard (as might be occasionally expected in near-real-time operations). Panels (c, d) show absolute difference in mean July and January tropospheric between the TEMPO algorithm and the global STS algorithm.
[Figure omitted. See PDF]
Near-real-time considerations
For retrievals in near-real time (i.e., within an hour of the observation), independent global observations in LEO may not be available (e.g., unexpected issues with LEO observation processing). Here we test the performance of the TEMPO algorithm without the supporting global observations by carrying out the identical steps outlined in Sects. 3 and 4 except without incorporating the GOME-2 observations outside the TEMPO field of regard. Comparing these results with the global algorithm isolates the penalty due to the limited TEMPO spatial domain alone, since the steps are otherwise computationally identical.
Figure 11 shows the mean July and January tropospheric columns resulting from this near-real time test. The spatial correlation with the global algorithm is still strong overall ( and for July and and for January), and between 90 %–95 % of pixels in both July and January differ from the global algorithm by less than . We find that, compared to a global algorithm, this stratosphere–troposphere separation approach gives rise to noticeable systematic biases near the field of regard edges (including Mexico, the Caribbean, and northern Canada). The differences are due to the lack of supporting data outside of the TEMPO field of regard.
This is most evidently a problem near the northern and southern borders of the field of regard, given the strong gradient in stratospheric as a function of latitude. At low latitudes, when the averaging windows intersect with the field of regard, the global algorithm would have lower mean values by including observations to the south. This causes the stratospheric column from the TEMPO algorithm to be systematically biased high compared to the global algorithm, translating into an underestimate in the tropospheric column (by more than in some locations). By the same logic, there is a high bias (also more than on average) along the northern edge of the field of regard in July. There are also small low biases in the tropospheric column throughout the eastern side of the TEMPO field of regard over the Atlantic Ocean. By excluding more pristine ocean conditions further to the east, the stratospheric column derived by the TEMPO algorithm is biased high compared to the global algorithm, which again translates into an underestimate in the tropospheric column.
In the absence of daily ancillary satellite data for estimating stratospheric outside the field of regard, a climatology built from satellite observations or model data could mitigate these edge effects for near real time retrievals since the average latitudinal and seasonal dependence of stratospheric are generally well known. For example, tests conducted using a monthly mean global stratospheric estimate as the supporting data outside the TEMPO field of regard improves the correlations in both cases ( and for July and and for January), now with % of the monthly mean pixels differing from the global algorithm results by less than .
Panels (a, b) show mean July tropospheric column densities at 11:30 UTC (a, c) and 02:00 UTC (b, d) resulting from our TEMPO STS algorithm without using independent low-Earth-orbit observations for context outside the TEMPO field of regard. Panels (c, d) show absolute difference in the tropospheric column between the TEMPO algorithm and the global STS algorithm.
[Figure omitted. See PDF]
Panels (a, b) show mean January tropospheric column densities at 14:00 UTC (a, c) and 23:30 UTC (b, d) resulting from our TEMPO STS algorithm without using independent low-Earth-orbit observations for context outside the TEMPO field of regard. (c, d) show absolute difference in the tropospheric column between the TEMPO algorithm and the global algorithm.
[Figure omitted. See PDF]
Similarly, we find weaker overall performance in the cases of partial fields of regard without context from surrounding LEO observations. Figure 12 shows the July mean tropospheric column retrievals calculated for 11:30 UTC (east coast summer morning) and the July mean tropospheric column retrievals for 02:00 UTC (west coast summer evening). Though this version of the algorithm performs less well compared to the results from incorporating independent LEO observations, the spatial correlation is still good (, for 11:30 UTC July; , for 02:00 UTC). The differences over most of the available domain remain small, with 90 %–95 % of the pixels having differences in the mean tropospheric column of less than compared to the global algorithm. Figure 13 shows the January mean tropospheric column retrievals calculated for 14:00 UTC (east coast winter morning) and the January mean tropospheric column retrievals for 23:00 UTC (west coast winter evening). The spatial correlation in both cases remains strong, again with some systematic biases observed (, at 14:00 UTC and , at 23:30 UTC). The biases remain modest, with % of the pixels being consistent to within of the global implementation of the algorithm. Again, using a monthly climatology mitigates the biases in all cases, with the smallest improvement for the retrieval in January at 14:00 UTC (going from 90 % to 94 % of the pixels being consistent to within of the global implementation of the algorithm).
Given these results, our recommendation for TEMPO is to use a climatological estimate (e.g., a 30-day mean) of stratospheric for context outside of the TEMPO field of regard during near-real-time retrieval if LEO observations are unavailable. This climatological estimate can be constructed based on satellite-derived observations in LEO from the preceding year and corrected for the time of day based on model results or other independent observations. We would then propose a subsequent reprocessing of the data that incorporates the daily LEO observations when available from the correct observation day.
Conclusions
The TEMPO geostationary satellite instrument is expected to provide hourly observations of columns (among a variety of other measurements) over North America. Here, we have developed and tested the first stratosphere–troposphere separation algorithm for TEMPO geostationary satellite observations of atmospheric column density. We use independent measurements from a low-Earth-observing satellite instrument to identify likely locations of tropospheric enhancements, and to provide context outside of the available TEMPO measurements. We consider partial fields of regard as a function of time of day, and implement a new filter based on stratospheric to tropospheric air mass factor ratios. We investigate in particular the information penalty associated with the limited TEMPO fields of regard as a function of season and time of day.
We find that our algorithm performs as well as a global LEO algorithm for most scenarios. When the whole continent is observed, monthly mean agreement with tropospheric retrieved from the global algorithm is excellent (, for July and , January). During most instances with a partial field of regard (e.g., east coast morning or west coast evening) the algorithm still performs robustly. We demonstrate that small biases near the southern and northern edges of the field of regard are avoided by incorporating independent LEO observations that have been corrected for the time of day. When the whole continent is observed, the vast majority of pixels ( %) agree with results from a global implementation of the same algorithm to within . We find that the TEMPO algorithm is challenged most by winter east coast morning retrievals, but nonetheless the difference between the TEMPO algorithm and the global implementation of the same algorithm produces differences that are less than for more than 90 % of the pixels. Even when supporting observations from LEO may not be available (as in near-real-time), a large majority of pixels ( % or greater) agree with the global algorithm to within on a monthly mean basis, which is generally accepted as typical estimates of stratospheric error due to stratosphere–troposphere separation algorithms. The differences can be reduced further in near-real-time retrievals by the use of a climatology outside the TEMPO field of regard. The value of independent LEO observations for TEMPO tropospheric retrievals implies benefit to TEMPO data from ongoing development of LEO observations.
We have demonstrated a feasible and robust stratosphere–troposphere separation algorithm for the retrieval of geostationary satellite-based tropospheric column densities by the TEMPO instrument notwithstanding the limited field of regard or changing time of day. Our TEMPO algorithm also demonstrates good performance when evaluated against the stratospheric columns provided with the NASA SPv3 standard product, but further independent evaluation using ground-based spectrometer network observations will be beneficial. This approach may be applicable to other planned geostationary satellite instruments including Sentinel-4 over Europe and GEMS over Asia. This spatial filtering and interpolation method may also have applications in offset removal during retrievals of HCHO and tropospheric columns.
Data from this study, and the algorithm developed for TEMPO, are available upon request by contacting the first author: [email protected].
The authors declare that they have no conflict of interest.
Acknowledgements
The authors are grateful to Kelly Chance, Xiong Liu, John Houck, Peter Zoogman,
and other members of the TEMPO trace gas retrieval team for their input
in preparation of this paper. Work at Dalhousie University was
supported by Environment and Climate Change Canada. The authors also
gratefully acknowledge the free use of TEMIS data from the GOME-2
sensor provided by
You have requested "on-the-fly" machine translation of selected content from our databases. This functionality is provided solely for your convenience and is in no way intended to replace human translation. Show full disclaimer
Neither ProQuest nor its licensors make any representations or warranties with respect to the translations. The translations are automatically generated "AS IS" and "AS AVAILABLE" and are not retained in our systems. PROQUEST AND ITS LICENSORS SPECIFICALLY DISCLAIM ANY AND ALL EXPRESS OR IMPLIED WARRANTIES, INCLUDING WITHOUT LIMITATION, ANY WARRANTIES FOR AVAILABILITY, ACCURACY, TIMELINESS, COMPLETENESS, NON-INFRINGMENT, MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE. Your use of the translations is subject to all use restrictions contained in your Electronic Products License Agreement and by using the translation functionality you agree to forgo any and all claims against ProQuest or its licensors for your use of the translation functionality and any output derived there from. Hide full disclaimer
© 2018. This work is published under https://creativecommons.org/licenses/by/4.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.
Abstract
Separating the stratospheric and tropospheric contributions in satellite retrievals of atmospheric
We compare our TEMPO field of regard algorithm against an identical global algorithm to investigate the penalty resulting from the limited spatial coverage in geostationary orbit, and find excellent agreement in the estimated mean daily tropospheric
You have requested "on-the-fly" machine translation of selected content from our databases. This functionality is provided solely for your convenience and is in no way intended to replace human translation. Show full disclaimer
Neither ProQuest nor its licensors make any representations or warranties with respect to the translations. The translations are automatically generated "AS IS" and "AS AVAILABLE" and are not retained in our systems. PROQUEST AND ITS LICENSORS SPECIFICALLY DISCLAIM ANY AND ALL EXPRESS OR IMPLIED WARRANTIES, INCLUDING WITHOUT LIMITATION, ANY WARRANTIES FOR AVAILABILITY, ACCURACY, TIMELINESS, COMPLETENESS, NON-INFRINGMENT, MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE. Your use of the translations is subject to all use restrictions contained in your Electronic Products License Agreement and by using the translation functionality you agree to forgo any and all claims against ProQuest or its licensors for your use of the translation functionality and any output derived there from. Hide full disclaimer
Details


1 Department of Physics and Atmospheric Science, Dalhousie University, Halifax, NS, Canada; now at: the Department of Earth and Environment, Boston University, Boston, MA, USA
2 Department of Physics and Atmospheric Science, Dalhousie University, Halifax, NS, Canada; Harvard-Smithsonian Center for Astrophysics, Cambridge, MA, USA
3 SRI International, Menlo Park, CA, USA
4 Air Quality Research Division, Environment and Climate Change Canada, Toronto, ON, Canada
5 Department of Physics and Atmospheric Science, Dalhousie University, Halifax, NS, Canada