1 Introduction
Atmospheric carbon dioxide () mole fraction has been increasing steadily since the first industrial revolution, primarily due to fossil fuel emissions and land use change . Recent estimates of sources and sinks at the global scale suggest a coincidental reinforcement of natural sinks balancing the continuously increasing anthropogenic emissions . Therefore, the fraction of fossil fuel remaining in the atmosphere
Atmospheric inversions of greenhouse gases (GHG) are now widely used to infer surface fluxes from natural
The increased density in existing tower networks and the availability of fine-scale satellite retrievals raised concerns about spatial and temporal structures in transport model errors . The proximity of the measurements (e.g., a couple of kilometers between OCO-2 retrievals) means that spatial correlations in model errors are significant and can no longer be ignored . This issue becomes critical to greenhouse gas inversion problems when applied to urban scales but remains poorly studied to date. Recent deployment of path-integrated instruments also increased the complexity of the problem from the ground when trying to invert for emissions from single facilities such as a large dairy .
Ensemble approaches are useful to describe flow-dependent errors
In this study, we apply the filter of variances and the covariance localization developed in and propose an additional solution to using the optimality condition, both for Gaussian and non-Gaussian error statistics cases. The filter is applied to several calibrated ensembles of different sizes to evaluate the impact of our filter on small (5 members) to larger (25 members) to the full ensemble (45 members) based on multi-physics simulations . Results are presented for in situ mole fractions, dry air mole fractions, mean horizontal winds and planetary boundary layer height. We discuss the results in Sect. .
2 Methods
2.1
Calibration of WRF- ensembles
We generate an ensemble using the Weather Research and Forecasting (WRF) model version 3.5.1 , including the chemistry module modified in this study for . The ensemble consists of 45 members that were generated by varying the different physics parameterization and meteorological data. The land surface models, surface layers, planetary boundary layer schemes, cumulus schemes, microphysics schemes and meteorological data (i.e., initial and boundary conditions) are alternated in the ensemble . All the simulations use the same radiation schemes, both long- and shortwave. All simulations were run using the one-way nesting method, with two nested domains. The coarse domain uses a horizontal grid spacing of 30 km and covers most of the United States and part of Canada. The inner domain uses a 10 km grid spacing, is centered in Iowa and covers the Midwest region of the United States. The vertical resolution of the model is described with 59 vertical levels, with 40 of them within the first 2 km of the atmosphere. This work focuses on the WRF simulation with the higher resolution; therefore only the 10 km domain will be analyzed. Simulations were performed from 27 June to 21 July 2008, with a 10 d spin-up for initial conditions. The fluxes for summer 2008 were obtained from NOAA Global Monitoring Division's CarbonTracker version 2009 (CT2009) data assimilation system (; with updates documented at
The ensemble was calibrated over the Midwest US using the available meteorological observations and the 10 km model simulation as described in . The measurements used included balloon soundings collected over the Midwest region (
Here, we will compare the different ensembles generated in from 5 to 8 to 10 members. An additional ensemble was created for our study with a larger number of members in order to address the potential lack of representativeness of model errors with small-size ensembles. Therefore, we generated a 25-member ensemble and applied the same calibration process. This ensemble has not been documented in but is described here in Appendix . We compare the results of the filtering for small sizes to the 25-member calibrated ensemble instead of the original 45-member ensemble that was not calibrated.
2.2 Variance filtering and covariance localizationhave proposed a new theory for the optimal filtering of sample variances and covariances. These are defined by the following empirical second-order moment statistics. Assume we have an ensemble of states for of mean , from which to infer the statistics. Define the associated anomalies , also called perturbations. Then, the sample covariance matrix is
1 which is an unbiased estimator of the true covariance matrix ; i.e., where is the expectation operator over the reference distribution from which the are sampled. In the following, we denote by the entries of this covariance matrix.
Filtering of variances and covariances is made necessary because of the finite size of the sample ensembles, which can generate significant sampling errors. The sampling errors can be filtered out by applying a linear filter to the variances and covariances. The most general linear filter is of the form 2 where is the filtered error covariance matrix. Typical examples are the application of a convolution to the vector of variances to smooth them out or the application of a Schur product with a nondegenerate, short-range correlation matrix to the sample covariance matrix. The linear filter often requires parameters, a correlation length typically, that must be tuned for the filter to be optimal.
The theory proposed in to achieve optimality of the filter is based on three key ingredients.
-
The first one consists in requiring that the residual sampling error be minimal. Assume that we have an estimator of some statistics of a reference distribution with true statistics , obtained from sampling from this distribution. We regularize with a linear filter (a matrix here) in order to minimize the sampling error: . A typical criterion to minimize is3The variation of this criterion with respect to a variation of is , which implies, that, at the minimum, we have an optimality condition in the form of an orthogonality of random vectors:4This is a linear equation in , whose solution is5
If is a Schur filter, i.e., , given by the Schur or Hadamart product (which is a subcase of the above problem) – hence is now a vector – then the solution has the form6where the division of vectors is component-wise. Eqs. () and () can be applied to the filtering of , storing the entries in . Hence, they provide optimality conditions for linear filtering of . They are known in the signal scientific community as Wiener filters. We note that , or , still depends on the unknown true statistics
-
The second ingredient is to exploit the structure relationships that bind the moments of sample estimators of the reference distribution. For any reference distribution (referred to as the non-Gaussian case in the following), the second-order moments of the sample covariances are functions of the second-order and fourth-order moments of the reference distribution. If, in addition, one assumes this reference distribution to be a Gaussian one, then the covariances of the sample covariances are only functions of the second-order moments of the reference distribution. This will be naturally referred to later as the Gaussian case. For instance, in the Gaussian case, the relation has the well-known form:7
-
In spite of the above key ideas, some local spatial averaging will additionally be needed to obtain robust estimators for the filters and their correlation lengths. Such averaging can be justified by ergodic assumptions regarding the statistics of the errors.
In the following, we make the difference between the cases where the true distribution is assumed to be Gaussian or not, since we saw it has an impact on the structure function such as Eq. () and could yield distinct optimal filtering results.
2.2.1 Gaussian caseIt turns out that it is more convenient to filter the variance and the correlation independently, in particular using a general linear filter for the variances and a Schur filter for the correlation .
We denote the vector of variances; i.e., . Combining the optimality criterion (Eq. ) with the structure relationship (Eq. ), without reference to any explicit filter at this stage, the filtered and the sampled variances are related by
8
with the optimality criterion in Gaussian conditions. If we filter the covariances with a Schur filter, i.e., , then
one obtains
In the non-Gaussian case, the structure relationship incorporates a term that depends on the fourth-order moments of the true error statistics. Using these relationships and the optimality criterion (Eq. ), without reference at this stage to any particular filter, one
obtains
10
Again, but in the non-Gaussian case, if we regularize the covariances with a Schur filter, i.e., , then ones obtains the optimal filter
For the localization of the covariances and hence the correlations, Eqs. () and () provide the optimal Schur localization. For the filtering of the variances, one uses Eqs. () and () but still needs to specify a filter, such as a convolution with a short-range kernel of correlation length . Then Eqs. () and () are implicit equations for , which can be solved iteratively using, for instance, a fixed-point method.
We note that all these formulae still depend on some statistical expectation, such as . To make those formulae practical, we identify these expectations as local, if not global, spatial averages.
2.2.3 Wiener filterThere is an alternative to using the optimality condition (Eq. ) in conjunction with the structure relationships of the moments of . We propose to solely use the optimality condition (Eq. ) and upon choosing the generic form of the filter use the optimal filters given by Eqs. () or (). We will call them Wiener filters in the following.
For instance, assuming Schur regularization, we obtain the following Wiener filter:
12 Using the sample estimator , we obtain 13
Both Wiener and Schur filters will be applied to sub-domains defined around instrumented tower locations measuring continuously mole fractions in the US Upper Midwest . The sub-domains cover an area of 400 km 400 km around each site (here seven sites across the domain), which also correspond to the spatial extent of the local spatial averaging (third item in Sect. ). Due to computational limitations, we performed additional experiments with larger sub-domains for our 25-member ensemble, as shown in Sect. .
2.3Meteorology and error structures
We want to explore the relationships between the different variables especially in situ mole fractions of , total-column and PBLH. We will compare both the error variances and covariances to identify possible links between error structures in PBLH and mole fractions. We will explore the spatial correlation lengths for mole fractions, mean horizontal wind (zonal and latitudinal components) and PBLH to quantify and possibly utilize error structures in meteorological fields to generate and error structures. Most ensemble prediction systems (EPSs) provide spatial error correlations for meteorological variables which could be used to construct error covariances for and . Error covariances of mole fractions depend on the fluxes, but error structures in the atmospheric models should remain independent of the flux distribution. show that first-order discrepancies in PBLH seem related to large errors in . Here, we investigate further the links between errors across different variables. We present the results in Sect. for the variances and in Sect. for the error correlations.
3 Results3.1 Sampling noise due to ensemble size
We computed the sample variances over the domain from the 5-, 8-, 10- and 25-member ensembles as shown in Fig. . The increase in variances and the presence of additional fine-scale structures are visible in small-size ensembles (5 to 10 members) compared to the 25-member ensemble. Fine-scale structures reflect the sampling noise in the small-size ensembles, reaching a maximum in the five-member ensembles (see Fig. d). These spurious structures appear with small-size ensembles and are to be filtered later. The range of values for error variances increases for small-size ensembles, independently of the calibration process. In addition, the variances in calibrated ensembles with more members are smaller because the inflation of the variance is a direct consequence of removing members. Hence, the calibration process better inflates the deviation of members from the mean for small ensembles. have shown that the calibration process yields smaller-size ensembles to better represent model errors. Here, the variance from the 25-member ensemble remains harder to inflate by the calibration process and also less affected by sampling noise, which is likely to be less representative of the actual transport model errors.
Figure 1
Variances of in situ mole fractions (about 100 m a.g.l.) (in ppm) using 25 members (a), 10 members (b), 8 members (c) and 5 members (d).
[Figure omitted. See PDF]
3.2 Filtering of sampling noiseWe show here the values of the length scales in our filter resulting from the optimality criteria, applying both Gaussian (see Eq. ) and non-Gaussian (see Eq. ) filters to the raw variances. We implemented the dichotomy algorithm proposed in to obtain the optimal length scales of the filter, dividing (or multiplying) the length scale by a factor of 2 until convergence. The algorithm solves for the optimal length scale of the filter by scanning the space of solutions iteratively (applying a multiplicative factor at each time step to minimize the cost function). For all our cases, we defined the upper bound of the diagnosed length scale at 750 km, to represent about half the size of our simulation domain (square of 1600 km wide). This large value means that the extent of noisy structures would encompass the entire domain and therefore would not be recoverable. Here, the sampling noise is characterized by length scales of sizes ranging from a few kilometers to several hundred kilometers. In practice, the algorithm always converges but length scale might be larger than the domain size, meaning that all spatial structures in the variances are regarded as noise. This situation happens for two main reasons: spatial structures in the noise are similar to spatial gradients in the true variances, or the noise is larger than the true variances. Hence, the length scale falls beyond the limit of our simulation domain. In the method described by , the ergodic assumption is necessary to diagnose robust estimators of the filter (see Sect. ).
For mole fractions (see Fig. ), the algorithm for the calibrated 25-member ensemble systematically converges to small length scales ( km), indicating that noise structures are very small in our optimal ensemble. When using the Gaussian filter, the algorithm systematically converges below our 750 km threshold for all cases except for 30 % of the days with the smallest ensemble (five members). In the non-Gaussian case, the filter converges to larger length scales beyond our threshold with the 5- and 10-member ensembles for less than 30 % of the days. Typically, length scales beyond our 750 km threshold are temporally coherent over periods of several days suggesting weather-related structures possibly inherited from synoptic-scale systems. These periods might be caused by high sampling noise compared to the true variances or by similar scales in spatial structures for both noise and true variances. Overall, the non-Gaussian filter shows a lower rate of convergence below 750 km compared to the Gaussian filter for mole fractions.
Figure 2
Length scale (in km) of the variance filter for in situ mole fractions at about 100 m a.g.l. using Gaussian (solid lines) and non-Gaussian (dash lines) equations from 27 June to 21 July 2008.
[Figure omitted. See PDF]
For column mole fractions (see Fig. ), the optimal length scales are larger and the non-Gaussian filter converges beyond our threshold more frequently (about 50 % of the days for eight members or less). Even with the optimal 25-member ensembles, error structures of about 50 to 200 km are filtered out, significantly larger than for the mole fractions. We discuss in Sect. the possible physical reasons behind these larger length scales, possibly due to large-scale structures in the free troposphere or to the complexity in noise structures as data integrate noises from different altitudes. Figure shows the results of the PBLH for which both filters converge beyond our threshold for half of the days in the Gaussian case. However, the filter converges more often below our threshold with the non-Gaussian filter applied to 10-member ensembles. Variance noise for PBLH present skewed distributions (not shown here) requiring the use of a non-Gaussian filter. We conclude here that 8- and 10-member ensembles are the minimum sizes with which sub-threshold convergence can be obtained on most days for most variables. Five-member ensembles will still be studied later on for covariances, as the localization of covariances does not depend on the filtered variances, but the low rate of convergence below 750 km might limit the use of the filtered variances.
Figure 3Length scale (in km) of the variance filter for total-column dry air mole fractions using Gaussian (solid lines) and non-Gaussian (dash lines) equations from 27 June to 21 July 2008.
[Figure omitted. See PDF]
Figure 4Length scale (in km) of the variance filter for planetary boundary layer heights using Gaussian (solid lines) and non-Gaussian (dash lines) equations from 27 June to 21 July 2008.
[Figure omitted. See PDF]
3.3 Variance filtering and ensemble sizesThe filtered variances shown in Fig. , here with the Gaussian filter, for the different ensemble sizes are in better agreement with the variances of the 25-member ensemble both in term of spatial patterns and magnitudes among the different ensembles. The filter successfully removed noisy structures, therefore decreasing the dependence on the number of members used in each case. Despite length scales beyond our threshold for 30 % of the days with the five-member ensemble, filtered variances at the monthly timescale show similar structures to 8- or 10-member ensembles, with nearly all of the noisy structures being removed by the filter. Compared to earlier results, the ensemble size does not seem to fundamentally limit the capacity of the filter to remove the noise, despite days with convergence beyond 750 km. The variance magnitude remains slightly larger for 10 members or less, with a relative overestimation of about 15 %. Our 5-member ensemble provided the best match with only 10 % higher than the 25-member filtered variances. The averaging over a whole month compensates for days with convergence beyond 750 km, producing reasonable estimates of the optimal variance even with five members. This result suggests that climatological error variances from small-size ensembles can be a good first approximation of the true variance when filtered correctly over most days.
Figure 5
Monthly averages of the filtered variances of in situ mole fractions (about 100 m a.g.l.) (in ppm) using 25 members (a), 10 members (b), 8 members (c) and 5 members (d).
[Figure omitted. See PDF]
3.4Error variances in , and PBLH
We show in Fig. the spatial distribution of error variances from the 25-member calibrated ensemble for in situ mole fractions in the planetary boundary layer (PBL; 100 m a.g.l.), in situ mole fractions in the free troposphere (about 5 km a.g.l.), total column of dry air mole fractions and PBLH (in m a.g.l.). The four variables display very distinct spatial patterns. variance spatial patterns (see Fig. c) exhibit distinct maximum values located in the eastern and southeastern part of the domain, whereas high variances are observed in the northeastern part of the domain for free-tropospheric (see Fig. b) or centrally located for variances in the PBL (see Fig. a). Finally, PBLH variances (see Fig. d) show no indication of direct relationship between large errors in the western part of the domain and the other three variables. We conclude here that no direct relationship can be utilized to construct variances based on PBLH. Similarly, maximum variances among the three variables are also significantly different in distribution and magnitudes.
Figure 6Filtered variances using the calibrated 25-member ensemble of in situ mole fractions at 100 m a.g.l. (in ppm) (a), in situ mole fractions at 5 km a.g.l. (in ppm) (b) total dry air mole fractions (in ppm) (c) and PBLH (in m) (d).
[Figure omitted. See PDF]
3.5 Covariance localization: Schur and Wiener filtersError covariances in mole fractions scale with the magnitude of the surface fluxes. They are therefore difficult to interpret. Instead, we present here the error correlations to highlight the spatial structures inherited from the transport models, independent of the magnitude of the underlying surface fluxes. We show in Fig. the hourly correlation structures from the full 45-member ensemble (a–c) and our 25-member calibrated ensemble (d–f) at one of the instrumented towers in the US Midwest, i.e., Centerville, Iowa. We applied both Schur (see Fig. b, e) and Wiener (see Fig. c, f) filters to compare the impact of both filters on the raw correlations (see Fig. a, d). The Schur filter has less impact on the correlations compared to the Wiener filter which attenuates significantly the magnitude of the correlations for both ensembles. In Sect. , the local averaging of the optimal length scale assumes that the sampling noise is spatially homogeneous (third ingredient of the methods). This homogeneity assumption is required for the ergodicity assumption to apply, therefore yielding a domain-averaged filtering approach. The sub-domain used for the covariance filtering (here 400 km 400 km) limits the spatial extent to 200 km around the observation location. The size of the domain was defined primarily for computational efficiency and based on the size of correlation structures, usually of about 100–200 km in length scale. To evaluate this assumption, we compared the size of the sub-domain to filter the covariances with a large area of 900 km 900 km for the 45-member ensemble to a smaller area of 400 km 400 km for the 25-member ensemble. Filtered correlations show similar results for Schur and slightly larger values for the smaller sub-domain when applying the Wiener filter. We conclude here that the spatial local averaging has a minor impact on the results and that our 25-member ensemble has similar spatial structures to the original 45-member ensemble, with larger correlations at short distances. We extend this analysis to the monthly timescale by showing monthly averaged error correlations, superimposed from different tower locations on the same map to aggregate the results at multiple locations (see Fig. ). When averaged over longer timescales (see Fig. ), the filtered correlations become isotropic, distributed around each location. The magnitudes remain larger with the Schur filter (see Fig. b) compared to the Wiener filter (see Fig. c) but the differences are noticeably smaller. The unfiltered correlations (see Fig. a) are noticeably larger due to noisy structures. After filtering, the spatial structures are distributed around the observation locations following a pseudo-Gaussian pattern. The magnitude of the error correlations, i.e., the length scale of the errors, is reduced in both cases compared to the raw correlations (see Fig. a). This result confirms that the sub-domain used here (400 km 400 km) is sufficient to represent the error correlation structures around each measurement location and describes fully the error structures.
Figure 7
Hourly raw (a, d) and filtered correlations using Schur (b, e) and Wiener (c, f) filtered correlations of in situ mole fractions at the Centerville tower (at about 100 m a.g.l.) on 26 June 2008. The correlations are based on the original 45-member ensemble (a, b, c) with a large subdomain (900 km 900 km) and the 25-member ensemble (d, e, f) over the reference subdomain (400 km 400 km). The highlighted domain also corresponds to the domain used for the spatial averaging of the correlations in the optimality conditions.
[Figure omitted. See PDF]
Figure 8Raw (a) and filtered correlations of in situ mole fractions at about 100 m a.g.l. based on 25 members using the Schur localization (b) and Wiener and Schur filter (c).
[Figure omitted. See PDF]
We show in Fig. the results for the different ensemble sizes using the Schur filter. The 10- and 8-member ensembles show similar magnitude and patterns for the different sites, but the correlations are smaller than with the original ensemble. In comparison, the Wiener filter (see Fig. ) generates consistent patterns with 25-, 10- and 8-member ensembles. In both cases, the filters decrease significantly the correlations in the five-member ensemble, revealing the inability of the filter to separate the noise from the actual error correlations. We present the localized correlation length scales for each tower and for each day in Fig. a. For both Center and Mead, length scales are noticeably larger than for the other towers and decrease rapidly until 2 July, before converging back to the same values diagnosed for other measurement sites. The differences across towers suggest local differences in error correlations, even across the same region for a single day (up to 70 km across our sites). These differences correspond to the beginning of summer, when both weather and ecosystem fluxes vary rapidly especially in agricultural areas. We discuss in Sect. the relationship between meteorological and variables for both error variances and error correlations.
Figure 9Filtered correlations (using Schur product only) of in situ mole fractions (about 100 m a.g.l.) (in ppm) (about 100 m a.g.l.) (in ppm) using 25 members (a), 10 members (b), 8 members (c) and 5 members (d).
[Figure omitted. See PDF]
Figure 10Filtered correlations (using Wiener and Schur) of in situ mole fractions (about 100 m a.g.l.) (in ppm) (about 100 m a.g.l.) (in ppm) using 25 members (a), 10 members (b), 8 members (c) and 5 members (d).
[Figure omitted. See PDF]
4 Discussion4.1 Minimum size of calibrated ensembles
We discussed in Sect. the dependence of the success of the variance filtering on the ensemble size. From these results, an ensemble of at least 8 to 10 members seems required to reach convergence below our 750 km convergence and hence filter the error variances. However, the spatial representation of the averaged filtered variances using a calibrated five-member ensemble (see Fig. ) indicates a reasonable recovery of the error variances at the monthly timescale but not at the daily timescale. Theoretically, the minimum number of members for the covariance filtering is four, based on Eq. () with a factor in the denominator, which shows that five-member ensembles are close to this limit and are not recommended in a more general context. The application here suggests 5-member ensembles are acceptable, but 8- to 10-member ensembles would be a minimum both in practice and in theory over different seasons and regions. Convergence beyond our threshold over single days has a limited impact on the monthly mean filtered variances. We conclude here that the filter produces satisfactory results to generate first-order estimates of the mole fraction errors. To achieve a systematic daily convergence below threshold, we recommend a larger number of members in the ensemble. One important point here is the calibration step performed before filtering, which optimizes the information content in each member relative to the other members. Therefore, a randomly generated ensemble may require additional members in order to represent the actual error variances. We tested the filtering technique on a random ensemble (i.e., uncalibrated) and found that beyond-threshold convergence is more frequent with 10 or less members (not shown here).
4.2 Impact of calibration on small-size ensembles
We have explored the impact of the calibration process on the error variances and covariances by filtering non-calibrated sub-ensembles of 8 and 10 members (see Fig. ). These random ensembles have no member in common with their calibrated counterpart and are composed of simulations using various physics configuration randomly selected among the 45 original model configurations. The optimal length scale of the variance filter is systematically lower for non-calibrated ensembles (see Fig. , in gray and light blue) compared to calibrated ensembles (see Fig. , in black and royal blue), suggesting lower levels of noise with larger spatial structures, similar to larger ensemble sizes (25 members or more). Because members of the calibrated ensembles were selected to maximize the information content, calibrated-ensemble members differ more from each other than non-calibrated ensemble members. As shown in , one member with higher or lower PBLH statistics (usually the monthly mean model estimate) is systematically selected in order to generate calibrated ensembles with enough variance, and therefore capture the spatial and temporal variability in observed PBLH's from 14 radiosondes. Calibration might suggest different combinations of model physics for every single time period. In future studies, we recommend a combination of several preselected model physics with added perturbations to produce a sufficient ensemble spread but not perform the calibration for every time period. The calibration procedure might still be applied to existing ensembles but remain insufficient to sample the full spatial and temporal variability as discussed in . Some of these members introduce different spatial structures compared to the original ensemble, increasing the spread significantly. However, the small size of our ensembles with a larger variance may affect the sampling of these structures and hence our ability to differentiate noise from actual error structures. The approach proposed by was initially designed for ensembles with independently distributed members, which is not the case here. Some true correlation structures in the calibrated ensemble may be regarded as noise by the filter. Another approach would generate an ensemble based on the localized ensemble-based error covariance matrix. This approach will be developed further in future studies but is beyond the scope of this paper.
Figure 11
Length scale (in km) of the Gaussian variance filter for 10-member random (in gray) and calibrated (in black) ensembles, and 8-member random (in light blue) and calibrated (royal blue) ensembles, for in situ mole fractions at about 100 m a.g.l. using Gaussian equations from 27 June to 21 July 2008.
[Figure omitted. See PDF]
4.3Spatial structures in and meteorological errors
In Fig. , significant differences in filtered error variances were observed between in situ mole fractions (at different altitudes), mole fractions and PBLH. Therefore, we conclude here that transport errors of meteorological variables are not transferable to and error variances. This finding is in agreement with , who found no direct relationship between errors in the meteorology and in situ mole fractions. However, considering the covariances, the spatial structures in mole fraction errors inherited from transport model errors exhibit well-defined patterns (e.g., Fig. ). By fitting a simple Gaussian function in the form of to the filtered covariance fields, we diagnosed the characteristic length scale of the spatial error structures for the different variables, here 100 m-high mole fractions, the mean horizontal zonal wind component and PBLH. Figure shows the daily length scales at the seven measurement locations over the simulation period (i.e., 27 June to 21 July). The length scales for the three variables increase rapidly between 27 June and 4 July from less than 100 to 150 km or higher. As there is no long-term spin-up (re-initialization of the perturbations every 5 d), the asymptotic behavior is most likely due to the seasonality of the errors from early to late summer. The seasonal changes in the atmospheric dynamics impact the spatial structures in the errors for the three variables. Across the seven sites, the characteristic length scale of spatial error structures also vary significantly, in particular for PBLH with large differences across sites. Both mole fractions and the mean zonal wind component reach a maximum value over July: respectively, 140 and 120 km. The comparison of the mean length scales (Fig. d) highlights the differences between the three variables. Both the 100 m high mole fractions and the mean horizontal zonal wind component show similar variations and converge towards the same values but differ significantly from 29 June to 10 July. We conclude here that first-order estimates for spatial error correlations may be derived from meteorological error structures, in particular from the mean horizontal wind speed. But these approximations may be valid only for specific time periods. As presented in Sect. , error variances in and mole fractions are decoupled from PBLH errors. Here, we suggest that error correlations may be derived from wind errors, but error variances should still be computed independently.
Figure 12Characteristic length scales of filtered error correlations (from the 25-member ensemble) using an exponential function () for 100 m high mole fractions (a), the mean horizontal zonal wind component (; b), PBLH (c) and the mean values for the three variables (d) for every day of the simulation period (27 June to 21 July).
[Figure omitted. See PDF]
4.4 Evaluation and modeling of error correlationsThis study presents a methodology to filter the noise in error structures from a small-size ensemble. The evaluation of the filtered structures would benefit from dense measurement campaigns sampling spatial structures across large domains, such as the Atmospheric Carbon and Transport (ACT)-America campaigns.
5 Conclusions
We have diagnosed the error variances and the spatial error structures from our mesoscale transport models at daily and monthly timescales. Applied to both mole fractions and meteorological variables, we implemented a cost-effective filtering technique currently used in meteorological data assimilation systems to describe spatial error structures using a small-size ensemble. The approach remains affordable for multiyear inversions of sources and sinks at continental or regional scales. The removal of noisy structures in our small-size ensembles is evaluated by comparison with larger-size ensembles, both the original 45-member ensemble and our optimal calibrated sub-ensemble of 25 members. A second filtering approach for error covariances was successfully applied using the Wiener filter, producing similar results compared to the Schur filter over the 1-month simulation period. Differences were noticeable at shorter timescales (i.e., daily). The spatial distribution of error variances and spatial error structures are recoverable from small-size ensembles of 8 to 10 members, daily for in situ mole fractions and monthly for total-column , providing a more realistic representation of transport errors in future mesoscale inversions of fluxes. We noted that error variances of in situ mole fractions and total-column differ significantly, even when varying the altitudes or considering PBLH error structures. We conclude that error variances for remote-sensing observations need to be quantified independently of PBL or free-tropospheric mole fractions.
We have discussed the potential use of meteorological error structures such as the mean horizontal wind to approximate spatial error correlations of in situ mole fractions. The seasonal variations in wind, PBLH and in situ mole fractions are highly correlated, while the typical length scales in error structures vary from 100 to 150 km in the middle of summer depending on the variable. We conclude here that meteorological error structures may provide a first-order estimation of correlation length scales in inversions when no ensemble of simulations is available.
Code availability
The code is accessible under request by contacting the corresponding author ([email protected]).
Data availability
The model simulation outputs are available under request by contacting the corresponding author ([email protected]).
Appendix A Calibration of the reference 25-member ensemble
In this study, we generate a reference ensemble to evaluate the sampling noise in the ensembles of smaller sizes. The original 45-member ensemble, uncalibrated, cannot be used as a reference as it underestimates model errors. Yet, the reference ensemble needs to include enough members to limit the sampling noise. Based on the same original ensemble of 45 members as in , we reduce it to a calibrated 25-member ensemble using the simulated annealing (SA) algorithm. The selection of the optimal calibrated ensemble is based on three meteorological variables (i.e., wind speed, wind direction and PBLH) and follows the same procedure described in . The SA for 25 members uses 40 000 iterations to reach convergence, significantly larger than the 20 000 iterations for 10-, 8- and 5-member ensembles. The same criterion used by was applied to the selection process of the calibrated 25-member ensemble, improving the flatness of the rank histograms (Fig. ). This selection is based on two criteria. First, we selected all the 25-member sub-ensembles with a rank histogram score smaller than six for each individual meteorological variable. In a second step, we filtered out the 25-member ensembles accepted by the SA algorithm but corresponding to a bias (i.e., mean model–data mismatch over 25 d) larger than the bias in the original 45-member ensemble. These criteria are applied to the three meteorological variables. This procedure is described in more detail in . The rank histograms in Fig. show a limited under-dispersion of the 25-member ensemble, significantly reduced after calibration from 6.1, 6.2, 3.2 to 5.1, 4.9, and 2.5 for wind speed, wind direction and PBLH, respectively.
Figure A1Rank histograms of the 25-member ensemble after calibration for wind speed (a), wind direction (b) and planetary boundary layer height (c) over 35 d (18 June to 21 July 2008) using 14 rawinsonde sites available over the US Midwest. The horizontal dashed line corresponds to the ideal value for a flat rank histogram with respect to the number of members. The rank histogram score () defines the flatness of the rank histogram, 1 being the ideal value.
[Figure omitted. See PDF]
Author contributions
The WRF-Chem simulations were performed by LIDI and TL; the filtering technique was coded by MB and TL based on the work of Benjamin Ménétrier; the concept and ideas were designed by MB, TL and NB; the paper was prepared by TL, LIDI, NB and MB.
Competing interests
The authors declare that they have no conflict of interest.
Acknowledgements
This research was supported by National Aeronautics and Space Administration (NASA) Terrestrial Ecosystem and Carbon Cycle Program (grant no. NNX11AE79G), by the NASA’s Earth Venture Program Atmospheric Carbon and Transport (ACT) – America (grant no. NNX15AG76G), by the Alfred P. Sloan Graduate Fellowship, by the NASA Carbon Monitoring System program (grant no. NNX13AP34G), and by the National Oceanic and Atmospheric Administration (grant no. NA14OAR4310136). CEREA is a member of Institut Pierre-Simon Laplace (IPSL).
Financial support
This research has been supported by NASA (grant nos. NNX15AG76, NNX13AP34G, NNX15AI42G and NNX11AE79G) and NOAA (grant no. NA14OAR4310136).
Review statement
This paper was edited by Christoph Gerbig and reviewed by Benjamin Ménétrier and one anonymous referee.
You have requested "on-the-fly" machine translation of selected content from our databases. This functionality is provided solely for your convenience and is in no way intended to replace human translation. Show full disclaimer
Neither ProQuest nor its licensors make any representations or warranties with respect to the translations. The translations are automatically generated "AS IS" and "AS AVAILABLE" and are not retained in our systems. PROQUEST AND ITS LICENSORS SPECIFICALLY DISCLAIM ANY AND ALL EXPRESS OR IMPLIED WARRANTIES, INCLUDING WITHOUT LIMITATION, ANY WARRANTIES FOR AVAILABILITY, ACCURACY, TIMELINESS, COMPLETENESS, NON-INFRINGMENT, MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE. Your use of the translations is subject to all use restrictions contained in your Electronic Products License Agreement and by using the translation functionality you agree to forgo any and all claims against ProQuest or its licensors for your use of the translation functionality and any output derived there from. Hide full disclaimer
© 2019. This work is published under https://creativecommons.org/licenses/by/4.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.
Abstract
Atmospheric inversions inform us about the magnitude and variations of greenhouse gas (GHG) sources and sinks from global to local scales. Deployment of observing systems such as spaceborne sensors and ground-based instruments distributed around the globe has started to offer an unprecedented amount of information to estimate surface exchanges of GHG at finer spatial and temporal scales. However, all inversion methods still rely on imperfect atmospheric transport models whose error structures directly affect the inverse estimates of GHG fluxes. The impact of spatial error structures on the retrieved fluxes increase concurrently with the density of the available measurements. In this study, we diagnose the spatial structures due to transport model errors affecting modeled in situ carbon dioxide (
You have requested "on-the-fly" machine translation of selected content from our databases. This functionality is provided solely for your convenience and is in no way intended to replace human translation. Show full disclaimer
Neither ProQuest nor its licensors make any representations or warranties with respect to the translations. The translations are automatically generated "AS IS" and "AS AVAILABLE" and are not retained in our systems. PROQUEST AND ITS LICENSORS SPECIFICALLY DISCLAIM ANY AND ALL EXPRESS OR IMPLIED WARRANTIES, INCLUDING WITHOUT LIMITATION, ANY WARRANTIES FOR AVAILABILITY, ACCURACY, TIMELINESS, COMPLETENESS, NON-INFRINGMENT, MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE. Your use of the translations is subject to all use restrictions contained in your Electronic Products License Agreement and by using the translation functionality you agree to forgo any and all claims against ProQuest or its licensors for your use of the translation functionality and any output derived there from. Hide full disclaimer
Details


1 Department of Meteorology and Atmospheric Science, The Pennsylvania State University, University Park, PA, USA; now at: Laboratoire des Sciences du Climat et de l'Environnement, CEA, CNRS, UVSQ/IPSL, Université Paris-Saclay, Orme des Merisiers, 91191 Gif-sur-Yvette CEDEX, France
2 Department of Meteorology and Atmospheric Science, The Pennsylvania State University, University Park, PA, USA; now at: Scripps Institution of Oceanography, University of California, San Diego, CA 92093, USA
3 CEREA, joint laboratory École des Ponts ParisTech and EDF R& D, Université Paris-Est, Champs-sur-Marne, France
4 Department of Mechanical Engineering, University of Colorado Boulder, Boulder, CO, USA; now at: European Centre for Medium-Range Weather Forecasts, Reading, UK