Validation of methane and carbon monoxide from Sentinel-5 Precursor using TCCON and NDACC-IRWG stations

Abstract

The Sentinel-5 Precursor (S5P) mission with the TROPOspheric Monitoring Instrument (TROPOMI) on board has been measuring solar radiation backscattered by the Earth's atmosphere and surface since its launch on 13 October 2017. In this paper, we present for the first time the S5P operational methane (${\mathrm{CH}}_{\mathrm{4}}$) and carbon monoxide (CO) products' validation results covering a period of about 3 years using global Total Carbon Column Observing Network (TCCON) and Infrared Working Group of the Network for the Detection of Atmospheric Composition Change (NDACC-IRWG) network data, accounting for a priori alignment and smoothing uncertainties in the validation, and testing the sensitivity of validation results towards the application of advanced co-location criteria. We found that the S5P standard and bias-corrected ${\mathrm{CH}}_{\mathrm{4}}$ data over land surface for the recommended quality filtering fulfil the mission requirements. The systematic difference of the bias-corrected total column-averaged dry air mole fraction of methane (${\mathrm{XCH}}_{\mathrm{4}}$) data with respect to TCCON data is $-\mathrm{0.26}\pm \mathrm{0.56}$ % in comparison to $-\mathrm{0.68}\pm \mathrm{0.74}$ % for the standard ${\mathrm{XCH}}_{\mathrm{4}}$ data, with a correlation of 0.6 for most stations. The bias shows a seasonal dependence. We found that the S5P CO data over all surfaces for the recommended quality filtering generally fulfil the missions requirements, with a few exceptions, which are mostly due to co-location mismatches and limited availability of data. The systematic difference between the S5P total column-averaged dry air mole fraction of carbon monoxide (XCO) and the TCCON data is on average $\mathrm{9.22}\pm \mathrm{3.45}$ % (standard TCCON XCO) and $\mathrm{2.45}\pm \mathrm{3.38}$ % (unscaled TCCON XCO). We found that the systematic difference between the S5P CO column and NDACC CO column (excluding two outlier stations) is on average $\mathrm{6.5}\pm \mathrm{3.54}$ %. We found a correlation of above 0.9 for most TCCON and NDACC stations. The study shows the high quality of S5P ${\mathrm{CH}}_{\mathrm{4}}$ and CO data by validating the products against reference global TCCON and NDACC stations covering a wide range of latitudinal bands, atmospheric conditions and surface conditions.

1 Introduction

The Sentinel-5 Precursor (S5P) mission with the TROPOspheric Monitoring Instrument (TROPOMI) on board was launched on 13 October 2017. The S5P is orbiting in a Sun-synchronous polar orbit with an Equator crossing at 13:30 local solar time. The TROPOMI instrument is a nadir-viewing hyperspectral spectrometer measuring solar radiation reflected by the Earth's atmosphere and its surface from the ultraviolet–visible (270–495 nm), near-infrared (675–775 nm) and shortwave–infrared (2305–2385 nm) with daily global coverage for monitoring atmospheric trace gases and aerosol . Methane (${\mathrm{CH}}_{\mathrm{4}}$) and carbon monoxide (CO) are retrieved from shortwave–infrared (SWIR) and near-infrared (NIR) measurements.

Methane is the second most important anthropogenic greenhouse gas (GHG) after carbon dioxide (${\mathrm{CO}}_{\mathrm{2}}$). It has a global warming potential that is about 28 times larger than ${\mathrm{CO}}_{\mathrm{2}}$ over a 100-year time period. It is less abundant in the atmosphere and has a significantly shorter lifetime than ${\mathrm{CO}}_{\mathrm{2}}$ . Reduction in ${\mathrm{CH}}_{\mathrm{4}}$ will affect the Earth's radiation budget on a short timescale. ${\mathrm{CH}}_{\mathrm{4}}$ is also relevant in atmospheric chemistry, where it reacts with hydroxyl radicals (OH), thereby reducing the oxidation capacity of the atmosphere and producing ozone .

Carbon monoxide is a poisonous reactive gas considered principally an anthropogenic atmospheric pollutant. Volatile organic compounds (VOCs) are emitted to the atmosphere by incomplete combustion (e.g. vehicles, industry and biomass burning) and have an important role in the production of CO. The lifetime of CO is relatively short and ranges from weeks to months . CO reacts with atmospheric oxidants, ozone (${\mathrm{O}}_{\mathrm{3}}$), hydroperoxy (${\mathrm{HO}}_{\mathrm{2}}$) and hydroxyl radicals (OH). It is the largest direct sink of OH affecting the self-cleansing capacity of the atmosphere. An increase in CO would imply a higher OH loss through chemical reaction and therefore less availability of OH for the depletion of other atmospheric constituents such as ${\mathrm{CH}}_{\mathrm{4}}$. CO is therefore affecting the concentrations of primary greenhouse gases and has an indirect but important influence in determining the chemical composition and radiative properties of the atmosphere. It is therefore considered as an indirect greenhouse gas .

Continuous precise and accurate global measurements of these gases are very important for long-term monitoring and their use by the inverse models such that the inferred surface fluxes can be better constrained. This paper focuses on the quality assessment of the operational S5P ${\mathrm{CH}}_{\mathrm{4}}$ and CO products by performing validation of the total columns of these two products with the reference data from all stations in the ground-based Total Carbon Column Observing Network (TCCON) and Infrared Working Group of the Network for the Detection of Atmospheric Composition Change (NDACC-IRWG) networks. The systematic and random error requirements of the ${\mathrm{CH}}_{\mathrm{4}}$ and CO products are checked based on 2.8 years of S5P data, and possible reasons are given where large deviations are observed.

The paper is organised as follows: Sect. 2 describes the satellite and ground-based reference data used in this study. Section 3 gives the details of the validation methodology. Section 4 gives the validation results for ${\mathrm{CH}}_{\mathrm{4}}$, and Sect. 5 gives the validation results for CO. Section 6 summarises our results and conclusions.

2 Data

In this section, we present an overview of the input data from the S5P and the reference ground-based data from the TCCON and NDACC-IRWG, herewith referred to as NDACC, which are used for the validation of the S5P operational ${\mathrm{CH}}_{\mathrm{4}}$ and CO products.

2.1 S5P methane and carbon monoxide data sets

TROPOMI is the unique payload of the ESA/Copernicus Sentinel-5 Precursor mission orbiting in a low-Earth Sun-synchronous polar orbit with a wide swath of 2600 km across track resulting in daily global coverage. The TROPOMI radiometric measurements of the Earth's radiance and solar irradiance are processed using an on-ground data processor to retrieve the atmospheric abundances of ozone (${\mathrm{O}}_{\mathrm{3}}$), nitrogen dioxide (${\mathrm{NO}}_{\mathrm{2}}$), sulfur dioxide (${\mathrm{SO}}_{\mathrm{2}}$), formaldehyde ($\mathrm{HCHO}$), methane (${\mathrm{CH}}_{\mathrm{4}}$), carbon monoxide ($\mathrm{CO}$), as well as cloud and aerosol properties. The spatial resolution of the operational level 2 (L2) ${\mathrm{CH}}_{\mathrm{4}}$ and CO products was originally $\mathrm{7}\times \mathrm{7}$ km${}^{\mathrm{2}}$ and was increased to $\mathrm{5.5}\times \mathrm{7}$ km${}^{\mathrm{2}}$ on 6 August 2019.

The operational processing to retrieve the total column-averaged dry air mole fraction of methane (${\mathrm{XCH}}_{\mathrm{4}}$) is performed by the RemoTeC-S5P algorithm. The information describing the theoretical baseline of the algorithm, the input and ancillary data needed, averaging kernel and the output generated is described in detail in and . The use of satellite measurements for estimating sources and sinks of ${\mathrm{CH}}_{\mathrm{4}}$ strongly depends on the precision and accuracy achieved. Systematic biases or lower precision on regional or seasonal scales can jeopardise the usefulness of the satellite measurements for the estimation of source and sink estimates . The bias requirement for S5P ${\mathrm{XCH}}_{\mathrm{4}}$ is 1.5 % and the random error requirement is 1 % (as reported in the official ESA document , Table 1, p. 14). The current S5P ${\mathrm{CH}}_{\mathrm{4}}$ data are only processed for cloud-free measurements over land. Along with the standard ${\mathrm{CH}}_{\mathrm{4}}$ product, a bias-corrected ${\mathrm{CH}}_{\mathrm{4}}$ product is also made operationally available. We provide a brief summary of the ${\mathrm{CH}}_{\mathrm{4}}$ bias correction here, and the details of the bias correction can be found in Sect. 5.6 of the algorithm theoretical baseline document (ATBD) for S5P methane retrieval . The operational S5P ${\mathrm{CH}}_{\mathrm{4}}$ product has been compared to co-located Greenhouse Gases Observing Satellite (GOSAT) proxy measurements. The S5P-GOSAT ${\mathrm{XCH}}_{\mathrm{4}}$ ratio shows a high correlation to the retrieved surface albedo in the SWIR. The highest correlation is for low surface albedo scenes. A posteriori bias correction has been applied to the S5P ${\mathrm{CH}}_{\mathrm{4}}$ product using a second-order polynomial fit. The effect of the bias correction is an increase of the retrieved ${\mathrm{CH}}_{\mathrm{4}}$ for scenes with relatively low albedo conditions (e.g. forest scenes) and a decrease of ${\mathrm{CH}}_{\mathrm{4}}$ for scenes with high albedo conditions (e.g. desert scenes). In the paper, we will show the validation results of both standard and bias-corrected S5P ${\mathrm{CH}}_{\mathrm{4}}$ products. The latest product versions of S5P ${\mathrm{CH}}_{\mathrm{4}}$ data for the reprocessed (RPRO) and offline (OFFL) data from the start of the mission to 30 September 2020 are used in this work. The version numbers and the respective dates are listed in Table , and further details on the relevant improvements are given in the product readme file (PRF; https://sentinel.esa.int/documents/247904/3541451/Sentinel-5P-Methane-Product-Readme-File, last access: 14 July 2020). The quality assurance (QA) value is provided as part of the ${\mathrm{CH}}_{\mathrm{4}}$ data product. $\text{QA}>\mathrm{0.5}$ is used as recommended by the PRF to filter out the S5P ${\mathrm{CH}}_{\mathrm{4}}$ data to be used for the validation studies. This selection filters out measurements performed with surface albedo $<\mathrm{0.02}$, solar zenith angle (SZA) $>\mathrm{70}$${}^{\circ }$, viewing zenith angle $>\mathrm{60}$${}^{\circ }$ and some other criteria as mentioned in the PRF.

Table 1

S5P operational ${\mathrm{CH}}_{\mathrm{4}}$ RPRO and OFFL data versions and CO RPRO and OFFL data versions used in the present work.

Product ID	Stream	Version	In operation from	In operation until
			(orbit no., date)	(orbit no., date)
L2_${\mathrm{CH}}_{\mathrm{4}}$	RPRO	01.02.02	0657, 28 November 2017	5346, 25 October 2018
		01.03.01	2818, 30 April 2018	5832, 28 November 2018
		01.03.02	2463, 4 April 2018	2477, 5 April 2018
	OFFL	01.02.02	5833, 28 November 2018	7424, 20 March 2019
		01.03.00	7425, 20 March 2019	7906, 23 April 2019
		01.03.01	7907, 23 April 2019	8814, 26 June 2019
		01.03.02	8812, 26 June 2019	current version
L2_CO	RPRO	01.02.02	5236, 17 October 2018	5346, 25 October 2018
		01.03.01	2818, 30 April 2018	5832, 28 November 2018
		01.03.02	2463, 4 April 2018	2477, 5 April 2018
	OFFL	01.02.00	5346, 25 October 2018	5832, 28 November 2018
		01.02.02	5833, 28 November 2018	7424, 20 March 2019
		01.03.00	7425, 20 March 2019	7906, 23 April 2019
		01.03.01	7907, 23 April 2019	8814, 26 June 2019
		01.03.02	8815, 26 June 2019	current version

The operational processing to retrieve the total column density of carbon monoxide (CO) simultaneously with interfering trace gases and effective cloud parameters (cloud height and optical thickness) is performed by the shortwave infrared carbon monoxide retrieval (SICOR) algorithm . The details describing the theoretical baseline of the algorithm, the input and ancillary data needed, example plots of averaging kernel and the output generated are described in detail in . The bias requirement for total column-averaged dry air mole fraction of carbon monoxide (XCO) is 15 % and the random error requirement is $<\mathrm{10}$ % (as reported in the official ESA document , Table 1, p. 14). The CO total column L2 data products are available as the OFFL and near-real-time (NRTI) timeliness data products. The version numbers and the respective dates are listed in Table  and further details on the relevant improvements are given in the PRF (https://sentinel.esa.int/documents/247904/3541451/ Sentinel-5P-Carbon-Monoxide-Level-2-Product-Readme-File, last access: 14 July 2020). The latest product versions of S5P CO data for the RPRO and OFFL data from the start of the mission to 30 September 2020 are used in this work. The NRTI data stream delivers the CO data product within 3 h after sensing, whereas the OFFL data are available a few days after sensing. Due to the different timeliness, the NRTI products are given in 5 min data granules, whereas the OFFL data products are given per satellite orbit. The consecutive data granules of the NRTI product show an overlap of about 12 scan lines. The NRTI processing chains employ the same algorithm as the OFFL since processor version 01.03.02 starting from orbit no. 8906 on 3 July 2019 (see Sect. 9.4 of , for validation results showing the equivalence of S5P NRTI and OFFL CO products). More details on the two processing streams of the two data sets are given in the ATBD . In this paper, we show the detailed validation results of the S5P OFFL CO product. Data with QA values $>\mathrm{0.5}$ are used as recommended by the PRF. This selection filters out measurements performed with SZA $\ge \mathrm{80}$${}^{\circ }$, sensor zenith angle $\ge \mathrm{80}$${}^{\circ }$, two most westward pixels due to unresolved calibration issues and some other criteria as mentioned in the PRF. Furthermore, we also separated retrievals performed for measurements under clear-sky (CLSKY; cloud optical thickness $<\mathrm{0.5}$ and cloud height $<\mathrm{500}$ m, over land) and cloudy conditions (CLOUD; cloud optical thickness $\ge \mathrm{0.5}$ and cloud height $<\mathrm{5000}$ m, over land and ocean) as suggested by . The clear-sky observations over the ocean have too-low signal intensities in the SWIR and therefore cannot be used for the data interpretation. Unlike the S5P ${\mathrm{CH}}_{\mathrm{4}}$ a priori profiles which are available in the L2 files, the S5P a priori profiles for CO were downloaded from ftp://ftp.sron.nl/pub/jochen/TROPOMI_apriori/ (last access: 1 December 2020). Among the known data quality issues of the CO product, single overpasses of S5P show stripes of erroneous CO values $<\mathrm{5}$ % in the flight direction, probably due to calibration issues of S5P. We did not do any correction of this stripe pattern as we show the operational validation of the CO product and also because a small number of pixels $<\mathrm{5}$ % are affected by it. The striping effect is analysed in detail by . The effect on the TCCON validation was small. The destriping approach suggested by this work is planned to be implemented by the operational TROPOMI CO processing in the near future. Furthermore, the effect of updating the spectral cross-sections in the TROPOMI CO processing for clear-sky and cloudy conditions was analysed with ground-based Fourier transform infrared (FTIR) measurements from 12 stations of the TCCON network .

In addition to the operational S5P ${\mathrm{CH}}_{\mathrm{4}}$ and CO products, a scientific version of the products (TROPOMI/WFMD) using the weighting function modified differential optical absorption spectroscopy (WFM-DOAS) has been developed by the University of Bremen (http://www.iup.uni-bremen.de/carbon_ghg/products/tropomi_wfmd/, last access: 1 June 2021). The details of the TROPOMI/WFMD ${\mathrm{CH}}_{\mathrm{4}}$ and CO products, their validation against reference ground-based measurements and operational TROPOMI products, as well as use cases of the products to address important scientific applications can be found in , .

2.2 Ground-based TCCON reference data set

The TCCON represents a network of ground-based Fourier transform spectrometers (FTSs), of the type Bruker IFS 125HR (some long-existing sites also use Bruker 120/5HR), that records direct solar absorption spectra in the NIR spectral range to retrieve accurate and precise column-averaged abundances of atmospheric constituents including ${\mathrm{CO}}_{\mathrm{2}}$, ${\mathrm{CH}}_{\mathrm{4}}$ and CO amongst other species . It is the current state-of-the-art validation system for total column measurements of important GHGs by remote sensing. TCCON data from several stations have been used in previous studies for the validation of trace gas data products from satellite platforms such as OCO-2 , GOSAT , S5P , MOPITT and SCIAMACHY . Data from all stations (23 in the Northern Hemisphere and 5 in the Southern Hemisphere) are used in this study and are listed in Table . The stations cover various atmospheric conditions (humid, dry, polluted, presence of aerosol), various surface conditions (range of albedo, flat terrain, high-altitude locations) and the latitudinal distribution from 80${}^{\circ }$ N to 45${}^{\circ }$ S. The stations at Nicosia and Xianghe are not yet officially part of TCCON but perform observations and data analysis fully compatible with TCCON guidelines. GGG2014 (the current standard TCCON retrieval code) ${\mathrm{XCH}}_{\mathrm{4}}$ systematic errors for TCCON are below 0.5 % for SZAs below 85${}^{\circ }$. The XCO errors are below 4 % and decrease with SZA . The uncertainty in the scaling slope for XCO is 6 % (2$\mathit{\sigma }$) . Previous studies have shown that the scaling factor of $\sim \mathrm{7}$ % used in GGG2014 to tie the TCCON XCO measurements to the World Meteorological Organization (WMO) in situ scale is large compared to the current uncertainty in spectroscopy . A scaling factor of 7 % provided the best scaling to the in situ data available when the scaling for GGG2014 was calculated. There is currently an ongoing effort within the TCCON community to determine whether the scaling factor is appropriate. These results are very important to decide on the choice of spectroscopic cross-sections that should be implemented for the future improved S5P CO product . In this work, we use the official TCCON XCO product as well as an XCO product without the application of the empirical scaling factor, herewith referred to as unscaled XCO. The unscaled XCO was calculated following Eq. (2) of , where the TCCON data without the scaling to the WMO scale were obtained from the site PIs. The validation work is done using the standard and rapid delivery of TCCON data from the whole network. The publicly available TCCON data can be accessed via https://tccondata.org/ (last access: 1 June 2021).

Table 2

List of FTIR stations that are associated with TCCON and contributed to the present work by providing public and rapid delivery data. The stations marked with an asterisk (${}^{*}$) are not yet associated with TCCON but perform observations and data analysis fully compatible with TCCON guidelines. Active dates correspond to the dates for which the measurements were provided from the satellite launch until the present work.

Station	Latitude	Longitude	Altitude	Active dates	Data reference
			(km a.s.l.)
Eureka	80.05${}^{\circ }$ N	86.42${}^{\circ }$ W	0.61	November 2017–Present
Ny-Ålesund	78.90${}^{\circ }$ N	11.90${}^{\circ }$ E	0.02	November 2017–Present
Sodankylä	67.37${}^{\circ }$ N	26.63${}^{\circ }$ E	0.19	November 2017–Present	,
East Trout Lake	54.35${}^{\circ }$ N	104.99${}^{\circ }$ W	0.50	November 2017–Present
Białystok	53.23${}^{\circ }$ N	23.05${}^{\circ }$ E	0.18	November 2017–October 2018
Bremen	53.10${}^{\circ }$ N	8.85${}^{\circ }$ E	0.03	November 2017–Present
Karlsruhe	49.10${}^{\circ }$ N	8.44${}^{\circ }$ E	0.12	November 2017–Present
Paris	48.85${}^{\circ }$ N	2.36${}^{\circ }$ E	0.06	November 2017–Present
Orléans	47.97${}^{\circ }$ N	2.11${}^{\circ }$ E	0.13	November 2017–Present
Garmisch	47.48${}^{\circ }$ N	11.06${}^{\circ }$ E	0.74	November 2017–Present
Zugspitze	47.42${}^{\circ }$ N	10.98${}^{\circ }$ E	2.96	November 2017–Present
Park Falls	45.95${}^{\circ }$ N	90.27${}^{\circ }$ W	0.44	November 2017–Present
Rikubetsu	43.46${}^{\circ }$ N	143.77${}^{\circ }$ E	0.38	November 2017–Present
Xianghe${}^{*}$	39.75${}^{\circ }$ N	116.96${}^{\circ }$ E	0.05	November 2017–Present
Lamont	36.60${}^{\circ }$ N	97.49${}^{\circ }$ W	0.32	November 2017–Present
Tsukuba	36.05${}^{\circ }$ N	140.12${}^{\circ }$ E	0.03	November 2017–Present
Nicosia${}^{*}$	35.14${}^{\circ }$ N	33.38${}^{\circ }$ E	0.19	August 2019–Present
Edwards	34.96${}^{\circ }$ N	117.88${}^{\circ }$ W	0.70	May 2018–Present
JPL	34.20${}^{\circ }$ N	118.18${}^{\circ }$ W	0.39	November 2017–May 2018
Pasadena	34.14${}^{\circ }$ N	118.13${}^{\circ }$ W	0.23	November 2017–Present
Saga	33.24${}^{\circ }$ N	130.29${}^{\circ }$ E	0.01	November 2017–Present
Izaña	28.30${}^{\circ }$ N	16.50${}^{\circ }$ W	2.37	November 2017–Present
Burgos	18.53${}^{\circ }$ N	120.65${}^{\circ }$ E	0.04	November 2017–Present	,
Ascension	7.92${}^{\circ }$ S	14.33${}^{\circ }$ W	0.01	November 2017–Present
Darwin	12.46${}^{\circ }$ S	130.93${}^{\circ }$ E	0.04	November 2017–Present
Réunion	20.90${}^{\circ }$ S	55.49${}^{\circ }$ E	0.09	November 2017–Present
Wollongong	34.41${}^{\circ }$ S	150.88${}^{\circ }$ E	0.03	November 2017–Present
Lauder	45.04${}^{\circ }$ S	169.68${}^{\circ }$ E	0.37	November 2017–Present	,

2.3 Ground-based NDACC-IRWG reference data set

The IRWG of the NDACC represents a network of high-resolution Fourier transform spectrometers that records solar absorption spectra in the mid-infrared (MIR) spectral range. It is a multi-national collection of over 20 stations distributed from pole to pole (Eureka at 80${}^{\circ }$ N to Arrival Heights at 77.8${}^{\circ }$ S). The solar absorption spectra are used to retrieve the atmospheric concentrations of a number of gaseous atmospheric components, including ozone (${\mathrm{O}}_{\mathrm{3}}$), nitric acid (${\mathrm{HNO}}_{\mathrm{3}}$), hydrogen chloride (HCl), hydrogen fluoride (HF), carbon monoxide (CO), nitrous oxide (${\mathrm{N}}_{\mathrm{2}}\mathrm{O}$), methane (${\mathrm{CH}}_{\mathrm{4}}$), hydrogen cyanide ($\mathrm{HCN}$), ethane (${\mathrm{C}}_{\mathrm{2}}{\mathrm{H}}_{\mathrm{6}}$) and chlorine nitrate (${\mathrm{ClONO}}_{\mathrm{2}}$) (https://www2.acom.ucar.edu/irwg, last access: 1 June 2021). NDACC ${\mathrm{CH}}_{\mathrm{4}}$ and CO data from several stations have been used in previous studies for satellites validation . In this study, data from all stations (19 in the Northern Hemisphere and 5 in the Southern Hemisphere) are used and are listed in Table . Several of the stations are located in high-latitude regions and many stations are located at high altitudes to reduce the interference of water vapour in the measurements. Some of these stations (e.g. Karlsruhe, Garmisch, Sodankylä, Porto Velho) are not officially part of NDACC but performs observations and data analysis fully compatible with NDACC guidelines. The co-located NDACC and TCCON stations often share one FTIR instrument, applying the respective detector and filter settings. The spectra are analysed either with the SFIT4 algorithm, an evolution of SFIT2 or the PROFFIT9 algorithm to retrieve vertical profiles of ${\mathrm{CH}}_{\mathrm{4}}$ and CO. The retrieval allows the derivation of a tropospheric and a stratospheric column of the target gases . The NDACC CO column values can be used directly to validate the S5P CO column values. However, for the S5P ${\mathrm{XCH}}_{\mathrm{4}}$ validation, the NDACC ${\mathrm{XCH}}_{\mathrm{4}}$ values need to be calculated. Due to the NDACC measurements being performed in the MIR range, the oxygen (${\mathrm{O}}_{\mathrm{2}}$) total column is not available from the spectrum for calculating the column-averaged dry air mole fractions of the target gas (Xgas), similar to what is done for TCCON (see Eq. A9 of ). Therefore, the total column of dry air is computed as described in Eq. (1) of . The surface pressure ($P_{\mathrm{s}}$) is recorded at the local weather station of the FTS stations and ${\mathrm{H}}_{\mathrm{2}}\mathrm{O}$ total column (${\mathrm{TC}}_{{\mathrm{H}}_{\mathrm{2}}\mathrm{O}}$) is derived from the National Centers for Environmental Prediction (NCEP) reanalysis data set. In the event that there is no surface pressure available, we extrapolate the pressure grid to the surface. The ${\mathrm{XCH}}_{\mathrm{4}}$ calculated values for NDACC measurements are then used for the validation of the S5P ${\mathrm{XCH}}_{\mathrm{4}}$ data. Unlike TCCON data, where a species-specific scaling factor is applied to tie the measurements to the WMO in situ scale, the NDACC data do not apply any scaling of the retrieved results. The typical accuracy and precision of the NDACC ${\mathrm{CH}}_{\mathrm{4}}$ data are about 3 % and 1.5 %, respectively. The typical accuracy and precision of the NDACC CO data are about 3 % and 1 %, respectively. High systematic uncertainty is mainly due to the too-conservative spectroscopic uncertainty component. Both the consolidated data available via http://www.ndaccdemo.org/ (last access: 1 June 2021) and the rapid delivery data supported by the CAMS27 project (https://cams27.aeronomie.be/, last access: 1 June 2021) have been used in this study.

Table 3

List of FTIR stations that are associated with NDACC-IRWG and contributed to the present work by providing public and rapid delivery data. The stations marked with an asterisk (${}^{*}$) are not yet associated with NDACC but perform observations and data analysis fully compatible with NDACC guidelines. The location of the stations and the teams involved are indicated for the respective stations.

Station	Latitude	Longitude	Altitude	Active dates	Teams
			(km a.s.l.)
Eureka	80.05${}^{\circ }$ N	86.42${}^{\circ }$ W	0.61	November 2017–Present	U. of Toronto;
Ny-Ålesund	78.90${}^{\circ }$ N	11.90${}^{\circ }$ E	0.02	November 2017–Present	U. of Bremen
Thule	76.52${}^{\circ }$ N	68.77${}^{\circ }$ W	0.22	November 2017–Present	NCAR;
Kiruna	67.84${}^{\circ }$ N	20.40${}^{\circ }$ E	0.42	November 2017–Present	KIT-ASF; IRF Kiruna
Sodankylä${}^{*}$	67.37${}^{\circ }$ N	26.63${}^{\circ }$ E	0.19	November 2017–Present	FMI; BIRA-IASB
Harestua	60.20${}^{\circ }$ N	10.80${}^{\circ }$ E	0.60	November 2017–Present	Chalmers
St. Petersburg	59.88${}^{\circ }$ N	29.83${}^{\circ }$ E	0.02	November 2017–Present	SPbU;
Bremen	53.10${}^{\circ }$ N	8.85${}^{\circ }$ E	0.03	November 2017–Present	U. of Bremen
Karlsruhe${}^{*}$	49.10${}^{\circ }$ N	8.44${}^{\circ }$ E	0.12	November 2017–Present	KIT-ASF
Garmisch${}^{*}$	47.48${}^{\circ }$ N	11.06${}^{\circ }$ E	0.74	November 2017–Present	KIT-IFU
Zugspitze	47.42${}^{\circ }$ N	10.98${}^{\circ }$ E	2.96	November 2017–Present	KIT-IFU
Jungfraujoch	46.55${}^{\circ }$ N	7.98${}^{\circ }$ E	3.58	November 2017–Present	U. of Liège
Toronto	43.60${}^{\circ }$ N	79.36${}^{\circ }$ W	0.17	November 2017–Present	U. of Toronto;
Rikubetsu	43.46${}^{\circ }$ N	143.77${}^{\circ }$ E	0.38	November 2017–Present	Nagoya U.; NIES
Boulder	40.04${}^{\circ }$ N	105.24${}^{\circ }$ W	1.61	November 2017–Present	NCAR;
Izaña	28.30${}^{\circ }$ N	16.50${}^{\circ }$ W	2.37	November 2017–Present	AEMET; KIT-ASF
Mauna Loa	19.54${}^{\circ }$ N	155.57${}^{\circ }$ W	3.40	November 2017–Present	NCAR
Altzomoni	19.12${}^{\circ }$ N	98.66${}^{\circ }$ W	3.98	November 2017–Present	UNAM
Paramaribo	5.81${}^{\circ }$ N	55.21${}^{\circ }$ W	0.03	November 2017–Present	U. of Bremen
Porto Velho${}^{*}$	8.77${}^{\circ }$ S	296.13${}^{\circ }$ E	0.09	November 2017–Present	BIRA-IASB
La Réunion–Maïdo	21.08${}^{\circ }$ S	55.38${}^{\circ }$ E	2.16	November 2017–Present	BIRA-IASB
Wollongong	34.41${}^{\circ }$ S	150.88${}^{\circ }$ E	0.03	November 2017–Present	U. of Wollongong
Lauder	45.04${}^{\circ }$ S	169.68${}^{\circ }$ E	0.37	November 2017–Present	NIWA
Arrival Heights	77.82${}^{\circ }$ S	166.65${}^{\circ }$ E	0.20	November 2017–Present	NIWA

3 Validation methodology

S5P provides the total column density of CO, which can be directly validated against the NDACC CO total column density product. However, we need to calculate the corresponding XCO values in order to compare to the TCCON XCO products. The S5P XCO is calculated by taking the ratio of the total column of CO (${\mathrm{TC}}_{\mathrm{CO}}$) divided by the total column of the dry air (${\mathrm{TC}}_{\mathrm{dry},\mathrm{air}}$) (following Eq. 1 in ).

1$$\begin{array}{rl}& \mathrm{XCO}={\displaystyle \frac{{\mathrm{TC}}_{\mathrm{CO}}}{{\mathrm{TC}}_{\mathrm{dry},\mathrm{air}}}}\\ & ={\displaystyle \frac{{\mathrm{TC}}_{\mathrm{CO}}}{P_{\mathrm{s}}/(g\times m_{\mathrm{dry},\mathrm{air}})-{\mathrm{TC}}_{{\mathrm{H}}_{\mathrm{2}}\mathrm{O}}\times (m_{{\mathrm{H}}_{\mathrm{2}}\mathrm{O}}/m_{\mathrm{dry},\mathrm{air}})}},\end{array}$$ where $P_{\mathrm{s}}$ is the surface pressure, ${\mathrm{TC}}_{{\mathrm{H}}_{\mathrm{2}}\mathrm{O}}$ is the total column of ${\mathrm{H}}_{\mathrm{2}}\mathrm{O}$, $g$ is the column-averaged acceleration due to gravity, $m_{\mathrm{dry},\mathrm{air}}$ and $m_{{\mathrm{H}}_{\mathrm{2}}\mathrm{O}}$ are the molecular masses of dry air and ${\mathrm{H}}_{\mathrm{2}}\mathrm{O}$, respectively. $P_{\mathrm{s}}$ and ${\mathrm{TC}}_{{\mathrm{H}}_{\mathrm{2}}\mathrm{O}}$ are taken from the S5P files.

The validation of the S5P methane and carbon monoxide data is performed based on the reference data sets from the ground-based TCCON and NDACC networks. We present the results for both of the networks with different co-location criteria applied to the data sets. The differences in the validation results are also based on whether or not a common prior has been used for the satellite and ground-based FTIR data sets; details are discussed in Appendix .

S5P provides daily global coverage with a huge data set having a wide swath at a high spatial resolution for every overpass. Therefore, the selection of good co-location criteria is a crucial task in finding the best strict criteria while ensuring sufficient co-located data for a statistically significant validation. We tried several co-location criteria to test the sensitivity of the method in relation to the choice of the parameter (e.g. time, distance, line of sight). The best co-location criteria will be such that the bias is robust and not sensitive to small changes in the co-location criteria. In the next sections, the results of the application of these criteria are shown for the case with the reduction of uncertainty due to smoothing and in relation to direct comparisons.

4 Validation of S5P methane products

The validation of the S5P methane products with the ground-based FTIR data is discussed in this section. The TCCON stations cover a wide range of varying ground conditions and topography. The high-latitude stations (e.g. Eureka, Ny-Ålesund, Sodankylä, East Trout Lake) challenge the satellite algorithm for measurements at very high SZAs, high air masses and scenes with snow or ice coverage. The Edward site is adjacent to a very bright playa. The Park Falls and Lamont stations have relatively uniform surface properties but the ground cover can vary seasonally. The TCCON stations at Izaña and Zugspitze are located at high altitude. Izaña along with Ascension, Réunion and Burgos are located on small islands, remote from large landmasses but with significant topography. Several stations are located near or in urban regions with a large population (e.g. Pasadena, Paris, Tsukuba). The Darwin site has the ocean to the north. The Wollongong site has the ocean on one side and a sharp escarpment on the other. The Lauder site is surrounded by hills. Nicosia is a new site, operational since August 2019, using a FTIR which was moved from the Białystok TCCON station after its closure in October 2018. The TCCON observatory at Nicosia has been calibrated by vertical aircraft profiling at its former location in Białystok but not at its current location. The Xianghe site in China, located in a heavily populated region, is a new site, which is operated following the recommendations of TCCON but is not yet affiliated as a TCCON station. The NDACC stations are often located at high altitude (e.g. Altzomoni, Jungfraujoch, Mauna Loa, Zugspitze, Izaña, Maïdo, Boulder). Several of the NDACC stations are located at high latitudes (e.g. Eureka, Ny-Ålesund, Thule, Kiruna, Sodankylä). Several of the NDACC stations are located near or in urban areas (e.g. Bremen, St. Petersburg, Toronto, Boulder, Altzomoni – close to Mexico City). The NDACC station at Arrival Heights is the only site on the Antarctic continent. TCCON provides dry-air column-averaged mole fractions of methane similar to the S5P product, whereas NDACC provides concentration profiles of methane with sensitivities up to about 20 km. As the characteristics of the two reference ground-based data sets are different, two slightly different comparison methods were applied for the validation study which are discussed in this section.

4.1 Validation of S5P bias-corrected vs. standard methane data using TCCON and NDACC data sets

The validation results of the S5P bias-corrected and standard methane products with reference TCCON and NDACC data are discussed in this section. The S5P observations co-located with the ground-based reference measurements are found by selecting all filtered S5P pixels within a radius of 100 km around each site and with a maximal time difference of 1 h for TCCON and 3 h for NDACC observations. The 1 h time difference for TCCON can be justified by noting that TCCON instruments acquire only one type of spectra and from each good spectrum methane is retrieved, while NDACC instruments are required to measure different types of spectra with different optical filter configurations, making the number of methane observations more sparse. An effective location of the FTIR measurement on the line of sight (i.e. at a 5 km altitude) is used to do the co-location. The co-located pixels can therefore differ from measurement to measurement. For each of the ground-based measurements which are co-located with the S5P measurements, an average of all S5P pixels is done. Co-located pairs are created between ground-based and averaged S5P only if a minimum of five pixels is found in applying the coincidence criteria. In the comparison, the a priori profiles in the TCCON and NDACC retrievals have been substituted with the S5P methane a priori following Eq. (). The a priori alignment, i.e. aligning the a priori profile to a common one, is done to compensate/correct its contribution to the smoothing equation . The TCCON results with the S5P prior substituted are then compared directly to the S5P ${\mathrm{XCH}}_{\mathrm{4}}$ data. However, the NDACC ${\mathrm{CH}}_{\mathrm{4}}$ concentration profile with the S5P prior substituted is additionally smoothed with the S5P column-averaging kernel following Eq. (). The NDACC ${\mathrm{XCH}}_{\mathrm{4}}$ is derived as discussed in Sect.  and then compared to the S5P ${\mathrm{XCH}}_{\mathrm{4}}$ data. Furthermore, each validation run also includes the adaptation of the S5P columns to the altitude of the ground-based FTIR instruments for cases where satellite averaging kernel is not applied or when column boundaries may differ (see Appendix  for details).

Table  provides the validation results for the S5P bias-corrected and standard ${\mathrm{XCH}}_{\mathrm{4}}$ data with the a priori aligned TCCON data at each TCCON station. The systematic difference (the mean of all relative differences) between the S5P and TCCON data is on average $-\mathrm{0.68}\pm \mathrm{0.74}$ % (S5P standard ${\mathrm{XCH}}_{\mathrm{4}}$ product) and $-\mathrm{0.26}\pm \mathrm{0.56}$ % (S5P bias-corrected ${\mathrm{XCH}}_{\mathrm{4}}$ product). Only at a few TCCON stations (Sodankylä, East Trout Lake, Park Falls and Wollongong) is the bias slightly higher than 1.5 % for the S5P standard ${\mathrm{XCH}}_{\mathrm{4}}$ product. The albedo dependence correction of the S5P ${\mathrm{XCH}}_{\mathrm{4}}$ product shows a reduced bias relative to the TCCON data and are within the 1.5 %. The standard deviation of the relative bias, which is a measure of the random error, is well below 1 % for both standard ($\mathrm{0.59}\pm \mathrm{0.17}$ %) and bias-corrected ($\mathrm{0.57}\pm \mathrm{0.18}$ %) S5P ${\mathrm{XCH}}_{\mathrm{4}}$ products.

Table 4

S5P ${\mathrm{XCH}}_{\mathrm{4}}$ validation results against TCCON ${\mathrm{XCH}}_{\mathrm{4}}$ data at 25 stations for the period between November 2017 and September 2020. Spatial co-location with radius of 100 km or cone with 1${}^{\circ }$ opening angle along the FTIR line of sight and time co-location of $\pm \mathrm{1}$ h around the satellite overpass were used. TCCON station (column 1) are sorted according to the decreasing latitude (column 2). The column with title “No.” represents the number of co-located measurements, column title “SD” represents the standard deviation of the time series of the ground-based data relative to the standard deviation of the time series of the S5P data, column title “Corr” represents the correlation coefficient between the S5P and the reference ground-based data, column title “Rel diff bias” represents the relative difference ((SAT – GB)/GB) bias in percent, and column title “Rel diff SD” represents the standard deviation of the relative bias in percent.

Site	Lat	S5P bc ${\mathrm{XCH}}_{\mathrm{4}}$ smooth 100 km 1 h					S5P ${\mathrm{XCH}}_{\mathrm{4}}$ smooth 100 km 1 h				S5P bc ${\mathrm{XCH}}_{\mathrm{4}}$ 100 km 1 h				S5P bc ${\mathrm{XCH}}_{\mathrm{4}}$ smooth cone 100 km 1 h
		No.	SD	Corr	Rel diff	Rel diff	SD	Corr	Rel diff	Rel diff	SD	Corr	Rel diff	Rel diff	No.	SD	Corr	Rel diff	Rel diff
					bias (%)	SD (%)			bias (%)	SD (%)			bias (%)	SD (%)				bias (%)	SD (%)
Eureka	80	1384	1	0.62	0.8	0.77	0.8	0.79	0.22	0.67	1	0.66	0.87	0.72	648	0.9	0.74	0.83	0.66
Ny-Ålesund	78.9	113	1	0.97	0.63	0.13	1	0.95	$-\mathrm{0.23}$	0.17	0.9	0.95	0.71	0.17	11	2.8	$-\mathrm{0.56}$	0.89	0.09
Sodankylä	67.4	5915	0.9	0.37	$-\mathrm{0.84}$	0.99	0.9	0.36	$-\mathrm{1.87}$	1.01	0.9	0.4	$-\mathrm{0.7}$	0.96	4681	0.9	0.42	$-\mathrm{0.92}$	0.93
East Trout Lake	54.3	12 302	0.8	0.64	$-\mathrm{0.9}$	0.93	0.8	0.62	$-\mathrm{1.85}$	0.95	0.9	0.67	$-\mathrm{0.72}$	0.91	10 358	0.9	0.65	$-\mathrm{0.98}$	0.88
Białystok	53.2	1821	0.7	0.46	$-\mathrm{0.46}$	0.56	0.8	0.37	$-\mathrm{0.99}$	0.57	0.8	0.49	$-\mathrm{0.21}$	0.56	1623	0.8	0.41	$-\mathrm{0.35}$	0.54
Bremen	53.1	1150	0.9	0.81	$-\mathrm{0.15}$	0.49	1	0.79	$-\mathrm{0.68}$	0.49	1	0.82	0.03	0.5	1081	0.9	0.8	$-\mathrm{0.17}$	0.5
Karlsruhe	49.1	4592	0.8	0.79	$-\mathrm{0.36}$	0.48	0.8	0.82	$-\mathrm{1.04}$	0.49	0.8	0.79	$-\mathrm{0.13}$	0.48	4114	0.8	0.81	$-\mathrm{0.35}$	0.45
Paris	48.8	4999	1	0.67	$-\mathrm{0.03}$	0.49	0.8	0.55	$-\mathrm{0.67}$	0.63	1	0.69	0.18	0.48	4370	0.9	0.67	0.01	0.53
Orléans	48	5984	0.8	0.79	$-\mathrm{0.34}$	0.52	0.6	0.79	$-\mathrm{0.94}$	0.65	0.8	0.79	$-\mathrm{0.15}$	0.52	5712	0.8	0.79	$-\mathrm{0.44}$	0.52
Garmisch	47.5	3149	0.9	0.77	0.19	0.49	0.8	0.77	$-\mathrm{0.61}$	0.51	0.9	0.79	0.41	0.48	1520	0.9	0.83	0.1	0.43
Zugspitze	47.4	578	1.3	0.59	0.03	0.73	1.4	0.62	$-\mathrm{0.78}$	0.69	1.4	0.61	0.23	0.75	290	1.5	0.48	0.09	0.69
Park Falls	45.9	7201	0.8	0.7	$-\mathrm{1.46}$	0.75	0.8	0.67	$-\mathrm{2.35}$	0.77	0.8	0.71	$-\mathrm{1.27}$	0.74	6671	0.8	0.7	$-\mathrm{1.43}$	0.77
Rikubetsu	43.5	2466	0.8	0.83	$-\mathrm{0.1}$	0.59	0.9	0.8	$-\mathrm{0.81}$	0.62	0.9	0.85	0.05	0.55	2206	0.8	0.83	$-\mathrm{0.1}$	0.6
Xianghe	39.8	4395	1	0.87	$-\mathrm{0.45}$	0.61	1.2	0.81	$-\mathrm{0.52}$	0.68	1	0.87	$-\mathrm{0.23}$	0.61	3706	0.9	0.88	$-\mathrm{0.47}$	0.6
Lamont	36.6	9608	0.9	0.84	$-\mathrm{0.36}$	0.53	0.9	0.84	$-\mathrm{0.58}$	0.53	0.9	0.84	$-\mathrm{0.22}$	0.52	8053	0.9	0.85	$-\mathrm{0.25}$	0.49
Tsukuba	36	4655	0.9	0.84	$-\mathrm{0.02}$	0.43	1	0.84	$-\mathrm{0.46}$	0.43	1	0.86	0.1	0.42	4494	0.9	0.86	0.03	0.43
Nicosia	35.1	3414	0.9	0.85	0.62	0.41	0.8	0.83	0.89	0.52	1	0.85	0.65	0.41	3325	0.9	0.85	0.6	0.41
Edwards	35	24 350	0.9	0.85	$-\mathrm{0.07}$	0.45	1	0.83	0.82	0.47	0.9	0.85	$-\mathrm{0.01}$	0.44	22 987	0.9	0.86	$-\mathrm{0.09}$	0.44
JPL	34.2	3233	1.1	0.33	$-\mathrm{1.34}$	0.63	1	0.4	$-\mathrm{0.54}$	0.65	1.1	0.34	$-\mathrm{1.2}$	0.62	1954	0.9	0.27	$-\mathrm{1.14}$	0.67
Pasadena	34.1	20 646	0.9	0.79	$-\mathrm{0.73}$	0.57	0.9	0.74	$-\mathrm{0.03}$	0.61	0.9	0.81	$-\mathrm{0.67}$	0.55	15 868	0.9	0.85	$-\mathrm{0.55}$	0.52
Saga	33.2	2539	0.9	0.79	0.09	0.53	0.9	0.79	$-\mathrm{0.6}$	0.51	0.9	0.81	0.21	0.5	1943	0.9	0.83	0.27	0.49
Burgos	18.5	417	1	0.76	0.23	0.36	0.9	0.77	$-\mathrm{0.75}$	0.37	0.9	0.77	0.28	0.34	269	0.8	0.76	0.26	0.33
Darwin	$-\mathrm{12.5}$	3598	0.5	0.23	$-\mathrm{0.32}$	0.71	0.5	0.3	$-\mathrm{0.53}$	0.71	0.5	0.27	$-\mathrm{0.24}$	0.69	3267	0.5	0.24	$-\mathrm{0.33}$	0.7
Wollongong	$-\mathrm{34.4}$	4765	0.9	0.55	$-\mathrm{0.88}$	0.69	0.8	0.56	$-\mathrm{1.57}$	0.69	0.8	0.54	$-\mathrm{0.81}$	0.69	4677	0.9	0.56	$-\mathrm{0.86}$	0.67
Lauder	$-\mathrm{45}$	6708	1	0.8	$-\mathrm{0.18}$	0.5	0.9	0.84	$-\mathrm{0.6}$	0.47	0.9	0.8	$-\mathrm{0.12}$	0.51	1771	0.9	0.92	$-\mathrm{0.48}$	0.37
Mean of all stations			0.9	0.7	$-\mathrm{0.26}$	0.57	0.9	0.7	$-\mathrm{0.68}$	0.59	0.9	0.71	$-\mathrm{0.12}$	0.57		1	0.65	$-\mathrm{0.23}$	0.55
SD of all stations			0.2	0.19	0.56	0.18	0.2	0.18	0.74	0.17	0.2	0.18	0.55	0.17		0.4	0.32	0.58	0.18

Figure  shows the bar plots for the S5P ${\mathrm{XCH}}_{\mathrm{4}}$ mean relative bias with respect to the TCCON ${\mathrm{XCH}}_{\mathrm{4}}$ data at all stations (left panel) and the standard deviation of the relative bias (right panel). The comparisons relative to the S5P bias-corrected ${\mathrm{XCH}}_{\mathrm{4}}$ product (labelled – bcsm100k1h) are the blue bars and those for the standard ${\mathrm{XCH}}_{\mathrm{4}}$ product (labelled – stdsm100k1h) are the magenta bars. The bias correction of the S5P ${\mathrm{XCH}}_{\mathrm{4}}$ product being a function of the surface albedo acts differently at the different TCCON stations. Figure  shows the relative difference of the bias for the standard (top panel) and bias-corrected (bottom panel) S5P ${\mathrm{XCH}}_{\mathrm{4}}$ products as a function of the retrieved S5P SWIR surface albedo at the TCCON stations. The bias correction of the S5P ${\mathrm{XCH}}_{\mathrm{4}}$ product brings the high negative relative differences closer to zero for low surface albedo conditions and the high positive relative differences closer to zero for high surface albedo conditions. The low surface albedo conditions also show a high scatter in the relative difference plots. The latter is mainly because the scenes with low surface albedo are challenging for satellite-retrieved products due to large measurement noise. The difference of the mean relative bias between the S5P bias-corrected and the standard ${\mathrm{XCH}}_{\mathrm{4}}$ product for each TCCON station is shown as a magenta bar in the middle panel plot (labelled – diff_bcvsstd) of Fig. . It shows the overall direction of change is positive for most stations (low surface albedo conditions) and negative for few stations like Edwards, JPL and Pasadena (high surface albedo conditions). The standard deviations of the relative bias for the S5P standard and bias-corrected ${\mathrm{XCH}}_{\mathrm{4}}$ products are comparable. Scenes with low and high albedos pose specific challenges for S5P ${\mathrm{CH}}_{\mathrm{4}}$ retrieval. Validation of S5P ${\mathrm{CH}}_{\mathrm{4}}$ data at additional sites with different conditions (e.g. high surface albedo, high humidity, regions not covered by TCCON and NDACC) using portable FTIR spectrometers will give further insight into the S5P ${\mathrm{CH}}_{\mathrm{4}}$ product quality.

Figure 1

S5P ${\mathrm{XCH}}_{\mathrm{4}}$ validation results against TCCON ${\mathrm{XCH}}_{\mathrm{4}}$ data at 25 stations within the period between November 2017 and September 2020. (a) Bar chart of mean relative bias ((SAT – GB)/GB) in percent; (c) standard deviation of the relative bias in percent; (b) difference of the mean relative bias for validation cases (stdsm100k1h, bc100k1h, bcsm100k1hcone) in percent against the reference case (bcsm100k1h) in percent. Spatial co-location with radius of 100 km or cone with 1${}^{\circ }$ opening angle along the FTIR line of sight and time co-location of $\pm \mathrm{1}$ h around the satellite overpass were used. The stations are sorted with decreasing latitude.

[Figure omitted. See PDF]

Figure 2

Relative biases between co-located S5P (standard ${\mathrm{XCH}}_{\mathrm{4}}$ product – a; bias-corrected ${\mathrm{XCH}}_{\mathrm{4}}$ product – b) and TCCON ${\mathrm{XCH}}_{\mathrm{4}}$ data with a priori alignment are plotted as a function of the surface albedo retrieved by S5P at 25 TCCON stations within the period between November 2017 and September 2020. Spatial co-location with radius of 100 km and time of $\pm \mathrm{1}$ h around the satellite overpass were used.

[Figure omitted. See PDF]

The relative biases are plotted as mosaic plots and shown in Fig. , where the top panel shows the bias for S5P standard ${\mathrm{XCH}}_{\mathrm{4}}$ product, while the bottom panel shows the bias for S5P bias-corrected ${\mathrm{XCH}}_{\mathrm{4}}$ product relative to TCCON. Each bar in the mosaic plots represents the weekly averages of the relative bias values. The high-latitude stations show a high positive bias during the spring, which is then reduced and even switched sign to show negative bias during the autumn. , while analysing the improvements of their scientific S5P ${\mathrm{XCH}}_{\mathrm{4}}$ product, found similar seasonality in the bias at the high-latitude sites of Sodankylä and East Trout Lake and indicated correlations of high bias during spring time with the presence of snow (low surface albedo in the SWIR but high surface albedo in the NIR). In addition, the high-latitude sites are also influenced by the polar vortex, which is difficult to be represented by the a priori profile. The difference of the a priori profile from the true atmospheric profile will also add to the bias. This will be discussed further in the next section. Since measurements rely on direct line of sight of the Sun, data are not available during the winter months for high-latitude stations. The time series of the S5P bias-corrected ${\mathrm{XCH}}_{\mathrm{4}}$ product and TCCON data for each site are shown in Figs.  and . The ground-based TCCON ${\mathrm{XCH}}_{\mathrm{4}}$ data are represented in grey and the S5P data during that period are shown in light blue. The S5P data co-located with TCCON data are shown in blue and the co-located TCCON data with a priori alignment are shown in black. The amplitude of the ${\mathrm{CH}}_{\mathrm{4}}$ seasonal cycle is different at the different sites. This is related to the variability of the ${\mathrm{CH}}_{\mathrm{4}}$ concentrations in the atmosphere. The ${\mathrm{CH}}_{\mathrm{4}}$ concentration profile decreases rapidly with increasing altitude above the tropopause height. The concentration of ${\mathrm{CH}}_{\mathrm{4}}$ in the stratosphere, along with the troposphere, plays a key role in determining the total column of ${\mathrm{CH}}_{\mathrm{4}}$ at the given location. The ${\mathrm{CH}}_{\mathrm{4}}$ seasonal cycle in the troposphere is driven by the seasonality of both ${\mathrm{CH}}_{\mathrm{4}}$ sources and its sinks (mainly due to the reaction with OH), while the ${\mathrm{CH}}_{\mathrm{4}}$ seasonal cycle in the stratosphere is dominated by the vertical transport . The time series of the relative bias plots shown in Figs.  and  indicate a seasonal cycle, which is clearly seen for stations with a high density of reference data with a low scatter, e.g. Park Falls, East Trout Lake, Lamont, Edwards and Pasadena.

Figure 3

Mosaic plots showing relative biases between co-located S5P (standard ${\mathrm{XCH}}_{\mathrm{4}}$ product – a; bias-corrected ${\mathrm{XCH}}_{\mathrm{4}}$ product – b) and TCCON ${\mathrm{XCH}}_{\mathrm{4}}$ data with a priori alignment at 25 TCCON stations within the period between November 2017 and September 2020. Spatial co-location with radius of 100 km and time of $\pm \mathrm{1}$ h around the satellite overpass was used. The time resolution of the data shown here is weekly. The stations are sorted with decreasing latitude.

[Figure omitted. See PDF]

Figure 4

${\mathrm{XCH}}_{\mathrm{4}}$ time series for all TCCON data (grey), S5P bias-corrected data (light blue), S5P data co-located with TCCON data (blue) and co-located TCCON data with a priori alignment (black) at each site ordered with decreasing latitude. Spatial co-location with radius of 100 km and time of $\pm \mathrm{1}$ h around the satellite overpass was used.

[Figure omitted. See PDF]

Figure 5

Same as Fig. .

[Figure omitted. See PDF]

Figure 6

Relative difference ((satellite $-$ ground-based)/ground-based]) of ${\mathrm{XCH}}_{\mathrm{4}}$ time series for all co-located S5P bias-corrected data and TCCON data with a priori alignment as the reference data at each site ordered with decreasing latitude as in Fig. . Spatial co-location with radius of 100 km and time of $\pm \mathrm{1}$ h around the satellite overpass was used.

[Figure omitted. See PDF]

Figure 7

Same as Fig. .

[Figure omitted. See PDF]

Taylor diagrams for the S5P bias-corrected ${\mathrm{XCH}}_{\mathrm{4}}$ and TCCON ${\mathrm{XCH}}_{\mathrm{4}}$ data with a priori alignment are shown in Fig. . The correlation, represented by the angular coordinate, is above 0.6 for most stations (see Table  for exact values), and the distance to the origin of the ground-based dot relative to the satellite dot (ratio of SD of ground-based data to the SD of S5P) is below 1 for most stations, implying that the satellite data are more variable than the ground-based data. The correlation is mostly dominated by the seasonal cycle, and low correlations are seen for high-latitude sites where a bias jump is seen between spring and summer periods. Outliers such as Ny-Ålesund, JPL and Białystok are due to the limited data sets available for the comparison. The Ny-Ålesund station is located on the shore of a bay on the west coast of the island of Spitsbergen in Svalbard, Norway. As a result, only a few valid S5P ${\mathrm{XCH}}_{\mathrm{4}}$ pixels are found around the station, resulting in limited co-located data available for comparison. The TCCON instruments from the JPL and Białystok stations were moved to Edwards and Nicosia, respectively, thus resulting in limited data sets available from these sites. The very low correlation for Darwin and Wollongong is due to the low satellite values for some days (see Fig. ), and for high-latitude sites it is due to the jump in the bias between the spring and later months (see Fig. ). The altitude correction of the pixels works well, as can be seen by the relatively good correlation for Zugspitze; however, the scatter in the data is high.

Figure 8

Taylor diagram for daily mean differences between S5P bias-corrected ${\mathrm{XCH}}_{\mathrm{4}}$ and TCCON ${\mathrm{XCH}}_{\mathrm{4}}$ data with a priori alignment at the 25 TCCON stations within the period between November 2017 and September 2020. Spatial co-location with radius of 100 km and time of $\pm \mathrm{1}$ h around the satellite overpass was used. The stations are sorted with decreasing latitude.

[Figure omitted. See PDF]

Table  provides the validation results for the S5P bias-corrected and standard ${\mathrm{XCH}}_{\mathrm{4}}$ data with the smoothed NDACC data at each NDACC station. The systematic difference (the mean of all relative differences) between the S5P and NDACC data is on average $-\mathrm{0.11}\pm \mathrm{1.19}$ % (S5P standard ${\mathrm{XCH}}_{\mathrm{4}}$ product) and $\mathrm{0.57}\pm \mathrm{0.83}$ % (S5P bias-corrected ${\mathrm{XCH}}_{\mathrm{4}}$ product). The mean of all stations is calculated by excluding outliers, which are stations with a low number of co-locations (Ny-Ålesund, Rikubetsu), high scatter in the ground-based data (Toronto) and unexpected high bias (Thule, Arrival Heights). Thule is located on the western coastline of Greenland. The valid S5P XCH4 pixels within the co-location radius around Thule show several pixels with high ${\mathrm{XCH}}_{\mathrm{4}}$ values. These high ${\mathrm{XCH}}_{\mathrm{4}}$ values are in general found along the coastline and regions with altitude variability. Although a filter for the variability of the terrain roughness is applied in the QA filter options, these high values along the coastline of Greenland need detailed investigation and possible optimisation of the filter settings to remove the unexpected high values. We also observe valid pixels with unexpected high ${\mathrm{XCH}}_{\mathrm{4}}$ around the coastline and terrains with altitude variability in Antarctica. This is also the reason for the high bias observed at the Arrival Heights station located along the west side of the Hut Point Peninsula on Ross Island, Antarctica. The bias at Altzomoni is relatively high (2.44 % for S5P ${\mathrm{XCH}}_{\mathrm{4}}$ bias-corrected product), while the random error is comparable to other sites and within 1 %. found large variability in ${\mathrm{CH}}_{\mathrm{4}}$ total columns measured at the Mexico City basin, pointing to significant local emissions affecting the natural background levels. A co-location mismatch would contribute partly to the bias seen with respect to S5P (see Sect.  on how using an advanced co-location criterion reduces the bias at Altzomoni). The mean standard deviation of the relative bias, which is a measure of the random error, is about 1 % for both the S5P standard ($\mathrm{1.05}\pm \mathrm{0.51}$ %) and bias-corrected ($\mathrm{1.04}\pm \mathrm{0.52}$ %) ${\mathrm{XCH}}_{\mathrm{4}}$ products. The high-latitude stations in the Northern Hemisphere show values slightly higher than 1 %.

Table 5

S5P ${\mathrm{XCH}}_{\mathrm{4}}$ validation results against NDACC ${\mathrm{XCH}}_{\mathrm{4}}$ data at 20 stations for the period between November 2017 and September 2020. Spatial co-location with radius of 100 km or cone with 1${}^{\circ }$ opening angle along the FTIR line of sight and time co-location of $\pm \mathrm{3}$ h around the satellite overpass were used. NDACC station (column 1) are sorted according to the decreasing latitude (column 2). The column with title “No.” represents the number of co-located measurements, column title “SD” represents the standard deviation of the time series of the ground-based data relative to the standard deviation of the time series of the S5P data, column title “Corr” represents the correlation coefficient between the S5P and the reference ground-based data, column title “Rel diff bias” represents the relative difference ((SAT – GB)/GB) bias in percent, and column title “Rel diff SD” represents the standard deviation of the relative bias in percent.

Site	Lat	S5P bc ${\mathrm{XCH}}_{\mathrm{4}}$ smooth 100 km 3 h					S5P ${\mathrm{XCH}}_{\mathrm{4}}$ smooth 100 km 3 h				S5P bc ${\mathrm{XCH}}_{\mathrm{4}}$ 100 km 3 h				S5P bc ${\mathrm{XCH}}_{\mathrm{4}}$ smooth cone 100 km 3 h
		No.	SD	Corr	Rel diff	Rel diff	SD	Corr	Rel diff	Rel diff	SD	Corr	Rel diff	Rel diff	No.	SD	Corr	Rel diff	Rel diff
					bias (%)	SD (%)			bias (%)	SD (%)			bias (%)	SD (%)				bias (%)	SD (%)
Eureka	80.1	264	2.5	0.37	0.95	2.57	3.4	0.34	0.16	2.56	2.5	0.35	0.41	2.71	67	1.3	0.74	0.88	0.75
Ny-Ålesund	78.9	10	2.9	0.92	4.73	0.98	3	0.82	3.79	1.03	2.9	0.94	2.53	0.9
Thule	76.5	262	1.2	0.7	4.52	1.09	1.2	0.67	3.47	1.12	1.2	0.68	2.66	1.12	65	0.9	0.61	4.98	1.14
Kiruna	67.8	367	0.9	0.14	$-\mathrm{0.15}$	1.43	1	0.16	$-\mathrm{1.12}$	1.37	0.8	0.3	$-\mathrm{0.55}$	1.23	256	1	0.2	$-\mathrm{0.4}$	1.38
Sodankylä	67.4	1694	1.1	0.45	0.15	1.07	1.1	0.42	$-\mathrm{0.88}$	1.09	1.2	0.49	$-\mathrm{0.17}$	1.11	1303	1.1	0.48	0.01	0.96
Harestua	60.2	161	2.2	0.31	0.86	1.57	2.2	0.29	$-\mathrm{0.27}$	1.57	2.3	0.31	0.84	1.67	89	1.2	0.22	0.86	0.99
St. Petersburg	59.9	647	1.3	0.49	0.31	0.9	1.3	0.39	$-\mathrm{0.64}$	0.98	1.4	0.51	$-\mathrm{0.21}$	0.94	529	1.3	0.5	0.43	0.89
Bremen	53.1	188	1.9	0.52	1.44	1.34	1.9	0.5	0.95	1.35	2.1	0.56	1.16	1.42	182	1.1	0.68	1.59	0.82
Karlsruhe	49.1	591	0.9	0.79	0.33	0.47	0.8	0.77	$-\mathrm{0.35}$	0.51	0.9	0.79	$-\mathrm{0.37}$	0.46	485	0.9	0.77	0.42	0.5
Garmisch	47.5	700	1	0.56	0.79	0.75	1	0.51	$-\mathrm{0.02}$	0.8	1.1	0.55	0.53	0.81	141	1	0.71	0.76	0.59
Zugspitze	47.4	485	1.1	0.7	0.65	0.65	1.1	0.69	$-\mathrm{0.13}$	0.65	1.3	0.68	0.58	0.77	86	1	0.63	0.69	0.61
Jungfraujoch	46.6	178	0.9	0.66	$-\mathrm{0.23}$	0.76	0.9	0.64	$-\mathrm{0.89}$	0.76	1.1	0.64	$-\mathrm{0.24}$	0.89	31	1	0.73	$-\mathrm{0.12}$	0.55
Toronto	43.6	337	3.5	$-\mathrm{0.13}$	1.72	3.95	3.6	$-\mathrm{0.08}$	1.14	3.87	3.6	$-\mathrm{0.12}$	0.67	3.98	235	2.5	$-\mathrm{0.18}$	1.78	3.4
Rikubetsu	43.5	31	1.9	$-\mathrm{0.02}$	1.7	2.29	2.2	0.06	0.96	2.17	1.8	0.09	1.56	2.03	24	1.8	0.02	2.1	2.38
Boulder	40	393	1.4	0.26	1.66	0.9	1.3	0.45	2.09	0.79	1.1	0.34	0.83	0.74	289	1.4	0.42	1.76	0.86
Altzomoni	19.1	325	0.9	0.45	2.44	0.68	1	0.23	2.59	0.76	1	0.52	2.52	0.68	188	1.1	0.48	1.95	0.64
Porto Velho	$-\mathrm{8.8}$	53	1.4	0.06	$-\mathrm{0.76}$	0.81	1.3	0.06	$-\mathrm{1.98}$	0.82	1.5	0.16	$-\mathrm{1.34}$	0.8	51	1.5	$-\mathrm{0.05}$	$-\mathrm{0.82}$	0.77
Wollongong	$-\mathrm{34.4}$	716	0.9	0.62	$-\mathrm{0.04}$	0.78	0.9	0.6	$-\mathrm{0.76}$	0.81	1	0.57	$-\mathrm{0.75}$	0.84	603	0.9	0.65	0	0.74
Lauder	$-\mathrm{45}$	561	1.5	0.61	0.08	0.99	1.4	0.68	$-\mathrm{0.33}$	0.9	1.3	0.61	$-\mathrm{0.41}$	0.89	41	1.4	0.71	0.38	0.75
Arrival Heights	$-\mathrm{77.8}$	45	0.7	0.64	2.65	0.78	0.7	0.62	1.66	0.8	1	0.81	2.26	0.62	2	0.3	$-\mathrm{1}$	2.22	0.19
Mean of all stations${}^{*}$			1.3	0.47	0.57	1.04	1.4	0.45	$-\mathrm{0.11}$	1.05	1.4	0.49	0.19	1.06		1.1	0.52	0.56	0.79
SD of all stations${}^{*}$			0.5	0.21	0.83	0.52	0.7	0.21	1.19	0.51	0.5	0.17	0.94	0.55		0.2	0.24	0.79	0.22

${}^{*}$ The mean of all stations is calculated by excluding outliers which are stations with a low number of co-locations (Ny-Ålesund, Arrival Heights, Rikubetsu), high scatter in the ground-based data (Toronto), high unexpected bias (Thule).

The S5P ${\mathrm{XCH}}_{\mathrm{4}}$ mean relative bias and the standard deviation of the relative bias with respect to the NDACC stations as shown in Table  are shown as bar plots in Fig. . The comparisons relative to the S5P bias-corrected ${\mathrm{XCH}}_{\mathrm{4}}$ product (labelled – bcsm100k1h) are the blue bars and those for the standard ${\mathrm{XCH}}_{\mathrm{4}}$ product (labelled – stdsm100k3h) are the magenta bars. The standard deviations of the relative bias (right panel) for the S5P standard and bias-corrected ${\mathrm{XCH}}_{\mathrm{4}}$ products are comparable. Figure  shows the relative difference of the bias for the S5P standard (top panel) and bias-corrected (bottom panel) ${\mathrm{XCH}}_{\mathrm{4}}$ products as a function of the retrieved surface albedo at the NDACC stations. Similar to the TCCON comparison, we also see here that the bias correction of the S5P ${\mathrm{XCH}}_{\mathrm{4}}$ product brings the high negative relative differences closer to zero for low surface albedo conditions and the high positive relative differences closer to zero for high surface albedo conditions. The data at stations with low surface albedo conditions also show a high scatter in the relative difference plots. The difference of the mean relative bias between the S5P bias-corrected and the standard ${\mathrm{XCH}}_{\mathrm{4}}$ product for each NDACC station is shown as a magenta bar in the middle plot (labelled – diff_bcvsstd) of Fig. . It shows the overall direction of change is positive for most stations (low surface albedo conditions) and negative for few stations like Boulder and Altzomoni (high surface albedo conditions).

Figure 9

S5P ${\mathrm{XCH}}_{\mathrm{4}}$ validation results against NDACC ${\mathrm{XCH}}_{\mathrm{4}}$ data at 20 stations within the period between November 2017 and September 2020. (a) Bar chart of mean relative bias ((SAT – GB)/GB) in percent; (c) standard deviation of the relative bias in percent; (b) difference of the mean relative bias for validation cases (stdsm100k3h, bc100k3h, bcsm100k3hcone) in percent against the reference case (bcsm100k3h) in percent. Spatial co-location with radius of 100 km or cone with 1${}^{\circ }$ opening angle along the FTIR line of sight and time co-location of $\pm \mathrm{3}$ h around the satellite overpass were used. The stations are sorted with decreasing latitude. The mean of all stations is calculated by excluding outliers which are stations with a low number of co-locations (Ny-Ålesund, Rikubetsu), high scatter in the ground-based data (Toronto), high unexpected bias (Thule, Arrival Heights).

[Figure omitted. See PDF]

Figure 10

Relative biases between co-located S5P (standard ${\mathrm{XCH}}_{\mathrm{4}}$ product – a; bias-corrected ${\mathrm{XCH}}_{\mathrm{4}}$ product – b) and NDACC ${\mathrm{XCH}}_{\mathrm{4}}$ data smoothed with S5P a priori and additionally smoothed with the S5P column-averaging kernel are plotted as a function of the surface albedo retrieved by S5P at 20 NDACC stations within the period between November 2017 and September 2020. Spatial co-location with radius of 100 km and time of $\pm \mathrm{3}$ h around the satellite overpass was used.

[Figure omitted. See PDF]

The relative biases are plotted as mosaic plots and are shown in Fig. , where the top panel shows the bias for the S5P standard ${\mathrm{XCH}}_{\mathrm{4}}$ product, while the bottom panel shows the bias for the S5P bias-corrected ${\mathrm{XCH}}_{\mathrm{4}}$ product relative to NDACC. Each bar in the mosaic plots represents the weekly averages of the relative bias values. The high-latitude stations show a high positive bias during the spring, which is then reduced and even switches sign to show a negative bias during the autumn. This is the reason for the high standard deviation of the relative difference seen for the high-latitude stations having measurements during the spring and summer or autumn. Since measurements rely on direct line of sight of the Sun, the data are not available during the winter months for high-latitude stations. The time series of the S5P bias-corrected ${\mathrm{XCH}}_{\mathrm{4}}$ product and the NDACC data for each site are shown in Figs.  and , and the respective relative biases are shown in Figs.  and . In the plots, the NDACC data are shown in grey and the S5P data are shown in light cyan. The S5P data co-located with NDACC data are shown in cyan and the co-located NDACC data are shown in black.

Figure 11

Mosaic plots showing relative biases between co-located S5P (standard ${\mathrm{XCH}}_{\mathrm{4}}$ product – a; bias-corrected ${\mathrm{XCH}}_{\mathrm{4}}$ product – b) and NDACC ${\mathrm{XCH}}_{\mathrm{4}}$ data smoothed with S5P a priori and additionally smoothed with the S5P column-averaging kernel at 20 NDACC stations within the period between November 2017 and September 2020. Spatial co-location with radius of 100 km and time of $\pm \mathrm{3}$ h around the satellite overpass was used. The time resolution of the data shown here is weekly. The stations are sorted with decreasing latitude.

[Figure omitted. See PDF]

Figure 12

${\mathrm{XCH}}_{\mathrm{4}}$ time series for all NDACC data (grey), S5P bias-corrected data (light cyan), S5P data co-located with NDACC data (cyan) and co-located NDACC data smoothed with S5P a priori and additionally smoothed with the S5P column-averaging kernel (black) at each site ordered with decreasing latitude. Spatial co-location with radius of 100 km and time of $\pm \mathrm{3}$ h around the satellite overpass was used.

[Figure omitted. See PDF]

Figure 13

Same as Fig. .

[Figure omitted. See PDF]

Figure 14

Relative difference ((satellite $-$ ground-based)/ground-based) of ${\mathrm{XCH}}_{\mathrm{4}}$ time series for all co-located S5P bias-corrected data and NDACC data smoothed with S5P a priori and additionally smoothed with the S5P column-averaging kernel as the reference data at each site ordered with decreasing latitude as in Fig. . Spatial co-location with radius of 100 km and time of $\pm \mathrm{3}$ h around the satellite overpass was used.

[Figure omitted. See PDF]

Figure 15

Same as Fig. .

[Figure omitted. See PDF]

Taylor diagrams for the S5P bias-corrected ${\mathrm{XCH}}_{\mathrm{4}}$ and NDACC smoothed ${\mathrm{XCH}}_{\mathrm{4}}$ data are shown in Fig. . The correlation, represented by the angular coordinate, is above 0.5 for most stations (see Table  for exact values). No clear conclusion can be drawn as to whether the satellite data are more variable than the ground-based NDACC data, as we find quite a few stations where the distance to the origin of the ground-based dot relative to the satellite dot is both below 1 and above 1. The correlation is mostly dominated by the seasonal cycle, and low correlations are seen for high-latitude sites where a bias jump is seen between spring and summer periods. Outliers such as Ny-Ålesund, Rikubetsu and Porto Velho are due to the limited data sets available for the comparison. The ground-based data set from Toronto shows a high scatter, while a high unexpected bias for Thule and Arrival Heights indicates some problem with the S5P data set. The ground-based data set from Harestua shows a high scatter for few co-locations. The low correlation for the high-latitude stations (Sodankylä and Kiruna) is due to the jump in bias between spring and later months (see Figs.  and ).

Figure 16

Taylor diagram for daily mean differences between S5P bias-corrected ${\mathrm{XCH}}_{\mathrm{4}}$ and NDACC ${\mathrm{XCH}}_{\mathrm{4}}$ data smoothed with S5P a priori and additionally smoothed with the S5P column-averaging kernel at the 20 NDACC stations within the period between November 2017 and September 2020. Spatial co-location with radius of 100 km and time of $\pm \mathrm{3}$ h around the satellite overpass was used. The stations are sorted with decreasing latitude.

[Figure omitted. See PDF]

Eight ground-based stations contributed to the validation study by providing ${\mathrm{XCH}}_{\mathrm{4}}$ data from both TCCON and NDACC measurements performed at the sites. The differences in the relative bias of the S5P bias-corrected ${\mathrm{XCH}}_{\mathrm{4}}$ product with respect to the TCCON and NDACC (${\text{bias}}_{\mathrm{NDACC}}-{\text{bias}}_{\mathrm{TCCON}}$) for these stations are the following: 0.15 % ($\sim \mathrm{2.9}$ ppb) for Eureka, 0.99 % ($\sim \mathrm{18.8}$ ppb) for Sodankylä, 1.59 % ($\sim \mathrm{30.2}$ ppb) for Bremen, 0.69 % ($\sim \mathrm{13.1}$ ppb) for Karlsruhe, 0.6 % ($\sim \mathrm{11.4}$ ppb) for Garmisch, 0.62 % ($\sim \mathrm{11.8}$ ppb) for Zugspitze, 0.84 % ($\sim \mathrm{16.0}$ ppb) for Wollongong and 0.26 % ($\sim \mathrm{5.0}$ ppb) for Lauder. in a multistation (five) intercomparison study of column-averaged methane from NDACC and TCCON showed that there is no overall bias between MIR (NDACC) and NIR (TCCON) ${\mathrm{XCH}}_{\mathrm{4}}$ retrievals in general. However, dynamical variability can cause NDACC-TCCON differences in the ${\mathrm{XCH}}_{\mathrm{4}}$ values at the sites, with values up to 30 ppb. The high-latitude stations are affected by the stratospheric subsidence induced by the polar vortex, whereas for other locations, a deep stratospheric intrusion event can be the cause for the difference. Our study also shows differences between the ${\text{bias}}_{\mathrm{NDACC}}-{\text{bias}}_{\mathrm{TCCON}}$ of the same order (up to $\sim \mathrm{30}$ ppb) for the co-located stations. In the next section, we show detailed results of the a priori alignment and smoothing correction at the individual stations.

4.2 Smoothing effect in the validation of S5P methane data

The validation of the S5P bias-corrected ${\mathrm{XCH}}_{\mathrm{4}}$ data relative to the TCCON and NDACC ${\mathrm{XCH}}_{\mathrm{4}}$ data with and without (i.e. direct comparison) a priori alignment and smoothing correction are discussed in this section. S5P, TCCON and NDACC all have different vertical sensitivities and use different a priori profiles for their retrievals. In the case of similar vertical sensitivities, we can assume that the smoothing effects from satellite and ground-based retrievals are of nearly equal magnitude. However, the vertical sensitivities and the a priori profiles used are different, which means that the a priori profiles and the averaging kernels should be taken into account. For the case of TCCON, only an a priori alignment is done. The S5P prior is used as the common prior in our validation study. Smoothing effects are most relevant for cases with strong dynamic variability in the atmosphere. TCCON performs a profile scaling retrieval on the measurements performed in the NIR spectral region, whereas NDACC performs a profile retrieval in the MIR spectral region. The altitude of perturbation of the ${\mathrm{CH}}_{\mathrm{4}}$ profile plays a significant role on smoothing correction and is different for NIR and MIR retrievals. showed that TCCON retrievals are more accurate when perturbations are due to stratosphere–troposphere exchange in the upper troposphere/lower stratosphere (UTLS) region, whereas NDACC retrievals are more accurate for cases of stratospheric subsidence. In order to ascertain the effect of a priori alignment and smoothing, the validation results of the direct comparison are compared against the validation results with a priori alignment and smoothing as discussed in the previous section.

The validation results of the S5P bias-corrected ${\mathrm{XCH}}_{\mathrm{4}}$ data relative to the TCCON and NDACC data without a priori alignment and smoothing correction (direct comparison) are shown in columns 12–15 of Tables  and , respectively. The S5P ${\mathrm{XCH}}_{\mathrm{4}}$ mean relative bias and the standard deviation of the relative bias with respect to TCCON and NDACC are shown as grey bars in the left panel and right panel plots of Figs.  and , respectively. The standard deviation of the relative bias without smoothing correction is similar to the standard deviation of the relative bias for the case with smoothing correction. The differences between the mean relative bias with and without smoothing correction for the S5P bias-corrected ${\mathrm{XCH}}_{\mathrm{4}}$ data for each TCCON and NDACC station are shown as grey bars in the middle panel plot (labelled – diff_smvsnosm) of Figs.  and , respectively. The difference plot relative to TCCON shows that the overall direction of change is negative for all stations, with high values for most stations in the Northern Hemisphere corresponding to regions with high dynamic variability. We observe a maximum difference of $-\mathrm{0.25}$ % ($\sim -\mathrm{4.8}$ ppb) and a mean difference of $-\mathrm{0.14}\pm \mathrm{0.07}$ % ($\sim -\mathrm{2.7}\pm \mathrm{1.3}$ ppb) across all TCCON sites for the duration of available measurements used in this study. The a priori alignment correction for the Southern Hemisphere sites is low where we observe on average a difference of about $-\mathrm{0.07}$ % ($\sim -\mathrm{1.3}$ ppb). The difference plot relative to NDACC shows that the overall direction of change is positive for all stations. Ny-Ålesund, which has the lowest number of collocations, shows the highest difference of 2.2 % ($\sim \mathrm{41.8}$ ppb). Thule, which has an unexpected high bias, shows the second highest difference of 1.86 % ($\sim \mathrm{35.3}$ ppb), and Toronto, which has a high scatter in the ground-based data, shows a high difference of 1.05 % ($\sim \mathrm{20}$ ppb). The difference at all other stations is below 1 %, with the high values seen for high-latitude sites; the mean difference of the selected NDACC sites shown in Table  is $\mathrm{0.38}\pm \mathrm{0.28}$ % ($\sim \mathrm{7}\pm \mathrm{5.3}$ ppb).

As pointed out in Sect. , the difference of smoothing (only a priori alignment for TCCON) vs. no smoothing for the eight co-located stations is observed highest for midlatitude TCCON stations and that for the NDACC stations, we observe the highest difference for the high-latitude stations. It is therefore important to use a realistic a priori profile for scaling retrievals, especially for cases of stratospheric subsidence or stratosphere–troposphere exchange. For such cases, improved a priori profiles representing the realistic atmospheric state will reduce the difference.

4.3 Comparison of circular vs. cone co-location criterion for validation of S5P methane data

In our standard S5P ${\mathrm{CH}}_{\mathrm{4}}$ validation settings with or without smoothing, we have used a co-location radius of 100 km around each ground-based site. As the operational S5P ${\mathrm{CH}}_{\mathrm{4}}$ pixels are currently provided only over land, the circular co-location criterion may not be optimal to be applied for all sites. Ground-based sites located close to a sea/ocean coast will always lack S5P ${\mathrm{CH}}_{\mathrm{4}}$ pixels over water. Furthermore, for sites located close to regions with high emission sources, there are possible scenarios when the ground-based FTIR line of sight is not covering all pixels observed by the satellite using the circular co-location criterion. This is also relevant for high-latitude sites where the ground-based FTIRs, mostly measuring at high solar zenith angles, are always looking south for Northern Hemisphere sites and are looking north for Southern Hemisphere sites. We have implemented a cone selection criterion where we follow the ground-based FTIR line of sight with a 1${}^{\circ }$ opening angle of the cone at the highest altitude. Using the cone co-location criterion, we have done the validation of the S5P bias-corrected ${\mathrm{CH}}_{\mathrm{4}}$ data with smoothing and compared to the validation results using circular co-location criterion using the same settings as discussed in Sect. .

The validation results of the S5P bias-corrected ${\mathrm{XCH}}_{\mathrm{4}}$ data relative to the TCCON and NDACC data applying cone co-location criterion are shown in columns 16–20 of Tables  and , respectively. Using the cone co-location criterion reduces the number of S5P co-locations with ground-based FTIRs significantly (see column 16 in relation to column 3). The S5P ${\mathrm{XCH}}_{\mathrm{4}}$ mean relative bias and the standard deviation of the relative bias with respect to TCCON and NDACC using the cone co-location criterion are shown as orange bars in the left panel and right panel plots of Figs.  and , respectively. The standard deviation of the relative bias with the cone co-location criterion is smaller than the standard deviation of the relative bias for the circular co-location criterion for sites with significantly reduced co-locations and is similar for other sites with small reduction in the number of co-locations. The difference between the mean relative bias with circular and cone co-location criterion for the S5P bias-corrected ${\mathrm{XCH}}_{\mathrm{4}}$ data for each TCCON and NDACC station is shown as orange bars in the middle panel plot (labelled – diff_circvscone) of Figs.  and , respectively. The difference plot relative to TCCON shows the magnitude of change in bias, with values for some stations being negative while being positive for others. We observe a maximum difference of 0.3 % ($\sim \mathrm{5.7}$ ppb) and a mean difference of $-\mathrm{0.02}\pm \mathrm{0.12}$ % ($\sim -\mathrm{0.4}\pm \mathrm{2.3}$ ppb) across all TCCON sites for the duration of available measurements used in this study. The high-latitude sites in the Northern Hemisphere show a significantly low number of co-locations for the cone criterion. The relative bias for these sites (Eureka, Ny-Ålesund, Sodankylä and East Trout Lake) shows a slight increase for the cone co-location criterion in comparison to the circular co-location criterion. Sites where the relative bias using the cone criterion as compared to the circular criterion is lower by at least 2 ppb are the following: JPL ($-\mathrm{0.2}$ %), Pasadena ($-\mathrm{0.18}$ %), Lamont ($-\mathrm{0.11}$ %) and Białystok ($-\mathrm{0.11}$ %). Meanwhile, the sites where the cone criterion as compared to the circular criterion is higher by at least 2 ppb are the following: Lauder (0.3 %), Saga ($-\mathrm{0.18}$ %) and Orléans (0.1 %). The difference plot relative to NDACC shows the magnitude of change in bias with values for some stations being negative while being positive for others. We observe a maximum difference of 0.49 % ($\sim \mathrm{9.3}$ ppb) and a mean difference of $\mathrm{0.01}\pm \mathrm{0.2}$ % ($\sim \mathrm{0.2}\pm \mathrm{3.8}$ ppb) across the selected NDACC sites (see Table ) for the duration of available measurements used in this study. Several sites have few co-locations left upon selecting the cone criterion, with Ny-Ålesund showing no match at all. Amongst the sites where a significant number of co-locations remains, the sites where the relative bias using the cone criterion as compared to the circular criterion is lower by at least 2 ppb are the following: Altzomoni (0.49 %), Sodankylä (0.14 %) and Jungfraujoch ($-\mathrm{0.11}$ %). The sites where the cone criterion as compared to the circular criterion is higher by at least 2 ppb are the following: Lauder ($-\mathrm{0.30}$ %), Kiruna (0.25 %), Bremen ($-\mathrm{0.15}$ %) and St. Petersburg ($-\mathrm{0.12}$ %).

We have observed that applying the cone co-location criterion reduces the number of co-locations for all sites and quite significantly for some sites. There are seven TCCON stations and seven NDACC stations where the magnitude of the difference is above 2 ppb. Amongst all the stations, the magnitude of change in the relative bias between the two settings is the highest for Altzomoni station (see Sect.  for further discussion on the site).

4.4 Solar zenith angle dependence of the S5P methane bias relative to ground-based reference data

The remote sensing measurements made either from the ground or satellites are known to be affected by the SZA of the measurements. In this section, we show the S5P ${\mathrm{CH}}_{\mathrm{4}}$ bias relative to the ground-based reference data as a function of the measurement SZA. Figure  shows the S5P relative bias for the a priori aligned and smoothed cases as a function of the measurement SZA against some of the reference ground-based TCCON stations. As mentioned in Sect. , the S5P ${\mathrm{CH}}_{\mathrm{4}}$ data are only available for $\text{SZA}\le \mathrm{70}$${}^{\circ }$. The upper limits of the plots therefore show values only until 70${}^{\circ }$. The S5P relative bias shows a high scatter for high SZAs. Stations like Sodankylä, East Trout Lake and Park Falls show high values in the relative bias for measurements at high SZAs when measurements are performed during winter and spring months. These measurements are influenced by surface conditions with snow cover and polar vortex conditions, whereas the negative bias at high SZA is from the summer and autumn measurements (e.g. see Figs.  and ). At Lamont, we observe a strong increase in bias with decreasing SZA for measurements performed during spring. This is seen particularly in the case where the bias correction due to the SWIR surface albedo change occurred between 0.25 and 0.1 for measurements performed in this period at the site. The bias increase with decreasing SZA is also seen for other months at the different sites. Except for the spring measurements, which show a high bias, we observe a general decrease in relative bias with increasing SZA.

Figure 17

Relative biases between co-located S5P bias-corrected ${\mathrm{XCH}}_{\mathrm{4}}$ and TCCON ${\mathrm{XCH}}_{\mathrm{4}}$ data with a priori alignment are plotted as a function of the S5P measurement solar zenith angles retrieved at a few TCCON stations within the period between November 2017 and September 2020. Spatial co-location with radius of 100 km and time of $\pm \mathrm{1}$ h around the satellite overpass was used. The colours represent the different months from January (1) until December (12) of a year.

[Figure omitted. See PDF]

5 Validation of S5P carbon monoxide products

The validation of the S5P carbon monoxide data with the ground-based FTIR data from TCCON and NDACC stations is discussed in this section. The official S5P CO products are available over land as well as over water. As a result, in addition to the stations mentioned in the S5P methane validation results, co-locations with ground-based stations located on islands (e.g. Ascension, Izaña, Réunion and Mauna Loa) are found and discussed here. The NDACC station at Paramaribo and Porto Velho are the only stations in the South American continent currently contributing to the S5P CO validation study. As NDACC provides the CO column values, they are used directly to validate the S5P CO column values, whereas for the validation using TCCON XCO data, the S5P CO columns are converted to XCO as described in Sect. .

5.1 Validation of S5P XCO data using TCCON standard and unscaled XCO data and analysis of smoothing uncertainty

As mentioned in Sect. , the validation of the S5P XCO offline data is performed with the TCCON standard XCO data as well as the TCCON unscaled XCO data, and the results are discussed in this section. The density of the official S5P valid CO pixels is higher as compared to the valid ${\mathrm{CH}}_{\mathrm{4}}$ pixels. As a result, we found that using a co-location radius of 50 km around each ground-based station gave a sufficient number of pixels for robust statistics. We have used a maximal time difference of 1 h for TCCON observations, which is similar to the settings used for ${\mathrm{CH}}_{\mathrm{4}}$ validation. An effective location of the FTIR measurement on the line of sight is used to do the co-location. As a result, the co-located pixels can differ from measurement to measurement. For each of the ground-based measurements, which are co-located with the S5P measurements, an average of all S5P pixels is made. Co-located pairs are created between ground-based and averaged S5P pixels only if a minimum of five pixels is found in applying the coincidence criteria. In the comparison, the a priori profile in the TCCON retrievals have been substituted with the S5P CO a priori following Eq. (). The TCCON results with the S5P prior substituted are then compared directly to the S5P XCO data. Furthermore, each validation run includes the adaptation of the S5P columns to the altitude of the ground-based FTIR instruments.

Table  provides the validation results using the a priori aligned TCCON unscaled and standard XCO data at each TCCON station. The systematic difference (the mean of all relative differences) between the S5P and TCCON data is on average $\mathrm{9.22}\pm \mathrm{3.45}$ % (TCCON standard XCO data) and $\mathrm{2.45}\pm \mathrm{3.38}$ % (TCCON unscaled XCO data). The absolute maximum bias value of 8.27 % is observed with respect to TCCON unscaled XCO data. While most stations show a positive relative bias of S5P XCO with respect to the TCCON unscaled XCO, there are few exceptions that show high negative values (e.g. Xianghe, JPL and Pasadena – all urban sites). This will be further discussed in detail later in this section. The standard deviation of the relative bias, which is a measure of the random error, is well below $<\mathrm{10}$ % for comparison against both TCCON standard and unscaled XCO data at all stations except at Wollongong where the value is 17.93 % (for TCCON unscaled XCO) and 19.37 % (for TCCON standard XCO). The high standard deviation of the relative bias at this station is due to the co-location mismatch during the period of fire event in that region producing enhanced CO plume passing over/nearby the ground-based station at Wollongong. As a result, for some of the days we found enhanced CO values in the S5P co-located pixels, which were not observed by the FTIR as the enhanced CO plume is not directly in the line of sight of the FTIR, while for other days we found enhanced CO values varying during the day as the fire plume passes by the station and in comparison the satellite measures for a shorter duration during the local noon and therefore misses the variability of CO during the co-location time selected for the validation. We tested with a reduced time co-location criterion of 30 min and found that, for the Wollongong station, the standard deviation of the relative bias reduced marginally to 17.89 % and the relative bias reduced to 1.87 % (for TCCON unscaled XCO validation results). The CO plumes emitted from the Australian fire during the summer of 2019/2020 were also observed at the Lauder station in New Zealand. The CO was well dispersed by the time the fire plumes were measured there, resulting in a better match between the S5P and ground-based FTIR measured XCO (see Figs.  and ).

Table 6

S5P XCO validation results against TCCON XCO data at 28 stations for the period between November 2017 and September 2020. Spatial co-location with radius of 50 km or cone with 1${}^{\circ }$ opening angle along the FTIR line of sight and time co-location of $\pm \mathrm{1}$ h around the satellite overpass were used. TCCON station (column 1) are sorted according to the decreasing latitude (column 2). The column with title “No.” represents the number of co-located measurements, column title “SD” represents the standard deviation of the time series of the ground-based data relative to the standard deviation of the time series of the S5P data, column title “Corr” represents the correlation coefficient between the S5P and the reference ground-based data, column title “Rel diff bias” represents the relative difference ((SAT – GB)/GB) bias in percent, and column title “Rel diff SD” represents the standard deviation of the relative bias in percent.

Site	Lat	TCCON unsc XCO smooth 50 km 1 h					TCCON SD XCO smooth 50 km 1 h				TCCON unsc XCO 50 km 1 h				TCCON unsc XCO smooth cone 50 km 1 h
		No.	SD	Corr	Rel diff	Rel diff	SD	Corr	Rel diff	Rel diff	SD	Corr	Rel diff	Rel diff	No.	SD	Corr	Rel diff	Rel diff
					bias (%)	SD (%)			bias (%)	SD (%)			bias (%)	SD (%)				bias (%)	SD (%)
Eureka	80	11 114	0.8	0.95	6.55	4.2	0.8	0.95	12.44	4.15	0.8	0.95	3.62	4.55	10 608	0.8	0.95	5.95	4.23
Ny-Ålesund	78.9	9495	0.9	0.97	7.54	4.4	0.8	0.97	13.1	4.45	0.8	0.97	5.78	4.54	8569	0.9	0.96	7.91	5.14
Sodankylä	67.4	19 439	0.9	0.95	5.79	4.92	0.9	0.96	11.88	4.7	0.9	0.96	3.42	4.86	18 057	0.9	0.95	5.78	5.24
East Trout Lake	54.3	31 198	1	0.94	5.92	5.18	0.9	0.94	12.53	5.16	0.9	0.94	3.75	4.74	29 856	1	0.94	5.85	5.33
Białystok	53.2	4698	0.9	0.97	2.88	3.24	0.9	0.97	9.89	3.39	0.9	0.97	1.94	3.22	4687	0.9	0.97	2.94	3.25
Bremen	53.1	1671	1	0.92	3.51	4.65	0.9	0.93	9.87	4.54	1	0.92	2.99	4.55	1651	1	0.92	3.47	4.83
Karlsruhe	49.1	8593	1	0.97	0.01	2.94	0.9	0.97	6.61	3.14	0.9	0.95	5.74	3.87	8508	1	0.97	0	2.99
Paris	48.8	12 139	1	0.93	2.27	3.59	1	0.94	9.06	3.64	1	0.93	1.06	3.53	11 960	1	0.93	2.04	3.66
Orléans	48	11 147	0.9	0.97	4.53	2.97	0.9	0.97	11.46	2.91	0.9	0.97	2.8	3.04	11 043	0.9	0.97	4.52	3.04
Garmisch	47.5	8325	1	0.92	4.16	4.58	0.9	0.93	10.87	4.45	0.9	0.9	5.65	5.16	5091	1	0.91	3.35	4.75
Zugspitze	47.4	1887	1.2	0.8	8.27	7.69	1.1	0.81	15.16	7.58	1.1	0.82	1.03	6.86	1093	1.2	0.81	5.71	7.91
Park Falls	45.9	16 796	1	0.94	4.31	6.48	0.9	0.95	11.3	6.82	1	0.94	2.51	5.58	16 643	1	0.94	4.25	6.48
Rikubetsu	43.5	5164	1.1	0.97	3.89	3.77	1	0.97	10.73	3.72	1	0.96	3.06	3.63	5163	1.1	0.96	4.05	3.97
Xianghe	39.8	11 349	0.9	0.95	$-\mathrm{6.02}$	6.9	0.8	0.95	$-\mathrm{0.73}$	7.35	0.9	0.95	11.41	7.36	11 290	0.9	0.95	$-\mathrm{5.81}$	6.96
Lamont	36.6	17 655	1	0.94	$-\mathrm{0.94}$	4.22	0.9	0.95	5.91	4.1	1	0.95	$-\mathrm{2.38}$	3.65	17 575	1	0.94	$-\mathrm{1.02}$	4.15
Tsukuba	36	10 467	1	0.95	3.05	4.54	0.9	0.96	9.94	4.5	0.9	0.93	3.24	5.43	10 434	1	0.95	3.21	4.73
Nicosia	35.1	10 668	0.9	0.91	3.44	3.66	0.8	0.92	10.75	3.79	1	0.92	2.56	3.47	10 651	0.9	0.91	3.39	3.66
Edwards	35	34 554	0.9	0.94	3.1	4.71	0.9	0.94	10.39	4.93	0.9	0.93	2.39	4.82	34 510	0.9	0.94	3.11	4.72
JPL	34.2	4951	1.3	0.89	$-\mathrm{3.3}$	5.02	1.2	0.89	3.36	5.18	1.2	0.89	$-\mathrm{1.28}$	5.1	4875	1.3	0.87	$-\mathrm{2.81}$	5.43
Pasadena	34.1	30 819	0.8	0.85	$-\mathrm{3.41}$	7.69	0.7	0.85	3.29	8.14	0.8	0.83	0.21	8.23	30 707	0.8	0.84	$-\mathrm{2.99}$	7.9
Saga	33.2	16 583	1	0.98	0.43	4	1	0.98	7.5	4.21	0.9	0.96	2.37	5.05	16 575	1	0.98	0.42	3.98
Izaña	28.3	8715	1	0.89	5.14	4.91	0.9	0.9	12.87	5.17	1	0.87	1.49	4.88	8715	1	0.89	5.1	4.87
Burgos	18.5	18 581	0.9	0.97	0.24	4.07	0.8	0.97	7.47	4.31	0.9	0.94	0.65	5.72	18 580	0.9	0.97	0.22	4.09
Ascension	$-\mathrm{7.9}$	406	1.2	0.63	$-\mathrm{0.62}$	4.66	1.1	0.63	6.83	5.01	1.2	0.63	$-\mathrm{3.07}$	4.47	406	1.2	0.63	$-\mathrm{0.62}$	4.66
Darwin	$-\mathrm{12.5}$	9292	1	0.92	$-\mathrm{0.66}$	6.13	1	0.92	6.3	6.49	0.9	0.9	1.19	6.7	9292	1	0.92	$-\mathrm{0.63}$	6.16
Réunion	$-\mathrm{20.9}$	4045	0.9	0.96	3.46	4.71	0.9	0.96	11.22	4.87	0.9	0.95	$-\mathrm{1.73}$	4.58	4045	0.9	0.96	3.49	4.72
Wollongong	$-\mathrm{34.4}$	10 479	0.8	0.82	2.02	17.93	0.8	0.82	8.8	19.37	0.8	0.82	$-\mathrm{2.05}$	17.14	10 472	0.8	0.82	2.06	18
Lauder	$-\mathrm{45}$	29 781	1	0.97	2.9	3.99	0.9	0.98	9.3	3.87	1	0.97	$-\mathrm{1.99}$	4.2	29 622	1	0.97	2.93	4.09
Mean of all stations			1	0.92	2.45	5.21	0.9	0.93	9.22	5.36	0.9	0.92	2.01	5.32		1	0.92	2.35	5.32
SD of all stations			0.1	0.07	3.38	2.79	0.1	0.07	3.45	3.05	0.1	0.07	3.06	2.63		0.1	0.07	3.16	2.79

Figure  shows the bar plots for the S5P XCO mean relative bias (left panel) and the standard deviation of the relative bias (right panel) with respect to the TCCON XCO data at all stations. The comparisons relative to the TCCON unscaled XCO data (labelled – unscsm50k1h) are the blue bars and those for the TCCON standard XCO data (labelled – stdsm50k1h) are the magenta bars. The mean relative bias of the S5P XCO data with respect to the TCCON unscaled XCO data is systematically lower than the mean relative bias with respect to the TCCON standard XCO data. The difference of the mean relative bias for S5P XCO data using the TCCON unscaled XCO and the standard XCO data for each station is shown as a magenta bar in the middle panel plot (labelled – diff_unscvsstd) of Fig. . It shows the overall direction of change is negative with a mean value of $-\mathrm{6.77}\pm \mathrm{0.57}$ % for all stations. The result confirms the previously reported studies showing that the correction factor to tie the TCCON XCO data to WMO in situ scale is large and that TCCON XCO data are smaller than the uncorrected XCO data by about 7 %. The standard deviations of the relative bias for the S5P XCO data relative to the TCCON unscaled and standard XCO data are comparable.

Figure 18

S5P XCO validation results against TCCON XCO data at 28 stations within the period between November 2017 and September 2020. (a) Bar chart of mean relative bias ((SAT – GB)/GB) in percent; (c) standard deviation of the relative bias in percent; (b) difference of the mean relative bias for validation cases (stdsm5ok1h, unsc50k1h, unscsm50k1hcone) in percent against the reference case (unscsm50k1h) in percent. Spatial co-location with radius of 50 km or cone with 1${}^{\circ }$ opening angle along the FTIR line of sight and time co-location of $\pm \mathrm{1}$ h around the satellite overpass were used. The stations are sorted with decreasing latitude.

[Figure omitted. See PDF]

The time series of the S5P XCO and TCCON unscaled XCO data for each site are shown in Figs.  and . The ground-based TCCON XCO data are represented in grey and the S5P XCO data during that period are shown in light red. The S5P data co-located with TCCON data are shown in red and the co-located TCCON data with a priori alignment are shown in black. The S5P and TCCON measurements observe the same seasonal cycle of CO. At the Northern Hemisphere sites, the high CO values are observed during winter and low values are observed during summer dominated by the OH variation . At Southern Hemisphere sites, the high CO values are observed during September–November dominated by the influence of biomass burning . In addition to the seasonal cycle, we also see that at several of the ground-based sites, S5P and TCCON observe sometimes very high values of CO. These enhanced CO concentrations are due to the passing of the plumes with elevated CO concentrations over/nearby the station location (e.g. high CO seen at Wollongong during the Australian forest fires in November 2019–February 2020). also reported enhanced CO buildup measured at several sites with values much larger than the emission estimates. The time series of the relative bias plots shown in Figs.  and  indicate a seasonal cycle with a high bias seen during the high CO event and low bias seen during the low CO event. Sometimes very low S5P XCO values are observed in the validation plots at some stations, which pass the quality filter and find a match with the reference TCCON XCO data following our selection criterion. In these particular cases, we observe very low values in the relative bias plots. However, there are only a few occurrences of such low S5P XCO values.

Figure 19

XCO time series for all unscaled TCCON data (grey), all S5P data (light red), S5P data co-located with TCCON data (red) and co-located unscaled TCCON data with a priori alignment (black) at each site ordered with decreasing latitude. Spatial co-location with radius of 50 km and time of $\pm \mathrm{1}$ h around the satellite overpass was used.

[Figure omitted. See PDF]

Figure 20

Same as Fig. .

[Figure omitted. See PDF]

Figure 21

Relative difference ((satellite $-$ ground-based)/ground-based) of XCO time series for all co-located S5P data and unscaled TCCON data with a priori alignment as the reference data at each site ordered with decreasing latitude as in Fig. . Spatial co-location with radius of 50 km and time of $\pm \mathrm{1}$ h around the satellite overpass was used.

[Figure omitted. See PDF]

Figure 22

Same as Fig. .

[Figure omitted. See PDF]

The relative biases are plotted as mosaic plots and shown in Fig. , where the top panel shows the S5P bias with respect to the TCCON standard XCO data, while the bottom panel shows the S5P bias with respect to the TCCON unscaled XCO data. Each bar in the mosaic plots represents the weekly averages of the relative bias values. We will focus on the comparison of the results using TCCON unscaled XCO data. As mentioned in the previous paragraph, we observe a high positive bias during the high CO event periods, which is then reduced and even switches sign to show a negative bias during the low CO event periods. As TCCON performs solar absorption measurements, data are not available during winter for high-latitude stations.

Figure 23

Mosaic plots showing relative biases between co-located S5P and TCCON XCO data with a priori alignment (standard – a; unscaled – b) at 28 TCCON stations within the period between November 2017 and September 2020. Spatial co-location with radius of 50 km and time of $\pm \mathrm{1}$ h around the satellite overpass was used. The time resolution of the data shown here is weekly. The stations are sorted with decreasing latitude.

[Figure omitted. See PDF]

Taylor diagrams for the S5P XCO and TCCON unscaled XCO data with a priori alignment are shown in Fig. . The correlation, represented by the angular coordinate, is above 0.9 for most stations (see Table  for exact values), and the distance to the origin of the ground-based dot relative to the satellite dot is below 1 for most stations, implying that the satellite data are more variable than the ground-based data. The good correlation indicates that the short-scale temporal variations in the XCO column captured by the ground-based instruments are moderately reproduced by S5P. Outliers such as Ascension, Zugspitze and JPL are due to the limited data sets available for the comparison. The altitude correction of the pixels works well, as can be seen by the relatively good correlation for Zugspitze; however, the scatter in the data is high.

Figure 24

Taylor diagram for daily mean differences between S5P and TCCON unscaled XCO data with a priori alignment at 28 TCCON stations within the period between November 2017 and September 2020. Spatial co-location with radius of 50 km and time of $\pm \mathrm{1}$ h around the satellite overpass was used. The stations are sorted with decreasing latitude.

[Figure omitted. See PDF]

In this section, we further show the results focusing on the effect of smoothing while doing the S5P XCO validation against TCCON unscaled XCO data. S5P and TCCON have different vertical sensitivities (averaging kernels) and use different a priori profiles for their retrievals. The different a priori and vertical sensitivities should be taken into account in the validation. In the case of TCCON, only an a priori alignment is done. Smoothing corrections are most relevant for cases with strong dynamic variability in the atmosphere. TCCON performs a profile scaling retrieval on the measurements performed in the NIR spectral range and provides XCO. In order to ascertain the effect of smoothing correction, the results of the S5P validation using TCCON unscaled XCO are compared to the S5P validation results using a priori aligned TCCON unscaled XCO data.

The validation results of the S5P XCO data relative to the TCCON unscaled XCO data without smoothing correction (direct comparison) are shown in columns 12–15 of Table . The S5P XCO mean relative bias and the standard deviation of the relative bias with respect to the TCCON unscaled XCO data are shown as grey bars (labelled – unsc50k1h) in the left panel and right panel plots of Fig. . It can be seen that there exists an apparent interhemispheric difference in the bias for the direct comparison case (grey bars) between the Southern Hemisphere and Northern Hemisphere sites. This difference is greatly reduced when smoothing uncertainties are correctly accounted (blue bars) in the validation results (see left panel of Fig. ). The difference between the mean relative bias with and without a priori alignment for the S5P XCO data for each TCCON station are shown as grey bars in the middle panel plot (labelled – diff_smvsnosm) of Fig. . The magnitude of change between the smoothed and direct comparison is larger in the Southern Hemisphere than in the Northern Hemisphere with exception for sites located in highly polluted regions. The change at some stations (e.g. the Southern Hemisphere sites and highly polluted sites) is significant as it is larger than the XCO error estimated in . reported similar findings for a comparison between six co-located sites, where both NDACC and TCCON CO measurements were performed. The difference plot shows the highest value of $-\mathrm{17.43}$ % for Xianghe, a station located in a polluted area, due to a very high a priori difference from the true atmospheric state. As a result, the CO volume mixing ratio (VMR) at the surface is relatively high but it is not represented by the TCCON a priori, leading to an underestimation from the smoothing uncertainty. The same is true for other stations like Karlsruhe (change of $-\mathrm{5.73}$ %) and Pasadena (change of $-\mathrm{3.62}$ %). We observe a mean difference of $\mathrm{0.43}\pm \mathrm{4.44}$ % across all TCCON stations. Figure  shows the TCCON stations where the a priori alignment uncertainty plays an important role in the bias and needs to be accounted for in the CO validation studies.

5.2 Validation of S5P CO column data using NDACC CO column data and analysis of smoothing uncertainty

In this section, the validation results of the S5P CO columns using NDACC CO columns are discussed. The S5P observations co-located with the NDACC measurements are found by selecting all filtered S5P pixels within a radius of 50 km around each site and with a maximal time difference of 3 h. An effective location of the measurement on the line of sight is used to do the co-location. The co-located pixels can therefore differ from measurement to measurement. For each of the NDACC measurements co-located with the S5P measurements, an average of all S5P pixels is done. Co-located pairs are created between NDACC and averaged S5P only if a minimum of five pixels is found in applying the coincidence criteria. In addition to the direct comparison of the S5P and NDACC CO columns (referred to as NDACC CO un-smooth), the NDACC CO column values are additionally aligned with the S5P prior (referred to as NDACC CO ap-smooth) and used for the S5P validation, and in a further step the NDACC CO column values with the S5P prior substituted are additionally smoothed with the S5P column-averaging kernel (referred to as NDACC CO smooth) following Eq. () and used for S5P validation. Each validation run also includes the adaptation of the S5P columns to the altitude of the ground-based FTIR instruments.

Table  provides the validation results for the S5P CO columns using smooth, un-smooth and ap-smooth NDACC CO column data at each NDACC station. The systematic difference (the mean of all relative differences) between the S5P and NDACC data is on average $\mathrm{6.76}\pm \mathrm{4.65}$ % (NDACC CO un-smooth), $\mathrm{4.27}\pm \mathrm{5.62}$ % (NDACC CO ap-smooth) and $\mathrm{7.62}\pm \mathrm{5.04}$ % (NDACC CO smooth). However, the bias values are quite high at the Altzomoni and Arrival Heights stations. Eliminating the results of these two stations from the statistics of the overall stations, we observe the systematic difference between the S5P and NDACC data is on average $\mathrm{5.69}\pm \mathrm{3.07}$ % (NDACC CO un-smooth), $\mathrm{3.14}\pm \mathrm{4.19}$ % (NDACC CO ap-smooth) and $\mathrm{6.5}\pm \mathrm{3.54}$ % (NDACC CO smooth). The NDACC station at Altzomoni is located at a high altitude in the southwest direction of the Mexico City . The station is located $<\mathrm{60}$ km from the city centre. As a result, the emission from the world's eighth-largest megacity, with $>\mathrm{22}$ million population in its metropolitan area, plays a significant role in the satellite footprint . In the example plot shown in Fig. , we can see that the ground-based FTIR located at Altzomoni, with the line of sight to the south indicated by the yellow line, is not able to observe the high CO values located to the northwest of the station, which are selected for S5P using our co-location criterion. However, using the cone co-location criterion as described in Sect. , we can eliminate the pixels with high CO values that are not in the line of sight of the FTIR instrument and thereby reduce the co-location mismatch. The bias at Arrival Heights, the high-latitude background station located on the Antarctic continent showing very low values of CO, is slightly worse than the requirement, while the random error is way below 10 %. The mean standard deviation of the relative bias, which is a measure of the random error, is well below $<\mathrm{10}$ % for validation using both smoothed and direct NDACC CO data. However, there are few exceptions for stations like Altzomoni, Wollongong and Boulder. The high values are due to the co-location mismatch during the high CO events (e.g. passage of a plume with a high CO concentration in the vicinity of the site) observed at these sites.

Table 7

S5P CO column validation results against NDACC CO column data at 23 stations for the period between November 2017 and September 2020. Spatial co-location with radius of 50 km or cone with 1${}^{\circ }$ opening angle along the FTIR line of sight and time co-location of $\pm \mathrm{3}$ h around the satellite overpass were used. NDACC station (column 1) are sorted according to the decreasing latitude (column 2). The column with title “No.” represents the number of co-located measurements, column title “SD” represents the standard deviation of the time series of the ground-based data relative to the standard deviation of the time series of the S5P data, column title “Corr” represents the correlation coefficient between the S5P and the reference ground-based data, column title “Rel diff bias” represents the relative difference ((SAT – GB)/GB) bias in percent, and column title “Rel diff SD” represents the standard deviation of the relative bias in percent.

Site	Lat	NDACC CO smooth 50 km 3 h					NDACC CO 50 km 3 h				NDACC CO ap 50 km 3 h				NDACC CO smooth cone 50 km 3 h
		No.	SD	Corr	Rel diff	Rel diff	SD	Corr	Rel diff	Rel diff	SD	Corr	Rel diff	Rel diff	No.	SD	Corr	Rel diff	Rel diff
					bias (%)	SD (%)			bias (%)	SD (%)			bias (%)	SD (%)				bias (%)	SD (%)
Eureka	80.1	714	0.8	0.95	12.96	4.56	0.8	0.96	11.64	3.72	0.8	0.96	11.65	3.79	636	0.8	0.95	12.18	4.83
Ny-Ålesund	78.9	90	0.9	0.97	11.43	4.26	0.8	0.98	8.12	3.73	0.9	0.98	1.78	3.37	89	0.9	0.96	11.77	4.33
Thule	76.5	2667	0.9	0.95	9.44	4.79	0.9	0.96	7.67	3.67	0.9	0.95	4.28	4.04	2516	0.9	0.95	9.02	5.06
Kiruna	67.8	622	0.8	0.95	3.38	4.7	0.9	0.97	4.32	3.63	0.9	0.97	2.36	3.63	604	0.8	0.95	3.47	5
Harestua	60.2	216	0.9	0.97	6.7	3.73	0.9	0.97	4.8	3.22	0.9	0.97	4.58	3.22	192	0.9	0.96	7.23	4.26
St. Petersburg	59.9	843	0.9	0.96	6.67	3.88	0.9	0.95	5.08	3.74	0.9	0.95	4	3.75	842	0.9	0.95	6.53	3.95
Bremen	53.1	257	0.9	0.95	4.88	3.85	0.9	0.95	5.93	3.81	0.9	0.95	4.1	3.78	251	0.9	0.95	4.93	3.8
Karlsruhe	49.1	933	1	0.96	$-\mathrm{0.55}$	3.24	0.9	0.96	6.34	3.47	1	0.97	$-\mathrm{0.14}$	3.07	913	1	0.96	$-\mathrm{0.41}$	3.46
Garmisch	47.5	2181	1	0.93	3.99	4.79	1	0.91	5.93	5.26	1.1	0.92	$-\mathrm{5.33}$	4.32	2058	1	0.91	3.83	5.46
Zugspitze	47.4	1773	1	0.91	6.16	5.16	1.1	0.9	7.62	5.49	1.1	0.9	7.77	5.38	1675	1	0.9	6.91	5.8
Jungfraujoch	46.6	384	1	0.94	8.09	4.43	1	0.92	11.34	4.87	1	0.91	10.92	4.97	377	1	0.92	8.79	4.93
Toronto	43.6	935	1	0.9	11.82	7.11	0.9	0.92	9.73	5.24	0.9	0.92	7.5	5.15	894	1	0.89	11.99	7.48
Rikubetsu	43.5	43	1	0.97	7.65	3.57	1	0.96	3.78	3.21	1	0.95	2.51	3.33	43	1	0.96	7.36	3.53
Boulder	40	610	0.8	0.73	8.32	11.89	0.9	0.76	3.62	9.87	1	0.76	$-\mathrm{2.91}$	9.72	601	0.8	0.77	7.68	11.5
Izaña	28.3	657	0.9	0.92	2.5	4.22	1	0.9	3.64	4.34	1	0.9	3.59	4.33	656	0.9	0.91	2.48	4.35
Mauna Loa	19.5	155	0.9	0.97	2.65	3.22	1	0.96	3.17	3.41	1	0.97	2.93	3.38	153	0.9	0.96	2.49	3.64
Altzomoni	19.1	364	0.7	0.62	20.6	10.73	0.8	0.56	20.32	11.2	0.8	0.56	20.35	11.2	358	0.6	0.63	20.26	11.79
Paramaribo	5.8	59	1.2	0.82	0.88	6	1.1	0.77	$-\mathrm{1.12}$	5.64	1.1	0.76	$-\mathrm{2.24}$	5.84	57	1.2	0.81	0.98	6.05
Porto Velho	$-\mathrm{8.8}$	168	1	0.97	6.09	8.13	1	0.96	1.02	8.42	1.1	0.96	0.95	8.36	164	1	0.96	6.33	8.5
La Réunion–Maïdo	$-\mathrm{21.1}$	1117	0.9	0.98	6.44	4.62	1	0.98	5.96	4.54	1	0.98	5.78	4.58	1055	0.9	0.97	6.69	5.53
Wollongong	$-\mathrm{34.4}$	1403	0.5	0.7	9.17	23.01	0.7	0.7	5.04	21.41	0.7	0.7	0.82	20.92	1382	0.5	0.71	8.84	21.88
Lauder	$-\mathrm{45}$	1805	0.9	0.96	7.82	4.54	0.9	0.97	5.93	4.27	0.9	0.97	1.08	3.99	1776	0.9	0.96	7.89	4.74
Arrival Heights	$-\mathrm{77.8}$	174	0.8	0.95	18.3	5.63	0.8	0.96	15.68	4.93	0.9	0.95	11.99	5.34	148	0.8	0.93	19.65	7.11
Mean of all stations			0.9	0.91	7.62	6.09	0.9	0.91	6.76	5.7	0.9	0.9	4.27	5.63		0.9	0.91	7.69	6.39
SD of all stations			0.13	0.1	5.04	4.31	0.1	0.11	4.65	4.02	0.1	0.11	5.62	3.94		0.14	0.09	5.09	4.07

Figure 25

S5P CO column number density plotted around NDACC station at Altzomoni for one sample day. Panel (a) shows all available S5P pixels containing CO data in the overpass file. Panel (b) shows the co-located S5P pixels with 50 km radius selection criterion. Panel (c) shows the co-located S5P pixels with the cone co-location criterion with 1${}^{\circ }$ opening angle of the cone at the highest altitude. The yellow line in the plots represents the line of sight of the ground-based FTIR at the time of the satellite overpass over the site.

[Figure omitted. See PDF]

Figure  shows the bar plots for the S5P CO mean relative bias (left panel) and the standard deviation of the relative bias (right panel) with respect to the NDACC CO column data at all stations. The comparisons relative to the NDACC smoothed CO data (labelled – ALLsm50k3h) are the blue bars, those for the NDACC un-smooth CO data (labelled – ALL50k3hr) are the magenta bars, and those for the NDACC ap-smooth CO data (labelled – ALLap50k3h) are the grey bars. The high-latitude stations show a high bias, while some stations like Paramaribo, Izaña and Mauna Loa show a low bias. The difference of the mean relative bias for S5P CO data for the NDACC smoothed CO (labelled – diff_smvsnosm) and NDACC ap-smooth (labelled – diff_apvsnosm) relative to the un-smooth CO data for each station are shown as magenta and grey bars in the middle panel plot of Fig. . It shows the magnitude of change in bias with values for some stations being positive while being negative for others. The effect of smoothing appears to be dependent on the station location. We observe a maximum difference of $-\mathrm{6.89}$ % and a mean difference of $\mathrm{0.86}\pm \mathrm{2.79}$ % for all stations for the diff_smvsnosm case. And we observe a maximum difference of $-\mathrm{11.26}$ % and a mean difference of $-\mathrm{2.49}\pm \mathrm{2.96}$ % for all stations for diff_apvsnosm case. The changes at some stations are significant as it is larger than the CO column error estimated in NDACC. The standard deviation of the relative bias for the S5P CO data relative to the NDACC CO data with and without smoothing is comparable.

Figure 26

S5P CO column validation results against NDACC CO column data at 23 stations within the period between November 2017 and September 2020. (a) Bar chart of mean relative bias ((SAT – GB)/GB) in percent; (c) standard deviation of the relative bias in percent; (b) difference of the mean relative bias for validation cases (ALL50k3h, ALLap50k3h, ALLsmcone50k3h) in percent against the reference case (ALLsm50k3h) in percent. Spatial co-location with radius of 50 km or cone with 1${}^{\circ }$ opening angle along the FTIR line of sight and time co-location of $\pm \mathrm{3}$ h around the satellite overpass was used. The stations are sorted with decreasing latitude.

[Figure omitted. See PDF]

The time series of the S5P CO column and NDACC smoothed CO column data for each site are shown in Figs.  and . The ground-based NDACC CO data are represented in grey and the S5P data during that period are shown in light red. The S5P data co-located with NDACC data are shown in red and the co-located NDACC smoothed data are shown in black. The implication of the altitude correction can easily be seen for stations located at high altitude (e.g. Zugspitze, Jungfraujoch, Izaña, Mauna Loa, Altzomoni, Maïdo). The S5P and NDACC measurements observe the same seasonal cycle of CO. Similar to the TCCON results, we also see that at several of the NDACC sites, S5P and NDACC sometimes observe very high values of CO columns due to the passing of the plumes with elevated CO concentrations over/nearby the station location (e.g. Wollongong, Boulder, St. Petersburg, Porto Velho). The time series of the relative bias plots shown in Figs.  and  indicate a seasonal cycle with a high bias seen during the high CO event and low bias seen during the low CO event. The high scatter observed at the Toronto site is related to the scatter observed in the ground-based NDACC CO column data at the site.

Figure 27

CO column time series for all NDACC data (grey), all S5P data (light red), S5P data co-located with NDACC data (red) and co-located NDACC data smoothed with S5P a priori and additionally smoothed with the S5P column-averaging kernel (black) at each site ordered with decreasing latitude. Spatial co-location with radius of 50 km and time of $\pm \mathrm{3}$ h around the satellite overpass was used.

[Figure omitted. See PDF]

Figure 28

Same as Fig. .

[Figure omitted. See PDF]

Figure 29

Relative difference ((satellite $-$ ground-based)/ground-based) of CO column time series for all co-located S5P data and NDACC data smoothed with S5P a priori and additionally smoothed with the S5P column-averaging kernel as the reference data at each site ordered with decreasing latitude as in Fig. . Spatial co-location with radius of 50 km and time of $\pm \mathrm{3}$ h around the satellite overpass was used.

[Figure omitted. See PDF]

Figure 30

Same as Fig. .

[Figure omitted. See PDF]

The relative biases of the S5P CO column and NDACC smoothed CO column data for each site are shown as a mosaic plot in Fig. . Each bar in the mosaic plot represents the weekly averages of the relative bias values. The plot shows high positive bias during the high CO event periods, which is then reduced and even switched sign to show negative bias during the low CO event periods. The biases at few stations like Toronto, Altzomoni and Arrival Heights appear as outliers in the plot. As NDACC CO column data are retrieved from solar absorption measurements, the data are not available during a few weeks in winter for high-latitude stations when the Sun is very low on the horizon.

Figure 31

Mosaic plots showing relative biases between co-located S5P and NDACC CO column data smoothed with S5P a priori and additionally smoothed with the S5P column-averaging kernel at 23 NDACC stations within the period between November 2017 and September 2020. Spatial co-location with radius of 50 km and time of $\pm \mathrm{3}$ h around the satellite overpass was used. The time resolution of the data shown here is weekly. The stations are sorted with decreasing latitude.

[Figure omitted. See PDF]

Taylor diagram for the S5P CO column and NDACC smoothed CO column data are shown in Fig. . The correlation, represented by the angular coordinate, is above 0.9 for most stations (see Table  for exact values), and the distance to the origin of the ground-based dot relative to the satellite dot is below 1 for most stations (except at Paramaribo and Rikubetsu, which is due to the limited data sets available for the comparison) implying that the satellite data are more variable than the ground-based data. The good correlation indicates that the temporal variations in the CO column captured by the ground-based instruments are reproduced very similarly by S5P. Outliers such as Wollongong, Boulder and Altzomoni are due to the co-location mismatch during the high CO events (e.g. passage of a plume with a high CO concentration in the vicinity of the site) observed at these sites. The altitude correction of the pixels works well, as can be seen by the relatively good correlation at the high-altitude stations.

Figure 32

Taylor diagram for daily mean differences between S5P and NDACC CO column data smoothed with S5P a priori and additionally smoothed with the S5P column-averaging kernel at 23 NDACC stations within the period between November 2017 and September 2020. Spatial co-location with radius of 50 km and time of $\pm \mathrm{3}$ h around the satellite overpass was used. The stations are sorted with decreasing latitude.

[Figure omitted. See PDF]

A total of 11 ground-based stations (Eureka, Ny-Ålesund, Bremen, Karlsruhe, Garmisch, Zugspitze, Rikubetsu, Izaña, Réunion–Maïdo, Wollongong and Lauder) contributed to the validation study by providing CO data from both TCCON and NDACC measurements performed at the sites. The mean difference in the relative bias of the S5P CO data with respect to the smoothed NDACC and TCCON (${\text{bias}}_{\mathrm{S}\mathrm{5}\mathrm{PvsNDACC}}-{\text{bias}}_{\mathrm{S}\mathrm{5}\mathrm{PvsTCCON}}$) for these 11 stations is $-\mathrm{4.41}\pm \mathrm{3.68}$ %. This indirectly implies that the NDACC CO is $\mathrm{4.41}\pm \mathrm{3.68}$ % larger than TCCON CO data. The ground-based data available for these 11 stations do not always cover the same period. Therefore, this is only a qualitative estimate indicating the mean difference between NDACC and TCCON CO data at these 11 sites. showed that the bias between co-located and smoothed TCCON and NDACC XCO data products for six stations has a mean value of 6.8 % (range 5.6 %–8.6 %). Our indirect comparison results for more sites and not exactly co-located ground-based data for the TCCON and NDACC show similar differences.

5.3 Comparison of circular vs. cone co-location criterion for validation of S5P carbon monoxide data

In our standard S5P CO validation settings with or without smoothing, we have used a co-location radius of 50 km around each ground-based site. In this section, we will discuss the validation results of the S5P CO column data with the smoothed ground-based data following the cone co-location criterion as described in Sect. . These results are further compared to the circular co-location criterion using the same settings.

The application of the cone co-location criterion is shown in Fig.  for one sample day. The top-left panel plot shows all available S5P pixels containing CO column number density data in the overpass file. The Altzomoni station is marked at the centre of the plot. The high CO values to the northwest of the station are the footprint of the CO from Mexico City. Towards the northeast side of the station, some missing pixels are filtered due to clouds. The top-right panel plot shows the co-located S5P pixels with circular co-location criterion with a radius of 50 km as used for the CO validation study. As seen in the plot, there are few pixels with high CO values in the northwest, which are included in the selected pixels. The yellow line in the plot represents the line of sight of the ground-based FTIR at Altzomoni. Therefore, the high CO values in the northwest will not be observed by the FTIR measurement. This mismatch is a cause of the potential bias. The bottom panel plot shows the co-located S5P pixels with the cone co-location criterion with 1${}^{\circ }$ opening angle of the cone at the highest altitude. The selected S5P pixels using the cone co-location criterion are in the line of sight of the ground-based FTIR instrument and will potentially reduce a mismatch and therefore lower the potential bias between the satellite and ground-based data.

The validation results of the S5P CO data relative to the TCCON and NDACC data with smoothing and applying cone co-location criterion are shown in columns 16–20 of Tables  and , respectively. Using the cone co-location criterion only marginally reduces the number of S5P co-locations with ground-based FTIRs (see column 16 in relation to column 3). This is due to the high density of the official S5P valid CO pixels availability. The S5P CO mean relative bias and the standard deviation of the relative bias with respect to TCCON and NDACC using the cone co-location criterion are shown as orange bars in the left panel and right panel plots of Figs.  and , respectively. The S5P CO mean relative bias is comparable or slightly smaller for the cone co-location criterion as compared to the circular co-location criterion. The standard deviation of the relative bias with the cone co-location criterion is similar to the standard deviation of the relative bias for the circular co-location criterion. The difference between the mean relative bias with circular and cone co-location criterion for the S5P CO data for each TCCON and NDACC station is shown as orange bars in the middle panel plot (labelled – diff_circvscone) of Figs.  and , respectively. The difference plot relative to TCCON shows the magnitude of change in bias, with values for some stations being negative while being positive for others. We observe a maximum difference of 2.56 % and a mean difference of $\mathrm{0.09}\pm \mathrm{0.55}$ % across all TCCON sites for the duration of available measurements used in this study. Sites where the relative bias using the cone criterion as compared to the circular criterion is outside the 1$\mathit{\sigma }$ limit of the mean are Eureka (0.6 %), Garmisch (0.81 %) and Zugspitze (2.56 %). The difference plot relative to NDACC shows the magnitude of change in bias, with values for some stations being negative while being positive for others. We observe a maximum difference of $-\mathrm{1.35}$ % and a mean difference of $-\mathrm{0.07}\pm \mathrm{0.47}$ % across the selected NDACC sites for the duration of available measurements used in this study. The sites where the relative bias using the cone criterion as compared to the circular criterion is outside the 1$\mathit{\sigma }$ limit of the mean are Eureka (0.78 %), Harestua ($-\mathrm{0.53}$ %), Zugspitze ($-\mathrm{0.75}$ %), Jungfraujoch ($-\mathrm{0.7}$ %), Boulder (0.64 %) and Arrival Heights ($-\mathrm{1.35}$ %). The high difference is observed mostly for the high-latitude stations where the cone co-location criteria following the ground-based FTIR line of sight are the best choice.

5.4 Validation of S5P CO (CLSKY, CLOUD and ALL) data using TCCON and NDACC data sets

As discussed in Sect. , we separated S5P retrievals performed for measurements under clear-sky (CLSKY; cloud optical thickness $<\mathrm{0.5}$ and cloud height $<\mathrm{500}$ m, over land) and cloudy conditions (CLOUD; cloud optical thickness $\ge \mathrm{0.5}$ and cloud height $<\mathrm{5000}$ m, over land and ocean) in addition to our standard all case (ALL; cloud height $<\mathrm{5000}$ m over land and ocean). The validation results of S5P CO for ALL settings have been discussed in detail in Sect. –. In this section, we show the validation results of the S5P CO for CLSKY and CLOUD settings against TCCON unscaled XCO with a priori alignment and NDACC CO column data with smoothing and compare the results in relation to the results of the ALL settings. Each validation run includes the adaptation of the S5P columns to the altitude of the ground-based FTIR instruments.

Tables  and  provide the validation results for the S5P CO data for the ALL case, CLSKY case and CLOUD case at each TCCON and NDACC station. The systematic difference (the mean of all relative differences) between the S5P and unscaled TCCON data is on average $\mathrm{2.45}\pm \mathrm{3.38}$ % (ALL case), $\mathrm{2.83}\pm \mathrm{3.43}$ % (CLSKY case) and $\mathrm{1.89}\pm \mathrm{3.11}$ % (CLOUD case). The standard deviation of the relative bias, which is a measure of the random error, is well below $<\mathrm{10}$ % for all sites except at Wollongong (ALL and CLOUD cases) and Pasadena (CLOUD case).

Table 8

Validation of S5P XCO ALL, CLSKY and CLOUD data with TCCON XCO data at 28 stations for the period between November 2017 and September 2020. Spatial co-location with radius of 50 km and time co-location of $\pm \mathrm{1}$ h around the satellite overpass were used. TCCON station (column 1) are sorted according to the decreasing latitude (column 2). The column with title “No.” represents the number of co-located measurements, column title “SD” represents the standard deviation of the time series of the ground-based data relative to the standard deviation of the time series of the S5P data, column title “Corr” represents the correlation coefficient between the S5P and the reference ground-based data, column title “Rel diff bias” represents the relative difference ((SAT – GB)/GB) bias in percent, and column title “Rel diff SD” represents the standard deviation of the relative bias in percent.

Sites	Lat	TCCON unsc XCO smooth 50 km 1 h ALL					TCCON unsc XCO smooth 50 km 1 h CLSKY					TCCON unsc XCO smooth 50 km 1 h CLOUD
		No.	SD	Corr	Rel diff	Rel diff	No.	SD	Corr	Rel diff	Rel diff	No.	SD	Corr	Rel diff	Rel diff
					bias (%)	SD (%)				bias (%)	SD (%)				bias (%)	SD (%)
Eureka	80	11 114	0.8	0.95	6.55	4.2	9738	0.8	0.94	7.31	4.34	6124	0.9	0.92	4.91	3.9
Ny-Ålesund	78.9	9495	0.9	0.97	7.54	4.4	7854	0.9	0.96	7.75	4.93	4637	0.9	0.97	6.12	4.43
Sodankylä	67.4	19 439	0.9	0.95	5.79	4.92	13242	0.9	0.94	6.44	5.56	8072	0.9	0.96	4.32	4.11
East Trout Lake	54.3	31 198	1	0.94	5.92	5.18	18 415	1	0.92	7.03	5.11	16 283	0.9	0.91	4.79	6.26
Białystok	53.2	4698	0.9	0.97	2.88	3.24	1122	1	0.98	2.04	2.02	4110	0.9	0.97	3.04	3.41
Bremen	53.1	1671	1	0.92	3.51	4.65	1028	1	0.96	4.82	3.65	1128	1	0.9	3.18	5.17
Karlsruhe	49.1	8593	1	0.97	0.01	2.94	4089	0.9	0.96	0.22	3.22	6472	1	0.96	0.04	3.21
Paris	48.8	12 139	1	0.93	2.27	3.59	5703	1.1	0.92	3.11	3.8	8627	1	0.93	1.77	3.64
Orléans	48	11 147	0.9	0.97	4.53	2.97	5155	0.9	0.95	4.98	3.44	8710	0.9	0.97	4.45	3.08
Garmisch	47.5	8325	1	0.92	4.16	4.58	3158	0.9	0.87	4.84	5.84	3609	0.9	0.93	3.07	4.36
Zugspitze	47.4	1887	1.2	0.8	8.27	7.69	741	1.2	0.7	5.86	9.38	861	1.1	0.84	5.13	7.12
Park Falls	45.9	16 796	1	0.94	4.31	6.48	9226	1	0.93	5.21	7.85	11 031	0.9	0.94	3.35	4.1
Rikubetsu	43.5	5164	1.1	0.97	3.89	3.77	2775	1	0.94	5.7	4.25	4398	1	0.97	3.15	3.53
Xianghe	39.8	11 349	0.9	0.95	$-\mathrm{6.02}$	6.9	4610	0.9	0.93	$-\mathrm{4.05}$	8.52	7910	0.9	0.95	$-\mathrm{6.79}$	6.79
Lamont	36.6	17 655	1	0.94	$-\mathrm{0.94}$	4.22	6513	0.9	0.88	$-\mathrm{0.4}$	4.79	15 225	1	0.94	$-\mathrm{1.15}$	4.27
Tsukuba	36	10 467	1	0.95	3.05	4.54	5651	0.9	0.95	5.04	4.2	7887	1	0.95	2.03	4.5
Nicosia	35.1	10 668	0.9	0.91	3.44	3.66	8320	0.8	0.87	4.38	4.78	9626	0.9	0.91	3.3	3.63
Edwards	35	34 554	0.9	0.94	3.1	4.71	17 050	0.9	0.94	2.32	4.74	32 387	0.9	0.93	3.5	5.09
JPL	34.2	4951	1.3	0.89	$-\mathrm{3.3}$	5.02	2626	1.2	0.84	$-\mathrm{2.9}$	5.75	3897	1.2	0.86	$-\mathrm{4.32}$	5.14
Pasadena	34.1	30 819	0.8	0.85	$-\mathrm{3.41}$	7.69	19 464	1	0.84	$-\mathrm{3.71}$	6.72	26 508	0.5	0.58	$-\mathrm{3.2}$	19.09
Saga	33.2	16 583	1	0.98	0.43	4	7581	1	0.95	1.36	4.89	14 660	1	0.97	0.63	4.27
Izaña	28.3	8715	1	0.89	5.14	4.91	3633	1	0.82	5.82	6.64	7997	1	0.89	5.02	4.96
Burgos	18.5	18 581	0.9	0.97	0.24	4.07	8442	0.9	0.94	0.69	4.67	17 951	0.9	0.97	0.09	4.17
Ascension	$-\mathrm{7.9}$	406	1.2	0.63	$-\mathrm{0.62}$	4.66	126	2	0.88	$-\mathrm{2.83}$	4.34	383	1.1	0.59	$-\mathrm{1.54}$	4.99
Darwin	$\mathrm{12.5}$	9292	1	0.92	$-\mathrm{0.66}$	6.13	3960	1.1	0.91	0.08	7.24	8361	1	0.93	$-\mathrm{0.76}$	5.83
Réunion	$-\mathrm{20.9}$	4045	0.9	0.96	3.46	4.71	1055	0.9	0.9	3.13	7.53	4045	0.9	0.95	3.59	4.9
Wollongong	$-\mathrm{34.4}$	10 479	0.8	0.82	2.02	17.93	7428	1	0.89	1.41	9.14	7430	0.8	0.77	2.52	22.37
Lauder	$-\mathrm{45}$	29 781	1	0.97	2.9	3.99	19 658	1	0.96	3.46	4.32	22 787	1	0.97	2.71	4.25
Mean of all stations			1	0.92	2.45	5.21		1	0.91	2.83	5.42		0.9	0.9	1.89	5.73
SD of all stations			0.1	0.07	3.38	2.79		0.2	0.06	3.43	1.84		0.1	0.1	3.11	4.37

Table 9

Validation of S5P CO column ALL, CLSKY and CLOUD data with NDACC CO column data at 23 stations for the period between November 2017 and September 2020. Spatial co-location with radius of 50 km and time co-location of $\pm \mathrm{3}$ h around the satellite overpass were used. NDACC station (column 1) are sorted according to the decreasing latitude (column 2). The column with title “No.” represents the number of co-located measurements, column title “SD” represents the standard deviation of the time series of the ground-based data relative to the standard deviation of the time series of the S5P data, column title “Corr” represents the correlation coefficient between the S5P and the reference ground-based data, column title “Rel diff bias” represents the relative difference ((SAT – GB)/GB) bias in percent, and column title “Rel diff SD” represents the standard deviation of the relative bias in percent.

Sites	Lat	NDACC CO smooth 50 km 3 h ALL					NDACC CO smooth 50 km 3 h CLSKY					NDACC CO smooth 50 km 1 h CLOUD
		No.	SD	Corr	Rel diff	Rel diff	No.	SD	Corr	Rel diff	Rel diff	No.	SD	Corr	Rel diff	Rel diff
					bias (%)	SD (%)				bias (%)	SD (%)				bias (%)	SD (%)
Eureka	80.1	714	0.8	0.95	12.96	4.56	597	0.8	0.95	12.23	4.08	300	0.8	0.96	11.72	4.64
Ny-Ålesund	78.9	90	0.9	0.97	11.43	4.26	89	0.8	0.96	10.7	4.65	71	0.9	0.97	11.72	4.1
Thule	76.5	2667	0.9	0.95	9.44	4.79	2388	0.9	0.95	9.43	4.67	1609	0.9	0.94	7.81	5.14
Kiruna	67.8	622	0.8	0.95	3.38	4.7	534	0.8	0.94	4.06	4.82	441	0.8	0.94	2.39	4.94
Harestua	60.2	216	0.9	0.97	6.7	3.73	159	0.9	0.95	6.48	4.45	126	1	0.97	6.81	3.69
St. Petersburg	59.9	843	0.9	0.96	6.67	3.88	741	0.9	0.94	6.41	4.31	654	0.9	0.94	6.76	4.52
Bremen	53.1	257	0.9	0.95	4.88	3.85	171	0.9	0.93	5.57	4.45	168	0.9	0.96	5.12	3.79
Karlsruhe	49.1	933	1	0.96	$-\mathrm{0.55}$	3.24	506	1	0.96	0.19	3.27	795	1	0.96	$-\mathrm{0.8}$	3.42
Garmisch	47.5	2181	1	0.93	3.99	4.79	1215	1	0.92	4.08	5.01	1773	1	0.94	3.93	5
Zugspitze	47.4	1773	1	0.91	6.16	5.16	1197	1	0.9	5.93	5.72	1326	1	0.94	6.38	5.31
Jungfraujoch	46.6	384	1	0.94	8.09	4.43	306	1	0.92	7	4.92	310	0.9	0.95	9.01	4.79
Toronto	43.6	935	1	0.9	11.82	7.11	400	1	0.9	10.27	6.32	868	1	0.89	12.47	7.74
Rikubetsu	43.5	43	1	0.97	7.65	3.57	31	1	0.95	6.98	3.63	37	1.1	0.96	8.82	4.61
Boulder	40	610	0.8	0.73	8.32	11.89	323	0.9	0.47	9.78	15.72	563	0.7	0.66	9.14	16.32
Izaña	28.3	657	0.9	0.92	2.5	4.22	276	1	0.85	2.67	5.78	613	0.9	0.93	2.53	4.14
Mauna Loa	19.5	155	0.9	0.97	2.65	3.22	81	0.9	0.88	2.1	6.11	145	0.9	0.96	2.51	3.64
Altzomoni	19.1	364	0.7	0.62	20.6	10.73	212	0.7	0.73	22.05	13.44	338	0.8	0.65	19.51	10.3
Paramaribo	5.8	59	1.2	0.82	0.88	6						59	1.2	0.82	1.01	5.98
Porto Velho	$-\mathrm{8.8}$	168	1	0.97	6.09	8.13	64	1	0.93	3.64	10.5	161	1	0.96	7.82	9.52
La Réunion–Maïdo	$-\mathrm{21.1}$	1117	0.9	0.98	6.44	4.62	265	0.9	0.96	7.92	6.61	1011	0.9	0.98	6.57	4.64
Wollongong	$-\mathrm{34.4}$	1403	0.5	0.7	9.17	23.01	1007	0.9	0.89	6.49	8.01	1050	0.5	0.7	10.7	26.87
Lauder	$-\mathrm{45}$	1805	0.9	0.96	7.82	4.54	1132	0.9	0.96	7.91	4.58	1501	0.9	0.97	7.82	4.81
Arrival Heights	$-\mathrm{77.8}$	174	0.8	0.95	18.3	5.63	164	0.8	0.95	17.59	5.2	111	0.9	0.94	18.24	5.95
Mean of all stations			0.9	0.91	7.62	6.09		0.9	0.9	7.7	6.19		0.9	0.91	7.74	6.69
SD of all stations			0.1	0.1	5.04	4.31		0.1	0.11	4.96	3.15		0.1	0.1	4.97	5.26

Figure  shows the bar plots for the S5P XCO mean relative bias (left panel) and the standard deviation of the relative bias (right panel) with respect to the TCCON XCO data at all stations. The comparisons relative to the TCCON unscaled XCO data for ALL case (labelled – unscsm50k1hALL) are the blue bars, those for the CLSKY case (labelled – unscsm50k1hCLSKY) are the red bars, and those for the CLOUD case (labelled – unscsm50k1hCLOUD) are the green bars. The middle panel plot of Fig.  shows for each TCCON station the difference of the mean relative bias for S5P XCO data using the TCCON unscaled XCO ALL case and the CLSKY case (labelled – diff_ALLvsCLSKY) as red bars, as well as the CLOUD case (labelled – diff_ALLvsCLOUD) as green bars. The overall direction of change for the CLSKY case is negative with few exceptions, the maximum value of change is 2.41 % and a mean value of $-\mathrm{0.38}\pm \mathrm{1.05}$ % for all stations. The overall direction of change for the CLOUD case is positive with few exceptions, the maximum value of change is 3.14 % and a mean value of $\mathrm{0.55}\pm \mathrm{0.79}$ % for all stations.

Figure 33

S5P XCO (ALL, CLSKY and CLOUD cases) validation results against TCCON XCO data at 28 stations within the period between November 2017 and September 2020. (a) Bar chart of mean relative bias ((SAT – GB)/GB) in percent; (c) standard deviation of the relative bias in percent; (b) difference of the mean relative bias for validation cases (unscsm50k1hCLSKY, unscsm50k1hCLOUD) in percent against the reference case (unscsm50k1hALL) in percent. Spatial co-location with radius of 50 km and time co-location of $\pm \mathrm{1}$ h around the satellite overpass was used. The stations are sorted with decreasing latitude.

[Figure omitted. See PDF]

The systematic difference (the mean of all relative differences) between the S5P and NDACC data is on average $\mathrm{7.62}\pm \mathrm{5.04}$ % (ALL case), $\mathrm{7.7}\pm \mathrm{4.96}$ % (CLSKY case) and $\mathrm{7.74}\pm \mathrm{4.97}$ % (CLOUD case). The validation results at the Altzomoni and Arrival Heights stations show a quite high bias also for the CLSKY and CLOUD cases, similar to that observed for the ALL case. Eliminating the results of these two stations from the statistics of the overall stations, we observe that the systematic difference between the S5P and NDACC data is on average $\mathrm{6.5}\pm \mathrm{3.54}$ % (ALL case), $\mathrm{6.49}\pm \mathrm{3.11}$ % (CLSKY case) and $\mathrm{6.68}\pm \mathrm{3.69}$ % (CLOUD case). The random error at Arrival Heights, a high-latitude station located on the Antarctic continent, is well below 10 %. The mean standard deviation of the relative bias, which is a measure of the random error, is well below $<\mathrm{10}$ % for all three cases of validation results with few exceptions for stations like Altzomoni, Wollongong and Boulder. The high values are due to the co-location mismatch during the high CO events (e.g. the passage of a plume with a high CO concentration in the vicinity of the site) observed at these sites.

Figure  shows the bar plots for the S5P CO mean relative bias (left panel) and the standard deviation of the relative bias (right panel) with respect to the NDACC CO column data at all stations. The comparisons relative to the NDACC CO column data for ALL case (labelled – ALLsm50k3h) are the blue bars, those for the CLSKY case (labelled – ALLsm50k3hCLSKY) are the red bars, and those for the CLOUD case (labelled – ALLsm50k3hCLOUD) are the green bars. The middle panel plot of Fig.  shows for each NDACC station the difference of the mean relative bias for S5P CO column data using the NDACC CO column ALL case and the CLSKY case (labelled – diff_ALLvsCLSKY) as red bars, as well as the CLOUD case (labelled – diff_ALLvsCLOUD) as green bars. The direction of change for the CLSKY and CLOUD cases is negative for some stations, while for other stations it is positive. The maximum value of change is 2.68 % and a mean value of $\mathrm{0.23}\pm \mathrm{1.11}$ % for CLSKY case for all stations. The maximum value of change is $-\mathrm{1.73}$ % and a mean value of $-\mathrm{0.11}\pm \mathrm{0.83}$ % for CLOUD case for all stations.

Figure 34

S5P CO column (ALL, CLSKY and CLOUD cases) validation results against NDACC CO column data at 23 stations within the period between November 2017 and September 2020. (a) Bar chart of mean relative bias ((SAT – GB)/GB) in percent; (c) standard deviation of the relative bias in percent; (b) difference of the mean relative bias for validation cases (ALLsm50k3hCLSKY, ALLsm50k3hCLOUD) in percent against the reference case (ALLsm50k3h) in percent. Spatial co-location with radius of 50 km and time co-location of $\pm \mathrm{3}$ h around the satellite overpass were used. The stations are sorted with decreasing latitude.

[Figure omitted. See PDF]

The CLSKY and CLOUD selection criteria can be useful in the case of specific applications. For example, the CLSKY case helped to reduce the standard deviation of the relative bias for Wollongong's TCCON and NDACC validation results. This is related to the significant filtering of the pixels over the ocean that are missing in the CLSKY case. The satellite clear-sky observations made over ocean have a too-low signal in the SWIR spectral region and are therefore filtered out. However, the ALL case results are quite comparable to the CLSKY and CLOUD cases in general and are therefore used as the general S5P CO data set in our validation studies.

5.5 Solar zenith angle dependence of the S5P carbon monoxide bias relative to ground-based reference data

In this section, we show the S5P carbon monoxide bias relative to the ground-based reference data as a function of the measurement SZA. Figure  shows the S5P relative bias for the a priori aligned and smoothed cases as a function of the measurement SZA against the reference ground-based TCCON stations at Sodankylä (left panel) and Lauder (right panel). As mentioned in Sect. , the S5P carbon monoxide data are only available for $\text{SZA}<\mathrm{80}$${}^{\circ }$. The upper limits of the plots therefore show values only until 80${}^{\circ }$. As explained in Sect. , the high values of S5P relative bias are observed during winter (measurements performed mostly at high SZAs) and the low values during summer (measurements performed mostly at low SZAs). We observe that the relative bias increases with increasing SZA of the measurement. This increase is about 10 % over the complete range of measurements SZAs.

Figure 35

Relative biases between co-located S5P XCO and TCCON unscaled XCO data with a priori aligned are plotted as a function of the S5P measurement solar zenith angles retrieved at a few TCCON stations within the period between November 2017 and September 2020. Spatial co-location with radius of 50 km and time of $\pm \mathrm{1}$ h around the satellite overpass was used. The colours represent the different months from January (1) until December (12) of a year.

[Figure omitted. See PDF]

6 Conclusions

In this study, we have done the geophysical validation of Sentinel-5 Precursor operational methane and carbon monoxide data sets (see Table  for version details) using reference ground-based TCCON and NDACC stations. A total of 28 TCCON stations and 24 NDACC stations covering a wide latitudinal range (Eureka at 80${}^{\circ }$ N to Arrival Heights at 77.8${}^{\circ }$ S), various atmospheric conditions (dry, humid, clean and polluted), various surface conditions (range of surface albedo), flat and high-altitude terrains, oceanic terrain have been used in this study. Furthermore, the combined use of the near-infrared TCCON data and mid-infrared NDACC data, as a whole network and at co-located stations, with their benefits helped to evaluate the Sentinel-5 Precursor operational methane and carbon monoxide product's quality in our validation study.

We found that the systematic difference between the S5P standard ${\mathrm{XCH}}_{\mathrm{4}}$ and a priori aligned TCCON data is on average $-\mathrm{0.68}\pm \mathrm{0.74}$ %. The systematic difference changes to a value of $-\mathrm{0.26}\pm \mathrm{0.56}$ % for the S5P bias-corrected ${\mathrm{XCH}}_{\mathrm{4}}$ data. The bias for both S5P standard and bias-corrected ${\mathrm{XCH}}_{\mathrm{4}}$ data is well within the mission requirements for bias (systematic error) of 1.5 %. We also found that the random error is well below 1 % for both standard ($\mathrm{0.59}\pm \mathrm{0.17}$ %) and bias-corrected ($\mathrm{0.57}\pm \mathrm{0.18}$ %) S5P ${\mathrm{XCH}}_{\mathrm{4}}$ data. Most stations show a correlation above 0.6; the poor correlations at some sites are mostly dominated by the seasonal cycle or due to limited data sets available for the comparison. The systematic differences between the S5P standard and bias-corrected ${\mathrm{XCH}}_{\mathrm{4}}$ against smoothed NDACC data are on average $-\mathrm{0.11}\pm \mathrm{1.19}$ % and $\mathrm{0.57}\pm \mathrm{0.83}$ %, respectively. As the accuracy and precision of NDACC ${\mathrm{CH}}_{\mathrm{4}}$ data are lower than TCCON, conclusions about the S5P systematic and random error are drawn based on TCCON validation results. The bias-correction of the S5P ${\mathrm{XCH}}_{\mathrm{4}}$ data being a function of the retrieved surface albedo acts differently at different locations. We observe high scatter in the relative bias for low surface albedo conditions. A seasonal dependency of the relative bias is seen. We observe a high bias during the springtime measurements at high SZAs for high-latitude sites and a decreasing bias with increasing SZA for the rest of the year at all sites. The SZA dependence of the bias includes albedo correction and a priori difference from the true atmospheric state. We estimated the contribution of the a priori alignment uncertainty at the ground-based stations and found values up to $\sim \mathrm{4.8}$ ppb at a TCCON station with mean value of $\sim -\mathrm{2.7}\pm \mathrm{1.3}$ ppb. The mean value of the smoothing uncertainty contribution at the NDACC stations is $\sim \mathrm{7}\pm \mathrm{5.3}$ ppb, with some stations showing high values of up to $\sim \mathrm{41.4}$ ppb. At the co-located TCCON and NDACC stations, we observed the highest contribution of the a priori alignment and smoothing uncertainty for midlatitude TCCON stations, whereas for the NDACC stations we observe the highest contribution for the high-latitude stations. The comparison with a priori alignment and taking smoothing effects into account is recommended as the preferred method. However, the direct comparison of the satellite and reference data is useful to see the influence of the averaging kernel and a priori difference compared to the true profile. We found that using the cone co-location criterion improves the co-location between the satellite and ground-based station by observing similar air mass. This is crucial for certain stations, which are located closer to emission sources or high-latitude ones. Currently, we found seven TCCON and NDACC stations where the bias changed by more than 2 ppb between the circular and cone co-location settings. The cone criterion also significantly reduces the number of co-locations for some sites, thereby making the statistics less reliable for those sites. The L2 algorithm teams are continuously working on improving the operational products by optimising their code with respect to the observed biases seen with respect to the reference data sets. These improvements will be implemented in future versions of the S5P data.

We found that the systematic difference between the S5P XCO and a priori aligned TCCON data is on average $\mathrm{9.22}\pm \mathrm{3.45}$ %. Due to the uncertainty of the scaling slope of XCO in TCCON to tie the TCCON XCO measurements to WMO in situ scale, we have also used the unscaled TCCON XCO data (without application of the empirical scaling factor) for S5P XCO validation. We found that the systematic difference between the S5P XCO and a priori aligned TCCON unscaled XCO data is on average $\mathrm{2.45}\pm \mathrm{3.38}$ %. Both results are within the mission requirements for bias (systematic error) of 15 %. We found that the difference of the relative bias using the TCCON unscaled XCO and the TCCON standard XCO data is on average $-\mathrm{6.77}\pm \mathrm{0.57}$ %. We estimated the contribution of the a priori alignment uncertainty in the validation and found that the magnitude of change between the a priori aligned and direct comparison is larger in the Southern Hemisphere than in the Northern Hemisphere except for sites located in polluted regions. The a priori alignment uncertainty contribution is significant at several sites, as it is larger than the estimated TCCON XCO error. We observe a mean difference of $\mathrm{0.43}\pm \mathrm{4.44}$ % across all TCCON stations with highest values of $-\mathrm{17.43}$ % for Xianghe (due to very high a priori profile difference). We found that the systematic difference between the S5P CO column and the NDACC CO column data (excluding two stations which were obvious outliers) is on average $\mathrm{5.69}\pm \mathrm{3.07}$ % (NDACC CO direct comparison), $\mathrm{3.14}\pm \mathrm{4.19}$ % (NDACC CO smoothed by using S5P a priori as the common prior) and $\mathrm{6.5}\pm \mathrm{3.54}$ % (NDACC CO profile with S5P a priori substituted and additionally smoothed with S5P column-averaging kernel). The effect of the smoothing depends on the station location with a mean difference of $\mathrm{0.86}\pm \mathrm{2.79}$ % across all NDACC stations and a maximum value of $-\mathrm{6.89}$ % in relation to the direct comparison. The effect of smoothing by doing only a priori substitution in relation to the direct comparison gives a mean difference of $-\mathrm{2.49}\pm \mathrm{2.96}$ % across all NDACC stations and a maximum value of $-\mathrm{11.26}$ %. The comparison with a priori alignment and taking smoothing effects into account is recommended as the preferred method. Most TCCON and NDACC stations show a correlation above 0.9, indicating that the temporal variations in CO column captured by the ground-based instruments are reproduced very similarly by S5P. The few exceptions are due to the limited data sets available for the comparison. We also found that the S5P random error for the TCCON and NDACC validation results is well below 10 %, except for few stations where a co-location mismatch occurs during certain periods with high values of CO events occurring due to plumes passing over/nearby the stations. A seasonal dependency of the relative bias is seen. We observe a high bias during the high CO event and low bias during the low CO event. We observed a mean difference of $\mathrm{0.09}\pm \mathrm{0.55}$ % with a maximum difference of 2.56 % for TCCON validation results using the cone co-location criterion compared to the circular co-location criterion. The results of the cone selection criterion at the NDACC stations show higher values than for the TCCON stations. We observe a mean difference of $-\mathrm{0.07}\pm \mathrm{0.47}$ % with a maximum difference of $-\mathrm{1.35}$ %. The high difference is observed mostly for high-latitude stations, where the cone co-location criterion following the line of sight of the ground-based FTIR is the best choice in finding co-located satellite pixels for validation. Furthermore, we observed that the validation results of the clear-sky and cloud cases of S5P pixels are in general comparable to the validation results including all pixels passing the filter criteria. The clear-sky or cloud cases are however useful for certain applications. We observe that the relative bias increases with increasing SZA of the measurement. We estimated this increase to be 10 % over the complete range of measurement SZAs.

Based on the validation results of the S5P operational methane and carbon monoxide data sets against the reference ground-based TCCON and NDACC data sets, we conclude that the S5P methane and carbon monoxide data are of high quality and fulfil the requirements for systematic and random uncertainties.

Appendix A Reducing a priori and averaging kernel contribution in the validation

The S5P and ground-based FTIR instruments have different instrument sensitivities and use different a priori profiles to retrieve the best representation of the true atmospheric state from the recorded spectra. The S5P uses an a priori profile derived from the TM5 model, a global chemistry transport model, whereas the TCCON uses a daily a priori profile generated by a stand-alone programme provided by and NDACC uses a single a priori profile from climatology of the Whole Atmosphere Community Climate Model version 6 (WACCM V6; ftp://nitrogen.acom.ucar.edu/user/jamesw/IRWG/2013/WACCM/V6/, last access: 1 June 2021). In order to make the quantitative comparison, the influence of the a priori contribution to the smoothing equation needs to be compensated/corrected by adjusting the retrieval results to a common a priori profile . The S5P prior is used as the common prior. It is regridded to the FTIR grid using a mass conservation algorithm . For the case where the satellite pixel elevation is above the ground-based site altitude, the S5P prior profile is extrapolated (i.e. a simple extension, the lowest VMR is taken as the VMR at the lowest ground-based grid) to the altitude of the ground-based instrument. The regridded S5P prior ${\mathit{x}}_{\mathrm{a}\mathrm{\_}\mathrm{S}\mathrm{5}\mathrm{P}}$ is substituted in the FTIR retrieval.

A1$${\mathit{x}}_{\mathrm{FTIR}\mathrm{\_}\mathrm{mod}\mathrm{\_}\mathrm{prior}}={\mathit{x}}_{\mathrm{FTIR}}+(\mathbf{I}-{\mathbf{A}}_{\mathrm{FTIR}})(x_{\mathrm{a}\mathrm{\_}\mathrm{S}\mathrm{5}\mathrm{P}}-{\mathit{x}}_{\mathrm{a}\mathrm{\_}\mathrm{FTIR}}),$$ where ${\mathit{x}}_{\mathrm{FTIR}}$ is the original VMR profile, $x_{\mathrm{a}\mathrm{\_}\mathrm{FTIR}}$ is the a priori profile used for the original FTIR retrieval (${\mathit{x}}_{\mathrm{FTIR}}$), ${\mathit{x}}_{\mathrm{FTIR}\mathrm{\_}\mathrm{mod}\mathrm{\_}\mathrm{prior}}$ is the corrected FTIR-retrieved profile, ${\mathbf{A}}_{\mathrm{FTIR}}$ is the FTIR averaging kernel matrix, and $\mathbf{I}$ is the unity matrix. This step reduces the total smoothing uncertainty on the column differences by eliminating the uncertainty on the FTIR a priori. Although Eq. () is only valid for NDACC profiles, it can be modified to be applied for TCCON column data as well. In that case, the prior profiles should be transformed to partial column profiles and divided by the total column of FTIR dry air.

For NDACC profiles, to further reduce the smoothing uncertainty contribution introduced by the averaging kernel, we smooth the corrected FTIR-retrieved profile (${\mathit{x}}_{\mathrm{FTIR}\mathrm{\_}\mathrm{mod}\mathrm{\_}\mathrm{prior}}$) with the S5P column-averaging kernel (${\mathbf{cA}}_{\mathrm{S}\mathrm{5}\mathrm{P}}$). This requires the regridding of the corrected FTIR-retrieved profile to the S5P column-averaging kernel grid before applying the smoothing equation: A2$$\begin{array}{rl}& {\mathit{c}}_{\mathrm{FTIR}\mathrm{\_}\mathrm{smoothed}}={\mathit{c}}_{\mathrm{a}\mathrm{\_}\mathrm{S}\mathrm{5}\mathrm{P}}\\ & +{\mathbf{cA}}_{\mathrm{S}\mathrm{5}\mathrm{P}}\left[\right({\mathit{x}}_{\mathrm{FTIR}\mathrm{\_}\mathrm{mod}\mathrm{\_}\mathrm{prior}}-{\mathit{x}}_{\mathrm{a}\mathrm{\_}\mathrm{S}\mathrm{5}\mathrm{P}})\times {\mathit{n}}_{\mathrm{dry},\mathrm{air}}],\end{array}$$ where ${\mathit{c}}_{\mathrm{a}\mathrm{\_}\mathrm{S}\mathrm{5}\mathrm{P}}$ is the column values derived from the S5P a priori profile and ${\mathit{c}}_{\mathrm{FTIR}\mathrm{\_}\mathrm{smoothed}}$ is the smoothed FTIR column associated with a co-located S5P pixel. The ${\mathit{n}}_{\mathrm{dryair}}$ in Eq. () is the partial column profile calculated from the pressure difference ($\mathrm{\Delta }P$) between the layer interfaces and the hydrostatic equation: A3$$\mathrm{\Delta }P=m_{\mathrm{wet},\mathrm{air}}\times n_{\mathrm{wet},\mathrm{air}}\times g.$$ For ${\mathrm{CH}}_{\mathrm{4}}$, the partial column of dry air is available in the S5P level 2 files. For CO, we derive it using the pressure on the boundaries as described in Eq. (). In Eq. () above, $n_{\mathrm{wet},\mathrm{air}}$ is approximated by $n_{\mathrm{dry},\mathrm{air}}$ and the molar mass of wet air is approximated by the molar mass of dry air as there is no ${\mathrm{H}}_{\mathrm{2}}\mathrm{O}$ profile available in the S5P prior. We found that this approximation has only a small influence, e.g. the bias change at Paramaribo, a tropical site, is about 0.2 % when compared to the case of using NCEP ${\mathrm{H}}_{\mathrm{2}}\mathrm{O}$ profile. If the satellite pixel elevation is below the FTIR site altitude, the regridding of the corrected FTIR-retrieved profile is done such that the FTIR profile is extended with the S5P a priori profile. This extension of the a priori profile cancels on the right-hand side of Eq. () and the FTIR smoothed column coincides with the S5P a priori partial column for the region where the grids mismatch.

Appendix B S5P pixel altitude correction

An altitude correction is done for each S5P pixel in order to take into account the altitude difference between the S5P pixels and the ground-based station. The correction can be significant for co-location with mountain stations where the satellite pixels can be picked up from locations around the station, which are at lower or higher altitudes than stations. The scaling factor ($f$) is calculated from the satellite a priori profile using the following equation: B1$$f={\displaystyle \frac{{\mathit{c}}_{\mathrm{S}\mathrm{5}\mathrm{P}}(\text{FTIR}\text{altitude}\to \text{toa})}{{\mathit{c}}_{\mathrm{S}\mathrm{5}\mathrm{P}}(\text{S5P}\text{pixel}\text{altitude}\to \text{toa})}},$$ where the numerator is the partial column from the FTIR station altitude to the top of the atmosphere (toa) and the denominator is the total column from the pixel altitude to the top of the atmosphere. The scaling factor is less than 1 for cases where the satellite pixels are located below the altitude of the FTIR station. In certain cases, where the S5P pixels are above the FTIR station, the scaling factor goes above 1. The scaling factor is applied to the satellite data such that the co-located pairs are on the same FTIR station altitude. Equation () is valid for satellite pixels $<$ station altitude, and we use the S5P prior profile. However, in the other case where satellite pixels $>$ station altitude, we extrapolate the satellite prior to compensate the small altitude differences.

The S5P products are adapted to the altitude of the station by either cutting off the scaled mixing ratio profiles at the station altitude (for the FTIR station at high-altitude locations) or by extending the profile assuming a constant elongation of the mixing ratio up to the station altitude (for the case where S5P pixel altitude is above the FTIR station). This method of S5P pixel altitude correction is applied when the satellite and ground-based columns are not calculated between the same boundaries, e.g. S5P vs. TCCON, and S5P vs. NDACC without extra satellite smoothing.

Data availability

The S5P ${\mathrm{CH}}_{\mathrm{4}}$ and $\mathrm{CO}$ data used in this study are made available to the S5P Mission Performance Centre via the ESA expert hub. Since the public release of the $\mathrm{CO}$ and ${\mathrm{CH}}_{\mathrm{4}}$ products, the data have been available at the Copernicus Open Access Hub (https://scihub.copernicus.eu, last access: 1 December 2020). The public S5P $\mathrm{CO}$ data can be accessed via (10.5270/S5P-1hkp7rp) and the public S5P ${\mathrm{CH}}_{\mathrm{4}}$ data can be accessed via (10.5270/S5P-3p6lnwd). The FTIR TCCON data are available via the TCCON data archive, hosted by CaltechDATA (, 10.14291/TCCON.GGG2014). The FTIR TCCON data without the scaling to the WMO scale were obtained from the site PIs. The data from individual stations can be downloaded from the ftp server hosted at NOAA (ftp://ftp.cpc.ncep.noaa.gov/ndacc/station/, last access: 1 June 2021) depending on the site PI's decision.

Author contributions

MKS and BL designed the study and produced the validation analysis and results. MKS wrote the first draft of the paper with support of BL. JL and AL had a joint responsibility in the S5P ${\mathrm{CH}}_{\mathrm{4}}$ prototype algorithm and operational processor. JL and TB had a joint responsibility in the S5P CO prototype algorithm and operational processor. All authors contributed in the generation of the data used in this study. All authors read the paper and provided comments.

Competing interests

The authors declare that they have no conflict of interest.

Disclaimer

Publisher’s note: Copernicus Publications remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Acknowledgements

Part of this study has been carried out in the framework of the Copernicus Sentinel-5 Precursor Mission Performance Centre (S5P, MPC) contracted by the European Space Agency (ESA/ESRIN, contract no. 4000117151/16/I-LG) and supported by the Belgian Federal Science Policy Office (BELSPO), the Royal Belgian Institute for Space Aeronomy (BIRA-IASB). Part of this study has also been supported by the S5P Validation Team (S5PVT) AO project TCCON4S5P (ID no. 28603, PI Mahesh Kumar Sha, BIRA-IASB) with national funding from the BELSPO through the ESA ProDEx projects TROVA and TROVA-E2 (PEA 4000116692). This work contains modified Copernicus Sentinel-5 Precursor satellite data (2018–2020) post-processed by BIRA-IASB.

The authors wish to thank the instrument operators and scientists doing the retrieval for the delivery of the ground-based reference data, which were used for the validation study in this paper. We thank Olivier Rasson and José Granville for their support with the creation of S5P overpass level 2 files and download of data used in this study at BIRA-IASB.

The Eureka TCCON and NDACC measurements were made at the Polar Environment Atmospheric Research Laboratory by the Canadian Network for the Detection of Atmospheric Change, primarily supported by the Natural Sciences and Engineering Research Council of Canada (NSERC), Environment and Climate Change Canada (ECCC) and the Canadian Space Agency. The Toronto NDACC measurements were made at the University of Toronto Atmospheric Observatory, supported by NSERC and ECCC. East Trout Lake is funded through grants from the CFI, ORF, NSERC and the CSA. Funding for the Edwards TCCON stations is provided by NASA's Earth Science Division. Funding for the Darwin, Lamont and Pasadena TCCON sites is provided by NASA's OCO-2/-3 projects (grant nos. NNN12AA01C and 80NM0018D0004), while the Park Falls site plus TCCON (the network) is funded through NASA Carbon Cycle Science Program (grant no. NNX17AE15G). Measurements in Ny-Ålesund and Paramaribo are supported by the Alfred Wegener Institute Potsdam. We thank the AWIPEV station personnel in Ny-Ålesund, Cornelis Becker and Sukarni Mitro (Meteorologische Dienst Suriname) in Paramaribo and the Senate of Bremen for support. The observations at Ny-Ålesund are supported within the DFG, German Research Foundation, project ID 268020496 – TRR 172 project (AC)3, Arctic Amplification, subproject E02. The Sodankylä site received financial support from the European Space Agency under the grant agreement no. ESA-IPL-POE-LG-cl-LE-2015-1129. The Paris TCCON site has received funding from Sorbonne Université, the French research centre CNRS, the French space agency CNES and Région Île-de-France. TCCON sites at Tsukuba, Rikubetsu and Burgos are supported in part by the GOSAT series project. Burgos is supported in part by the Energy Development Corp. Philippines. The TCCON Nicosia site has received additional support from the European Union's Horizon 2020 research and innovation programme under grant agreement no. 856612 and the Cyprus Government, and by the University of Bremen. The Ascension Island TCCON station has been supported by the European Space Agency (ESA) under grant no. 4000120088/17/I-EF and by the German Bundesministerium für Wirtschaft und Energie (BMWi) under grant nos. 50EE1711C and 50EE1711E. We thank the ESA Ariane Tracking Station at North East Bay, Ascension Island, for hosting and local support. The TCCON and NDACC sites at Réunion Island is operated by the Royal Belgian Institute for Space Aeronomy and local activities supported by LACy/UMR8105 and by OSU-R/UMS3365 – Université de La Réunion. The TCCON Réunion Island site is financially supported since 2014 by the EU project ICOS-Inwire and the ministerial decree for ICOS (FR/35/IC1 to FR/35/IC5). The ${\mathrm{CH}}_{\mathrm{4}}$ and $\mathrm{CO}$ measurements at Porto Velho have been supported by the cooperation agreement BAAF and the BRAIN-pioneer project IKARE, respectively, both funded by BELSPO. We thank Carlos Augusto Bauer Aquino (IFRO) and Luciana Vanni Gatti (INPE) for their technical support for the measurements at Porto Velho.

The NDACC data used in this publication were obtained as part of the Network for the Detection of Atmospheric Composition Change (NDACC) and are publicly available (see http://www.ndaccdemo.org/, last access: 1 June 2021). Rapid delivery data on NDACC are supported for selected sites by the CAMS27 project (https://cams27.aeronomie.be/, last access: 1 June 2021). The National Center for Atmospheric Research is sponsored by the National Science Foundation. The NCAR FTS observation programmes at Thule, GR, Boulder, CO, and Mauna Loa, HI, are supported under contract by the National Aeronautics and Space Administration (NASA). The Thule work is also supported by the NSF Office of Polar Programs (OPP). We wish to thank the Danish Meteorological Institute for support at the Thule site and NOAA for support of the Mauna Loa Observatory (MLO) site. The NDACC and TCCON stations (Ascension Island, Bremen, Garmisch, Izaña, Ny-Ålesund, Paramaribo and Karlsruhe) have been supported by the German Bundesministerium für Wirtschaft und Energie (BMWi) via DLR under grants 50EE1711A–E. The FTIR sites (Garmisch, Izaña, Karlsruhe, Kiruna and Zugspitze) have been supported by the Helmholtz Society via the research program ATMO. The NDACC/TCCON Izaña data benefit from the financial support from the Ministerio de Economía y Competitividad from Spain for the project INMENSE (CGL2016-80688-P). We thank the International Foundation High Altitude Research Stations Jungfraujoch and Gornergrat (HFSJG, Bern) for supporting the facilities needed to perform the FTIR observations at Jungfraujoch. The University of Liège contribution has been supported primarily by the Fonds de la Recherche Scientifique – FNRS under grant no. J.0147.18, by the GAW-CH program of MeteoSwiss, as well as by the CAMS project. Emmanuel Mahieu is a senior research associate of the F.R.S.-FNRS. The RUOA network “Red Universitaria de Observatorios Atmosféricos de la Universidad Nacional Autónoma de México” is acknowledged for the support of the Altzomoni site. Omar Lopez and Delibes Flores Roman are acknowledged for technical support. Alejandro Bezanilla and Noemie Taquet are acknowledged for helping with measurements and data processing. For the Altzomoni site, UNAM-DGAPA (grant nos. IN111418 and IN107417) and CONACYT (grant no. 290589) are acknowledged. The St. Petersburg site of the NDACC is operated by Saint Petersburg State University with the financial support provided by the Russian Foundation for Basic Research (grant no. 18-05-00011). The scientific equipment is maintained by the Geomodel research centre of SPbU. The NDACC site at Rikubetsu is operated as parts of the joint research programme of the Institute for Space-Earth Environmental Research (ISEE), Nagoya University, and supported in part by the GOSAT series project. The Wollongong NDACC site is funded by the Australia Research Council (grant no. DP160101598). Measurements at Lauder and Arrival Heights are core funded by NIWA through New Zealand's Ministry of Business, Innovation and Employment Strategic Science Investment Fund. Dan Smale thanks Antarctica New Zealand for providing support for the measurements at Arrival Heights.

Financial support

This research has been supported by the European Space Agency (ESA/ESRIN, contract no. 4000117151/16/I-LG) and the Belgian Federal Science Policy Office (BELSPO), the Royal Belgian Institute for Space Aeronomy (BIRA-IASB), the S5P Validation Team (S5PVT) AO project TCCON4S5P (ID no. 28603, PI Mahesh Kumar Sha, BIRA-IASB) with national funding from the BELSPO through the ESA ProDEx projects TROVA and TROVA-E2 (PEA 4000116692).

Review statement

This paper was edited by Andreas Richter and reviewed by two anonymous referees.