# Error Analysis and Evaluation of the Latest GSMap and IMERG Precipitation Products over Eastern China

Authors: Shaowei Ning; Fan Song; Parmeshwar Udmale; Juliang Jin; Bhesh Raj Thapa; Hiroshi Ishidaira
Journal: Advances in Meteorology
 (2017)

---

## Abstract

The present study comprehensively analyzes error characteristics and performance of the two latest GPM-era satellite precipitation products over eastern China from April 2014 to March 2016. Analysis results indicate that the two products have totally different spatial distributions of total bias. Many of the underestimations for the GSMap-gauged could be traced to significant hit bias, with a secondary contribution from missed precipitation. For IMERG, total bias illustrates significant overestimation over most of the eastern part of China, except upper reaches of Yangtze and Yellow River basins. GSMap-gauged tends to overestimate light precipitation (<16 mm/day) and underestimate precipitation with rain rate larger than 16 mm/day; however, IMERG underestimates precipitation at rain rate between 8 and 64 mm/day and overestimates precipitation at rain rate more than 64 mm/day. IMERG overestimates extreme precipitation indices (RR99P and R20TOT), with relative bias values of 17.9% and 11.5%, respectively. But GSMap-gauged shows significant underestimation of these indices. In addition, both products performed well in the Huaihe, Liaohe, and Yangtze River basins for extreme precipitation detection. At basin scale comparisons, the GSMap-gauged data has a relatively higher accuracy than IMERG, especially at the Haihe, Huaihe, Liaohe, and Yellow River basins.


---

## Body

## 1. Introduction

An accurate estimation of precipitation is essential to provide useful information for meteorological and climatological research, water resource management, and natural disasters (e.g., drought and flood) management caused by extreme rainfall events [1]. Current unevenly and sparsely distributed rain-gauge networks, especially in developing countries, face severe challenges while obtaining reliable spatiotemporal precipitation information. By contrast, satellite meteorology has remarkably contributed to estimating spatially continuous precipitation on a global basis by various visible/thermal infrared (Vis/IR) and passive microwave (PMW) sensors [2–7]. Till date, numerous sorts of satellite precipitation retrieving algorithms and products (e.g., TRMM Multisatellite Precipitation Analysis product (TMPA), Precipitation Estimation from Remote Sensed Information Using Artificial Neural Networks-Cloud Classification System (PERSIANN-CCS), Global Satellite Mapping of Precipitation product (GSMap), and Climate Prediction Center (CPC) morphing technique product (CMORPH)) have been developed and generated over the past decades [8–13].As TRMM’s successor, the Global Precipitation Mission (GPM) which is managed by the American National Aeronautics and Space Administration (NASA) and the Japanese Aerospace Exploration Agency (JAXA) has provided the latest high spatiotemporal resolution global precipitation products since March 2014. Compared to previous TRMM instruments, the GPM Microwave Imager (GMI) and the Dual-Frequency Precipitation Radar (DPR) operated by the GPM Core Observatory improve the precipitation detection capabilities significantly [6]. NASA has released its first GPM-era global precipitation product named the Integrated Multisatellite Retrievals for the GPM (IMERG) since 12th March 2014. Meanwhile, JAXA also upgraded its precipitation retrieving algorithm by assimilating PMW information from GPM Core GMI and released its newest version of global precipitation product, GSMap (version 6). The above two products which have a fine spatial resolution (0.1° for both) and relatively short temporal resolution (half-hourly for IMERG and hourly for GSMap) are referred as GPM-era satellite precipitation products (GSPPs).There are promising and wide-ranging uses of these GSPPs, from near real-time extreme weather monitoring to climatological and hydrometeorological research, especially for developing countries (like China) with sparsely distributed in situ gauge network and long latency time for data availability. Nevertheless, previous studies have found that inherent biases and errors of satellite precipitation products might notably influence their applications in hydrological modeling and extreme weather impact assessment [14]. To facilitate the applications of these products at regional and global scales, it is important to quantitatively validate them and identify the error characteristics before being used in applied settings. Currently, few researchers have assessed the accuracy of these products over China. Chen and Li [15] and Ning et al. [16] analyzed IMERG product error over Mainland China for a year and 20 months, respectively, by comparing satellite precipitation products with about 800 rain-gauge stations. However, the above analyses were based on the monthly scale, and the approximate 800 discrete rain-gauge stations that were used for the analysis could not provide a very detailed precipitation observation for error analysis in spatial. Xu et al. [17] and Tang et al. [18] investigated the characteristics and the source of the errors contained in IMERG by a bias decomposition scheme for warm season in 2014 and 2015 which could not reflect error distribution in different seasons for IMERG. Also, Guo et al. [19] evaluated IMERG over China with China daily Precipitation Analysis Product (CPAP) as a reference, but the evaluation and comparison were only performed over one year from March 12, 2014, through February 28, 2015. In addition, previous researchers evaluated performance of IMERG only at country scale but not at the basin or subbasin scales where GSPPs might usually be used for various hydrometeorological studies [20]. Furthermore, there have been few explorations of the error characteristics for the newest GSMap dataset (GPM-GSMap Ver. 6, released to the public since September 2, 2014) and even limited evaluations of the performance of these GSPPs for capturing extreme precipitation events over China.Therefore, to evaluate the effective application of GSPPs, the main objectives of this study are (1) to analyze the comprehensive error structures of two latest GSPPs (i.e., GSMap-gauged Ver. 06 and IMERG Ver. 04) over eastern China at 0.25° spatial resolution; (2) to explore the capacity of these GSPPs in detecting extreme precipitation events throughout eastern China; and (3) further to test the performance of these two products over the eight main river basins of eastern China where GSPPs have broader use of space. Besides, our overarching goal is to provide basic accuracy information about the GSPPs over eastern China for potential users who wish to use these products in their research, such as water balance analysis, water resource management, and hydrometeorological modeling, and we anticipate that these products will prove useful for subsequent investigations. A two-year data sequence (April 2014 to March 2016) was selected for this study, during which both the satellite data and reference data were available.


## 2. Study Area and Data

### 2.1. Study Area

Previous studies have indicated that most satellite precipitation products show significant differences between the western and eastern parts of China and application of satellite precipitation products over the western China is difficult [21, 22]. In this study, we mainly focus on the eastern part of China, including eight first level river basins (Figure 1). The study area has a typical humid/semihumid climate and is under control of tropical, subtropical, and temperate monsoon, with annual precipitation more than 400 mm. Concentrating period of precipitation over this region is from May to September. In addition, this region is the most economically active region in China, about 95% of the Chinese population lives in this area, and it comprises 56.1% of the total land area and 73% of the national GDP. Figure 1 and Table 1 provide details about the study region and eight main river basins selected for this study.Table 1
Summary of eight first level basins of eastern China.
River basin name
Number of subbasins
Area (thousand Km2)
Songhua River
8
964.6
Liaohe River
6
326.0
Haihe River
4
322.5
Huaihe River
5
799.4
Yellow River
8
335.5
Yangtze River
12
1803.8
Southeast River
6
249.5
Pearl River
9
582.0Figure 1
Study area and location of about 2400 gauges used in CPAP.


### 2.2. Ground Reference Data

The ground reference data named China daily Precipitation Analysis Product (CPAP) was obtained from the National Meteorological Information Center and China’s Meteorological Administration (CMA). This product with a 0.25° spatial resolution is used as a reference to evaluate the GSPPs. About 2419 rain-gauge observations (as shown in Figure1) were interpolated with the climatology-based Optimal Interpolation (OI) technique to yield the gridded analysis product. All the gauge data used in CPAP have undergone strict quality control in three levels including the extreme values’ check, internal consistency check, and spatial consistency check [19]. CPAP has been systematically validated by Shen and Xiong [23] and found that the daily analysis has very good agreements with the observations over different regions of China. It has been shown that this dataset can accurately capture precipitation processes and has a definitive advantage in quantitative precipitation monitoring and was also successful in validating high-resolution satellite-based precipitation estimates [19, 24].


### 2.3. Satellite-Based Precipitation Datasets

The characteristics of two latest GSPPs data used in this study for detail analysis are described in Table2. The data from April 2014 to March 2016 is used for the analysis. The IMERG final run version 04 product (first released to the public since March 22, 2017) is the latest level-3 GPM precipitation dataset. The IMERG estimate takes advantages of three prior precipitation retrieval algorithms (PERSIANN-CCS, CMORPH, and TMPA). It combines precipitation measurements from various PMW sensors of GPM constellation and infrared estimates on geosynchronous satellites and is finally adjusted by monthly gauge data from GPCC (Global Precipitation Climatology Centre) Monitoring Product (Version 4) using the method applied in TMPA [16]. Readers can refer to Huffman et al. [25, 26] and Hou et al. [6] for more detailed introduction about IMERG products.Table 2
Characteristics of the two latest GSPPs.
Name
Input PMW sensor
Temporalresolution
Spatialresolution
Coverage & start time
Latency
Provider
IMERG (v.4)
GMI, TMI, AMSR-E, SSMIS, MHS
0.5 hourly
0.1°
60°N–S/Mar. 2014
2–4 months
NASA
GSMap-gauged (v.6)
TMI, GMI, AMSR-E, SSM/I, SSMIS, AMSU, MHS, AMSR, AMSR2
1 hourly
0.1°
60°N–S/Mar. 2014
1-2 days
JAXAAt the time when the GPM mission was launched, GSMap project developed a corresponding GPM-era precipitation retrieval algorithm (GPM-GSMap Version 06) by adding information from GPM Core GMI. The GSMap algorithm generates precipitation estimates by following steps: first, calculating the rainfall rate from PWM sensors; then, propagating rainfall affected area using forward and backward morphing technique; finally, refining the estimated data based on infrared brightness temperature by Kalman filter approach [10, 27–29]. The GSMap algorithm also includes the Japan Meteorological Agency Global Analysis (JMA-GANAL) data and Merged Satellite/in situ Global Daily Sea Surface Temperatures (MGDSST) data as inputs [15]. The GSMap-Gauge dataset is one error-corrected GSMap product which is based on GSMap-MVK (a pure satellite-based GSMap product without correction by gauge data) and adjusted by the CPC global daily gauge data analysis [30, 31]. In this article, we also use “GSMap-gauged” to stand for GSMap-Gauge data.Both IMERG and GSMap-gauged products with native 0.1° spatial resolution are aggregated into 0.25°/daily spatiotemporal resolutions to keep consistent with the ground reference dataset (CPAP). In addition, the gauge analysis used to adjust and correct the satellite estimates, which are the CPC Unified Daily Gauge Analysis for the GSMap-gauged and the GPCC monthly gauge analysis for the IMERG, may contain the same gauge stations which are also used to generate CPAP. Results of the comparison between the GSMap and the IMERG with the ground reference data (CPAP) are therefore affected by the similarities between the two gauge analyses used to adjust the satellite estimates and the reference dataset. We provide the detailed gauge station density distribution for the CPAP, CPC, and GPCC data in the Supplementary File (Figures A1–3) in Supplementary Material available online athttps://doi.org/10.1155/2017/1803492. Table A1 shows information of gauge stations used for generating or adjusting the three products and the same stations numbers between CPAP and CPC, GPCC products for eight river basins. There are 348 and 582 stations used in CPC and GPCC data over the study area; among them, 195 and 129 stations are the same with the stations used in CPAP data for CPC and GPCC data, respectively. The grids which cover these same stations are not used for comparison; only the data pairs over a grid where there is reporting stations are used in calculating comparison statistics which are shown in Figures 5, 6, 7, 11, 12, and 13, as well as Table 6.


## 2.1. Study Area

Previous studies have indicated that most satellite precipitation products show significant differences between the western and eastern parts of China and application of satellite precipitation products over the western China is difficult [21, 22]. In this study, we mainly focus on the eastern part of China, including eight first level river basins (Figure 1). The study area has a typical humid/semihumid climate and is under control of tropical, subtropical, and temperate monsoon, with annual precipitation more than 400 mm. Concentrating period of precipitation over this region is from May to September. In addition, this region is the most economically active region in China, about 95% of the Chinese population lives in this area, and it comprises 56.1% of the total land area and 73% of the national GDP. Figure 1 and Table 1 provide details about the study region and eight main river basins selected for this study.Table 1
Summary of eight first level basins of eastern China.
River basin name
Number of subbasins
Area (thousand Km2)
Songhua River
8
964.6
Liaohe River
6
326.0
Haihe River
4
322.5
Huaihe River
5
799.4
Yellow River
8
335.5
Yangtze River
12
1803.8
Southeast River
6
249.5
Pearl River
9
582.0Figure 1
Study area and location of about 2400 gauges used in CPAP.


## 2.2. Ground Reference Data

The ground reference data named China daily Precipitation Analysis Product (CPAP) was obtained from the National Meteorological Information Center and China’s Meteorological Administration (CMA). This product with a 0.25° spatial resolution is used as a reference to evaluate the GSPPs. About 2419 rain-gauge observations (as shown in Figure1) were interpolated with the climatology-based Optimal Interpolation (OI) technique to yield the gridded analysis product. All the gauge data used in CPAP have undergone strict quality control in three levels including the extreme values’ check, internal consistency check, and spatial consistency check [19]. CPAP has been systematically validated by Shen and Xiong [23] and found that the daily analysis has very good agreements with the observations over different regions of China. It has been shown that this dataset can accurately capture precipitation processes and has a definitive advantage in quantitative precipitation monitoring and was also successful in validating high-resolution satellite-based precipitation estimates [19, 24].


## 2.3. Satellite-Based Precipitation Datasets

The characteristics of two latest GSPPs data used in this study for detail analysis are described in Table2. The data from April 2014 to March 2016 is used for the analysis. The IMERG final run version 04 product (first released to the public since March 22, 2017) is the latest level-3 GPM precipitation dataset. The IMERG estimate takes advantages of three prior precipitation retrieval algorithms (PERSIANN-CCS, CMORPH, and TMPA). It combines precipitation measurements from various PMW sensors of GPM constellation and infrared estimates on geosynchronous satellites and is finally adjusted by monthly gauge data from GPCC (Global Precipitation Climatology Centre) Monitoring Product (Version 4) using the method applied in TMPA [16]. Readers can refer to Huffman et al. [25, 26] and Hou et al. [6] for more detailed introduction about IMERG products.Table 2
Characteristics of the two latest GSPPs.
Name
Input PMW sensor
Temporalresolution
Spatialresolution
Coverage & start time
Latency
Provider
IMERG (v.4)
GMI, TMI, AMSR-E, SSMIS, MHS
0.5 hourly
0.1°
60°N–S/Mar. 2014
2–4 months
NASA
GSMap-gauged (v.6)
TMI, GMI, AMSR-E, SSM/I, SSMIS, AMSU, MHS, AMSR, AMSR2
1 hourly
0.1°
60°N–S/Mar. 2014
1-2 days
JAXAAt the time when the GPM mission was launched, GSMap project developed a corresponding GPM-era precipitation retrieval algorithm (GPM-GSMap Version 06) by adding information from GPM Core GMI. The GSMap algorithm generates precipitation estimates by following steps: first, calculating the rainfall rate from PWM sensors; then, propagating rainfall affected area using forward and backward morphing technique; finally, refining the estimated data based on infrared brightness temperature by Kalman filter approach [10, 27–29]. The GSMap algorithm also includes the Japan Meteorological Agency Global Analysis (JMA-GANAL) data and Merged Satellite/in situ Global Daily Sea Surface Temperatures (MGDSST) data as inputs [15]. The GSMap-Gauge dataset is one error-corrected GSMap product which is based on GSMap-MVK (a pure satellite-based GSMap product without correction by gauge data) and adjusted by the CPC global daily gauge data analysis [30, 31]. In this article, we also use “GSMap-gauged” to stand for GSMap-Gauge data.Both IMERG and GSMap-gauged products with native 0.1° spatial resolution are aggregated into 0.25°/daily spatiotemporal resolutions to keep consistent with the ground reference dataset (CPAP). In addition, the gauge analysis used to adjust and correct the satellite estimates, which are the CPC Unified Daily Gauge Analysis for the GSMap-gauged and the GPCC monthly gauge analysis for the IMERG, may contain the same gauge stations which are also used to generate CPAP. Results of the comparison between the GSMap and the IMERG with the ground reference data (CPAP) are therefore affected by the similarities between the two gauge analyses used to adjust the satellite estimates and the reference dataset. We provide the detailed gauge station density distribution for the CPAP, CPC, and GPCC data in the Supplementary File (Figures A1–3) in Supplementary Material available online athttps://doi.org/10.1155/2017/1803492. Table A1 shows information of gauge stations used for generating or adjusting the three products and the same stations numbers between CPAP and CPC, GPCC products for eight river basins. There are 348 and 582 stations used in CPC and GPCC data over the study area; among them, 195 and 129 stations are the same with the stations used in CPAP data for CPC and GPCC data, respectively. The grids which cover these same stations are not used for comparison; only the data pairs over a grid where there is reporting stations are used in calculating comparison statistics which are shown in Figures 5, 6, 7, 11, 12, and 13, as well as Table 6.


## 3. Methods

### 3.1. Validation and Extreme Precipitation Metrics

A set of widely used traditional statistical metrics were selected to quantitatively evaluate the performance of GSPPs in this study. Two continuous verification metrics which measure the accuracy of a continuous variable (i.e., precipitation volume) were used: Correlation Coefficient (CC) and Mean Error (ME). The CC was used to check the degree of linear correlation between GSPPs and observations. The ME describes the average magnitude of the error. In addition, a contingency table was used to evaluate the capacity of GSPPs in monitoring the occurrence of precipitation events (as shown in Table3). Hit stands for a case that observed precipitation is detected by satellite product correctly. Missed is the case that observed precipitation is not detected by satellite product. False case means when the observation is not precipitation but satellite product is. Hn, Mn, and Fn are the times of occurrence of the corresponding cases, respectively. Based on Table 3, two categorical verification metrics which measure the correspondence between the estimated and observed occurrences of precipitation events were selected: the Probability of Detection (POD) and False Alarm Ratio (FAR). POD measures the fraction of occurred precipitation events that are correctly detected by satellite product. FAR measures the fraction of events in which satellite detects precipitation but precipitation does not occur [23, 32, 33]. Table 4 lists the validation metrics used in this study.Table 3
Contingency table for comparing observed and satellite-based precipitation.
Satellite products
Rain
No rain
Observation
Rain
Hit(Hn)
Missed(Mn)
No rain
False(Fn)
Correct negative(Cn)Table 4
List of the continuous and categorical verification metrics used in the evaluation.
Statistic metric
Formula
Perfect value (range)
Correlation Coefficient (CC)
C
C
=
1
/
N
∑
n
=
1
N
(
S
n
-
S
-
)
(
O
n
-
O
-
)
σ
s
σ
o
1 (0-1)
Mean Error (ME)
M
E
=
1
N
∑
n
=
1
N
S
n
-
O
n
0 (−∞–+∞)
Probability of Detection (POD)
P
O
D
=
H
n
H
n
+
M
n
1 (0-1)
False Alarm Ratio (FAR)
F
A
R
=
F
n
H
n
+
F
n
0 (0-1)Besides, six extreme precipitation indices were used to evaluate the performance of the two GSPPs in detecting precipitation extremes over eastern China. They are divided into three categories: percentile (RR99p and RR95p), absolute threshold (R20 and R20TOT), and duration (CWD and CDD). All these indices are defined by the Expert Team on Climate Change Detection and Indices (ETCCDI) which is sponsored by the Commission for Climatology of the World Meteorological Organization’s World Climate Research Program [16, 34–36]. The indices are listed in Table 5.Table 5
The precipitation indices used in this study.
Name
Definition
RR99p (mm/day)
The 99th percentile of daily precipitation on wet days
RR95p (mm/day)
The 95th percentile of daily precipitation on wet days
R20 (day)
Number of days with daily precipitation amount more than 20 mm
R20TOT (mm)
Total precipitation sum of daily precipitation that is more than 20 mm
CWD (day)
The largest number of consecutive days during which all daily precipitation amount is above 1 mm
CDD (day)
The largest number of consecutive days during which all daily precipitation amount is below 1 mmTable 6
Statistics of extreme precipitation indices for the eight river basins over eastern China.
Basins
GSMap-gauged
GPM IMERG
CC
RB (%)
RMSE
CC
RB (%)
RMSE
Songhua River
RR99P
0.42
−17.60
5.90
0.52
21.45
7.19
RR95P
0.71
−11.75
1.61
0.69
−4.89
1.45
R20
0.46
−38.90
2.49
0.52
15.15
1.74
R20TOT
0.44
−41.84
81.51
0.54
42.77
84.96
CWD
0.48
20.83
2.28
0.09
−3.67
2.12
CDD
0.71
3.05
11.41
0.40
10.32
19.49
Haihe River
RR99P
0.77
−8.93
3.99
0.59
12.63
6.11
RR95P
0.62
−2.24
1.07
0.32
0.05
1.60
R20
0.80
−13.31
1.34
0.60
11.91
1.71
R20TOT
0.85
−16.60
43.18
0.70
27.80
70.79
CWD
0.22
20.98
1.44
0.25
−3.64
1.07
CDD
0.33
−1.84
13.55
0.16
−2.15
16.58
Huaihe River
RR99P
0.80
−5.43
6.84
0.82
7.83
6.98
RR95P
0.91
3.31
1.65
0.86
2.07
2.04
R20
0.90
−0.53
1.68
0.83
0.47
2.18
R20TOT
0.94
−6.98
64.39
0.90
8.72
82.28
CWD
0.63
16.69
1.63
0.43
−4.68
1.54
CDD
0.68
−4.79
6.21
0.36
−0.49
8.84
Yellow River
RR99P
0.88
−10.10
3.91
0.71
3.91
5.66
RR95P
0.89
−3.59
1.35
0.70
−13.30
2.46
R20
0.87
−15.22
1.64
0.77
−0.24
1.93
R20TOT
0.89
−19.85
49.73
0.77
16.56
66.94
CWD
0.81
9.29
1.36
0.62
−10.11
1.70
CDD
0.45
−1.17
12.48
−0.22
40.36
39.43
Yangtze River
RR99P
0.78
−14.52
10.30
0.79
20.07
14.58
RR95P
0.91
−8.69
3.07
0.85
−2.76
4.34
R20
0.92
−11.17
3.90
0.87
−5.00
4.05
R20TOT
0.92
−18.42
172.60
0.90
11.92
178.04
CWD
0.60
25.76
3.13
0.19
−6.89
2.54
CDD
0.86
−3.98
7.75
0.55
39.08
26.31
Pearl River
RR99P
0.69
−15.63
14.81
0.53
30.10
23.71
RR95P
0.80
−10.56
4.28
0.83
−0.34
3.51
R20
0.83
−9.88
4.62
0.83
−12.48
4.72
R20TOT
0.82
−18.49
258.00
0.81
9.24
205.10
CWD
0.53
22.21
3.81
0.50
−22.53
3.42
CDD
0.64
−3.00
6.22
0.52
15.18
9.39
Southeast River
RR99P
0.38
−19.55
15.11
0.31
9.42
13.35
RR95P
0.80
−13.23
4.92
0.75
−1.00
3.22
R20
0.75
−9.83
4.77
0.49
−3.77
5.07
R20TOT
0.77
−20.89
292.03
0.66
0.43
201.83
CWD
−0.11
38.87
4.64
0.08
3.39
2.22
CDD
−0.07
4.73
4.10
0.19
5.06
4.32
Liaohe River
RR99P
0.84
−13.93
5.15
0.73
22.90
8.53
RR95P
0.87
−5.34
1.25
0.81
−4.41
1.80
R20
0.72
−19.58
1.94
0.75
31.02
2.43
R20TOT
0.83
−30.26
69.93
0.83
43.34
107.01
CWD
0.61
29.50
2.40
0.58
−13.71
1.58
CDD
0.86
−0.26
12.74
0.36
−9.78
25.08


### 3.2. Error Decomposition

The error decomposition method used to evaluate the error components of satellite precipitation estimates is first proposed by Tian et al. [33, 37]. This method breaks down the total precipitation error E (total bias) into three independent parts: hits error (H), missed precipitation (-M), and false precipitation (F). The total bias is calculated by satellite-based precipitation minus observed precipitation. The three decomposed components can be obtained by subtracting observed precipitation from the satellite precipitation estimate for hit, missed, and false alarm events, respectively. The description of hit, missed, and false alarm events have already been presented in Table 3. The relation of these four error type can be described by the following equation: E=H-M+F. This approach of decomposing the total bias has been proved that it could improve our understanding and recognizing of the error characteristics of satellite precipitation products.


## 3.1. Validation and Extreme Precipitation Metrics

A set of widely used traditional statistical metrics were selected to quantitatively evaluate the performance of GSPPs in this study. Two continuous verification metrics which measure the accuracy of a continuous variable (i.e., precipitation volume) were used: Correlation Coefficient (CC) and Mean Error (ME). The CC was used to check the degree of linear correlation between GSPPs and observations. The ME describes the average magnitude of the error. In addition, a contingency table was used to evaluate the capacity of GSPPs in monitoring the occurrence of precipitation events (as shown in Table3). Hit stands for a case that observed precipitation is detected by satellite product correctly. Missed is the case that observed precipitation is not detected by satellite product. False case means when the observation is not precipitation but satellite product is. Hn, Mn, and Fn are the times of occurrence of the corresponding cases, respectively. Based on Table 3, two categorical verification metrics which measure the correspondence between the estimated and observed occurrences of precipitation events were selected: the Probability of Detection (POD) and False Alarm Ratio (FAR). POD measures the fraction of occurred precipitation events that are correctly detected by satellite product. FAR measures the fraction of events in which satellite detects precipitation but precipitation does not occur [23, 32, 33]. Table 4 lists the validation metrics used in this study.Table 3
Contingency table for comparing observed and satellite-based precipitation.
Satellite products
Rain
No rain
Observation
Rain
Hit(Hn)
Missed(Mn)
No rain
False(Fn)
Correct negative(Cn)Table 4
List of the continuous and categorical verification metrics used in the evaluation.
Statistic metric
Formula
Perfect value (range)
Correlation Coefficient (CC)
C
C
=
1
/
N
∑
n
=
1
N
(
S
n
-
S
-
)
(
O
n
-
O
-
)
σ
s
σ
o
1 (0-1)
Mean Error (ME)
M
E
=
1
N
∑
n
=
1
N
S
n
-
O
n
0 (−∞–+∞)
Probability of Detection (POD)
P
O
D
=
H
n
H
n
+
M
n
1 (0-1)
False Alarm Ratio (FAR)
F
A
R
=
F
n
H
n
+
F
n
0 (0-1)Besides, six extreme precipitation indices were used to evaluate the performance of the two GSPPs in detecting precipitation extremes over eastern China. They are divided into three categories: percentile (RR99p and RR95p), absolute threshold (R20 and R20TOT), and duration (CWD and CDD). All these indices are defined by the Expert Team on Climate Change Detection and Indices (ETCCDI) which is sponsored by the Commission for Climatology of the World Meteorological Organization’s World Climate Research Program [16, 34–36]. The indices are listed in Table 5.Table 5
The precipitation indices used in this study.
Name
Definition
RR99p (mm/day)
The 99th percentile of daily precipitation on wet days
RR95p (mm/day)
The 95th percentile of daily precipitation on wet days
R20 (day)
Number of days with daily precipitation amount more than 20 mm
R20TOT (mm)
Total precipitation sum of daily precipitation that is more than 20 mm
CWD (day)
The largest number of consecutive days during which all daily precipitation amount is above 1 mm
CDD (day)
The largest number of consecutive days during which all daily precipitation amount is below 1 mmTable 6
Statistics of extreme precipitation indices for the eight river basins over eastern China.
Basins
GSMap-gauged
GPM IMERG
CC
RB (%)
RMSE
CC
RB (%)
RMSE
Songhua River
RR99P
0.42
−17.60
5.90
0.52
21.45
7.19
RR95P
0.71
−11.75
1.61
0.69
−4.89
1.45
R20
0.46
−38.90
2.49
0.52
15.15
1.74
R20TOT
0.44
−41.84
81.51
0.54
42.77
84.96
CWD
0.48
20.83
2.28
0.09
−3.67
2.12
CDD
0.71
3.05
11.41
0.40
10.32
19.49
Haihe River
RR99P
0.77
−8.93
3.99
0.59
12.63
6.11
RR95P
0.62
−2.24
1.07
0.32
0.05
1.60
R20
0.80
−13.31
1.34
0.60
11.91
1.71
R20TOT
0.85
−16.60
43.18
0.70
27.80
70.79
CWD
0.22
20.98
1.44
0.25
−3.64
1.07
CDD
0.33
−1.84
13.55
0.16
−2.15
16.58
Huaihe River
RR99P
0.80
−5.43
6.84
0.82
7.83
6.98
RR95P
0.91
3.31
1.65
0.86
2.07
2.04
R20
0.90
−0.53
1.68
0.83
0.47
2.18
R20TOT
0.94
−6.98
64.39
0.90
8.72
82.28
CWD
0.63
16.69
1.63
0.43
−4.68
1.54
CDD
0.68
−4.79
6.21
0.36
−0.49
8.84
Yellow River
RR99P
0.88
−10.10
3.91
0.71
3.91
5.66
RR95P
0.89
−3.59
1.35
0.70
−13.30
2.46
R20
0.87
−15.22
1.64
0.77
−0.24
1.93
R20TOT
0.89
−19.85
49.73
0.77
16.56
66.94
CWD
0.81
9.29
1.36
0.62
−10.11
1.70
CDD
0.45
−1.17
12.48
−0.22
40.36
39.43
Yangtze River
RR99P
0.78
−14.52
10.30
0.79
20.07
14.58
RR95P
0.91
−8.69
3.07
0.85
−2.76
4.34
R20
0.92
−11.17
3.90
0.87
−5.00
4.05
R20TOT
0.92
−18.42
172.60
0.90
11.92
178.04
CWD
0.60
25.76
3.13
0.19
−6.89
2.54
CDD
0.86
−3.98
7.75
0.55
39.08
26.31
Pearl River
RR99P
0.69
−15.63
14.81
0.53
30.10
23.71
RR95P
0.80
−10.56
4.28
0.83
−0.34
3.51
R20
0.83
−9.88
4.62
0.83
−12.48
4.72
R20TOT
0.82
−18.49
258.00
0.81
9.24
205.10
CWD
0.53
22.21
3.81
0.50
−22.53
3.42
CDD
0.64
−3.00
6.22
0.52
15.18
9.39
Southeast River
RR99P
0.38
−19.55
15.11
0.31
9.42
13.35
RR95P
0.80
−13.23
4.92
0.75
−1.00
3.22
R20
0.75
−9.83
4.77
0.49
−3.77
5.07
R20TOT
0.77
−20.89
292.03
0.66
0.43
201.83
CWD
−0.11
38.87
4.64
0.08
3.39
2.22
CDD
−0.07
4.73
4.10
0.19
5.06
4.32
Liaohe River
RR99P
0.84
−13.93
5.15
0.73
22.90
8.53
RR95P
0.87
−5.34
1.25
0.81
−4.41
1.80
R20
0.72
−19.58
1.94
0.75
31.02
2.43
R20TOT
0.83
−30.26
69.93
0.83
43.34
107.01
CWD
0.61
29.50
2.40
0.58
−13.71
1.58
CDD
0.86
−0.26
12.74
0.36
−9.78
25.08


## 3.2. Error Decomposition

The error decomposition method used to evaluate the error components of satellite precipitation estimates is first proposed by Tian et al. [33, 37]. This method breaks down the total precipitation error E (total bias) into three independent parts: hits error (H), missed precipitation (-M), and false precipitation (F). The total bias is calculated by satellite-based precipitation minus observed precipitation. The three decomposed components can be obtained by subtracting observed precipitation from the satellite precipitation estimate for hit, missed, and false alarm events, respectively. The description of hit, missed, and false alarm events have already been presented in Table 3. The relation of these four error type can be described by the following equation: E=H-M+F. This approach of decomposing the total bias has been proved that it could improve our understanding and recognizing of the error characteristics of satellite precipitation products.


## 4. Results and Discussions

### 4.1. Error Components Analysis

In this section, we analyze the error characteristics for both satellite precipitation products at the daily scale and 0.25° resolution. For each product, we broke down the total bias for each day over the eastern China region and then aggregated the daily error components and total errors to whole study period and seasonal time scale (two summer periods and two winter periods). Figure2 shows the spatial distributions of error components for the study period. The two products have totally different spatial patterns. For GSMap-gauged, total bias indicates that this product underestimates precipitation over most of the southern China region. This underestimation might have resulted from the hit bias which shows obvious underestimation over southern China, as shown in Figure 2(b). Missed precipitation is not as obvious as false precipitation but has distinct influence over the south part of Pearl River basin (Figure 2(c)). The slight overestimation at Huaihe, Haihe, middle, and lower reaches of Yellow River basin is mainly caused by false precipitation (Figure 2(e)). For IMERG, total bias illustrates significant overestimations over most of the eastern part of China, except upper reaches of Yangtze and Yellow River basins (Figure 2(e)). This overestimation at eastern part of China is the comprehensive impact of hit bias and false precipitation, although missed precipitation may counteract some of this impact. Besides, missed precipitation is more evident in case of IMERG than GSMap-gauged and underestimations in total bias of IMERG are mostly caused by missed precipitation, especially over upper reaches of Yangtze and Yellow River basins (Figure 2(g)). The spatial patterns of the error components, averaged for the summer (June, July, and August) and winter (December, January, and February), are shown in Figures 3 and 4, respectively, to look into seasonal variations of error components distribution.Figure 2
Total bias and three error components of GSMap-gauged and IMERG precipitation data from April 2014 to March 2016 over eastern China.
(a)
GSMap-gauged
(b)
GSMap-gauged
(c)
GSMap-gauged
(d)
GSMap-gauged
(e)
GPM IMERG
(f)
GPM IMERG
(g)
GPM IMERG
(h)
GPM IMERGFigure 3
Total bias and three error components of GSMap-gauged and IMERG precipitation data for the summer (JJA) over two years (2014 and 2015).
(a)
GSMap-gauged
(b)
GSMap-gauged
(c)
GSMap-gauged
(d)
GSMap-gauged
(e)
GPM IMERG
(f)
GPM IMERG
(g)
GPM IMERG
(h)
GPM IMERGFigure 4
Same as Figure3 but for the winter (DJF).
(a)
GSMap-gauged
(b)
GSMap-gauged
(c)
GSMap-gauged
(d)
GSMap-gauged
(e)
GPM IMERG
(f)
GPM IMERG
(g)
GPM IMERG
(h)
GPM IMERGFigure 5
Variations of the error components for both satellite products by elevation over the total study period from April 2014 to March 2016.
(a)
GSMap-gauged
(b)
GPM IMERGFigure 6
The intensity distribution of the total precipitation as well as the hit, missed, and false precipitation.
(a)
(b)
(c)
(d)Figure 7
Scatter diagrams of extreme precipitation indices between GSPPs and observations over eastern China. The color represents the occurrence possibility and red color region shows that more percent of points are located there.In the case of the summer, the two satellite products have similar hit bias and total bias over most part of study area, suggesting that the most significant error contribution is from hit events (Figure3). Regarding the GSMap-gauged, underestimation is dominant and spatial pattern of underestimation in total bias is very similar with that in hit bias, with less contribution from missed precipitation. Slight overestimation in total bias over Huaihe and lower reaches of Yangtze River basins is related to a significant amount of hit bias (Figure 3(b)), with some contribution from false precipitation events (Figure 3(d)). For the IMERG, however, the positive total bias over the eastern China is mostly due to hit bias. This overestimation in hit bias may be caused by the inability to capture warm rain processes or short-lived convective storms at lower latitudes [38]. In addition, the obvious underestimation in total bias over upper reaches of Yellow and Yangtze River basins is mainly cause by the hit bias (Figure 3(f)) and missed precipitation (Figure 3(g)), the possible reasons are that, first, the IMERG algorithm may miss warm and orographic precipitation in this mountainous regions; second, the CPCC data used to adjust IMERG may also have significant error in this region because of few gauge stations here used for interpolation and unsatisfactory treatment of orographic effects here. Conversely, missed precipitation is not a significant error source for the GSMap-gauged data (Figure 3(c)). Figures 3(d) and 3(h) demonstrate that false precipitation of GSMap-gauged is more pronounced than that of IMERG in summer.During the winter season, both products showed similar spatial distributions for the total bias and hit bias with the results for the summer season. The significant difference exists in missed precipitation, where comparing with the summer season the GSMap-gauged clearly missed more events in the south part of Pearl River basin (Figure4(c)); this may be associated with low-level cloudiness and warm rain processes in the winter that may not have the distinct characteristics of ice particles. Meanwhile, IMERG missed more events in the upper reaches of Yangtze and Yellow River basins and southern part of China (Figure 4(g)); this may be attributed to PMW’s inability to measure snowfall/rainfall over snow and ice covered land surfaces. Regarding GSMap-gauged data, overestimation over the southern China are mainly determined by false precipitation, while for the IMERG, the primary determining error factor is hit bias. It is also noted that false precipitation for both products is more obvious in winter.Elevation may also be a major impact factor in the error distribution of the satellite precipitation data. Therefore it is useful to identify the total bias and each error component with respect to elevation over eastern China, as shown in Figure5. We found that for both products, the impact of elevation was totally different. The error components of IMERG show an obvious topographic dependency, but such feature is not very obvious in GSMap-gauged. The total bias of GSMap-gauged keeps the similar tendency with that of hit bias and is all negative. This indicates that GSMap-gauged tends to underestimate precipitation over most regions of eastern China. For the IMERG, total bias is positive when elevation is less than 750 meters and changes to be negative with elevation larger than 750 meters due to the contribution of hit bias and missed precipitation which increase negatively with the rising of the terrain. In addition, there is more missed precipitation for the IMERG than the GSMap-gauged product, which can also be seen in Figures 2–4(c, g). From the topographic analysis of error components, it can be concluded that the GSMap algorithm and error-correction method are more effective in balancing the errors related to topography.To better explore the feature of error components of the two products, the intensity distributions of total precipitation as well as precipitation amount of hit, missed, and false precipitation events are shown in Figure6. These intensity distributions are calculated as the ratio of sum of precipitation amounts in each bin to the total sum of observed precipitation amount over the total study period. Both datasets show different distributions of the total precipitation, as shown in Figure 6(a). GSMap-gauged overestimates light precipitation (<16 mm/day) but underestimates more precipitation with rain rate larger than 32 mm/day, whereas although IMERG gets close to observation for light precipitation (<8 mm/day), it underestimates precipitation at rain rate between 8 and 64 mm/day and significantly overestimates precipitation at rain rate more than 64 mm/day. Distributions of hit precipitation of the two products look similar as these of total precipitation, which proves that hit bias plays the major role in total bias. Figure 6(c) shows that missed precipitation is almost located in range of 1 to 64 mm/day for both products; IMERG has more missed precipitation than GSMap-gauged, which is also reflected by the spatial distribution shown in Figures 2(c) and 2(g). In addition, GSMap-gauged has a narrow distribution of false precipitation, concentrating at precipitation with rain rates less than 64 mm/day, as compared to IMERG. False precipitation for GSMap-gauged is larger than its missed precipitation, while for IMERG the situation is quite the reverse. In summary, the breakdown of errors at spatial better enabled us to identify the error sources and their contributions to the total error.


### 4.2. Extreme Precipitation Events Comparison

Density-colored scatter diagrams of extreme precipitation indices between GSPPs and observations over eastern China are presented in Figure7. For two percentile indices (RR99P and RR95P), both satellite products have good correlation with observation with high CC values (all greater than 0.85). It is obvious that IMERG tends to overestimate extreme precipitation with relative bias (RB) values of RR99P more than 17%. But the condition is almost opposite for GSMap-gauged which underestimates RR99P significantly (with RB lower than −10%). This may be explained by probability density function shown in Figure 6(a) that intensity distribution of total precipitation for IMERG (GSMap-gauged) is higher (lower) than that for observation at precipitation rate more than 64 mm/day. For RR95P, both products have high CC values (all more than 0.90) but with negative RB. This may also be explained by probability density function shown in Figure 6(a) that intensity distributions of total precipitation for both products are lower than that for observation at precipitation rate between 16 and 64 mm/day. Regarding absolute threshold indices (R20 and R20TOT), results are similar with percentile indices for both products. In addition, it should be noted that the CC (RMSE) values of six indices for GSMap-gauged are almost higher (lower) than that for IMERG. This implies that the ability of GSMap-gauged in detecting extreme precipitation is relatively more stable than IMERG. For two duration indices (CWD and CDD), IMERG shows poor results with low CC value and high RMSE values. Figure 7(e) shows that GSMap-gauged overestimates CWD significantly (RB more than 20%). This may be attributed to the reason that more no-rain days are identified as rain events when correcting GSMap-gauged data using daily observation data to reduce overall precipitation error. It should be noted by data users, especially while utilizing these products to monitor real-time drought, that IMERG identifies more no-rain days than reality.In addition, we calculated these extreme precipitation indices for both products over eight eastern river basins, respectively. The results indicate that at basin scale, both products performed well in cases of the Huaihe, Liaohe, and Yangtze River basins; however, for the Songhua, Haihe, and Southeast River basins, the two products could not observe accurate extreme precipitation, as shown in Table6. IMERG overestimates RR99P and R20TOT at most of eight basins. GSMap-gauged shows different degrees of underestimation for these two indices at all of eight basins. For duration indices, IMERG shows very bad results at all eight basins.


### 4.3. Performance Analysis at the Basin Scale

Researchers have been attempting to use satellite precipitation data in water balance analyses, hydrological modeling, and flood forecasting at the basin or subbasin scale [20, 39]. Considering its usefulness, in this section we consider the basin scale analysis to evaluate the performance of both products over the eight main basins in eastern China. Figures 8 and 9 show the daily and monthly spatial distributions of CC and ME over the 58 subbasins that are located within the eight main river basins. For the GSMap-gauged data on the daily scale, CC values tend to be higher at the middle part of eastern China, with high values (>0.80) located at the Haihe, Huaihe River basins, and the lower reaches of the Yellow and Yangtze River basins. CC values for the IMERG are not as high as those of the GSMap-gauged, but the spatial trend is similar, with the exception of low CC values at upper reaches of Yangtze River. The distribution of ME (Figures 8(c) and 8(d)) shows that IMERG tends to overestimate precipitation over most subbasins that located in the eastern part of the study area and underestimate precipitation over the western part of the study area. But GSMap-gauged shows underestimation over most subbasins of the study area except Huaihe River basin and lower reaches of Yellow and Yangtze River basins. At the monthly scale, CC values of almost all subbasins are higher than 0.8 in the case of both products (Figure 9), and the spatial distributions of these high values are similar for both products. The monthly precipitation accuracy is clearly higher than daily precipitation accuracy over the majority of the subbasins, and this result is even more significant for the IMERG data. However, when comparing the monthly ME, both products have very similar spatial pattern as that on daily scale.Figure 8
CC and ME distributions over 58 subbasins (included in eight main basins of eastern China) at the daily scale from April 2014 to March 2016: CC for (a) GSMap-gauged and (b) IMERG; ME for (c) GSMap-gauged and (d) IMERG.
(a)
(b)
(c)
(d)Figure 9
CC and ME distributions over 58 subbasins (included in eight main basins of eastern China) at the monthly scale from April 2014 to March 2016: CC for (a) GSMap-gauged and (b) IMERG; ME for (c) GSMap-gauged and (d) IMERG.
(a)
(b)
(c)
(d)The spatial patterns of POD and FAR at the subbasin scale for both products are shown in Figure10. It is clearly seen that the GSMap-gauge performed better than the IMERG for POD, with high values (>0.8) locating in most parts of the Yangtze, Haihe, and Huaihe River basins. Similarly, for FAR the GSMap-gauged also performed better than the IMERG. The possible reasons could be partially explained by the results in Section 4.1: missed precipitation for the GSMap-gauged is lower than IMERG over eastern China during the study period (Figures 2(c) and 2(g)). Hence, POD of the GSMap-gauged show higher values than IMERG.Figure 10
POD and FAR distributions over 58 subbasins (included in eight main basins of eastern China) from April 2014 to March 2016: POD for (a) GSMap-gauged and (b) IMERG; FAR for (c) GSMap-gauged and (d) IMERG.
(a)
(b)
(c)
(d)Figure 11
Spatially averaged CC and ME at the eight main basins over eastern China at the daily scale from April 2014 to March 2016.Figure 12
Spatially averaged CC and ME at the eight main basins over eastern China at the monthly scale from April 2014 to March 2016.Figure 13
Spatially averaged POD and FAR at the eight main basins over eastern China at the monthly scale from April 2014 to March 2016.Figures11 and 12 show the CC and ME values for the eight main basins at the daily and monthly scales. Similar to the results of the previous analysis and based on the CC comparison, the monthly precipitation is more accurate than daily precipitation. The GSMap-gauge seems to perform better than the IMERG at all eight basins, with higher CC values and lower absolute value of ME (except for Yangtze and Southeast River basins, with higher absolute ME values). Figure 13 shows the POD and FAR values for the eight main basins, indicating that GSMap-gauged performs better than IMERG in monitoring the occurrence of precipitation events. Furthermore, the GSMap-gauged data has higher accuracy over the Haihe, Huaihe, Liaohe, and Yellow basins, compared to the rest of the basins. Therefore, for satellite precipitation data application in these regions, we recommend the GSMap-gauged over the IMERG.


## 4.1. Error Components Analysis

In this section, we analyze the error characteristics for both satellite precipitation products at the daily scale and 0.25° resolution. For each product, we broke down the total bias for each day over the eastern China region and then aggregated the daily error components and total errors to whole study period and seasonal time scale (two summer periods and two winter periods). Figure2 shows the spatial distributions of error components for the study period. The two products have totally different spatial patterns. For GSMap-gauged, total bias indicates that this product underestimates precipitation over most of the southern China region. This underestimation might have resulted from the hit bias which shows obvious underestimation over southern China, as shown in Figure 2(b). Missed precipitation is not as obvious as false precipitation but has distinct influence over the south part of Pearl River basin (Figure 2(c)). The slight overestimation at Huaihe, Haihe, middle, and lower reaches of Yellow River basin is mainly caused by false precipitation (Figure 2(e)). For IMERG, total bias illustrates significant overestimations over most of the eastern part of China, except upper reaches of Yangtze and Yellow River basins (Figure 2(e)). This overestimation at eastern part of China is the comprehensive impact of hit bias and false precipitation, although missed precipitation may counteract some of this impact. Besides, missed precipitation is more evident in case of IMERG than GSMap-gauged and underestimations in total bias of IMERG are mostly caused by missed precipitation, especially over upper reaches of Yangtze and Yellow River basins (Figure 2(g)). The spatial patterns of the error components, averaged for the summer (June, July, and August) and winter (December, January, and February), are shown in Figures 3 and 4, respectively, to look into seasonal variations of error components distribution.Figure 2
Total bias and three error components of GSMap-gauged and IMERG precipitation data from April 2014 to March 2016 over eastern China.
(a)
GSMap-gauged
(b)
GSMap-gauged
(c)
GSMap-gauged
(d)
GSMap-gauged
(e)
GPM IMERG
(f)
GPM IMERG
(g)
GPM IMERG
(h)
GPM IMERGFigure 3
Total bias and three error components of GSMap-gauged and IMERG precipitation data for the summer (JJA) over two years (2014 and 2015).
(a)
GSMap-gauged
(b)
GSMap-gauged
(c)
GSMap-gauged
(d)
GSMap-gauged
(e)
GPM IMERG
(f)
GPM IMERG
(g)
GPM IMERG
(h)
GPM IMERGFigure 4
Same as Figure3 but for the winter (DJF).
(a)
GSMap-gauged
(b)
GSMap-gauged
(c)
GSMap-gauged
(d)
GSMap-gauged
(e)
GPM IMERG
(f)
GPM IMERG
(g)
GPM IMERG
(h)
GPM IMERGFigure 5
Variations of the error components for both satellite products by elevation over the total study period from April 2014 to March 2016.
(a)
GSMap-gauged
(b)
GPM IMERGFigure 6
The intensity distribution of the total precipitation as well as the hit, missed, and false precipitation.
(a)
(b)
(c)
(d)Figure 7
Scatter diagrams of extreme precipitation indices between GSPPs and observations over eastern China. The color represents the occurrence possibility and red color region shows that more percent of points are located there.In the case of the summer, the two satellite products have similar hit bias and total bias over most part of study area, suggesting that the most significant error contribution is from hit events (Figure3). Regarding the GSMap-gauged, underestimation is dominant and spatial pattern of underestimation in total bias is very similar with that in hit bias, with less contribution from missed precipitation. Slight overestimation in total bias over Huaihe and lower reaches of Yangtze River basins is related to a significant amount of hit bias (Figure 3(b)), with some contribution from false precipitation events (Figure 3(d)). For the IMERG, however, the positive total bias over the eastern China is mostly due to hit bias. This overestimation in hit bias may be caused by the inability to capture warm rain processes or short-lived convective storms at lower latitudes [38]. In addition, the obvious underestimation in total bias over upper reaches of Yellow and Yangtze River basins is mainly cause by the hit bias (Figure 3(f)) and missed precipitation (Figure 3(g)), the possible reasons are that, first, the IMERG algorithm may miss warm and orographic precipitation in this mountainous regions; second, the CPCC data used to adjust IMERG may also have significant error in this region because of few gauge stations here used for interpolation and unsatisfactory treatment of orographic effects here. Conversely, missed precipitation is not a significant error source for the GSMap-gauged data (Figure 3(c)). Figures 3(d) and 3(h) demonstrate that false precipitation of GSMap-gauged is more pronounced than that of IMERG in summer.During the winter season, both products showed similar spatial distributions for the total bias and hit bias with the results for the summer season. The significant difference exists in missed precipitation, where comparing with the summer season the GSMap-gauged clearly missed more events in the south part of Pearl River basin (Figure4(c)); this may be associated with low-level cloudiness and warm rain processes in the winter that may not have the distinct characteristics of ice particles. Meanwhile, IMERG missed more events in the upper reaches of Yangtze and Yellow River basins and southern part of China (Figure 4(g)); this may be attributed to PMW’s inability to measure snowfall/rainfall over snow and ice covered land surfaces. Regarding GSMap-gauged data, overestimation over the southern China are mainly determined by false precipitation, while for the IMERG, the primary determining error factor is hit bias. It is also noted that false precipitation for both products is more obvious in winter.Elevation may also be a major impact factor in the error distribution of the satellite precipitation data. Therefore it is useful to identify the total bias and each error component with respect to elevation over eastern China, as shown in Figure5. We found that for both products, the impact of elevation was totally different. The error components of IMERG show an obvious topographic dependency, but such feature is not very obvious in GSMap-gauged. The total bias of GSMap-gauged keeps the similar tendency with that of hit bias and is all negative. This indicates that GSMap-gauged tends to underestimate precipitation over most regions of eastern China. For the IMERG, total bias is positive when elevation is less than 750 meters and changes to be negative with elevation larger than 750 meters due to the contribution of hit bias and missed precipitation which increase negatively with the rising of the terrain. In addition, there is more missed precipitation for the IMERG than the GSMap-gauged product, which can also be seen in Figures 2–4(c, g). From the topographic analysis of error components, it can be concluded that the GSMap algorithm and error-correction method are more effective in balancing the errors related to topography.To better explore the feature of error components of the two products, the intensity distributions of total precipitation as well as precipitation amount of hit, missed, and false precipitation events are shown in Figure6. These intensity distributions are calculated as the ratio of sum of precipitation amounts in each bin to the total sum of observed precipitation amount over the total study period. Both datasets show different distributions of the total precipitation, as shown in Figure 6(a). GSMap-gauged overestimates light precipitation (<16 mm/day) but underestimates more precipitation with rain rate larger than 32 mm/day, whereas although IMERG gets close to observation for light precipitation (<8 mm/day), it underestimates precipitation at rain rate between 8 and 64 mm/day and significantly overestimates precipitation at rain rate more than 64 mm/day. Distributions of hit precipitation of the two products look similar as these of total precipitation, which proves that hit bias plays the major role in total bias. Figure 6(c) shows that missed precipitation is almost located in range of 1 to 64 mm/day for both products; IMERG has more missed precipitation than GSMap-gauged, which is also reflected by the spatial distribution shown in Figures 2(c) and 2(g). In addition, GSMap-gauged has a narrow distribution of false precipitation, concentrating at precipitation with rain rates less than 64 mm/day, as compared to IMERG. False precipitation for GSMap-gauged is larger than its missed precipitation, while for IMERG the situation is quite the reverse. In summary, the breakdown of errors at spatial better enabled us to identify the error sources and their contributions to the total error.


## 4.2. Extreme Precipitation Events Comparison

Density-colored scatter diagrams of extreme precipitation indices between GSPPs and observations over eastern China are presented in Figure7. For two percentile indices (RR99P and RR95P), both satellite products have good correlation with observation with high CC values (all greater than 0.85). It is obvious that IMERG tends to overestimate extreme precipitation with relative bias (RB) values of RR99P more than 17%. But the condition is almost opposite for GSMap-gauged which underestimates RR99P significantly (with RB lower than −10%). This may be explained by probability density function shown in Figure 6(a) that intensity distribution of total precipitation for IMERG (GSMap-gauged) is higher (lower) than that for observation at precipitation rate more than 64 mm/day. For RR95P, both products have high CC values (all more than 0.90) but with negative RB. This may also be explained by probability density function shown in Figure 6(a) that intensity distributions of total precipitation for both products are lower than that for observation at precipitation rate between 16 and 64 mm/day. Regarding absolute threshold indices (R20 and R20TOT), results are similar with percentile indices for both products. In addition, it should be noted that the CC (RMSE) values of six indices for GSMap-gauged are almost higher (lower) than that for IMERG. This implies that the ability of GSMap-gauged in detecting extreme precipitation is relatively more stable than IMERG. For two duration indices (CWD and CDD), IMERG shows poor results with low CC value and high RMSE values. Figure 7(e) shows that GSMap-gauged overestimates CWD significantly (RB more than 20%). This may be attributed to the reason that more no-rain days are identified as rain events when correcting GSMap-gauged data using daily observation data to reduce overall precipitation error. It should be noted by data users, especially while utilizing these products to monitor real-time drought, that IMERG identifies more no-rain days than reality.In addition, we calculated these extreme precipitation indices for both products over eight eastern river basins, respectively. The results indicate that at basin scale, both products performed well in cases of the Huaihe, Liaohe, and Yangtze River basins; however, for the Songhua, Haihe, and Southeast River basins, the two products could not observe accurate extreme precipitation, as shown in Table6. IMERG overestimates RR99P and R20TOT at most of eight basins. GSMap-gauged shows different degrees of underestimation for these two indices at all of eight basins. For duration indices, IMERG shows very bad results at all eight basins.


## 4.3. Performance Analysis at the Basin Scale

Researchers have been attempting to use satellite precipitation data in water balance analyses, hydrological modeling, and flood forecasting at the basin or subbasin scale [20, 39]. Considering its usefulness, in this section we consider the basin scale analysis to evaluate the performance of both products over the eight main basins in eastern China. Figures 8 and 9 show the daily and monthly spatial distributions of CC and ME over the 58 subbasins that are located within the eight main river basins. For the GSMap-gauged data on the daily scale, CC values tend to be higher at the middle part of eastern China, with high values (>0.80) located at the Haihe, Huaihe River basins, and the lower reaches of the Yellow and Yangtze River basins. CC values for the IMERG are not as high as those of the GSMap-gauged, but the spatial trend is similar, with the exception of low CC values at upper reaches of Yangtze River. The distribution of ME (Figures 8(c) and 8(d)) shows that IMERG tends to overestimate precipitation over most subbasins that located in the eastern part of the study area and underestimate precipitation over the western part of the study area. But GSMap-gauged shows underestimation over most subbasins of the study area except Huaihe River basin and lower reaches of Yellow and Yangtze River basins. At the monthly scale, CC values of almost all subbasins are higher than 0.8 in the case of both products (Figure 9), and the spatial distributions of these high values are similar for both products. The monthly precipitation accuracy is clearly higher than daily precipitation accuracy over the majority of the subbasins, and this result is even more significant for the IMERG data. However, when comparing the monthly ME, both products have very similar spatial pattern as that on daily scale.Figure 8
CC and ME distributions over 58 subbasins (included in eight main basins of eastern China) at the daily scale from April 2014 to March 2016: CC for (a) GSMap-gauged and (b) IMERG; ME for (c) GSMap-gauged and (d) IMERG.
(a)
(b)
(c)
(d)Figure 9
CC and ME distributions over 58 subbasins (included in eight main basins of eastern China) at the monthly scale from April 2014 to March 2016: CC for (a) GSMap-gauged and (b) IMERG; ME for (c) GSMap-gauged and (d) IMERG.
(a)
(b)
(c)
(d)The spatial patterns of POD and FAR at the subbasin scale for both products are shown in Figure10. It is clearly seen that the GSMap-gauge performed better than the IMERG for POD, with high values (>0.8) locating in most parts of the Yangtze, Haihe, and Huaihe River basins. Similarly, for FAR the GSMap-gauged also performed better than the IMERG. The possible reasons could be partially explained by the results in Section 4.1: missed precipitation for the GSMap-gauged is lower than IMERG over eastern China during the study period (Figures 2(c) and 2(g)). Hence, POD of the GSMap-gauged show higher values than IMERG.Figure 10
POD and FAR distributions over 58 subbasins (included in eight main basins of eastern China) from April 2014 to March 2016: POD for (a) GSMap-gauged and (b) IMERG; FAR for (c) GSMap-gauged and (d) IMERG.
(a)
(b)
(c)
(d)Figure 11
Spatially averaged CC and ME at the eight main basins over eastern China at the daily scale from April 2014 to March 2016.Figure 12
Spatially averaged CC and ME at the eight main basins over eastern China at the monthly scale from April 2014 to March 2016.Figure 13
Spatially averaged POD and FAR at the eight main basins over eastern China at the monthly scale from April 2014 to March 2016.Figures11 and 12 show the CC and ME values for the eight main basins at the daily and monthly scales. Similar to the results of the previous analysis and based on the CC comparison, the monthly precipitation is more accurate than daily precipitation. The GSMap-gauge seems to perform better than the IMERG at all eight basins, with higher CC values and lower absolute value of ME (except for Yangtze and Southeast River basins, with higher absolute ME values). Figure 13 shows the POD and FAR values for the eight main basins, indicating that GSMap-gauged performs better than IMERG in monitoring the occurrence of precipitation events. Furthermore, the GSMap-gauged data has higher accuracy over the Haihe, Huaihe, Liaohe, and Yellow basins, compared to the rest of the basins. Therefore, for satellite precipitation data application in these regions, we recommend the GSMap-gauged over the IMERG.


## 5. Conclusions

In this study, first, error sources and characteristics of the two latest GSPPs (i.e., GSMap-gauged and IMERG) were comprehensively looked into by breaking down the total bias of these datasets into three independent components. Then, the performance of the two products over eastern China including eight main river basins has been systematically evaluated during the period of April 2014 to March 2016 in terms of ability of extreme precipitation detection, precipitation measurement systemic errors (CC and ME), and occurrence of precipitation events (POD and FAR). The main findings are summarized as follows:(1)
The two products have totally different spatial distributions of error components. Much of the underestimations over the study area for the GSMap-gauged could be traced to significant hit bias, with a secondary contribution from missed precipitation. For IMERG, total bias illustrates significant overestimation over most of the eastern part of China, except upper reaches of Yangtze and Yellow River basins. This overestimation is the comprehensive impact of hit bias and false precipitation, although missed precipitation may counteract some of this impact. GSMap algorithm and error-correction method are more effective in balancing the errors related to topography. GSMap-gauged tends to overestimate light precipitation (<16 mm/day) and underestimate more precipitation with rain rate larger than 32 mm/day; however, IMERG underestimates precipitation at rain rate between 8 and 64 mm/day and overestimates precipitation at rain rate more than 64 mm/day.(2)
Both products can capture the percentile and absolute threshold extreme precipitation indices well with CC and ME values more than 0.85 over eastern China. While the IMERG overestimates RR99P and R20TOT, with RB values of 17.9% and 11.5%, respectively. GSMap-gauged shows significant underestimation of these indices. For two duration indices (CWD and CDD), IMERG shows poor results with low CC value and high absolute RB and RMSE values. IMERG identifies more no-rain days than reality. At basin scale, both products perform well in cases of the Huaihe, Liaohe, and Yangtze River basins, but for the Songhua, Haihe, and Southeast River basins, the two products could not observe very accurate extreme precipitation.(3)
Generally, GSMap-gauged performed better than IMERG with higher CC and lower absolute ME values at daily and monthly scale over eight eastern river basins. For the GSMap-gauged data at the daily scale, CC values tend to be higher at the middle part of eastern China, with high values (>0.80) located at the Haihe and Huaihe River basins and the lower reaches of the Yellow and Yangtze River basins. The monthly precipitation accuracy is clearly higher than daily precipitation for both products over most of the subbasins; this phenomenon is more significant for the IMERG data. The GSMap-gauged data shows higher accuracy over the Haihe, Huaihe, Liaohe, and Yellow River basins compared to other basins.The evaluation of the performance of the IMERG and the GSMap-gauged datasets in this study could provide better understanding on spatial distribution of the error feature and uncertainty of these GSPPs over China. Based on these findings, we recommend that future correction efforts could focus on further reducing underestimation of strong rain for the GSMap-gauged, missed precipitation, and overestimation of heavy rain for IMERG data, respectively, especially over southern China. On the other hand, a better understanding of the advantages and limitations of these products can assist researchers in supporting their use in China.



---

*Source: 1803492-2017-09-06.xml*