# Presentation: 323591

## Hurricane synoptic surveillance using the Ensemble Transform Kalman Filter

- Sharanya J. Majumdar (RSMAS/MPO Univ. of Miami)
- Collaborators: Sim Aberson (HRD), Craig Bishop (NRL Monterey), Brian Etherton (UNC Charlotte), James Franklin (TPC/NHC), Istvan Szunyogh (U.Maryland), Zoltan Toth (EMC), Chun-Chieh Wu (National Taiwan University)
- Acknowledgment: NOAA Joint Hurricane Testbed

- NOAA/NCEP/EMC, October 28th 2004

## Florida: Under the Gun in 2004

## Slide 3

## ETKF PLANNED FLIGHT

**NOAA G-IV AIRCRAFT TRACK AROUND HURRICANE IVAN.**

**ETKF PLANNED FLIGHT**

**ACTUAL G-IV FLIGHT**

## Ensemble Transform Kalman Filter (ETKF)

- Outline of talk
- Targeted Observations:
- Theory
- Main Results from Winter Storm Reconnaissance
- Tropical Cyclones
- ETKF publications
- Theory: Bishop *et al.* (MWR, 2001)
- Data assimilation: Etherton and Bishop (MWR, 2004)
- Ensemble generation: Wang and Bishop (JAS, 2003, 2004)
- Targeted Observations: Majumdar *et al.* (QJRMS 2001, MWR 2002, QJRMS 2002)

## How the ETKF works I

- Given ensemble forecasts initialized at time ti, how do we choose the optimal deployment of observations to improve a forecast between times ta and tv?
- ETKF specifies error covariance matrices for routine (r) and targeted (q) observational networks, in the form
- Pf = Zf ZfT

- ti

- td

- ta

- tv

- Ensemble
- Initialization time

- Decision
- time

- Adaptive sampling
- (analysis) time

- Verification
- time

- t

## How the ETKF works II

- 1: Kalman Filter error statistics equations to produce error covariances for the routine observational network:
- Pr = Pf – Pf HrT (Hr Pf HrT+Rr)-1 Hr Pf
- 2: Update forecast error covariance matrix for qth set of targeted observations (repeat Q > 100 times):
- Pq = Pr – Pr HqT (Hq Pr HqT+Rq)-1 Hq Pr
- ETKF predicts “signal covariance” Sq: reduction in forecast error covariance for qth deployment of adaptive observations:
- Sq=Pr–Pq = M Pr(ta) HqT (Hq Pr(ta) HqT+Rq)-1 Hq Pr(ta) MT
-                      = Zr(tv) Tr Cq q (q+I)-1 CqT TrT ZrT(tv)
- “Signal variance” = diagonal of Sq, calculated rapidly

## Main results from WSR programs

- 60-80% of forecasts improved because of targeted observations
- 12-hour gain in forecast lead time
- RMS forecast errors reduced by 10-20%
- Improvement similar to that achieved in last 20 years of advances in numerical modeling and data acquisition

- Toth *et al.* (2000)

- (based on data from winters 1998-2002)

## Signals and Signal Variance

- Squared NCEP MRF signal
- 1/2 (u’2+v’2) + (cp/Tr) T’2
- valid at analysis time ta

## Summary Maps of Signal Variance

- ETKF predicts signal variance (reduction in forecast error variance) for all feasible deployments of targeted observations.
- Summarize these predictions in the form of a map or bar chart.

## Aim: to improve a 24-hr forecast on the West Coast

## Shortcomings of ETKF targeting strategy

- Inconsistency between imperfect error covariance in ETKF and operational data assimilation scheme
- Limited # ensemble members gives a rank-deficient P : leads to spurious correlations
- Ensemble mean and variance predictions must be reasonably accurate
- Theory is (quasi) linear

## Serial adaptive sampling

- Many combinations and permutations of adaptive observations are available.
- Suppose that two sets of observations can be deployed simultaneously.
- First, find the optimal first deployment. Next, calculate the best second deployment given that the first set of observations are to be assimilated by the ETKF at the same time.
- Reduces observational redundancy.

## Serial adaptive sampling during Winter Storm Reconnaissance

## Questions

- 1. Can an ETKF predict signal variance for any deployment of targeted observations?
- 2. Is the signal variance related to the reduction in forecast error variance?
- Investigate using WSR flights, and 2 parallel NCEP MRF analysis-forecast cycles (with and without targeted data)

## Evolution of operational signal over 84h

## Evolution of predicted ETKF signal variance over 84h

## Slide 18

## Slide 19

## Answer to Question 1

- YES: a linear, increasing relationship is found to exist between the ETKF predicted signal variance, and the sample variance of operational signal realizations.
- Q2: Is the operational signal variance related to the reduction in operational forecast error variance?

## Signal realization versus forecast error reduction, at verification time tv

- Signal realization versus forecast error reduction, at verification time tv

## WSR01: Signal Variance vs Reduction in Forecast Error Variance

## Final Result from WSR01

- Rescaled ETKF Signal Variance

- Reduction in NCEP forecast error variance

## Summary and Conclusions 1

- In the mid-latitudes, ETKF has demonstrated the ability to predict the reduction in forecast error variance due to any set of targeted observations.
- There is potential to:
- 	(i) select good observing locations from bad locations
- 	(ii) select good flight days from bad flight days
- 	(iii) predict quantitatively the economic benefits of new observational networks
- Now, how about the tropics??

## Targeted observations to improve tropical cyclone forecasts

- Current operational synoptic surveillance strategy at NHC: combination of uniform sampling and ensemble spread.
- Is the ETKF a viable objective strategy to deploy aircraft-borne observations around hurricanes and typhoons?
- Problems:
- 	1. Error statistics are highly non-Gaussian
- 	2. Linearity assumptions in ETKF may be violated
- 	3. Ensemble initialization in tropics is questionable
- Acknowledgment: NOAA Joint Hurricane Testbed

## Typhoon Nida: May 17 2004, 12Z

- SPREAD

- ETKF

## Typhoon Conson: June 8 2004, 12Z

- SPREAD

- ETKF

## Typhoon Aere: August 24 2004, 12Z

- SPREAD

- ETKF

- SPREAD

- ETKF

## Latest ETKF Summary for Aere

## Latest flight tracks for 12Z August 24th 2004, based on ETKF and ensemble spread output. Maps produced during Sim’s seminar!

## ISABEL: 00Z 14 Sep 2003

- NOGAPS Singular Vector Sensitivity Summary, first 5 SVs. T79L30 (+48h, -48h)
- (Courtesy M. Peng, C. A. Reynolds of NRL Monterey)

- SPREAD

- ETKF

## SPREAD

- ETKF

## ETKF predicts the variance of the “signal” : the influence of the targeted observations on the operational forecast.

**ETKF PREDICTED SIGNAL VAR.**

**ACTUAL NCEP GFS SIGNAL**

- Preliminary result from Hurricane Isabel

- ETKF used 20-member 1-deg res NCEP GFS Ensemble, initialized 24-36h prior to targeted observing time.

**Influence on GFS analysis**

**Influence on 1-day forecast**

**Influence on 2-day forecast**

## Slide 34

## Hurricane Isabel: Targeting Discussion, 00Z 14 Sep 2003

- At 00Z 14th, there were several features in the deep layer mean flow around Isabel. A cyclonic circulation was located near the Carolina coastline. And anti-cyclonic circulation was located to the south of Newfoundland. Just to the south of this feature was a smaller anti-cyclonic circulation. The cyclonic circulation over the eastern US seaboard and the anti-cyclonic circulation in the north Atlantic would help guide Isabel to the northwest over time. In addition, there was another cyclonic circulation to the east of Isabel, and a short-wave trough moving into the Central United States.
- Ensemble spread at 00Z 14th was mostly associated with Isabel. In addition, there was a lesser amount of ensemble spread to the northwest of Isabel, associated with the cyclonic circulation near the eastern US seaboard. There were also regions of spread to the east of Isabel, to the northeast of Isabel, and over the south-central United States. None of these regions was appropriate for aircraft observations, but the area of spread associated with the cyclonic circulation near the eastern US seaboard was sampled.
- The ET KF selection for observing sites on the 14th at 00Z concentrated on two areas: Isabel, and the anti-cyclone to the North of Isabel. These were considered to be the two most important and poorest observed features. While the trough in the eastern United States was important, the ET KF did not select it as a target area, in contrast to the ensemble spread, which did depict uncertainty in the east coast cut-off low.

## ISABEL: 00Z 15 Sep 2003

- NOGAPS Singular Vector Sensitivity Summary, first 5 SVs. T79L30 (+48h, -48h)
- (Courtesy M. Peng, C. A. Reynolds of NRL Monterey)

- SPREAD

- ETKF

## Hurricane Isabel: Targeting Discussion, 00Z 15 Sep 2003

- Ensemble spread at 00Z on the 15th was greatest near Isabel, to the east of  Isabel, and near the short-wave trough over the eastern United States. The ET KF gave the greatest support to sampling the storm. Secondary targets were (a) the east coast US short wave, (b) the anti-cyclone south of the Canadian Maritimes,  and (c) an anti-cyclone to the east of Isabel. Given logistical constraints, the anti-cyclone to the east of Isabel could not be a target area, though the flight did go as far east as possible. The short-wave trough in the eastern US was sampled, however, the anti-cyclone to the north of Isabel was not.

## SPREAD

- ETKF

## ISABEL: 00Z 16 Sep 2003

- NOGAPS Singular Vector Sensitivity Summary, first 5 SVs. T79L30 (+48h, -48h)
- (Courtesy M. Peng, C. A. Reynolds of NRL Monterey)

- SPREAD

- ETKF

## SPREAD

- ETKF

## SPREAD

- ETKF

## SPREAD

- ETKF

## SPREAD

- ETKF

## SPREAD

- ETKF

## 2004 Hurricane Season

- A combination on uniform sampling, ensemble spread and ETKF (using GFS ensembles) were used to design G-IV synoptic surveillance tracks.
- Summary map maxima were traversed by an automated “travelling salesman” algorithm (Aberson and Leighton) to plot coordinates.

## SPREAD

- ETKF

## SPREAD

- ETKF

## SPREAD

- ETKF

## Typhoon Mindulle: June 27 2004, 12Z

- (DOTSTAR)

- SPREAD

- ETKF

## Typhoon Aere: August 23 2004, 12Z

- (DOTSTAR)

- SPREAD

- ETKF

## ETKF PLANNED FLIGHT

**NOAA G-IV AIRCRAFT TRACK AROUND HURRICANE IVAN.**

**ETKF PLANNED FLIGHT**

**ACTUAL G-IV FLIGHT**

## Hurricane Ivan: September 15 2004, 00Z

## Hurricane Jeanne: September 24 2004, 00Z

- SPREAD

- ETKF

## Hurricane Jeanne: September 25 2004, 00Z

## Summary and Conclusions 2

- ETKF is a theoretical improvement over ensemble spread: accounts for observational networks and future forecasts.
- Reality: ETKF and ensemble spread maps often similar in vicinity of TC (within flight range). Dependent on ensemble.
- Quantitative tests required to evaluate ETKF’s predictions of signal variance and reduction in forecast error variance.
- Systematic comparison between ETKF targets vs ECMWF and NRL Singular vector targets is under way. Both ETKF and SV targets often suggest flying BEHIND the storm, which is contrary to the NHC’s thoughts.
- Real-time maps _[http://orca.rsmas.miami.edu/~majumdar/tc](http://orca.rsmas.miami.edu/~majumdar/tc)_

## Future Work

- Synoptic Interpretation of ETKF and Spread targets
- Need to UNDERSTAND how G-IV observations are affecting hurricane forecast.
- Which levels and variables are most important to observe?
- Would hurricane forecasts benefit from further observations over land?
- Extend targeting and data denial experiments for satellite observations.