RAPIDLY DEVELOPING THUNDERSTORM - Convection Warning (GEO v2018)
- Goal of the RDT-CW product
- RDT-CW Algorithm summary description
- List of inputs for RDT-CW and configuration parameters
- Coverage and resolution
- Description of RDT-CW outputs
- Examples of RDT-CW visualization
Access to user documentation for more details on Convection Products:
- User Manual
- Algorithm Theoretical Basis Document
- Validation Report
The RDT-CW (Rapidly Developing Thunderstorm - Convection Warning) product has been developed by Meteo-France in the framework of the EUMETSAT SAF in support to Nowcasting. Using mainly geostationnary satellite data, it provides information on clouds related to significant convective systems, from meso scale (200 to 2000 km) down to smaller scales (tenth of km).
The objectives of RDT-CW are:
- The identification, monitoring and tracking of intense convective system clouds
- The detection of rapidly developing convective cells
- The forecast of the convective cells
The object-oriented approach underlying the RDT-CW product allows to add value to the satellite image by characterizing convective, spatially consistent, entities through various parameters of interest to the forecaster such as motion vector, cooling and expansion rate, cloud top height... and their time series.
Thereby, RDT-CW is a tool for forecaster but can be used by research teams, and end-users like aeronautical users.
The RDT process includes four steps:
- The detection of cloud systems
- Cells identification
- Brightness Temperature limitation or correction for some special cases
- The tracking of cloud systems
- The discrimination of convective objects
- Forecasting convective cloud systems
- External attributes of convective objects, and 3D description
Prior to any analysis, RDT-CW undertakes a cloud filtering using CT product. All non-cloudy pixels are ignored through a dynamic cloud filtering. Since cloud type information is further used as attribute to cloud cell objects, CT is rather used than CMA product.
Moreover the product takes into account the deformation of pixels when on the edge of the spaceview domain. A mask of stretched pixels (pixels more than 5 * nominal_area) is automatically elaborated and backuped, and masked zones are ignored in the detection step, where gradients processing (used as predictor in discrimination scheme) should be less reliable.
The detection algorithm allows to define “cells” which represent the cloud systems as seen in the infrared 10.8 channel.
Non cloudy pixels identification
stretched pixels masking (backup file)
mask for stretched pixels
stretched pixels + non cloudy pixels
Non cloudy or stretched pixels identification
Working image for RDT-CW detection step
The RDT-CW detection method is based upon an adaptive temperature thresholding of infrared images. Thus, each cloud system is represented by one or several cells defined by its own, cell-specific, temperature threshold, ranged between a warm threshold and a cold threshold.
RDT-CW cells point out the bottom of cloud towers included inside cloud system. The temperature threshold used to define the bottom of an RDT-CW object is the warmest one which allows to distinguish it from others nearby temperature extremes.
In order to increase the relevancy of the cloud contour, modifications have been introduced. These modifications concern the choice of the value for the bottom of tower (BT).
- On one hand, before becoming mature, some cloud cells could sometimes exhibit too large BT contours regarding the top extent of growing tower. For some clouds with large base a second outline describing top of tower is added.
- On the other hand, aeronautical users have recently specified the need of cells' contour including as much as possible whole mature cloud systems, especially in tropical regions. This appeared essential for Cb avoidance. This specification has been satisfied by introducing a configurable and an absolute temperature threshold for the BT level.
Once the detection of cloud systems is performed, the tracking module of the RDT-CW software is applied on the detected “cells” and allows building trajectories of cloud systems from a sequence of infrared images. The tracking algorithm is based on the geographical overlapping of “cells” between two successive infrared images. It also handles splits and merges of cloud systems.
One main input of the tracking of the cloud system is the previous moving speed estimation of cloud cells. Main results are the current moving speed estimation, and time-based links with previous cells.
For that reason RDT-CW software pre-calculates a movement guess field to consolidate this approach. A 2D movement field is estimated in optimum configuration with last available HRW wind observations. Those observations are filtered (selection of IR channels observations, using the corresponding valid pixel’s brightness temperature to keep one observation per pixel), and are remapped on the satellite grid-field region, through a weighted interpolation taking into account a radius of influence and a cut-off distance.
An additional blending with low level (700hPa) NWP wind field can be optionally processed where no information is available, but priority is given to HRW wind observations. This “guess” field allows:
- Initializing moving speed with “cold start” cases (first run), which will be useful for the next runs
- Initializing moving speed for cells with no recovery and no neighbouring cells, used for a retro-advection and checking recovery again.
For smaller cells, the use of a guess in tracking algorithm is crucial.
Motion vectors are estimated by default using displacement of weighted gravity centers positions in successive images. What's more a time-based coherence of motion vectors is undertaken to eliminate erratic estimation due to split, merge or differences in temperature thresholds.
The goal of the discrimination method is to identify the convective RDT-CW objects among all cloud cells.
The left picture below displays all RDT-CW detected cells. It points out the detection and tracking efficiency of RDT-CW. We can notice the phenomena and scale diversity of RDT-CW objects.
The right image displays convective objects only. The ratio between no convective and convective objects is about 100.
Two kinds of discrimination parameters are computed:
- Spatial characteristics (peripheral gradient, surface...)
- Temporal characteristics (rate, extremum on various past period )
The discrimination scheme is a mix between statistical models and empirical rules:
- The convective diagnosis is the result of a statistical model applied to a growing or triggering cloud system depending on its current and past parameters
- This convective characteristic is inherited as long as the cloud system is developping as expected
- Empirical rules apply after a given period, to check, confirm or declassify the convective characteristic of the cloud systems
There are now two different discrimination schemes.
- The generic discrimination (GEN). It has been implemented with the initial statistical models tuned with SEVIRI over France. The discrimination method makes use of discrimination parameters calculated from five SEVIRI channels : IR 10.8µm, IR 8.7µm, IR 12.0µm, WV 6.2µm and WV 7.3µm. Statistical models for each configuration (processing modes, vertical categories, time-based depth) have been previously tuned on a learning database over widened France. The ground truth used for this data base is cloud to ground lightning occurrence.
The discrimination scheme has then been validated over a large Europe domain using the ground truth from the extended EUCLID lightning network.
- The calibrated discrimination (CAL). It has been tuned for several geostationary satellites and corresponding update rates, and validated using local network over Europe, and a global lightning network in other regions as ground truth.
NWP data is used for a guidance of discrimination scheme when available:
- Convective indexes are computed from NWP to produce a convective/non convective mask to identify non convective areas
- Only cloud cells out of non convective areas are submitted to discrimination scheme
- LI (Lifted Index) and gap to tropopause may be used as extra predictors for GEN discrimination scheme
NWP mask : 0 = non convective areas = union of 3 non convective indexes
The discrimination scheme is described with further details into ATBD document.
Convective cells have their own dynamic and can have a trajectory that does not always follow the environmental displacement fields. The object mode of RDT-CW analyses the motion of each cell, and computes this speed. The forecast scheme uses this speed estimate to forecast the successive position of each cell. The Lagrangian method is proved to be quite efficient up to 1 hour range. Thus the forecast is proposed up to this limit. This leads, for MSG FDSS (15min update rate), to an independant product for each lead range (+15', +30, +45 and +60'). Corresponding products constitute the Convection-Warning part of RDT-CW.
Analyzed (yellow contours) and 60min-forecast (magenta contours) RDT-CW cells
- RDT-CW is able to take into account lightning strokes location. This optional additionnal data may also allow to improve discrimination skill, if requested. The object approach of RDT-CW algorithm allows to characterize the lightning activity associated to a convective cloud object and to build its time series. It is to note that the time-based shift between satellite data and flash impact is taken into account.
- RDT-CW takes also into account a lightning trend at higher temporal resolution to approach the concept of "lightning jump", which is an interesting feature derived from total lightning activity analysis. The trend is not only evaluated between each satellite slot but also at minute scale, if the lightning data allows it.
- RDT-CW can take advantage of cloud top pressure information as additional attribute, when CTTH is requested as additional optional data
- minimum value of pressure over cloud cell extension is estimated to qualify the most representative and relevant value of cloud top
- RDT-CW can take advantage of cloud type and cloud microphysics information as additional attribute, when CT and CMIC are requested as additional optional data
- Type of cloud of each pixel of cloud cell is collected and the highest proportion is estimated
- Phase information of each pixel of cloud cell is collected and the highest proportion is estimated, to qualify the cloud cell phase as water / ice / mixed
- maximum values of each COT (Cloud Optical Thickness), Reff (Effective Radius) and CWP=LWP+IWP (Cloud Water Path = Liquid Water Path + Ice Water Path) are identified when available. Those parameters may be linked to a beta-index related to High Altitude Icing Hazard
- RDT-CW can take advantage of CRR data as optional input, for additional attribute, when CRR is requested as additional optional data. CRR data is used to identify maximum convective rain rate over cloud cell extension.
- In case of a second outline close to top of tower; some new attributes are estimated over horizontal extension of the upper part of the cloud.
- Overshooting Top Detection (OTD) is attempted for each cloud satisfying some criteria
- Static and morphological analysis of cloud cell allows a pre-detection of OT candidates
- Relevant BT, BTD and VIS criteria, combined with NWP tropopause Temperature values allow a confirmation of the OT
- They are also two synthesis attributes:
- the attribute "phase of development", ranging from "triggering" (or "split") to "growing", "mature" then "decaying" values. The attribute is a short mix of parameters linked to history, vertical extension, activity of the system
- the attribute "severity" : low, moderate, high or very high. It considers presence of overshooting top, high cooling rate, strong horizontal expansion rate, high lightning activity, occurrence of lightning jump, high values of convective rain rate, presence of high altitude ice crystals.
SEV_BANDS channel bands to be used by PGE (HRV) VIS06 NIR16 IR38 WV62 WV73 IR87 IR108 IR120
CT 0 or 1 (default) if using CT product for additional attributes Cloud Type and Cloud Phase
CMa 0 or 1 (default) if using CT product for masking non cloud pixels
CMIC 0 or 1 (default) if using CMIC product for microphysics characteristics
CTTH 0 or 1 (default) if adding top cloud attribute via CTTH product
CRRph 0 or 1 (default) if using CRR product for additional attribute
HRW 0 or 1 (default) if using HRW product as guess data for movement estimation
NWP_PARAM NWP_UW U component of wind at pressure levels specified in nwp_conf_file
NWP_PARAM NWP_VW V component of wind at pressure levels specified in nwp_conf_file
NWP_PARAM NWP_TT tropopause temperature (when available)
NWP_PARAM NWP_TP tropopause pressure (when available)
NWP_PARAM NWP_LI Lifted index (when available)
NWP_PARAM NWP_KI K index (when available)
NWP_PARAM NWP_SHW Showalter index (when available)
NWPMVTLVL Pressure level of U/V NWP data as guess data for movement estimation (default 700hPa)
0: no association
-1 : association without forcing discrimination result
N (default = 1): association with impact forcing convective diagnostic from Nth impact
LGHDTANT time limit (sec) before current slot for considering lightning data (default 900 sec)
LGHDTPOST time limit (sec) after current slot for considering lightning data (default 300 sec)
LGHTLR spatial tolerance (nb of pixels - default 3) for pairing lightning stroke with cloud cell
LGHPROXI maximum distance (nb of pixels - default 50) for processing distance between lightning stroke and cloud cell
Detection parametersTCOLD cold temperature threshold when multiple thresholding, deg Celsius. Recommended temperature is -75 degC
TWARM warm temperature threshold when multiple thresholding, deg Celsius. Recommended temperature is 5degC
DELTATEMPE temperature step between Tcold and Twarm, deg, default 1
SMIN min detection area , km2, default 1. Recommended value is 60
SMAX max detection area , km2, default no limit. Recommended value is 400 000
DBG More precise Informations on program running, default 0 (no information)
OMP_NBTHREAD Number of threads to use for parallelization, default 0 (no parallelization)
FCST Maximum range value (in minutes) for forecast products - nb of products = FCST/update rate.
Recommanded value = 60min for FDSS, 20min for RSS (4 additional forecast products).
FCSTEP Forecast step in minutes (default 15 min).
PARALLAX 0 or 1 (default) for activation of parallax correction
SMOOTHPTS 0 (default) or >1 for number of points taken into account for the smoothing of contours
DILAT 0 (default) or 1 for activation of dilation of cloud contour
NCMAPINCLD 0 or 1 (default): whether or not map of convective cells is included in netcdf product
INT_PRODUCT Production of the ended trajectories file (default YES)
TRAJ Format specification of the ended trajectories file when requested (for example: TISXOLH)
At the start of 2019, the RDT-CW software is designed to allow the processing at normal resolution of any rectangular areas defined by the user inside MSG or HIMAWARI geostationary satellite full disk (the processing of the full disk is also possible). The validity of the RDT-CW product is committed inside the MSG and HIMAWARI full disks. For example, the SAF NWC runs the RDT-CW on a MSG sub-domain centered on Europe.
The final products concerning RDT-CW are
- Current living cloud cells: numerical data which depicts infrared characteristics (in space and time) and move information associated to RDT-CW cells. Numerical data is provided in a bulletin-like NetCDF format. Depending on user's configuration, it may also contain a map of cloud cells, whose numerical values correspond to the phase of development of each cloud system.
- Forecasted cloud cells: numerical data provided in a bulletin-like NetCDF format, focusing on localization and a limited set of attributes for the next 15, 30, 45 or 60min (one product for each forecast range).
- Achieved cloud trajectories: the whole life of a cloud system is described once completed, from its triggering phase to its dissipation. This information is encoded in ASCII format.
Example of RDT-CW analyzed map. For a correspondance between encoded values and Cloud type and phase, see DOF documentation
Access to visualization specifications for convection products on the NWC SAF (look for Code : NWC/CDOP2/GEO/MFT/SCI/RP/06).
The RDT-CW needs development of a dedicated post-processing, depending on given specifications: access to current cell's localizations and attributes, or access to the recent current trajectories (with historical past series) from a single RDT-CW product, or to the whole trajectory through a series of RDT-CW products, the latter case implying to manage the time-based links between cloud cells.
The Current Object-Netcdf and Trajectory-ASCII formats are described in the Document Output Format (DOF) of SAFNWC. Trajectory file is produced only on user's request (see List of inputs).
Example of visualization
RDT-CW is visualized at Meteo-France on several platforms:
- Web-browser prototype for intranet / internet purposes
- SYNERGIE: Meteo-France forecaster workstation
- SYNOPSIS: new generation Meteo-France forecaster workstation
Example of product visualization with SYNOPSIS, RDT-CW cells on the left, gauge for one cell on the right (pop-up window).
Analysed RDT-CW cells with motion vectors (left), RDT-CW +15, +30, +45 and +60 minutes smoothed and dilated forecast cells (right).
- The ACMAD (African Center of Meteorological Application for Development) offers a mirrored near real time visualization of RDT-CW products over Africa, based on Meteo-France web browser prototype visualization.