Accession Number : AD1042612


Title :   Application of the Fractions Skill Score for Tracking the Effectiveness of Improvements Made to Weather Research and Forecasting Model Simulations


Descriptive Note : Technical Report,01 Oct 2016,01 Aug 2017


Corporate Author : US Army Research Laboratory, Computational and Information Sciences Directorate White Sands Missile Range United States


Personal Author(s) : Raby, John W ; Cai,Huaqing


Full Text : https://apps.dtic.mil/dtic/tr/fulltext/u2/1042612.pdf


Report Date : 22 Nov 2017


Pagination or Media Count : 44


Abstract : Spatial forecasts from Numerical Weather Prediction (NWP) models of meteorological variables supporting US Army battlefield operations are an integral part of the products available for the Staff Weather Officers use in providing mission forecasts. This report presents some preliminary results obtained from the application of a nontraditional fuzzy verification method to evaluate the ability of NWP to simulate spatial variable fields filtered using thresholds. Fuzzy methods have been developed in recent years to overcome limitations encountered when applying traditional verification techniques to high-resolution NWP forecasts, which often result in misleading assessments of forecast accuracy. This study illustrates how the Fractions Skill Score (FSS) generated by the Model Evaluation Tools can be applied to assess the US Army Research Laboratory's Weather Running Estimate Nowcast (WREN) model forecasts. The FSS is widely recognized as an important metric for verifying model performance as a function of threshold value and spatial scale and, when used to characterize the baseline performance, provides the basis for comparison as model improvements are implemented. Preliminary results suggest that the FSS applied to assess the WREN provides a robust metric to track changes in model performance and a better metric of the skill in predicting objects that affect input to My Weather Impact Decision Aid.


Descriptors :   weather forecasting , test and evaluation , precipitation , delphi method , digital data , accuracy , case studies , numerical analysis , simulations , METEOROLOGICAL DATA


Subject Categories : Meteorology


Distribution Statement : APPROVED FOR PUBLIC RELEASE