Application of the Fractions Skill Score for Tracking the Effectiveness of Improvements Made to Weather Research and Forecasting Model Simulations
Technical Report,01 Oct 2016,01 Aug 2017
US Army Research Laboratory, Computational and Information Sciences Directorate White Sands Missile Range United States
Pagination or Media Count:
Spatial forecasts from Numerical Weather Prediction NWP models of meteorological variables supporting US Army battlefield operations are an integral part of the products available for the Staff Weather Officers use in providing mission forecasts. This report presents some preliminary results obtained from the application of a nontraditional fuzzy verification method to evaluate the ability of NWP to simulate spatial variable fields filtered using thresholds. Fuzzy methods have been developed in recent years to overcome limitations encountered when applying traditional verification techniques to high-resolution NWP forecasts, which often result in misleading assessments of forecast accuracy. This study illustrates how the Fractions Skill Score FSS generated by the Model Evaluation Tools can be applied to assess the US Army Research Laboratorys Weather Running Estimate Nowcast WREN model forecasts. The FSS is widely recognized as an important metric for verifying model performance as a function of threshold value and spatial scale and, when used to characterize the baseline performance, provides the basis for comparison as model improvements are implemented. Preliminary results suggest that the FSS applied to assess the WREN provides a robust metric to track changes in model performance and a better metric of the skill in predicting objects that affect input to My Weather Impact Decision Aid.