Accession Number:

ADA617632

Title:

Accuracy vs. Robustness: Bi-criteria Optimized Ensemble of Metamodels

Descriptive Note:

Conference paper

Corporate Author:

AIR FORCE INSTITUTE OF TECHNOLOGY WRIGHT-PATTERSON AFB OH DEPT OF OPERATIONAL SCIENCES

Report Date:

2014-12-01

Pagination or Media Count:

13.0

Abstract:

Simulation has been widely used in modeling engineering systems. A metamodel is a surrogate model used to approximate a computationally expensive simulation model. Extensive research has investigated the performance of different metamodeling techniques in terms of accuracy andor robustness and concluded no model outperforms others across diverse problem structures. Motivated by this finding, this research proposes a bi-criteria accuracy and robustness optimized ensemble framework to optimally identify the contributions from each metamodel Kriging, Support Vector Regression and Radial Basis Function, where uncertainties are modeled for evaluating robustness. Twenty-eight functions from the literature are tested. It is observed for most problems, a Pareto Frontier is obtained, while for some problems only a single point is obtained. Seven geometrical and statistical metrics are introduced to explore the relationships between the function properties and the ensemble models. It is concluded that the bi-criteria optimized ensembles render not only accurate but also robust metamodels.

Subject Categories:

  • Operations Research
  • Computer Systems

Distribution Statement:

APPROVED FOR PUBLIC RELEASE