Optimal Subset Selection of Stochastic Model Using Statistical Hypothesis Test

Abstract

This paper proposes an improved algorithm for the optimal subset selection of a stochastic simulation model. The algorithm uses a statistical hypothesis test based on frequentist inference to evaluate the uncertainty about the selection, and it distributes simulation resources to designs for minimizing the uncertainty in each iteration. Several experiments demonstrate the improved performance compared to the other algorithms, and the performance increases significantly as the noise of the model increases. As a result, its high robustness to noise allows the algorithm to efficiently analyze real-world problems.