Automatic Optimal Batch Size Selection for Recursive Estimators of Time-Average Covariance Matrix

Chan, K. W. & Yau, C. Y. (2017). Automatic Optimal Batch Size Selection for Recursive Estimators of Time-Average Covariance Matrix. Journal of the American Statistical Association, 112, 1076-1089.

Abstract:

The time-average covariance matrix (TACM) Σ:=∑k∈ℤΓk , where Γk is the auto-covariance function, is an important quantity for the inference of the mean of an ℝd-valued stationary process (d ⩾ 1). This article proposes two recursive estimators for Σ with optimal asymptotic mean square error (AMSE) under different strengths of serial dependence. The optimal estimator involves a batch size selection, which requires knowledge of a smoothness parameter ϒβ:=∑k∈ℤ|k|β Γk , for some β. This article also develops recursive estimators for ϒβ. Combining these two estimators, we obtain a fully automatic procedure for optimal online estimation for Σ. Consistency and convergence rates of the proposed estimators are derived. Applications to confidence region construction and Markov chain Monte Carlo convergence diagnosis are discussed. Supplementary materials for this article are available online.

Figure: Graphical illustration of automatic optimal batch size selection.

      • (Dotted): Oracle estimator.
      • (Solid): Proposed estimator.
      • (Dashed): Estimator without automatic update.