Deep bootstrap for Bayesian inference

For a Bayesian, the task to define the likelihood can be as perplexing as the task to define the prior. We focus on situations when the parameter of interest has been emancipated from the likelihood and is linked to data directly through a loss function. We survey existing work on both Bayesian parametric inference with Gibbs posteriors and Bayesian non-parametric inference. We then highlight recent bootstrap computational approaches to approximating loss-driven posteriors. In particular, we focus on implicit bootstrap distributions defined through an underlying push-forward mapping. We investigate independent, identically distributed (iid) samplers from approximate posteriors that pass random bootstrap weights through a trained generative network. After training the deep-learning mapping, the simulation cost of such iid samplers is negligible. We compare the performance of these deep bootstrap samplers with exact bootstrap as well as MCMC on several examples (including support vector machines or quantile regression). We also provide theoretical insights into bootstrap posteriors by drawing upon connections to model mis-specification. This article is part of the theme issue 'Bayesian inference: challenges, perspectives, and prospects'.

The robust estimation of autoregressive processes by functional least squares

The stationary autoregressive model but with a long-tailed error distribution is analysed using the method of functional least squares. A family of estimators indexed by a real parameter is obtained and uniform consistency and weak convergence established. The optimum member of the family is chosen to have minimum variance with respect to the parameter, and the parameter value chosen detects and adjusts for long-tailed error distributions. Results of a simulation are given.