Title: On the Stability of Sequential Monte Carlo Methods in High Dimensions

Abstract: We investigate the stability of a Sequential Monte Carlo (SMC) method applied to the problem of sampling from a target distribution on R^d for large d. It is well known that, using a single importance sampling step, one produces an approximation for the target distribution that deteriorates as the dimension $d$ increases, unless the number of Monte Carlo samples $N$ increases at an exponential rate in d. We show that this degeneracy can be avoided by introducing a sequence of artificial targets, starting from a `simple' target density and moving to the one of interest and using an SMC method to sample from the sequence. Using this class of SMC methods with a fixed number of samples, one can produce an approximation for which the effective sample size (ESS) converges to a random variable varepsilon_N as d -> infty, such that 1<varepsilon_{N}<N. The convergence is achieved with a computational cost proportional to Nd^2. If varepsilon_{N} is reasonably close to N no additional work is needed. However, if varepsilon_N << N, we can raise its value by introducing a number of resampling steps, say m (where m is independent of d). In this case, the ESS of the system of samples converges to a random variable varepsilon_{N,m} as d -> infty and lim_{m->infty} varepsilon_{N,m}=N. In addition, we show that the corresponding Monte Carlo error for estimating a fixed dimensional marginal expectation is of order 1/\sqrt{N} uniformly in d. The results imply that, in high dimensions, SMC algorithms can efficiently control the variability of the importance sampling weights and estimate fixed dimensional marginals at a cost which is less than exponential in d.