Upcoming Seminar Presentations
All seminars are on Tuesdays [ 8:30 am PT ] = [ 11:30 am ET ] = [ 4:30 pm London ] = [ 5:30 pm Paris ] = [ 0:30 am Beijing + 1d]
Subscribe to our mailing list and calendar for up-to-date schedule!
In this talk, we first establish a remarkable connection between the zigzag sampler and a variant of Hamiltonian Monte Carlo based on Laplace-distributed momentum. The position-velocity component of the corresponding Hamiltonian dynamics travels along a zigzag path paralleling the Markovian zigzag process; however, the dynamics is non-Markovian as the momentum component encodes non-immediate pasts. In the limit of increasingly frequent momentum refreshments in which we preserve its direction but re-sample magnitude, we prove that Hamiltonian zigzag converges strongly to its Markovian counterpart. This theoretical insight in particular explains the two zigzags' relative performance on target distributions with highly correlated parameters, which we demonstrate on a 11,235-dimensional truncated Gaussian target arising from Bayesian phylogenetic multivariate probit model applied to an HIV virus dataset. We then proceed to construct a Hamiltonian counterpart to the bouncy particle sampler (BPS), further strengthening the connection between the two paradigms. We achieve this by turning BPS's Poisson schedule for velocity switch events into a deterministic one dictated by an auxiliary "inertia" parameter. The resulting Hamiltonian BPS constitutes an efficient sampler on log-concave targets and straightforwardly accommodates parameter constraints. We demonstrate its competitive performance in the posterior computation under Bayesian sparse logistic regression model applied to a large-scale observational study consisting of 72,489 patients and 22,175 clinical covariates.