We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:


Current browse context:


Change to browse by:

References & Citations


(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Statistics > Methodology

Title: Hamiltonian zigzag accelerates large-scale inference for conditional dependencies between complex biological traits

Abstract: Inferring dependencies between complex biological traits while accounting for evolutionary relationships between specimens is of great scientific interest yet remains infeasible when trait and specimen counts grow large. The phylogenetic multivariate probit model uses a latent variable framework to accommodate binary and continuous traits, but integrating many latent variables requires many computationally expensive draws from a high-dimensional truncated normal. The state-of-the-art approach, which combines the bouncy particle sampler (BPS) with dynamically programmed gradient evaluations, breaks down as the number of specimens grows and fails to reliably characterize conditional dependencies between traits. We develop an inference scheme that combines the recent Zigzag Hamiltonian Monte Carlo (Zigzag-HMC) with linear-time gradient evaluations and joint updates for highly correlated latent variables and correlation matrix elements. In an application exploring HIV-1 evolution from 535 viruses, the inference requires joint sampling from an 11,235-dimensional truncated normal and a 24-dimensional covariance matrix. Our method yields a 5-fold speedup compared to BPS and makes it possible to learn partial correlations between candidate viral mutations and virulence. Computational speedups now allow us to tackle larger problems: we study the evolution of influenza H1N1 glycosylations on around 900 viruses. For broader applicability, we extend the phylogenetic probit model to incorporate categorical traits, and demonstrate its use to study Aquilegia flower and pollinator co-evolution.
Comments: 36 pages, 5 figures, 3 tables
Subjects: Methodology (stat.ME); Populations and Evolution (q-bio.PE); Computation (stat.CO)
Cite as: arXiv:2201.07291 [stat.ME]
  (or arXiv:2201.07291v2 [stat.ME] for this version)

Submission history

From: Zhenyu Zhang [view email]
[v1] Tue, 18 Jan 2022 20:07:00 GMT (408kb,D)
[v2] Mon, 7 Mar 2022 21:10:26 GMT (1645kb,D)
[v3] Wed, 7 Sep 2022 22:13:25 GMT (2110kb,D)

Link back to: arXiv, form interface, contact.