We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.DC

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Distributed, Parallel, and Cluster Computing

Title: Parallel Pairwise Correlation Computation On Intel Xeon Phi Clusters

Abstract: Co-expression network is a critical technique for the identification of inter-gene interactions, which usually relies on all-pairs correlation (or similar measure) computation between gene expression profiles across multiple samples. Pearson's correlation coefficient (PCC) is one widely used technique for gene co-expression network construction. However, all-pairs PCC computation is computationally demanding for large numbers of gene expression profiles, thus motivating our acceleration of its execution using high-performance computing. In this paper, we present LightPCC, the first parallel and distributed all-pairs PCC computation on Intel Xeon Phi clusters. It achieves high speed by exploring the SIMD-instruction-level and thread-level parallelism within Xeon Phis as well as accelerator-level parallelism among multiple Xeon Phis. To facilitate balanced workload distribution, we have proposed a general framework for symmetric all-pairs computation by building bijective functions between job identifier and coordinate space for the first time. We have evaluated LightPCC and compared it to the sequential C++ implementation in ALGLIB (both use double-precision floating point) using a set of gene expression datasets. Performance evaluation revealed that LightPCC runs up to 20.6 and 218.2 faster than ALGLIB by using one and 16 Xeon Phi 5110P coprocesssors, respectively. In addition, LightPCC demonstrated good parallel scalability in terms of number of Xeon Phis. LightPCC is publicly available at this http URL
Comments: 8 pages, 2 figures, 2 tables, to be submitted to a parallel computing conference
Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Genomics (q-bio.GN)
Cite as: arXiv:1605.01584 [cs.DC]
  (or arXiv:1605.01584v2 [cs.DC] for this version)

Submission history

From: Yongchao Liu [view email]
[v1] Thu, 5 May 2016 13:30:28 GMT (329kb)
[v2] Fri, 10 Jun 2016 13:35:27 GMT (340kb)
[v3] Tue, 27 Sep 2016 00:15:44 GMT (346kb)

Link back to: arXiv, form interface, contact.