We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.DC

Change to browse by:

cs

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Computer Science > Distributed, Parallel, and Cluster Computing

Title: StreamFlow: cross-breeding cloud with HPC

Abstract: Workflows are among the most commonly used tools in a variety of execution environments. Many of them target a specific environment; few of them make it possible to execute an entire workflow in different environments, e.g. Kubernetes and batch clusters. We present a novel approach to workflow execution, called StreamFlow, that complements the workflow graph with the declarative description of potentially complex execution environments, and that makes it possible the execution onto multiple sites not sharing a common data space. StreamFlow is then exemplified on a novel bioinformatics pipeline for single-cell transcriptomic data analysis workflow.
Comments: 30 pages - 2020 IEEE Transactions on Emerging Topics in Computing
Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)
ACM classes: D.1.3; D.3.2; C.1.3
DOI: 10.1109/TETC.2020.3019202
Cite as: arXiv:2002.01558 [cs.DC]
  (or arXiv:2002.01558v3 [cs.DC] for this version)

Submission history

From: Marco Aldinucci [view email]
[v1] Tue, 4 Feb 2020 22:00:56 GMT (222kb,D)
[v2] Wed, 26 Feb 2020 23:42:19 GMT (223kb,D)
[v3] Sun, 30 Aug 2020 22:20:18 GMT (184kb,D)

Link back to: arXiv, form interface, contact.