We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.DC

Change to browse by:

cs

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Computer Science > Distributed, Parallel, and Cluster Computing

Title: Triggerflow: Trigger-based Orchestration of Serverless Workflows

Abstract: As more applications are being moved to the Cloud thanks to serverless computing, it is increasingly necessary to support native life cycle execution of those applications in the data center. But existing systems either focus on short-running workflows (like IBM Composer or Amazon Express Workflows) or impose considerable overheads for synchronizing massively parallel jobs (Azure Durable Functions, Amazon Step Functions, Google Cloud Composer). None of them are open systems enabling extensible interception and optimization of custom workflows. We present Triggerflow: an extensible Trigger-based Orchestration architecture for serverless workflows built on top of Knative Eventing and Kubernetes technologies. We demonstrate that Triggerflow is a novel serverless building block capable of constructing different reactive schedulers (State Machines, Directed Acyclic Graphs, Workflow as code). We also validate that it can support high-volume event processing workloads, auto-scale on demand and transparently optimize scientific workflows.
Comments: The 14th ACM International Conference on Distributed and Event-based Systems (DEBS 2020)
Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)
DOI: 10.1145/3401025.3401731
Cite as: arXiv:2006.08654 [cs.DC]
  (or arXiv:2006.08654v2 [cs.DC] for this version)

Submission history

From: Pedro García-López [view email]
[v1] Mon, 15 Jun 2020 18:04:33 GMT (2513kb,D)
[v2] Wed, 17 Jun 2020 14:18:34 GMT (2509kb,D)

Link back to: arXiv, form interface, contact.