We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.LG

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Computer Science > Machine Learning

Title: nuts-flow/ml: data pre-processing for deep learning

Abstract: Data preprocessing is a fundamental part of any machine learning application and frequently the most time-consuming aspect when developing a machine learning solution. Preprocessing for deep learning is characterized by pipelines that lazily load data and perform data transformation, augmentation, batching and logging. Many of these functions are common across applications but require different arrangements for training, testing or inference. Here we introduce a novel software framework named nuts-flow/ml that encapsulates common preprocessing operations as components, which can be flexibly arranged to rapidly construct efficient preprocessing pipelines for deep learning.
Comments: 11 pages, 4 figures
Subjects: Machine Learning (cs.LG); Software Engineering (cs.SE)
Cite as: arXiv:1708.06046 [cs.LG]
  (or arXiv:1708.06046v2 [cs.LG] for this version)

Submission history

From: Stefan Maetschke [view email]
[v1] Mon, 21 Aug 2017 01:28:37 GMT (60kb,D)
[v2] Wed, 10 Jan 2018 00:46:13 GMT (60kb,D)

Link back to: arXiv, form interface, contact.