We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.DC

Change to browse by:

cs

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Distributed, Parallel, and Cluster Computing

Title: Separating Data via Block Invalidation Time Inference for Write Amplification Reduction in Log-Structured Storage

Abstract: Log-structured storage has been widely deployed in various domains of storage systems, yet its garbage collection incurs write amplification (WA) due to the rewrites of live data. We show that there exists an optimal data placement scheme that minimizes WA using the future knowledge of block invalidation time (BIT) of each written block, yet it is infeasible to realize in practice. We propose a novel data placement algorithm for reducing WA, SepBIT, that aims to infer the BITs of written blocks from storage workloads and separately place the blocks into groups with similar estimated BITs. We show via both mathematical and production trace analyses that SepBIT effectively infers the BITs by leveraging the write skewness property in practical storage workloads. Trace analysis and prototype experiments show that SepBIT reduces WA and improves I/O throughput, respectively, compared with state-of-the-art data placement schemes. SepBIT is currently deployed to support the log-structured block storage management at Alibaba Cloud.
Comments: 19 pages. Accepted by the 20th USENIX Conference on File and Storage Technologies (FAST '22)
Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)
Cite as: arXiv:2104.12425 [cs.DC]
  (or arXiv:2104.12425v3 [cs.DC] for this version)

Submission history

From: Qiuping Wang [view email]
[v1] Mon, 26 Apr 2021 09:36:24 GMT (565kb,D)
[v2] Tue, 27 Apr 2021 02:29:39 GMT (565kb,D)
[v3] Thu, 10 Feb 2022 11:07:27 GMT (886kb,D)

Link back to: arXiv, form interface, contact.