We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

physics.ins-det

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Physics > Instrumentation and Detectors

Title: ReCoDe: A Data Reduction and Compression Description for High Throughput Time-Resolved Electron Microscopy

Abstract: Fast, direct electron detectors have significantly improved the spatio-temporal resolution of electron microscopy movies. Preserving both high spatial and temporal resolution in extended observations, however, requires storing prohibitively large amounts of data. The exception is when electron arrival events are spaced apart such that electron counting is possible. Here, we describe an efficient and flexible data reduction and compression scheme (ReCoDe) that retains both high spatial and temporal resolution for electron-counted data. Running ReCoDe on a workstation we demonstrate on-the-fly reduction and compression of raw data streaming off a detector at 3 GB/s, for hours of uninterrupted data collection. The output was 100-fold smaller than the raw data and saved directly onto network-attached storage drives over a 10 GbE connection. Additionally, we discuss new electron microscopy modalities that will become possible with ReCoDe, including a noise-robust motion correction algorithm that succeeds with highly dose-fractionated, time-resolved electron-counted data.
Comments: 23 pages, 7 figures
Subjects: Instrumentation and Detectors (physics.ins-det); Computational Physics (physics.comp-ph); Data Analysis, Statistics and Probability (physics.data-an)
Cite as: arXiv:1911.06013 [physics.ins-det]
  (or arXiv:1911.06013v1 [physics.ins-det] for this version)

Submission history

From: Duane Loh [view email]
[v1] Thu, 14 Nov 2019 09:56:52 GMT (2215kb)

Link back to: arXiv, form interface, contact.