Current browse context:
cs.LG
Change to browse by:
References & Citations
Computer Science > Machine Learning
Title: GeneFormer: Learned Gene Compression using Transformer-based Context Modeling
(Submitted on 16 Dec 2022 (v1), last revised 31 Jan 2023 (this version, v3))
Abstract: With the development of gene sequencing technology, an explosive growth of gene data has been witnessed. And the storage of gene data has become an important issue. Traditional gene data compression methods rely on general software like G-zip, which fails to utilize the interrelation of nucleotide sequence. Recently, many researchers begin to investigate deep learning based gene data compression method. In this paper, we propose a transformer-based gene compression method named GeneFormer. Specifically, we first introduce a modified transformer structure to fully explore the nucleotide sequence dependency. Then, we propose fixed-length parallel grouping to accelerate the decoding speed of our autoregressive model. Experimental results on real-world datasets show that our method saves 29.7% bit rate compared with the state-of-the-art method, and the decoding speed is significantly faster than all existing learning-based gene compression methods.
Submission history
From: Zhanbei Cui [view email][v1] Fri, 16 Dec 2022 10:12:54 GMT (4926kb,D)
[v2] Mon, 26 Dec 2022 12:46:06 GMT (4926kb,D)
[v3] Tue, 31 Jan 2023 07:14:42 GMT (461kb,D)
Link back to: arXiv, form interface, contact.