SPRING: a next-generation compressor for FASTQ data

S Chandak, K Tatwawadi, I Ochoa, M Hernaez… - …, 2019 - academic.oup.com
Bioinformatics, 2019academic.oup.com
Abstract Motivation High-Throughput Sequencing technologies produce huge amounts of
data in the form of short genomic reads, associated quality values and read identifiers.
Because of the significant structure present in these FASTQ datasets, general-purpose
compressors are unable to completely exploit much of the inherent redundancy. Although
there has been a lot of work on designing FASTQ compressors, most of them lack in support
of one or more crucial properties, such as support for variable length reads, scalability to …
Motivation
High-Throughput Sequencing technologies produce huge amounts of data in the form of short genomic reads, associated quality values and read identifiers. Because of the significant structure present in these FASTQ datasets, general-purpose compressors are unable to completely exploit much of the inherent redundancy. Although there has been a lot of work on designing FASTQ compressors, most of them lack in support of one or more crucial properties, such as support for variable length reads, scalability to high coverage datasets, pairing-preserving compression and lossless compression.
Results
In this work, we propose SPRING, a reference-free compressor for FASTQ files. SPRING supports a wide variety of compression modes and features, including lossless compression, pairing-preserving compression, lossy compression of quality values, long read compression and random access. SPRING achieves substantially better compression than existing tools, for example, SPRING compresses 195 GB of 25× whole genome human FASTQ from Illumina’s NovaSeq sequencer to less than 7 GB, around 1.6× smaller than previous state-of-the-art FASTQ compressors. SPRING achieves this improvement while using comparable computational resources.
Availability and implementation
SPRING can be downloaded from https://github.com/shubhamchandak94/SPRING.
Supplementary information
Supplementary data are available at Bioinformatics online.
Oxford University Press
以上显示的是最相近的搜索结果。 查看全部搜索结果