Genozip - a universal extensible genomic data compressor
Files
(Published version)
Date
2021
Authors
Lan, D.
Tobler, R.
Souilmi, Y.
Llamas, B.
Editors
Kelso, J.
Advisors
Journal Title
Journal ISSN
Volume Title
Type:
Journal article
Citation
Bioinformatics, 2021; 37(16):2225-2230
Statement of Responsibility
Divon Lan, Ray Tobler, Yassine Souilmi, Bastien Llamas
Conference Name
Abstract
We present Genozip, a universal and fully featured compression software for genomic data. Genozip is designed to be a general-purpose software and a development framework for genomic compression by providing five core capabilities - universality (support for all common genomic file formats), high compression ratios, speed, feature-richness, and extensibility. Genozip delivers high-performance compression for widely-used genomic data formats in genomics research, namely FASTQ, SAM/BAM/CRAM, VCF, GVF, FASTA, PHYLIP, and 23andMe formats. Our test results show that Genozip is fast and achieves greatly improved compression ratios, even when the files are already compressed. Further, Genozip is architected with a separation of the Genozip Framework from file-format-specific Segmenters and data-type-specific Codecs. With this, we intend for Genozip to be a general-purpose compression platform where researchers can implement compression for additional file formats, as well as new codecs for data types or fields within files, in the future. We anticipate that this will ultimately increase the visibility and adoption of these algorithms by the user community, thereby accelerating further innovation in this space. Availability: Genozip is written in C. The code is open-source and available on GitHub (https://github.com/divonlan/genozip). The package is free for non-commercial use. It is distributed as a Docker container on DockerHub and through the conda package manager. Genozip is tested on Linux, Mac, and Windows. Supplementary information: Supplementary data are available at Bioinformatics online.
School/Discipline
Dissertation Note
Provenance
Description
Access Status
Rights
© The Author(s) 2021. Published by Oxford University Press. 2225 This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted reuse, distribution, and reproduction in any medium, provided the original work is properly cited.