FiniteStateEntropy alternatives and similar libraries
Based on the "Compression" category.
Alternatively, view FiniteStateEntropy alternatives based on common mentions on social networks and blogs.
zstd9.6 9.8 L2 FiniteStateEntropy VS zstdZstandard - Fast real-time compression algorithm
brotli9.3 4.3 L2 FiniteStateEntropy VS brotliBrotli compression format
LZ49.0 9.2 L2 FiniteStateEntropy VS LZ4Extremely Fast Compression algorithm
ZLib8.7 3.2 L2 FiniteStateEntropy VS ZLibA massively spiffy yet delicately unobtrusive compression library.
Snappy8.5 3.0 L2 FiniteStateEntropy VS SnappyA fast compressor/decompressor
LZFSE6.5 0.0 L2 FiniteStateEntropy VS LZFSELZFSE compression library and command line tool
Minizip6.0 3.9 L2 FiniteStateEntropy VS MinizipFork of the popular zip manipulation library found in the zlib distribution.
zlib-ng5.8 9.6 L3 FiniteStateEntropy VS zlib-ngzlib replacement with optimizations for "next generation" systems.
smaz5.5 0.0 L4 FiniteStateEntropy VS smazSmall strings compression library
LZHAM4.7 0.0 L1 FiniteStateEntropy VS LZHAMLossless data compression codec with LZMA-like ratios but 1.5x-8x faster decompression speed, C/C++
tiny_jpeg.h3.4 2.0 L1 FiniteStateEntropy VS tiny_jpeg.hSingle header lib for JPEG encoding. Public domain. C99. stb style.
PhysicsFS2.4 0.0 L5 FiniteStateEntropy VS PhysicsFSPhysFS++ is a C++ wrapper for the PhysicsFS library.
minizSingle C source file Deflate/Inflate compression library with zlib-compatible API, ZIP archive reading/writing, PNG writing. [Unlicense]
LZMA1.9 0.0 L1 FiniteStateEntropy VS LZMA(Unofficial) Git mirror of LZMA SDK releases
KArchive1.9 2.4 L1 FiniteStateEntropy VS KArchiveQt 5 addon providing access to numerous types of archives
dobozCompression library with very fast decompression. [zlib]
LZMAT1.4 0.0 L2 FiniteStateEntropy VS LZMATgit mirror of LZMAT (http://www.matcode.com/lzmat.htm)
bzip2A freely available, patent free, high-quality data compressor. [BSD]
ZZIPlibProvides read access on ZIP-archives. [MPL/LGPL]
Access the most powerful time series database as a service
* Code Quality Rankings and insights are calculated and provided by Lumnify.
They vary from L1 to L5 with "L5" being the highest.
Do you think we are missing an alternative of FiniteStateEntropy or a related project?
New Generation Entropy coders
This library proposes two high speed entropy coders :
Huff0, a Huffman codec designed for modern CPU, featuring OoO (Out of Order) operations on multiple ALU (Arithmetic Logic Unit), achieving extremely fast compression and decompression speeds.
FSE is a new kind of Entropy encoder, based on ANS theory, from Jarek Duda, achieving precise compression accuracy (like Arithmetic coding) at much higher speeds.
Benchmarks are run on an Intel Core i7-5600U, with Linux Mint 64-bits.
Source code is compiled using GCC 4.8.4, 64-bits mode.
Test files are generated using the provided
Benchmark breaks sample files into blocks of 32 KB.
FSE are compared to
zlibh, the huffman encoder within zlib, provided by Frederic Kayser.
|Huff0||6.38||600 MB/s||1350 MB/s|
|FSE||8.84||325 MB/s||440 MB/s|
|zlibh||6.38||265 MB/s||300 MB/s|
|Huff0||1.90||595 MB/s||860 MB/s|
|FSE||1.91||330 MB/s||460 MB/s|
|zlibh||1.90||255 MB/s||250 MB/s|
|Huff0||1.13||525 MB/s||555 MB/s|
|FSE||1.13||325 MB/s||445 MB/s|
|zlibh||1.13||180 MB/s||210 MB/s|
By design, Huffman can't break the "1 bit per symbol" limit, hence loses efficiency on squeezed distributions, such as
FSE is free of such limit, and its compression efficiency remains close to Shannon limit in all circumstances.
However, this accuracy is not always necessary, and less compressible distributions show little difference with Huffman.
On its side, Huff0 delivers in the form of a massive speed advantage.
External contributions are welcomed and encouraged. The "master" branch is only meant to host stable releases. The "dev" branch is the one where all contributions are merged. If you want to propose a patch, please commit into "dev" branch or dedicated feature branch. Direct commit to "master" are not permitted.