- A collection of 120+ RLE and related codecs optimized for all kinds of different inputs and scenarios
- Single Core decompression speeds > 34 GB/s and compression > 28 GB/s have been observed with large files. Small files can even exceed 120 GB/s decode, 60 GB/s encode.
- Written in C.
- SIMD Variants for AVX-512F, AVX2, AVX, SSE4.1, SSSE3 and SSE2 variants are available for various decoders and encoders. Automatically picked at runtime based on the extensions available on the current platform.
- Specialized versions for various different scenarios. (Single RLE Symbol, Short Strings of RLE Symbol, 8 Bit, 16 Bit, 24 Bit, 32 Bit, 48 Bit, 64 Bit, 128 Bit, High probability of reoccuring symbols etc.)
- OpenCL variant available for some of the decoders.
- Licensed under Two Clause BSD.
- Obligatory link to the repository.
the fastest run-length-encoding for x64
headline decode/ratio pareto encode/ratio pareto decode/entropy pareto encode/entropy pareto
text1
text2
text3
text4
benchmarks
enwiki.bwt (wikipedia extract encoded using libdivsufsort)
Single Symbol codecs have been removed since the dataset isn't suitable.
tj5oyhhuehv11.bmp (high-resolution pixelart bitmap image)
Non 24/48 Bit codecs have been removed since the compression ratio is negligible or uncompetitive everywhere else.
Decompression and Compression Speed don't start at zero, because otherwise the graph wouldn't be particularly useful.