Compression Benchmark

Lzturbo library: world's fastest compression library

+ Lzturbo vs. fastest and popular compressors

- Method 1 - compress better, more than 2x faster, decompress 3x faster than Snappy.

- Method 1 - compress better and faster, decompress up to 1.8x faster than Lz4.

- Method 1 - decompress ~7x! faster than LZO

- Method 2 - compress better and 4x faster, decompress 7x! faster than zlib-1.

- Method 3 - compress better and up to 13x! faster, decompress ~6x faster than zlib-9.

- Method 3 - decompress 7x faster than Lzham.

- Method 3 - can decompress 30x faster than lzma with a bit less compression ratio.

TurboBench: In Memory Compression Benchmark

Single core in memory compression benchmark, 64 bits gcc 8.3 - CPU: Skylake i7-6700 3.4 GHz

(MB=1.000.000 bold= Pareto frontier)

Size Ratio % C.MB/s D.MB/s Compressor Binary App: app3.tar(Apps Suite Light)

32823983 32.8 3.35 55.45 lzma 9 32872154 32.8 0.43 268.74 brotli 11d29 32925079 32.9 1.69 57.81 LzTurbo 49 33570586 33.5 2.49 1622.37 LzTurbo 39 33761620 33.7 2.57 264.51 lzham 4 34105370 34.1 3.25 853.62 zstd 22 36776484 36.7 54.70 1978.70 LzTurbo 32 36920708 36.9 2.56 2741.83 LzTurbo 29 40025360 40.0 57.18 2405.98 LzTurbo 22 41415820 41.4 3.17 5024.02 LzTurbo 19 45975365 45.9 34.24 308.57 brotli 5 46199461 46.2 11.45 947.68 zstd 15 46805879 46.8 51.05 924.87 zstd 9 47414312 47.4 189.09 1792.95 LzTurbo 31 48156977 48.1 62.97 304.58 brotli 4 48249922 48.2 11.50 28.35 bzip2 48803828 48.8 0.33 276.28 zopfli 49497505 49.4 2.80 2304.54 lizard 49 49521949 49.5 64.46 603.79 lzfse 49860700 49.8 12.66 272.94 zlib 9 49962678 49.9 27.87 271.54 zlib 6 50381965 50.3 319.52 1727.33 LzTurbo 30 52509931 52.5 247.27 299.54 brotli 1 52855721 52.8 262.35 2163.12 LzTurbo 21 52928477 52.9 59.93 257.08 zlib 1 52983490 52.9 339.37 900.27 zstd 1 53159431 53.1 136.92 4299.58 LzTurbo 12 54410769 54.4 38.10 2883.30 lz4 9 55482271 55.4 2.53 3410.75 lzsse8 17 55721002 55.7 307.00 4376.28 LzTurbo 11 58496030 58.4 670.19 2250.16 LzTurbo 20 61262695 61.2 900.28 4555.53 LzTurbo 10 61938605 61.9 659.12 2859.94 lz4 1 100098564 100.0 12939.79 13502.26 memcpy

Size Ratio % C.MB/s D.MB/s Compressor Binary Game data: pd3d.tar

7929564 24.8 2.28 64.34 LzTurbo 49 7992210 25.0 4.14 66.85 lzma 9 8318958 26.0 3.28 1106.71 LzTurbo 39 8588746 26.9 0.44 252.81 brotli 11d29 9456758 29.6 3.38 173.47 lzham 4 9662627 30.2 4.24 479.06 zstd 22 9737886 30.5 36.43 1385.34 LzTurbo 32 10104630 31.6 35.56 331.43 brotli 5 10257124 32.1 214.59 1576.68 LzTurbo 31 10355528 32.4 13.81 752.30 zstd 15 10425683 32.6 51.01 732.87 zstd 9 10664607 33.4 357.13 1666.99 LzTurbo 30 10708458 33.5 0.29 333.92 zopfli 10940860 34.2 71.32 684.60 lzfse 11001632 34.4 69.22 329.02 brotli 4 11061382 34.6 6.97 333.46 zlib 9 11122434 34.8 32.81 330.46 zlib 6 11595241 36.3 3.90 2165.53 LzTurbo 29 11611013 36.3 78.91 314.30 zlib 1 11654415 36.5 320.30 685.47 zstd 1 12094776 37.9 264.53 294.38 brotli 1 12265594 38.4 10.73 34.89 bzip2 13045392 40.8 38.37 2098.57 LzTurbo 22 13399053 41.9 3.91 2005.34 lizard 49 13475874 42.2 324.73 2653.23 lzturbo 21 13546415 42.4 4.73 4089.19 LzTurbo 19 13982585 43.8 3.92 3118.60 lzsse8 17 14146562 44.3 152.48 3771.14 LzTurbo 12 14279732 44.7 50.20 2867.73 lz4 9 14765532 46.2 769.89 2624.04 LzTurbo 20 14749411 46.2 395.17 4147.57 LzTurbo 11 16069624 50.3 687.01 3152.06 lz4 1 16072802 50.3 871.91 4191.64 LzTurbo 10 31952900 100.0 13671.20 13699.49 memcpy

Size Ratio % C.MB/s D.MB/s Compressor (Binary 42% + Text 58%) Silesia.tar

48616057 22.9 1.07 77.11 LzTurbo 49 48758739 23.0 2.47 81.17 lzma 9 49517150 23.4 0.46 336.19 brotli 11d29 50861542 24.0 1.68 269.97 lzham 4 51505589 24.3 1.57 1200.06 LzTurbo 39 52715921 24.9 2.03 602.56 zstd 22 54596837 25.8 11.80 38.94 bzip2 58008992 27.4 7.96 853.20 zstd 15 59279197 28.0 44.14 1347.68 LzTurbo 32 59581397 28.1 33.48 416.81 brotli 5 60411647 28.5 45.64 798.97 zstd 9 60813803 28.7 1.60 2002.86 LzTurbo 29 64147793 30.3 173.04 1536.45 LzTurbo 31 64191258 30.3 65.28 416.81 brotli 4 64711652 30.5 0.22 325.27 zopfli 67624724 31.9 62.86 692.87 lzfse 67647204 31.9 9.99 316.72 zlib 9 68225985 32.2 24.46 313.67 zlib 6 68627981 32.4 1.92 1879.16 lizard 49 69836866 32.9 278.02 1506.13 LzTurbo 30 70965257 33.5 44.10 1692.58 LzTurbo 22 72240333 34.1 1.93 3605.48 LzTurbo 19 73441969 34.7 222.31 335.06 brotli 1 73643046 34.7 310.86 805.86 zstd 1 75328465 35.5 3.14 3636.47 lzsse8 17 77256401 36.5 80.46 295.37 zlib 1 77892574 36.8 27.02 2601.03 lz4 9 78109960 36.9 222.71 1873.79 LzTurbo 21 79889973 37.7 116.07 3694.92 LzTurbo 12 85601074 40.4 248.60 3980.77 LzTurbo 11 93142669 43.9 525.66 1885.78 LzTurbo 20 99550147 47.0 644.82 4190.19 LzTurbo 10 100881352 47.6 536.46 2627.10 lz4 1 211948036 100.0 13148.80 13543.59 memcpy

Size Ratio % C.MB/s D.MB/s Compressor Text log: NASA_access_log

11355945 5.5 0.86 320.68 LzTurbo 49 11916112 5.8 1.27 2466.44 LzTurbo 39 11960483 5.8 10.13 67.81 bzip2 12236072 6.0 0.51 1022.47 brotli 11d29 12617026 6.1 1.36 1348.32 zstd 22 13598062 6.6 2.68 265.69 lzma 9 13651218 6.7 1.33 880.25 lzham 4 14661031 7.1 8.67 1819.99 zstd 15 15041556 7.3 1.13 3732.63 LzTurbo 29 16665926 8.1 78.89 1245.90 brotli 5 17387746 8.5 117.98 1375.73 zstd 9 18280957 8.9 130.54 2639.37 LzTurbo 32 18654669 9.1 173.25 1227.89 brotli 4 19085875 9.3 1.50 3527.36 lizard 49 19088752 9.3 1.44 4499.74 LzTurbo 19 19545036 9.5 32.75 651.55 zlib 9 20695664 10.1 74.74 647.11 zlib 6 20793102 10.1 371.78 2638.38 LzTurbo 31 21004908 10.2 83.53 1387.17 lzfse 22756147 11.1 534.69 1122.78 zstd 1 23713745 11.6 635.42 2579.46 LzTurbo 30 24557455 12.0 49.28 3212.04 lz4 9 24579485 12.0 6.84 5803.38 lzsse8 17 25275862 12.3 492.67 804.38 brotli 1 25831444 12.6 134.51 3085.98 LzTurbo 22 28146385 13.7 238.97 4821.18 LzTurbo 12 28269751 13.8 418.94 2690.43 LzTurbo 21 29129222 14.2 180.85 518.62 zlib 1 31506601 15.4 456.67 4132.12 LzTurbo 11 34664447 16.9 863.58 2368.88 LzTurbo 20 36414892 17.7 1000.22 3948.03 LzTurbo 10 38130859 18.6 820.91 2303.70 lz4 1 205242372 100.0 13092.72 13758.48 memcpy

Size Ratio % C.MB/s D.MB/s Compressor Text XML: enwik8

24362183 24.4 1.01 82.32 LzTurbo 49 24810184 24.8 0.44 299.94 brotli 11d29 24861228 24.9 1.49 83.07 lzma 9 25021508 25.0 1.16 241.56 lzham 4 25314329 25.3 1.28 677.82 LzTurbo 39 25380048 25.4 1.58 504.75 zstd 22 28788842 28.8 1.23 1299.99 LzTurbo 29 29008762 29.0 13.02 33.46 bzip2 29292948 29.3 35.18 757.62 LzTurbo 32 30307444 30.3 6.68 694.76 zstd 15 31766514 31.8 34.34 656.35 zstd 9 31776975 31.8 28.08 362.17 brotli 5 33515149 33.5 54.12 387.73 brotli 4 33577346 33.6 126.59 1154.84 LzTurbo 31 34326559 34.3 33.79 1181.13 LzTurbo 22 34966070 35.0 0.46 265.78 zopfli 36157832 36.2 50.56 546.82 lzfse 36433239 36.4 1.93 1270.23 lizard 49 36475796 36.5 15.85 255.73 zlib 9 36548925 36.5 19.88 255.37 zlib 6 37204707 37.2 198.91 1185.61 LzTurbo 30 38716643 38.7 9.48 3118.28 lzsse8 17 39123260 39.1 153.00 301.37 brotli 1 39663589 39.7 1.43 3043.77 LzTurbo 19 40734395 40.7 152.67 1355.79 LzTurbo 21 40859471 40.9 234.47 688.37 zstd 1 42203257 42.2 28.23 2410.35 lz4 9 42298778 42.3 70.33 251.72 zlib 1 43419940 43.4 75.90 3307.86 LzTurbo 12 46672274 46.7 163.77 3676.74 LzTurbo 11 52105294 52.1 362.34 1350.68 LzTurbo 20 56832299 56.8 463.86 3970.46 LzTurbo 10 57262285 57.3 397.11 2314.29 lz4 1 100000004 100.0 13436.29 13495.14 memcpy

The compression benchmark libraries:

- brotli 18-07-10 (d29 w/ large window brotli) - lzfse - zlib 1.2.9 - lizard v2.0 - lz4 v1.7.5 - lzturbo v19.8 - zstd v1.1.3

Compression Benchmark last update: 11 Aug 2019