Compression Benchmark

TurboBench: In Memory Compression Benchmark

Single core in memory compression benchmark, 64 bits gcc 8.3 - CPU: Skylake i7-6700 3.4 GHz

(MB=1.000.000 bold= Pareto frontier)

Size Ratio % C.MB/s D.MB/s Compressor Binary App: app3.tar(Apps Suite Light)

32823983 32.8 3.35 55.45 lzma 9
32872154 32.8 0.43 268.74 brotli 11d29
32925079 32.9 1.69 57.81 LzTurbo 49
33570586 33.5 2.49 1622.37 LzTurbo 39
33761620 33.7 2.57 264.51 lzham 4
34105370 34.1 3.25 853.62 zstd 22
36776484 36.7 54.70 1978.70 LzTurbo 32
36920708 36.9 2.56 2741.83 LzTurbo 29
40025360 40.0 57.18 2405.98 LzTurbo 22
41415820 41.4 3.17 5024.02 LzTurbo 19
45975365 45.9 34.24 308.57 brotli 5
46199461 46.2 11.45 947.68 zstd 15
46805879 46.8 51.05 924.87 zstd 9
47414312 47.4 189.09 1792.95 LzTurbo 31
48156977 48.1 62.97 304.58 brotli 4
48249922 48.2 11.50 28.35 bzip2
48803828 48.8 0.33 276.28 zopfli
49497505 49.4 2.80 2304.54 lizard 49
49521949 49.5 64.46 603.79 lzfse
49860700 49.8 12.66 272.94 zlib 9
49962678 49.9 27.87 271.54 zlib 6
50381965 50.3 319.52 1727.33 LzTurbo 30
52509931 52.5 247.27 299.54 brotli 1
52855721 52.8 262.35 2163.12 LzTurbo 21
52928477 52.9 59.93 257.08 zlib 1
52983490 52.9 339.37 900.27 zstd 1
53159431 53.1 136.92 4302.72 LzTurbo 12
54410769 54.4 38.10 2883.30 lz4 9
55482271 55.4 2.53 3410.75 lzsse8 17
55721002 55.7 307.00 4376.28 LzTurbo 11
58496030 58.4 670.19 2250.16 LzTurbo 20
61262695 61.2 900.28 4555.53 LzTurbo 10
61938605 61.9 659.12 2859.94 lz4 1
100098564 100.0 12939.79 13502.26 memcpy

Size Ratio % C.MB/s D.MB/s Compressor Binary Game data: pd3d.tar

7929564 24.8 2.28 64.34 LzTurbo 49
7992210 25.0 4.14 66.85 lzma 9
8318958 26.0 3.28 1106.71 LzTurbo 39
8588746 26.9 0.44 252.81 brotli 11d29
9456758 29.6 3.38 173.47 lzham 4
9662627 30.2 4.24 479.06 zstd 22
9737886 30.5 36.43 1385.34 LzTurbo 32
10104630 31.6 35.56 331.43 brotli 5
10257124 32.1 214.59 1576.68 LzTurbo 31
10355528 32.4 13.81 752.30 zstd 15
10425683 32.6 51.01 732.87 zstd 9
10664607 33.4 357.13 1666.99 LzTurbo 30
10708458 33.5 0.29 333.92 zopfli
10940860 34.2 71.32 684.60 lzfse
11001632 34.4 69.22 329.02 brotli 4
11061382 34.6 6.97 333.46 zlib 9
11122434 34.8 32.81 330.46 zlib 6
11595241 36.3 3.90 2165.53 LzTurbo 29
11611013 36.3 78.91 314.30 zlib 1
11654415 36.5 320.30 685.47 zstd 1
12094776 37.9 264.53 294.38 brotli 1
12265594 38.4 10.73 34.89 bzip2
13045392 40.8 38.37 2098.57 LzTurbo 22
13399053 41.9 3.91 2005.34 lizard 49
13475874 42.2 324.73 2653.23 lzturbo 21
13546415 42.4 4.73 4089.19 LzTurbo 19
13982585 43.8 3.92 3118.60 lzsse8 17
14146562 44.3 152.48 3771.14 LzTurbo 12
14279732 44.7 50.20 2867.73 lz4 9
14765532 46.2 769.89 2624.04 LzTurbo 20
14749411 46.2 395.17 4147.57 LzTurbo 11
16069624 50.3 687.01 3152.06 lz4 1
16072802 50.3 871.91 4191.64 LzTurbo 10
31952900 100.0 13671.20 13699.49 memcpy

Size Ratio % C.MB/s D.MB/s Compressor (Binary 42% + Text 58%) Silesia.tar

48616057 22.9 1.07 77.11 LzTurbo 49
48758739 23.0 2.47 81.17 lzma 9
49517150 23.4 0.46 336.19 brotli 11d29
50861542 24.0 1.68 269.97 lzham 4
51505589 24.3 1.57 1200.06 LzTurbo 39
52715921 24.9 2.03 602.56 zstd 22
54596837 25.8 11.80 38.94 bzip2
58008992 27.4 7.96 853.20 zstd 15
59279197 28.0 44.14 1347.68 LzTurbo 32
59581397 28.1 33.48 416.81 brotli 5
60411647 28.5 45.64 798.97 zstd 9
60813803 28.7 1.60 2002.86 LzTurbo 29
64147793 30.3 173.04 1536.45 LzTurbo 31
64191258 30.3 65.28 416.81 brotli 4
64711652 30.5 0.22 325.27 zopfli
67624724 31.9 62.86 692.87 lzfse
67647204 31.9 9.99 316.72 zlib 9
68225985 32.2 24.46 313.67 zlib 6
68627981 32.4 1.92 1879.16 lizard 49
69836866 32.9 278.02 1506.13 LzTurbo 30
70965257 33.5 44.10 1692.58 LzTurbo 22
72240333 34.1 1.93 3605.48 LzTurbo 19
73441969 34.7 222.31 335.06 brotli 1
73643046 34.7 310.86 805.86 zstd 1
75328465 35.5 3.14 3636.47 lzsse8 17
77256401 36.5 80.46 295.37 zlib 1
77892574 36.8 27.02 2601.03 lz4 9
78109960 36.9 222.71 1873.79 LzTurbo 21
79889973 37.7 116.07 3694.92 LzTurbo 12
85601074 40.4 248.60 3986.98 LzTurbo 11
93142669 43.9 525.66 1885.78 LzTurbo 20
99550147 47.0 644.82 4196.91 LzTurbo 10
100881352 47.6 536.46 2627.10 lz4 1
211948036 100.0 13148.80 13543.59 memcpy

Size Ratio % C.MB/s D.MB/s Compressor Text log: NASA_access_log

11355945 5.5 0.86 320.68 LzTurbo 49
11916112 5.8 1.27 2466.44 LzTurbo 39
11960483 5.8 10.13 67.81 bzip2
12236072 6.0 0.51 1022.47 brotli 11d29
12617026 6.1 1.36 1348.32 zstd 22
13598062 6.6 2.68 265.69 lzma 9
13651218 6.7 1.33 880.25 lzham 4
14661031 7.1 8.67 1819.99 zstd 15
15041556 7.3 1.13 3732.63 LzTurbo 29
16665926 8.1 78.89 1245.90 brotli 5
17387746 8.5 117.98 1375.73 zstd 9
18280957 8.9 130.54 2639.37 LzTurbo 32
18654669 9.1 173.25 1227.89 brotli 4
19085875 9.3 1.50 3527.36 lizard 49
19088752 9.3 1.44 4499.74 LzTurbo 19
19545036 9.5 32.75 651.55 zlib 9
20695664 10.1 74.74 647.11 zlib 6
20793102 10.1 371.78 2638.38 LzTurbo 31
21004908 10.2 83.53 1387.17 lzfse
22756147 11.1 534.69 1122.78 zstd 1
23713745 11.6 635.42 2579.46 LzTurbo 30
24557455 12.0 49.28 3212.04 lz4 9
24579485 12.0 6.84 5803.38 lzsse8 17
25275862 12.3 492.67 804.38 brotli 1
25831444 12.6 134.51 3085.98 LzTurbo 22
28146385 13.7 238.97 4821.18 LzTurbo 12
28269751 13.8 418.94 2690.43 LzTurbo 21
29129222 14.2 180.85 518.62 zlib 1
31506601 15.4 456.67 4132.12 LzTurbo 11
34664447 16.9 863.58 2368.88 LzTurbo 20
36414892 17.7 1000.22 3948.03 LzTurbo 10
38130859 18.6 820.91 2303.70 lz4 1
205242372 100.0 13092.72 13758.48 memcpy

Size Ratio % C.MB/s D.MB/s Compressor Text XML: enwik8

24362183 24.4 1.01 82.32 LzTurbo 49
24810184 24.8 0.44 299.94 brotli 11d29
24861228 24.9 1.49 83.07 lzma 9
25021508 25.0 1.16 241.56 lzham 4
25314329 25.3 1.28 677.82 LzTurbo 39
25380048 25.4 1.58 504.75 zstd 22
28788842 28.8 1.23 1299.99 LzTurbo 29
29008762 29.0 13.02 33.46 bzip2
29292948 29.3 35.18 757.62 LzTurbo 32
30307444 30.3 6.68 694.76 zstd 15
31766514 31.8 34.34 656.35 zstd 9
31776975 31.8 28.08 362.17 brotli 5
33515149 33.5 54.12 387.73 brotli 4
33577346 33.6 126.59 1154.84 LzTurbo 31
34326559 34.3 33.79 1181.13 LzTurbo 22
34966070 35.0 0.46 265.78 zopfli
36157832 36.2 50.56 546.82 lzfse
36433239 36.4 1.93 1270.23 lizard 49
36475796 36.5 15.85 255.73 zlib 9
36548925 36.5 19.88 255.37 zlib 6
37204707 37.2 198.91 1185.61 LzTurbo 30
38716643 38.7 9.48 3118.28 lzsse8 17
39123260 39.1 153.00 301.37 brotli 1
39663589 39.7 1.43 3043.77 LzTurbo 19
40734395 40.7 152.67 1355.79 LzTurbo 21
40859471 40.9 234.47 688.37 zstd 1
42203257 42.2 28.23 2410.35 lz4 9
42298778 42.3 70.33 251.72 zlib 1
43419940 43.4 75.90 3307.86 LzTurbo 12
46672274 46.7 163.77 3676.74 LzTurbo 11
52105294 52.1 362.34 1350.68 LzTurbo 20
56832299 56.8 463.86 3970.46 LzTurbo 10
57262285 57.3 397.11 2314.29 lz4 1
100000004 100.0 13436.29 13495.14 memcpy

The compression benchmark libraries:

- brotli 18-07-10 (d29 w/ large window brotli)
- lzfse - zlib 1.2.9
- lizard v2.0
- lz4 v1.7.5
- lzturbo v19.8
- zstd v1.1.3

Compression Benchmark last update: 11 Aug 2019