Home‎ > ‎

Compression Benchmark

Lzturbo library: world's fastest compression library

+ Lzturbo vs. fastest and popular compressors
- Method 1 - compress better, more than 2x faster, decompress 3x faster than Snappy.
- Method 1 - compress better and faster, decompress up to 1.8x faster than Lz4.
- Method 1 - decompress ~7x! faster than LZO
- Method 2 - compress better and 4x faster, decompress 7x! faster than zlib-1.
- Method 3 - compress better and up to 13x! faster, decompress ~6x faster than zlib-9.
- Method 3 - decompress 7x faster than Lzham.
- Method 3 - can decompress 30x faster than lzma with a bit less compression ratio.

TurboBench: In Memory Compression Benchmark

Single core in memory compression benchmark, 64 bits gcc 8.3 - CPU: Skylake i7-6700 3.4 GHz
                                                                                                                      (MB=1.000.000    bold= Pareto frontier)

Size Ratio % C.MB/s D.MB/s Compressor Binary App: app3.tar(Apps Suite Light)
32823983 32.8 3.35 55.45 lzma 9 32872154 32.8 0.43 268.74 brotli 11d29 32925079 32.9 1.69 57.81 LzTurbo 49 33570586 33.5 2.49 1622.37 LzTurbo 39 33761620 33.7 2.57 264.51 lzham 4 34105370 34.1 3.25 853.62 zstd 22 36776484 36.7 54.70 1978.70 LzTurbo 32 36920708 36.9 2.56 2741.83 LzTurbo 29 40025360 40.0 57.18 2405.98 LzTurbo 22 41415820 41.4 3.17 5024.02 LzTurbo 19 45975365 45.9 34.24 308.57 brotli 5 46199461 46.2 11.45 947.68 zstd 15 46805879 46.8 51.05 924.87 zstd 9 47414312 47.4 189.09 1792.95 LzTurbo 31 48156977 48.1 62.97 304.58 brotli 4 48249922 48.2 11.50 28.35 bzip2 48803828 48.8 0.33 276.28 zopfli 49497505 49.4 2.80 2304.54 lizard 49 49521949 49.5 64.46 603.79 lzfse 49860700 49.8 12.66 272.94 zlib 9 49962678 49.9 27.87 271.54 zlib 6 50381965 50.3 319.52 1727.33 LzTurbo 30 52509931 52.5 247.27 299.54 brotli 1 52855721 52.8 262.35 2163.12 LzTurbo 21 52928477 52.9 59.93 257.08 zlib 1 52983490 52.9 339.37 900.27 zstd 1 53159431 53.1 136.92 4299.58 LzTurbo 12 54410769 54.4 38.10 2883.30 lz4 9 55482271 55.4 2.53 3410.75 lzsse8 17 55721002 55.7 307.00 4376.28 LzTurbo 11 58496030 58.4 670.19 2250.16 LzTurbo 20 61262695 61.2 900.28 4555.53 LzTurbo 10 61938605 61.9 659.12 2859.94 lz4 1 100098564 100.0 12939.79 13502.26 memcpy

 Size  	   Ratio %     C.MB/s     D.MB/s  Compressor   Binary Game data: pd3d.tar    

  7929564    24.8       2.28      64.34   LzTurbo 49      
  7992210    25.0       4.14      66.85   lzma 9     
  8318958    26.0       3.28    1106.71   LzTurbo 39  
  8588746    26.9       0.44     252.81   brotli 11d29    
  9456758    29.6       3.38     173.47   lzham 4  
  9662627    30.2       4.24     479.06   zstd 22      
  9737886    30.5      36.43    1385.34   LzTurbo 32   
 10104630    31.6      35.56     331.43   brotli 5
 10257124    32.1     214.59    1576.68   LzTurbo 31   
 10355528    32.4      13.81     752.30   zstd 15      
 10425683    32.6      51.01     732.87   zstd 9        
 10664607    33.4     357.13    1666.99   LzTurbo 30   
 10708458    33.5       0.29     333.92   zopfli
 10940860    34.2      71.32     684.60   lzfse 
 11001632    34.4      69.22     329.02   brotli 4      
 11061382    34.6       6.97     333.46   zlib 9       
 11122434    34.8      32.81     330.46   zlib 6         
 11595241    36.3       3.90    2165.53   LzTurbo 29      
 11611013    36.3      78.91     314.30   zlib 1          
 11654415    36.5     320.30     685.47   zstd 1
 12094776    37.9     264.53     294.38   brotli 1
 12265594    38.4      10.73      34.89   bzip2           
 13045392    40.8      38.37    2098.57   LzTurbo 22      
 13399053    41.9       3.91    2005.34   lizard 49       
 13475874    42.2     324.73    2653.23   lzturbo 21      
 13546415    42.4       4.73    4089.19   LzTurbo 19
 13982585    43.8       3.92    3118.60   lzsse8 17
 14146562    44.3     152.48    3771.14   LzTurbo 12      
 14279732    44.7      50.20    2867.73   lz4 9           
 14765532    46.2     769.89    2624.04   LzTurbo 20      
 14749411    46.2     395.17    4147.57   LzTurbo 11      
 16069624    50.3     687.01    3152.06   lz4 1          
 16072802    50.3     871.91    4191.64   LzTurbo 10    
 31952900   100.0   13671.20   13699.49   memcpy        

Size Ratio % C.MB/s D.MB/s Compressor (Binary 42% + Text 58%) Silesia.tar

 48616057    22.9       1.07      77.11   LzTurbo 49
 48758739    23.0       2.47      81.17   lzma 9    
 49517150    23.4       0.46     336.19   brotli 11d29 
 50861542    24.0       1.68     269.97   lzham 4     
 51505589    24.3       1.57    1200.06   LzTurbo 39
 52715921    24.9       2.03     602.56   zstd 22         
 54596837    25.8      11.80      38.94   bzip2     
 58008992    27.4       7.96     853.20   zstd 15         
 59279197    28.0      44.14    1347.68   LzTurbo 32
 59581397    28.1      33.48     416.81   brotli 5
 60411647    28.5      45.64     798.97   zstd 9          
 60813803    28.7       1.60    2002.86   LzTurbo 29
 64147793    30.3     173.04    1536.45   LzTurbo 31
 64191258    30.3      65.28     416.81   brotli 4  
 64711652    30.5       0.22     325.27   zopfli  
 67624724    31.9      62.86     692.87   lzfse
 67647204    31.9       9.99     316.72   zlib 9          
 68225985    32.2      24.46     313.67   zlib 6          
 68627981    32.4       1.92    1879.16   lizard 49       
 69836866    32.9     278.02    1506.13   LzTurbo 30
 70965257    33.5      44.10    1692.58   LzTurbo 22      
 72240333    34.1       1.93    3605.48   LzTurbo 19
 73441969    34.7     222.31     335.06   brotli 1        
 73643046    34.7     310.86     805.86   zstd 1    
 75328465    35.5       3.14    3636.47   lzsse8 17 
 77256401    36.5      80.46     295.37   zlib 1          
 77892574    36.8      27.02    2601.03   lz4 9           
 78109960    36.9     222.71    1873.79   LzTurbo 21      
 79889973    37.7     116.07    3694.92   LzTurbo 12      
 85601074    40.4     248.60    3980.77   LzTurbo 11      
 93142669    43.9     525.66    1885.78   LzTurbo 20
 99550147    47.0     644.82    4190.19   LzTurbo 10      
100881352    47.6     536.46    2627.10   lz4 1     
211948036   100.0   13148.80   13543.59   memcpy    

Size Ratio % C.MB/s D.MB/s Compressor Text log: NASA_access_log

11355945 5.5 0.86 320.68 LzTurbo 49 11916112 5.8 1.27 2466.44 LzTurbo 39 11960483 5.8 10.13 67.81 bzip2 12236072 6.0 0.51 1022.47 brotli 11d29 12617026 6.1 1.36 1348.32 zstd 22 13598062 6.6 2.68 265.69 lzma 9 13651218 6.7 1.33 880.25 lzham 4 14661031 7.1 8.67 1819.99 zstd 15 15041556 7.3 1.13 3732.63 LzTurbo 29 16665926 8.1 78.89 1245.90 brotli 5 17387746 8.5 117.98 1375.73 zstd 9 18280957 8.9 130.54 2639.37 LzTurbo 32 18654669 9.1 173.25 1227.89 brotli 4 19085875 9.3 1.50 3527.36 lizard 49 19088752 9.3 1.44 4499.74 LzTurbo 19 19545036 9.5 32.75 651.55 zlib 9 20695664 10.1 74.74 647.11 zlib 6 20793102 10.1 371.78 2638.38 LzTurbo 31 21004908 10.2 83.53 1387.17 lzfse 22756147 11.1 534.69 1122.78 zstd 1 23713745 11.6 635.42 2579.46 LzTurbo 30 24557455 12.0 49.28 3212.04 lz4 9 24579485 12.0 6.84 5803.38 lzsse8 17 25275862 12.3 492.67 804.38 brotli 1 25831444 12.6 134.51 3085.98 LzTurbo 22 28146385 13.7 238.97 4821.18 LzTurbo 12 28269751 13.8 418.94 2690.43 LzTurbo 21 29129222 14.2 180.85 518.62 zlib 1 31506601 15.4 456.67 4132.12 LzTurbo 11 34664447 16.9 863.58 2368.88 LzTurbo 20 36414892 17.7 1000.22 3948.03 LzTurbo 10 38130859 18.6 820.91 2303.70 lz4 1 205242372 100.0 13092.72 13758.48 memcpy

Size Ratio % C.MB/s D.MB/s Compressor Text XML
: enwik8
 24362183    24.4       1.01      82.32   LzTurbo 49
 24810184    24.8       0.44     299.94   brotli 11d29
 24861228    24.9       1.49      83.07   lzma 9    
 25021508    25.0       1.16     241.56   lzham 4   
 25314329    25.3       1.28     677.82   LzTurbo 39
 25380048    25.4       1.58     504.75   zstd 22   
 28788842    28.8       1.23    1299.99   LzTurbo 29
 29008762    29.0      13.02      33.46   bzip2     
 29292948    29.3      35.18     757.62   LzTurbo 32
 30307444    30.3       6.68     694.76   zstd 15       
 31766514    31.8      34.34     656.35   zstd 9          
 31776975    31.8      28.08     362.17   brotli 5
 33515149    33.5      54.12     387.73   brotli 4  
 33577346    33.6     126.59    1154.84   LzTurbo 31
 34326559    34.3      33.79    1181.13   LzTurbo 22      
 34966070    35.0       0.46     265.78   zopfli          
 36157832    36.2      50.56     546.82   lzfse
 36433239    36.4       1.93    1270.23   lizard 49       
 36475796    36.5      15.85     255.73   zlib 9          
 36548925    36.5      19.88     255.37   zlib 6          
 37204707    37.2     198.91    1185.61   LzTurbo 30
 38716643    38.7       9.48    3118.28   lzsse8 17       
 39123260    39.1     153.00     301.37   brotli 1        
 39663589    39.7       1.43    3043.77   LzTurbo 19
 40734395    40.7     152.67    1355.79   LzTurbo 21      
 40859471    40.9     234.47     688.37   zstd 1    
 42203257    42.2      28.23    2410.35   lz4 9           
 42298778    42.3      70.33     251.72   zlib 1          
 43419940    43.4      75.90    3307.86   LzTurbo 12
 46672274    46.7     163.77    3676.74   LzTurbo 11      
 52105294    52.1     362.34    1350.68   LzTurbo 20
 56832299    56.8     463.86    3970.46   LzTurbo 10
 57262285    57.3     397.11    2314.29   lz4 1     
100000004   100.0   13436.29   13495.14   memcpy         

The compression benchmark libraries:
- brotli 18-07-10 (d29 w/ large window brotli)
- lzfse
- zlib 1.2.9
- lizard v2.0
- lz4 v1.7.5
- lzturbo v19.8
- zstd v1.1.3

Compression Benchmark last update: 11 Aug 2019