Home‎ > ‎

Compression Benchmark

Lzturbo library: world's fastest compression library

+ Lzturbo vs. fastest and popular compressors
- Method 1 - compress better, more than 2x faster, decompress 3x faster than Snappy.
- Method 1 - compress better and faster, decompress up to 1.8x faster than Lz4.
- Method 1 - decompress ~7x! faster than LZO
- Method 2 - compress better and 4x faster, decompress 7x! faster than zlib-1.
- Method 3 - compress better and up to 13x! faster, decompress ~6x faster than zlib-9.
- Method 3 - decompress 7x faster than Lzham at nearly the same compression ratio.
- Method 3 - can decompress 30x faster than lzma with a bit less compression ratio.

Single core in memory benchmarks, 64 bits gcc 7.3 - CPU: Skylake i7-6700 3.4 GHz
                                                                                                                      (MB=1.000.000    bold= Pareto frontier)

Size Ratio % C.MB/s D.MB/s Compressor Binary App: app3.tar(Apps Suite Light)
32823983 32.8 3.35 55.45 lzma 9 32872154 32.8 0.43 268.74 brotli 11d29 32925079 32.9 1.69 57.81 LzTurbo 49 33761620 33.7 2.57 264.51 lzham 4 33885839 33.9 2.30 1755.31 LzTurbo 39 34105370 34.1 3.25 853.62 zstd 22 36782684 36.7 75.17 1901.00 LzTurbo 32 36920708 36.9 2.56 2741.83 LzTurbo 29 43818077 43.8 2.81 4746.93 LzTurbo 19 45975365 45.9 34.24 308.57 brotli 5 46199461 46.2 11.45 947.68 zstd 15 46805879 46.8 51.05 924.87 zstd 9 47427918 47.4 185.97 1562.60 LzTurbo 31 48156977 48.1 62.97 304.58 brotli 4 48249922 48.2 11.50 28.35 bzip2 48803828 48.8 0.33 276.28 zopfli 49497505 49.4 2.80 2304.54 lizard 49 49521949 49.5 64.46 603.79 lzfse 49773791 49.7 53.94 1705.11 LzTurbo 22 49860700 49.8 12.66 272.94 zlib 9 49962678 49.9 27.87 271.54 zlib 6 50403015 50.2 312.84 1478.82 LzTurbo 30 52509931 52.5 247.27 299.54 brotli 1 52549656 52.5 212.44 1740.39 LzTurbo 21 52928477 52.9 59.93 257.08 zlib 1 52983490 52.9 339.37 900.27 zstd 1 54410769 54.4 38.10 2883.30 lz4 9 55482275 55.4 2.53 3410.75 lzsse8 17 55862927 55.8 123.17 4057.01 LzTurbo 12 57786466 57.6 308.98 4084.82 LzTurbo 11 59085724 59.0 700.40 1766.22 LzTurbo 20 61635248 61.6 755.31 4203.53 LzTurbo 10 61938605 61.9 659.12 2859.94 lz4 1 100098564 100.0 12939.79 13502.26 memcpy

 Size  	   Ratio %     C.MB/s     D.MB/s  Compressor   Binary Game data: pd3d.tar    

  7929564    24.8       2.28      64.34   LzTurbo 49      
  7992210    25.0       4.14      66.85   lzma 9     
  8444352    26.4       3.22    1138.17   LzTurbo 39  
  8588746    26.9       0.44     252.81   brotli 11d29    
  9456758    29.6       3.38     173.47   lzham 4  
  9662627    30.2       4.24     479.06   zstd 22      
  9733986    29.9      55.07    1286.81   LzTurbo 32   
 10104630    31.6      35.56     331.43   brotli 5
 10258715    32.1     194.31    1491.45   LzTurbo 31   
 10355528    32.4      13.81     752.30   zstd 15      
 10425683    32.6      51.01     732.87   zstd 9        
 10668580    33.4     322.36    1594.14   LzTurbo 30   
 10708458    33.5       0.29     333.92   zopfli
 10940860    34.2      71.32     684.60   lzfse 
 11001632    34.4      69.22     329.02   brotli 4      
 11061382    34.6       6.97     333.46   zlib 9       
 11122434    34.8      32.81     330.46   zlib 6         
 11595241    36.3       3.90    2165.53   LzTurbo 29      
 11611013    36.3      78.91     314.30   zlib 1          
 11654415    36.5     320.30     685.47   zstd 1
 12094776    37.9     264.53     294.38   brotli 1
 12265594    38.4      10.73      34.89   bzip2           
 13296062    41.6     270.65    2103.69   lzturbo 21      
 13399053    41.9       3.91    2005.34   lizard 49       
 13661437    42.8       4.22    3729.76   LzTurbo 19
 13934588    43.6      57.53    2001.06   LzTurbo 22      
 13982589    43.8       3.92    3118.60   lzsse8 17
 14279732    44.7      50.20    2867.73   lz4 9           
 14722730    46.1     713.04    2172.48   LzTurbo 20      
 14813445    46.4     142.33    3344.45   LzTurbo 12      
 15442195    48.3     384.82    3769.36   LzTurbo 11      
 16069624    50.3     687.01    3152.06   lz4 1          
 16084009    50.3     823.46    3980.18   LzTurbo 10    
 31952900   100.0   13671.20   13699.49   memcpy        

Size Ratio % C.MB/s D.MB/s Compressor (Binary 42% + Text 58%) Silesia.tar

 48616057    22.9       1.07      77.11   LzTurbo 49
 48758739    23.0       2.47      81.17   lzma 9    
 49517150    23.4       0.46     336.19   brotli 11d29 
 50861542    24.0       1.68     269.97   lzham 4     
 51720632    24.4       1.42    1239.95   LzTurbo 39
 52715921    24.9       2.03     602.56   zstd 22         
 54596837    25.8      11.80      38.94   bzip2     
 58008992    27.4       7.96     853.20   zstd 15         
 59273940    28.0      59.48    1293.41   LzTurbo 32
 59581397    28.1      33.48     416.81   brotli 5
 60411647    28.5      45.64     798.97   zstd 9          
 60813803    28.7       1.60    2002.86   LzTurbo 29
 64141404    30.3     162.02    1372.34   LzTurbo 31
 64191258    30.3      65.28     416.81   brotli 4  
 64711652    30.5       0.22     325.27   zopfli  
 67624724    31.9      62.86     692.87   lzfse
 67647204    31.9       9.99     316.72   zlib 9          
 68225985    32.2      24.46     313.67   zlib 6          
 68627981    32.4       1.92    1879.16   lizard 49       
 69819633    32.9     247.86    1301.67   LzTurbo 30
 73441969    34.7     222.31     335.06   brotli 1        
 73643046    34.7     310.86     805.86   zstd 1    
 73814486    34.8      60.54    1616.76   LzTurbo 22      
 74581806    35.2       1.69    3738.92   LzTurbo 19
 75328465    35.5       3.14    3636.47   lzsse8 17 
 77256401    36.5      80.46     295.37   zlib 1          
 77892574    36.8      27.02    2601.03   lz4 9           
 80293719    37.9     196.57    1490.27   LzTurbo 21      
 82882887    39.1     111.15    3734.17   LzTurbo 12      
 87565369    41.3     255.31    3696.98   LzTurbo 11      
 95089381    44.9     492.22    1464.83   LzTurbo 20
100009787    47.2     607.24    3912.43   LzTurbo 10      
100881352    47.6     536.46    2627.10   lz4 1     
211948036   100.0   13148.80   13543.59   memcpy    

Size Ratio % C.MB/s D.MB/s Compressor Text log: NASA_access_log

11355945 5.5 0.86 320.68 LzTurbo 49 11907661 5.8 0.99 2502.71 LzTurbo 39 11960483 5.8 10.13 67.81 bzip2 12236072 6.0 0.51 1022.47 brotli 11d29 12617026 6.1 1.36 1348.32 zstd 22 13598062 6.6 2.68 265.69 lzma 9 13651218 6.7 1.33 880.25 lzham 4 14661031 7.1 8.67 1819.99 zstd 15 15041556 7.3 1.13 3732.63 LzTurbo 29 16665926 8.1 78.89 1245.90 brotli 5 17387746 8.5 117.98 1375.73 zstd 9 18279979 8.9 187.64 2186.17 LzTurbo 32 18654669 9.1 173.25 1227.89 brotli 4 19085875 9.3 1.50 3527.36 lizard 49 19545036 9.5 32.75 651.55 zlib 9 20695664 10.1 74.74 647.11 zlib 6 21485133 10.5 1.15 4306.30 LzTurbo 19 20792134 10.1 344.59 2068.41 LzTurbo 31 21004908 10.2 83.53 1387.17 lzfse 22756147 11.1 534.69 1122.78 zstd 1 23712749 11.6 565.27 1962.67 LzTurbo 30 24557455 12.0 49.28 3212.04 lz4 9 24579485 12.0 6.84 5803.38 lzsse8 17 25275862 12.3 492.67 804.38 brotli 1 26164435 12.7 191.55 2877.69 LzTurbo 22 29129222 14.2 180.85 518.62 zlib 1 29511723 14.4 415.71 2313.35 LzTurbo 21 31188743 15.2 221.70 4240.46 LzTurbo 12 34919744 17.0 466.23 3614.69 LzTurbo 11 35418563 17.3 839.95 2062.65 LzTurbo 20 37730477 18.4 914.22 3704.00 LzTurbo 10 38130859 18.6 820.91 2303.70 lz4 1 205242372 100.0 13092.72 13758.48 memcpy

Size Ratio % C.MB/s D.MB/s Compressor Text XML
: enwik8
 24362183    24.4       1.01      82.32   LzTurbo 49
 24810184    24.8       0.44     299.94   brotli 11d29
 24861228    24.9       1.49      83.07   lzma 9    
 25021508    25.0       1.16     241.56   lzham 4   
 25361864    25.4       1.17     668.42   LzTurbo 39
 25380048    25.4       1.58     504.75   zstd 22   
 28788842    28.8       1.23    1299.99   LzTurbo 29
 29008762    29.0      13.02      33.46   bzip2     
 29290130    29.3      47.69     899.98   LzTurbo 32
 30307444    30.3       6.68     694.76   zstd 15       
 31766514    31.8      34.34     656.35   zstd 9          
 31776975    31.8      28.08     362.17   brotli 5
 33515149    33.5      54.12     387.73   brotli 4  
 33573327    33.6     120.01    1086.32   LzTurbo 31
 34966070    35.0       0.46     265.78   zopfli          
 36157832    36.2      50.56     546.82   lzfse
 36433239    36.4       1.93    1270.23   lizard 49       
 36475796    36.5      15.85     255.73   zlib 9          
 36548925    36.5      19.88     255.37   zlib 6          
 37198792    37.2     175.78    1059.29   LzTurbo 30
 37689079    37.7      48.87    1100.07   LzTurbo 22      
 38716647    38.7       9.48    3118.28   lzsse8 17       
 39123260    39.1     153.00     301.37   brotli 1        
 40859471    40.9     234.47     688.37   zstd 1    
 41434197    41.4       1.41    3289.15   LzTurbo 19
 42170239    42.2     138.74    1060.56   LzTurbo 21      
 42203257    42.2      28.23    2410.35   lz4 9           
 42298778    42.3      70.33     251.72   zlib 1          
 44378119    44.4      75.01    3461.17   LzTurbo 12
 47785919    47.8     159.89    3145.84   LzTurbo 11      
 53070139    53.1     324.75    1052.62   LzTurbo 20
 56821220    56.8     447.01    3731.20   LzTurbo 10
 57262285    57.3     397.11    2314.29   lz4 1     
100000004   100.0   13436.29   13495.14   memcpy         

The compression benchmark libraries:
- brotli 18-07-10 (d29 w/ large window brotli)
- lzfse
- zlib 1.2.9
- lizard v2.0
- lz4 v1.7.5
- lzturbo v18.7
- zstd v1.1.3

Compression Benchmark last update: 22 Jul 2018