The BOSARIS Toolkit provides MATLAB code for calibrating, fusing and evaluating scores from (automatic) binary classifiers. It was developed to provide solutions for automatic speaker recognition, but we envision that much of the code will have wider applicability for other biometric and/or forensics problems, where the calibration of likelihood-ratios is of interest. The main features of the toolkit are:
  1. The Normalized Bayes Error-Rate Plot, which analyses likelihood ratio calibration over a wide range of operating points. These plots also help in judging the adequacy of the sizes of calibration and evaluation databases.
  2. ROC, ROCCH and DET plots.
  3. Efficient algorithms to compute these plots for very large score files.
  4. Logistic regression solution for fusing multiple sub-systems.
  5. Logistic regression, or PAV/ROCCH calibration solutions for mapping scores to likelihood-ratios.
  6. A fast logistic regression optimizer.
  7. An efficient, binary, platform-independent (HDF5) score file format, which facilitates interoperability with other tools.
More details are available in:

New for SRE'12: Utility for simple to compound LLR transformation

This may be helpful to NIST SRE'12 participants. BOSARIS fusion and calibration outputs simple LLRs. For some SRE'12 test conditions you will need compound LLRs. The MATLAB function llrTrans_simple2compound.m may be useful for this purpose. Also consult the SRE'12 page for more information and resources.

MATLAB version 

The toolkit has an object-oriented API, for which it needs a recent verson of MATLAB. We have verified that it runs on MATLAB version R2008a and later versions.

Getting started

  1. if !agree with License agreement return end
  2. Read the user guide, to see what the toolkit does and why.
  3. Download: The toolkit is available in both zipped (.zip) and tar gzipped (.tgz) versions.  The contents are identical.  See attachments at the bottom of this page.
  4. Go to: getting started, which will tell you again to read the user guide, to add the code to the MATLAB path and to run the demo.

This toolkit was assembled at the 2010 BOSARIS Speaker Recognition Workshop

Niko Brummer,
Jun 24, 2013, 4:33 AM
Edward de Villiers,
Mar 27, 2012, 5:13 AM
Edward de Villiers,
Mar 27, 2012, 5:13 AM
Niko Brummer,
Nov 22, 2011, 1:18 AM