Evaluation Criteria

For the performance evaluation, we use the standardized ISO/IEC 30107:3 metrics: Bona fide Presentation Attack Detection Classification Error Rate (BPCER) and Attack Presentation Attack Detection Classification Error Rate (APCER). 

The widely used Half Total Error Rate (HTER), the mean of the APCER and BPCER, and Area Under Curve (AUC), defined as the area under the ROC curve, will be reported.

Additionally, Area Under Curve (AUC), defined as the area under the ROC curve, will used as the evaluation criterion.

The BPCER at the different ACPER will be reported and used as the evaluation criterion. 

The final teams ranking will be based on the BPCER at different fixed APCER. 

The top-3 ranked teams will be invited as the co-authors of the competition report paper (this will be extended in case of a large number of competitive participants).