Evaluation

Algorithm Performance Evaluation

The parameters adopted for the performance evaluation will be the following:

Evaluation will be performed at a fixed threshold of 50, with scores normalized from 0 to 100.

  • Attack presentation classification error rate (APCER): proportion of attack presentations using the same PAI species incorrectly classified as bona fide presentations at the PAD subsystem in a specific scenario
  • Bona fide presentation classification error rate (BPCER): proportion of bona fide presentations incorrectly classified as presentation attacks at the PAD subsystem in a specific scenario
  • The Average Classification Error Rate (ACER): The average of the APCER and the BPCER for a pre-defined decision threshold (T).

Declaration of the Winner

  • Winner will be decided based on the minimum ACER. Only one winner will be awarded.