Hatef Otroshi Shahreza
Idiap Research Institute, Switzerland
Foundation and Multimodal Large Language Models for Biometrics
Abstract: Foundation models and multimodal LLMs have achieved significant performance on downstream tasks and promise zero-shot and few-shot generalisation in natural-language reasoning over images. In this talk, we focus on face biometrics and discuss if these models can be trusted in biometric applications. The talk explores where these models meet biometric recognition, attack detection, and security, and reports findings from systematic evaluations. Under standard verification protocols, multimodal LLMs capture useful semantic cues but trail specialised face recognition systems at high-precision operating points. For attack detection, in-context learning makes general-purpose models competitive, with the added benefit of explanations. We further investigate different approaches of adapting MLLMs for biometric security, which outperform state-of-the-art in the literature. The presentation is closed with open challenges and directions.
Bio: Hatef Otroshi Shahreza is currently a Postdoctoral Researcher at Idiap Research Institute, Switzerland. He received his PhD from the EPFL, Switzerland, in 2024, and also received Marie Skłodowska-Curie Fellowship for his doctoral program. During his PhD, he spent six months as a Visiting Scholar with the Biometrics and Internet Security Research Group, Hochschule Darmstadt (HDA), Germany. He was the recipient of the European Association for Biometrics (EAB) Research Award 2023 and the IEEE Biometrics Council Best Doctoral Dissertation Award 2025. He has authored more than 50 papers and holds 3 US patents. His research interests include computer vision, foundation models, generative models, and biometrics. He is an IEEE Senior Member and an ELLIS member.