A Decade of Sparse Training:
Why Do We Still Stick to Dense Training?
Tuesday, 26 May 2026, Cyprus
Tuesday, 26 May 2026, Cyprus
Abstract:
This tutorial targets researchers, practitioners, and advanced students in machine learning who seek to reduce the computational and energy costs of training large neural networks without sacrificing performance. Participants will learn the theory, algorithms, and system-level aspects of dynamic sparse training (DST) across supervised learning, reinforcement learning, generative Artificial Intelligence (AI), and truly sparse implementations. The tutorial combines algorithmic foundations with practical demonstrations using open-source code and commodity hardware, offering an innovative end-to-end perspective that connects cutting-edge research to executable systems. By the end, attendees will understand DST’s performance-efficiency trade-offs, gain hands-on experience, and join a dedicated Slack community to continue discussions, share results, and collaborate on advancing DST toward sustainable, Green AI.
Organizers:
Dr. Elena Mocanu, Assistant Professor, University of Twente, The Netherlands
Boqian Wu, PhD Student, University of Twente, The Netherlands; University of Luxembourg, Luxembourg
Bram Grooten, PhD Student, Eindhoven University of Technology, The Netherlands
Mohammad Pasande, PhD Student, University of Twente, The Netherlands
Dr. Qiao Xiao, Postdoctoral Researcher, Eindhoven University of Technology, The Netherlands
Dr. Decebal Constantin Mocanu, Associate Professor, University of Luxembourg, Luxembourg
Slides:
Coming soon
Slack channel:
Coming soon
Lab materials:
Coming soon