Techniques to Make Large Language Models SmallerÂ
Solvable Model for Inheriting the Regularization through Knowledge Distillation
The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks or a universal law of robustness
Deconstructing Lottery Tickets: Zeros, Signs, and the Supermask