I am Avrajit Ghosh. I am a fourth year PhD student in the department of Computational Mathematics Science and Engineering, Michigan State University (MSU) where I work with Rongrong Wang and Saiprasad Ravishankar.
My primary research interests are in optimization, generalization (overparameterized models) and inverse problems. (see link)
More specifically, I am interested in large learning rate dynamics (h>2/L) of optimizers that is prelevant in deep learning.
Recent Research Updates:
New paper on Edge of Stability in deep matrix factorization is released!
April-2024: Selected as an Outstanding Reviewer for ICLR-2024 ! (Top 1%)
April-2024: Received Outstanding Graduate Student Award (Runner up) by College of Engineering, MSU !
May-2024: "Optimal Eye Surgeon: Finding Image Priors through Sparse Generators at Initialization." will be presented at ICML-2024 ! (Arxiv)(code)
Old Updates:
November-2023: Selected as a Top Reviewer for Neurips-2023. (Top 8%)
Feb-2023: "Implicit regularization in Heavy-ball momentum accelerated stochastic gradient descent" presented as a Spotlight paper in ICLR-2023. (Top 7%)