Bensaid Bilel
Bensaid Bilel
Team: "Statistics and decision theory"
Deep Learning Optimizers and Complexity bounds: Gradient Descent, Armijo Backtracking, Rescaled GD, Normalized GD, Momentum/Heavy-Ball, RMSProp, Adam
Mini-Batch Optimization: Stochastic Gradient Descent and Reshuffling, Incremental algorithms, Variance Reduction
Fairness in ML: amplification of bias, unbalanced data (resampling)
Stability Theory: Lyapunov and partial stability of differential equations and discrete systems
Dissipative systems: asymptotic convergence rates under Kurdyka-Lojasiewicz structure
Structure preserving scheme: Discrete Gradient and Invariant Energy Quadratization method
Splitting schemes: especially balanced ones
Code verification for Deep Learning