Interesting Literature

Convex and Non-Convex Optimization

Visualizing the Loss Landscape of Neural Nets (2017)

Shaping the learning landscape in neural networks around wide flat minima (2019)

Why Learning of Large-Scale Neural Networks Behaves Like Convex Optimization (2019)

EASING NON-CONVEX OPTIMIZATION WITH NEURAL NETWORKS (2018)

Convex Neural Networks (2006)

Breaking the Curse of Dimensionality with Convex Neural Networks (2014)

Deep Neural Networks with Multi-Branch Architectures Are Intrinsically Less Non-Convex (2019)

Graph Neural Networks

Geometric deep learning

HOW POWERFUL ARE GRAPH NEURAL NETWORKS?

GRAPH TRANSFORMER

A Comprehensive Survey on Graph Neural Networks