Books and Lectures

Machine Learning Basics:

• Machine Learning: Stanford CS229

• CS229 Lecture notes: Lecture Notes 

• Dive into deep learning

Reinforcement Basics:

• Reinforcement Learning: Stanford CS234 

• 蘑菇书

• 深度强化学习 

Causal Inference Basics:

• Causal Inference: Introduction to Causal Inference 

• Causal Inference-Standford 

Bandit Algorithm Basics:

• Lecture 1: Introduction  , Lecture 2: Stochastic Multi-armed bandit (IID model) , Lecture 3: UCB Algorithm Worst-Case Regret Bound， Lecture 4 Thompson Sampling (part 1)  和 Lecture 5 Thompson Sampling (part 2) regret bounds proofs 

• Bandit Algorithm

• Bridging Learning and Decision Making