Publications (* indicates equal contribution):
Preprints.
Statistically Meaningful Approximation: a Case Study on Approximating Turing Machines with Transformers. Colin Wei, Yining Chen, Tengyu Ma. Preprint 2021.
Meta-learning Transferable Representations with a Single Target Domain. Hong Liu, Jeff Z. HaoChen, Colin Wei, Tengyu Ma. Preprint 2020.
2021.
Why Do Pretrained Language Models Help in Downstream Tasks? An Analysis of Head and Prompt Tuning. Colin Wei, Sang Michael Xie, Tengyu Ma. NeurIPS 2021 (Spotlight).
Provable Guarantees for Self-Supervised Deep Learning with Spectral Contrastive Loss. Jeff Z. HaoChen, Colin Wei, Adrien Gaidon, Tengyu Ma. NeurIPS 2021 (Oral).
Shape Matters: Understanding the Implicit Bias of the Noise Covariance. Jeff Z. HaoChen, Colin Wei, Jason D. Lee, Tengyu Ma. COLT 2021.
Theoretical Analysis of Self-Training with Deep Networks on Unlabeled Data. Colin Wei, Kendrick Shen, Yining Chen, Tengyu Ma. ICLR 2021 (Oral).
2020.
Self Training Avoids Using Spurious Features Under Domain Shift. Yining Chen*, Colin Wei*, Ananya Kumar, Tengyu Ma. NeurIPS 2020.
The Implicit and Explicit Regularization Effects of Dropout. Colin Wei, Sham Kakade, Tengyu Ma. ICML 2020.
Improved Sample Complexities for Deep Networks and Robust Classification via an All-Layer Margin. Colin Wei, Tengyu Ma. ICLR 2020.
2019.
Learning Imbalanced Datasets with Label-Distribution-Aware Margin Loss. Kaidi Cao, Colin Wei, Adrien Gaidon, Nikos Arechiga, Tengyu Ma. NeuRIPS 2019.
Towards Explaining the Regularization Effect of Initial Large Learning Rate in Training Neural Networks. Yuanzhi Li*, Colin Wei*, Tengyu Ma. NeuRIPS 2019 (Spotlight).
Data-dependent Sample Complexity of Deep Neural Networks via Lipschitz Augmentation. Colin Wei, Tengyu Ma. NeuRIPS 2019 (Spotlight).
Regularization Matters: Generalization and Optimization of Neural Nets v.s. their Induced Kernel. Colin Wei, Jason D. Lee, Qiang Liu, Tengyu Ma. NeuRIPS 2019 (Spotlight).
2017.
Markov Chain Truncation for Doubly-Intractable Inference. Colin Wei, Iain Murray. AISTATS 2017.
General Bounds on Satisfiability Thresholds for Random CSPs via Fourier Analysis. Colin Wei, Stefano Ermon. AAAI 2017.
2016.
Generic 3D Representation via Pose Estimation and Matching. Amir Zamir, Tilman Wekel, Pulkit Agrawal, Colin Wei, Jitendra Malik, Silvio Savarese. ECCV 2016.