Jiannan Lu [Google Scholar] [LinkedIn]

• AI/ML, Apple, 2021 - 

• Experimentation Platform, Microsoft, 2015 - 2021 

• Ph.D. in Statistics, Harvard University, 2015

• B.Sc. in Mathematics and Physics, Tsinghua University, 2010

Selected Journal Articles

• Novelty and primacy: A long-term estimator for online experiments. [Technometrics]

• Sharp bounds on the relative treatment effect for ordinal outcomes. [Biometrics]

• Treatment effects on ordinal outcomes: Causal estimands and sharp bounds. [JEBS]

• A note on type S/M errors in hypothesis testing. [BJMSP]

• Principal stratification analysis using principal scores. [JRSSB]

Selected Conference Proceedings

• All about sample-size calculations for A/B testing: Novel extensions and practical guide. [CIKM'23]

• Feedback effect in user interaction with Intelligent Assistants: Delayed engagement, adaption and drop-out. [PAKDD'23]

• On post-selection inference in A/B tests. [KDD'21]

• On heavy-user bias in A/B testing. [CIKM'19]

• Applying the Delta method in metric analytics: A practical guide with novel ideas. [KDD'18]

• Trustworthy analysis of online A/B tests: Pitfalls, challenges and solutions. [WSDM'17]

• Continuous monitoring of A/B tests without pain: Optional stopping in Bayesian testing. [DSAA'16]