Research
Research
Peer Reviewed Publications
(Review of Economic Studies, 2023) with John List, Ian Muir, and Devin Pope
Left-digit bias (or 99-cent pricing) has been discussed extensively in economics, psychology, and marketing. Based on observational data from Lyft sessions followed by a field experiment conducted with 21 million Lyft passengers, we provide evidence of large discontinuities in demand at dollar values. Approximately half of the downward slope of the demand curve occurs discontinuously as the price of a ride drops below a dollar value (e.g. $14.00 to $13.99). Our results showcase the robustness of an important behavioral bias for large, modern companies and its persistence in a highly-competitive market.
(Econometric Reviews, 2024) with John List and Ian Muir. Winner of the 2025 Esfandiar Maasoumi Best Paper Award
This study investigates the optimal use of covariates in reducing variance when analyzing experimental data. We show that finding the variance-minimizing strategy for making use of pre-treatment observables is equivalent to estimating the conditional expectation function of the outcome given all available pre-randomization observables. This is a pure prediction problem, which recent advances in machine learning (ML) are well-suited to tackling. Through a number of empirical examples, we show how ML-based regression adjustments can feasibly be implemented in practical settings. We compare our proposed estimator to other standard variance reduction techniques in the literature. Two important advantages of our ML-based regression adjustment estimator are that (i) they improve asymptotic efficiency relative to other alternatives, and (ii) they can be implemented automatically, with relatively little tuning from the researcher, which limits the scope for data-snooping.
(Science, 2025) with Pradhi Aggarwal, Alec Brandon, Ariel Goldszmidt, Justin Holz, John List, Ian Muir, and Thomas Yu
Prior research finds that, conditional on an encounter, minority civilians are more likely to be punished by police than white civilians. An open question is whether the actual encounter is related to race. Using high-frequency location data of rideshare drivers operating on the Lyft platform in Florida, we estimate the effect of driver race on traffic stops and fines for speeding. Estimates obtained across traditional and machine learning approaches show that, relative to a white driver traveling the same speed, minorities are 24 to 33 percent more likely to be stopped for speeding and pay 23 to 34 percent more in fines. We find no evidence that these estimates can be explained by racial differences in accident and re-offense rates. Our approach provides key insights into the total effect of civilian race on outcomes of interest and highlights the methodological import of combining high-frequency data and machine learning to evaluate critical social issues.
Working Papers
Physician Private Information as an Input into Pharmaceutical Innovation: A Proposal
Under Revision. Most recent revision: 09/23/2025
How skilled are doctors at predicting what will happen to their patients? And could pharmaceutical companies make use of doctor predictive ability to lower the cost of developing new drugs? In this paper, I provide a simple statistical framework to show how physician-generated predictions about patient health can be directly leveraged to reduce the sample size necessary to conduct a clinical trial. Guided by this framework, I conduct a meta-analysis of studies that quantify the ability of physicians to predict patient outcomes. My results suggest that the information contained in physician predictions can reduce the number of participants needed to run a single clinical trial by 20%. A back-of-the-envelope calculation suggests that this could translate into as much as $7B in cost savings on clinical trial costs annually. If industry regulators are maximizing total surplus, these cost saving amount to $51B in increased economic surplus.
with Aaron Bodoh-Creed, Brent Hickman, John List, Ian Muir
Under Revision. Most recent revision: 08/18/2023
In this paper, we provide a suite of tools for empirical market design, including optimal nonlinear pricing in intensive-margin consumer demand, as well as a broad class of related adverse-selection models. Despite significant data limitations, we are able to derive informative bounds on demand under counterfactual price changes. These bounds arise because empirically plausible DGPs must respect the Law of Demand and the observed shift(s) in aggregate demand resulting from a known exogenous price change(s). These bounds facilitate robust policy prescriptions using rich, internal data sources similar to those available in many real-world applications. Our partial identification approach enables viable nonlinear pricing design while achieving robustness against worst-case deviations from baseline model assumptions. As a side benefit, our identification results also provide useful, novel insights into optimal experimental design for pricing RCTs.
Judging Nudging: Understanding the Welfare Effects of Nudges Versus Taxes
with John List, Matthias Rodemeier, and Sutanuka Roy
Most recent revision: 09/23/2023
While behavioral non-price interventions (“nudges”) have grown from academic curiosity to a bona fide policy tool, their relative economic efficiency remains under-researched. We develop a unified frame- work to estimate welfare effects of both nudges and taxes, while allowing for normative ambiguity about how nudges map into utility. We showcase our approach by creating a database of more than 300 carefully hand-coded point estimates of non-price and price interventions in the markets for cigarettes, influenza vaccinations, and household energy. While nudges are effective in changing behavior in all three markets, they are not necessarily the most efficient policy. When nudges are debiasing, they are more efficient in the market for cigarettes, while taxes are more efficient in the vaccine and energy market. Interestingly, these conclusions also often hold when nudges are deceptive rather than debiasing. We identify two key factors that govern the difference in results across markets: i) an elasticity-weighted standard deviation of the behavioral bias, and ii) the magnitude of the average externality. Nudges dominate taxes whenever i) exceeds ii). Finally, we consider cases in which nudges cause direct psychic costs or benefits to consumers.
Most recent revision: 9/11/2023
In traditional adverse selection models, the principal is fully informed about the distribution of types as well as the objective function of the agents given that type, and the only source of uncertainty is that the type of any individual in particular is not known. How realistic is it to assume that principals have this information? I frame this question as one of structural econometric identification and study it by deriving constructive nonparametric identification results in two canonical adverse selection models: monopoly nonlinear pricing and optimal income taxation. Without functional form restrictions, identifying these models requires the principle to possess data which is arguably unrealistically rich. The standard specifications in the literature often impose further restrictions on the form of the agent's utility function. Beyond their role in making theoretical results more tractable, I show that they also all aid empirical tractability by implicitly encoding different forms of dimension reduction. My results make the dimension reduction implicit in these popular specifications explicit. I demonstrate the empirical power of my results by estimating the structural primitives of a model of optimal income taxation using experimental variation from the Seattle/Denver Negative Income Tax experiments, and use the results from this estimation to inform the design of a cost-minimizing universal basic income program.
The Generality and Generalizability of Aggregate Ratio Parameters
Most recent revision: 10/24/2023
Many parameters in empirical economics are identified by taking the ratio of two average causal effects. A famous example of this strategy, which I refer to as the "aggregate ratio parameter", is the Wald estimator from the instrumental variables (IV) model. I show that this paradigm is more general than the IV example and unifies quantities ranging from the equivalent price metric in behavioral economics to the diversion ratio in merger analysis. I generalize well-known results for IV and show that the aggregate ratio parameter identifies only the average of individual-level ratio parameters within a suitably defined "complier" population. Thus, the concerns raised in the context of IV that estimands may have limited policy relevance/external validity apply more broadly to empirical objects other than treatment effects. I show how to use covariates to empirically probe the importance of these external validity concerns and how to correct estimates to bring the identified complier population closer to the policy-relevant population along observable dimensions. I use my framework to re-analyze data from a diverse range of empirical examples.
Why Do Robust Standard Errors Hardly Change Inference?
Most recent revision: 09/21/2022
A folk wisdom in applied econometrics is that adjusting OLS standard errors for heteroskedasticity rarely leads to large changes whereas adjusting for other statistical considerations such as clustering is likely to be more consequential. In this note, I derive a tractable formula for the ratio between robust and conventional standard errors for a given covariate of interest in a multi-variate linear regression. This formula helps clarify when and in which direction we should expect robust standard errors to differ from conventional standard errors. I argue that a motivating example of heteroskedasticity in econometrics pedogogy is ambiguously signed because factors pushing in opposite directions will tend to cancel each other out.
Works in Progress
Structural Meta-Analysis of the Tax Bunching Literature
with Matthias Rodemeier
Identification of Random Coefficients Models without Linearity
Behavioral Nonlinear Pricing
with Matthias Rodemeier and Nicola Gennaioli