Measuring Academic Mindset in Economics Courses [Working Paper][Published Paper]
(with Emily Marshall, Brandon J Sheridan, Douglas McKee, George Orlov, William Goffe, Allen Bellas, Brooks Depro, Paul Graf, Alan Green, Devon Hawkins, Olivia Healy, Basak Horowitz, Justin Jarvis, Siny Joseph, Anna Klis, Caroline Krafft, Marilyn Markel, Stefani Milovanska-Farrington, Gina Pieters, Olena Rarytska, Josh Staveley-O'Carroll, Jörg Stoye, Kristine West, Cora Wigger, and Kelvin Wong)
International Review for Economics Education, Volume 52, June 2026
Understanding relevance, belonging, and growth mindset (RBG) has become a focal point in economics education for improving diversity. Previous literature suggests students from underrepresented groups have lower RBG (Bayer, Bhanot, Bronchetti, and O'Connell 2020) and improving RBG leads to higher academic success (Broda et al. 2018). Before developing interventions to improve RBG and persistence in economics, it is important to understand which students are most at-risk of having low RBG. This paper proposes an aggregate measure of academic mindset including elements of RBG and investigates how students' demographic characteristics predict their initial academic mindset when entering an economics course. This paper also investigates determinants of an economics-specific mindset index. The sample consists of 3,212 students, 45 courses, 35 instructors, and 24 U.S. institutions and finds that students who identify as male tend to have higher academic mindset scores than those who do not identify as male, and this result seems driven by economics-specific attitudes. First generation college students (FGCS) also exhibit a lower initial academic mindset. The probability that non-male and FGCS students have a lower initial mindset is larger in introductory courses relative to upper-level courses. Future research should consider targeting these groups for interventions.
Do incentives matter in elicitation of beliefs? [Published Paper]
Journal of Behavioral and Experimental Economics, November 2025
Beliefs are a critical component of economic decision-making. Since they are not directly observable, they are generally elicited through survey questions. Hence, it is important to know whether and how incentivization affects the elicited beliefs. Using an experiment, this paper tests the effect of incentivized versus unincentivized belief elicitation on students’ beliefs about returns to effort in an educational setting. Initially, incentivization significantly reduces the bias in beliefs, without impacting the accuracy of beliefs. It also reduces the frequency of round answers and increases time spent responding to the belief questions, both of which suggest increased effort. However, these initial effects on bias and response times diminish or become nonexistent in later weeks, suggesting short-lived effects.
Effects of Cooperative Learning on Trust, Attitudes About Group Work, and Performance [Published Paper] [Working Paper] [Presentation Slides][AEA 2023 Webcast]
(with Graham Beattie)
Journal of Economic Education, June 2025
Given the critical role that group work plays in many educational and work settings, it is crucial to understand how it affects individuals’ cognitive and non-cognitive skills. Using an in-class field experiment, the authors study how cooperative learning affects trust, attitudes about group work, and performance. Students in some classrooms completed in-class quizzes individually and students in other classrooms completed the quizzes in pairs. Completing quizzes in pairs led to higher levels of in-classroom trust, indicating they helped build a sense of community in the classroom. Further, taking quizzes in pairs led to more positive attitudes about group work and better performance on quizzes. The positive impact of group quizzes on performance is particularly pro- nounced for weaker students who are matched with stronger students. Taking quizzes in pairs does not significantly help or hinder performance on subsequent individual exams.
Opening the Black Box of College Major Choice: Evidence from an Information Intervention [Published Paper] [Working Paper]
(with Jamin Speer)
Journal of Economic Behavior and Organization, Volume 231, March 2025.
This study examines the role of job-related and non-job-related factors in college major choice. Using a staggered intervention, we provide students information on various aspects of majors and assess the impact of different pieces of information on their stated choices. We show that major choices depend on a wide set of factors, especially for students who are initially unsure about their major choice. The non-job-related factors, such as a major’s course difficulty and gender composition, are particularly important to students. Male and female students value different major characteristics in different ways. Female students – particularly those with below-median high school GPA – avoid majors that are more difficult than they originally believed, while male students are averse to majors with more female faculty but prefer those with more female students. Our findings help us understand gender gaps in college major choice and have a number of implications for researchers and policymakers seeking to study major choice or influence those choices.
The Effect of Peers on the Quality of Financial Decision Making - A Case of the Blind Leading the Blind? [Published Paper] [NBER Working Paper]
(with Sandro Ambuehl, B. Douglas Bernheim and Donhatai Harris)
The Review of Economics and Statistics, Volume 107, January 2025, pp. 240–255.
Media Coverage: Wall Street Journal, MarketWatch
We investigate the impact of peer interaction on the quality of financial decision making in a laboratory experiment. Face-to-face communication with a randomly assigned peer significantly improves the quality of subsequent private decisions even though simple mimicry would have the opposite effect. We present evidence that the mechanism involves general conceptual learning (because the benefits of communication extend to previously unseen tasks), and that the most effective learning relationships are horizontal rather than vertical (because people with weak skills benefit most when their partners also have weak skills). The benefits of demonstrably effective financial education do not propagate to peers.
Invisible Hurdles: Gender and Institutional Bias in the Publication Process in Economics [Published Paper] [Presentation Slides] [25-min Presentation][AEA 2022 Session]
(with Jennifer Pate)
Economic Inquiry, Volume 61, October 2023, pp. 777-797. (Featured Article)
Media Coverage: Times Higher Education, Inside Higher ED
How might the visibility of an author's name and/or institutional affiliation allow bias to enter the evaluation of economics papers? We ask highly qualified journal editors to review abstracts of solo-authored papers which differ along the dimensions of gender and institution of the author. We exogenously vary whether editors observe the name and/or institution of the author. We identify positive name visibility effects for female economists and positive institution visibility effects for economists at the top institutions. Our results suggest that male economists at top institutions benefit the most from non-blind evaluations, followed by female economists (regardless of their institution).
Effects of Perceived Productivity on Study Effort: Evidence from a Field Experiment [Published Paper] [Working Paper] [5-min Presentation][15-min Presentation]
Journal of Economic Behavior and Organization, Volume 207, March 2023, pp. 376-391.
How does the perceived relationship between effort and achievement affect effort? To answer this question, I conduct a framed field experiment with a popular online learning platform. I exogenously manipulate students’ beliefs about returns to effort by assigning them to a control group or to treatments which provide information about returns to effort. Students update their beliefs towards the information and change their study effort in the same direction with the shifts in their beliefs. This result shows that low-cost information interventions can influence students’ beliefs about returns to effort and these beliefs are important components of their effort choices.
Returns to Effort: Experimental Evidence from an Online Language Platform [Paper]
Experimental Economics, Volume 24, September 2021, pp. 1047-1073.
While distance learning has become widespread, causal estimates regarding returns to effort in technology-assisted learning environments are scarce due to high attrition rates and endogeneity of effort. In this paper, I manipulate effort by randomly assigning students different numbers of lessons in a popular online language learning platform. Using administrative data from the platform and the instrumental variables strategy, I find that completing 9 Duolingo lessons, which corresponds to approximately 60 minutes of studying, leads to a 0.057–0.095 standard deviation increase in test scores. Comparisons to the literature and back-of-the-envelope calculations suggest that distance learning can be as effective as in-person learning for college students for an introductory language course.
The Effects of the Great Recession on College Majors [Paper]
Economics of Education Review, Volume 77, August 2020.
How did the Great Recession affect the college degree fields? Utilizing the geographic variation in the severity of the recession in the US, I answer this question using the differences-in-differences and synthetic controls approaches. To explore these effects systematically, I categorize fields based on their sensitivity to the recession. The results show that there was a shift from recession-sensitive majors towards recession-resistant majors. The effects were immediate and larger for more local institutions. These findings suggest that students’ expectations about future labor market outcomes are affected by shocks to the current local labor market conditions.
Parking as a Loss Leader at Shopping Malls [Paper]
(with Kevin Hasker and Eren Inci)
Transportation Research Part B, Volume 91, September 2016, pp. 98-112.
This paper investigates the pricing of malls in an environment where shoppers choose between a car and public transportation in getting to a suburban mall. The mall implicitly engages in mixed bundling; it sells goods bundled with parking to shoppers who come by car, and only goods to shoppers who come by public transportation. There are external costs of discomfort in public transportation due to crowdedness. Thus, shoppers using public transportation crowd out each other. The mall internalizes these external costs, much like a policy maker. To do so, it raises the sales price of the good and sets a parking fee less than parking's marginal cost. Hence, parking is always a loss leader. Surprisingly, this pricing scheme is not necessarily distortionary.
Closing the Gender Gap in STEM: Role of Performance Feedback and Advice [Working Paper]
(with Derek Rury)
R&R at Journal of Economic Behavior and Organization
Women remain underrepresented in STEM occupations, largely due to educational choices. This study investigates two interventions—performance feedback and advice—aimed at narrowing the gender gap in selecting math tasks over verbal tasks. In an online lab experiment, participants chose between completing a math task or a verbal task. Before making their choice, they received either performance feedback on previous tasks, advice on which task to choose, or both, with advisor gender varied. A significant gender gap was observed in math task choices in the group who did not receive the interventions. Performance feedback intervention eliminated this gap by increasing the proportion of females selecting the math task, while leaving choices of males unaffected. Being advised to choose math task increased math task selection only among females, while being advised to choose verbal task decreased math task selection only among males. The advisor’s gender generally had no significant impact on the effectiveness of advice. This study contributes to our understanding how performance feedback and advice affect educational decisions, highlighting the complexity of these interventions.
The Use of Generative Artificial Intelligence in Economics Authors [Working Paper]
(with James Staveley-O’Carroll, Petar Stankov, Emily C. Marshall, Brandon Sheridan, Douglas McKee, Celina Owiyo, Zahra Akbari, Stephen Day, Chelsea Dowell, Martin Enilov, Basak Horowitz, Justin Jarvis, Siny Joseph, Sarah King, Anna A. Klis, Corissa Marson, Brian O’Roark, George Orlov, Fikri Pitsuwan, Jana Sadeh, Adeel Tariq, Kristine West, and Kelvin Wong)
R&R at Journal of Economic Education
The use of Generative Artificial Intelligence (Gen AI) in economics classrooms has the potential to both improve learning—democratizing education, personalizing tutoring, and summarizing content—as well as harm it—reducing student effort, offloading critical thinking, and encouraging cheating. It thus behooves instructors to understand how Gen AI is used in their classes. To that end, we design comprehensive surveys on the use of Gen AI by both economics instructors and their students. Surveys are completed at the start and end of the 2025 Spring semester and provide a snapshot of perceptions, policies, and usage of Gen AI tools. For example, we find 43 percent of students believe Gen AI policies to be restrictive when instructors report no restrictions at all. This implies the need for better communication. In addition, survey results show how students use Gen AI to help with both studying and completing assignments. While sentiment about usage of Gen AI for studying aligns between instructors and students, more instructor guidance on how best to use Gen AI for learning is recommended. Unsurprisingly, we find divergence between instructor and student sentiment regarding the use of Gen AI for completing assignments.
Signed, Sealed, Delivered: Measuring the Effectiveness of Team Contracts in a Randomized Control Experiment
(with Ishita Dey, Chelsea T. Dowell, Amy Eremionkhale, John Hartman, Doug McKee, Ashley Chiang, and other EENE members)
Teamwork is a critical skill in the workforce and is often the most despised aspect of classroom instruction by students. Team contracts require students to decide and document how they will communicate, divide work, and resolve potential conflicts before beginning their course-specific group work. We examine the effects of team contracts on students’ attitudes towards teamwork, individual teamwork skills, team dynamics, and their sense of classroom community using a large scale randomized experiment administered through the Economic Education Network for Experiments (EENE). Estimated effects are small and not distinguishable from zero.
A Short Guide to Designing and Administering Surveys in Economic Education
Economic education research frequently relies on surveys of students and instructors to measure experiences, beliefs, and outcomes related to teaching and learning. Yet, many researchers lack formal training in survey design. Poorly designed surveys can lead to low response rates and biased or mismeasured responses, undermining the credibility of findings. This paper provides a concise, practice-oriented guide to designing and administering high-quality surveys in economic education contexts. Drawing on insights from economics and survey methodology, it outlines best practices for question design and survey delivery. It also discusses the role of incentivization in improving response quality and participation, as well as key ethical considerations. By focusing on common pitfalls and actionable solutions, this guide aims to improve the quality and credibility of survey-based research in economic education.
Can a customized AI tutor support collaborative learning? Evidence from a field experiment in a large introductory economics course [Link to AEA RCT Registry]
(with Matthew Brown, Pavitra Govindan, Tomer Yehoshua-Sandak, and Peilu Zhang)
This study examines how access to LLMs affects cooperative learning and student performance in undergraduate economics education. While generative AI tools are increasingly common in classrooms, little is known about how they shape peer interaction and collaborative learning environments. We conduct a randomized classroom experiment in an introductory economics course at the University of Chicago. Students work in small groups during weekly discussion sections and in each session, some groups are randomly assigned to receive access to a custom course-specific AI tutor. To balance fairness and experimental variation, each student receives AI access in exactly half of the discussion sections. The design generates within-student variation in AI exposure over time as well as across-student variation in AI exposure before midterm. Primary outcomes include quiz and exam performance. Secondary outcomes measure peer interaction, teamwork experiences, and attitudes toward AI.