Research

Publications

Interacting User-Generated Content Technologies: How Questions and Answers Affect Consumer Reviews [journal] [SSRN] [Taverne Open Access Version]

(with Georgios Zervas and Chris Dellarocas)

Journal of Marketing Research, 2021

External coverage: 

Ariyh

RIMtailing

This article studies the question and answer (Q&A) technology of electronic commerce platforms, an increasingly common form of user-generated content that allows consumers to publicly ask product-specific questions and receive responses, either from the platform or from other customers. Using data from a major online retailer, the authors show that Q&As complement consumer reviews: unlike reviews, questions are primarily asked prepurchase and focus on clarification of product attributes rather than discussion of quality; answers convey fit-specific information in a predominantly sentiment-free way. Drawing on these observations, the authors hypothesize that Q&As mitigate product fit uncertainty, leading to better matches between products and consumers and, therefore, improved product ratings. Indeed, when products suffering from fit mismatch start receiving Q&As, their subsequent ratings improve by approximately .1 to .5 stars, and the fraction of negative reviews that discuss fit-related issues declines. The extent of the rating increase due to Q&As is proportional to the probability that purchasers will experience fit mismatch without Q&A. These findings suggest that, by resolving product fit uncertainty in an e-commerce setting, the addition of Q&As can be a viable way for retailers to improve ratings of products that have incurred low ratings due to customer–product fit mismatch. 

AI Applications to Customer Feedback Research: A Review [book chapter] [SSRN]

(with Ishita Chakraborty and Peter Lee)

Review of Marketing Research, special issue on AI in Marketing, 2023

In this paper, we aim to provide a comprehensive overview of customer feedback literature, highlighting the burgeoning role of AI. Customer feedback has long been a valuable source of customer insights for businesses and market researchers. While previously survey focused, customer feedback in the digital age has evolved to be rich, interactive, multi-modal and virtually real-time. Such explosion in feedback content has also been accompanied by a rapid development of artificial intelligence and machine learning technologies that enable firms to understand and take advantage of these high-velocity data sources. Yet, some of the challenges with traditional surveys remain, such as self-selection concerns of who chooses to participate and what attributes they give feedback on. In addition, these new feedback channels face other unique challenges like review manipulation and herding effects due to their public and democratic nature. Thus, while the AI toolkit has revolutionized the area of customer feedback, extracting meaningful insights requires complementing it with the appropriate social science toolkit. We begin by touching upon conventional customer feedback research and chart its evolution through the years as the nature of available data and analysis tools develop. We conclude by providing recommendations for future questions that remain to be explored in this field. 

PAPERS under review/revision 

What’s in a Response? Uncovering Management Response Strategies and Their Impact on Future Ratings and Sales (under review) [SSRN]

(with Ishita Chakraborty and Hulya Karaman)

Online reviews have become more interactive, with most businesses responding to reviewers on review platforms. These public responses can influence both future ratings and sales. While past literature has studied the impact of the decision to respond on subsequent ratings, the impact on sales has not been

investigated, nor the important question of how to respond. In this paper, we leverage a proprietary dataset comprising of online reviews, corresponding responses, and subsequent sales over three years from a major international hotel group to study the impact of both these decisions on subsequent ratings

and sales. We use advanced text analysis to classify response text beyond simple metrics into elements such as problem acceptance, responsibility, regret, and action, and analyze their effects on future ratings and sales using causal inference techniques. Our findings indicate that responding generally benefits

both ratings and sales, but the impact varies significantly depending on response elements. First, we find that personalizing responses based on review content boosts ratings and sales, whereas mimicking the reviewer’s style has adverse effects on both outcomes. Second, contrary to previous findings, responding

to positive reviews can be advantageous for specific strategies, and the effects of response elements vary between sales and ratings. Finally, for negative reviews, we find that an accommodative strategy is less effective than a defensive one for both outcomes, in contrast to earlier findings in offline complaint man-

agement. Thus, our work offers new evidence and insights into the boundary conditions for management response effectiveness in an online context. 

The Impact of “From” prices on the Purchase Funnel: Insights from Field Experiments at an Online Travel Marketplace  [SSRN] 

(previously circulated as "Reference Price Effects in Search Aggregators")

(with Anita Rao and Georgios Zervas)

How do consumers respond to "Starting From'' (floor) prices advertised by firms that differ from the actual purchase price to be paid? While a low "From'' price is likely to draw consumers in, a high one is likely to be closer to the true price and thus be perceived as more fair. Although floor prices are ubiquitous, they have been studied much less compared to other forms of advertised reference prices (e.g.,"Was-Now"). In this paper, we conduct pre-registered field experiments on an online travel marketplace (Holidu.com) to investigate how consumers respond when floor prices are raised. We find that high floor prices lead to decreased user engagement (as measured by listing clicks, number of searches, and time spent on the website), and noisy but negative effects on booking related outcomes. These effects occur despite higher floor prices providing users with an estimate closer to actual prices on average. Our findings indicate that less accurate up-front prices can actually lead to more customer engagement, and dominates the countervailing sticker-shock or anchoring effect, wherein consumers would be deterred if offered a low initial price estimate and a higher price further down the purchase funnel. Overall, this result has implications for platform design and regulation by demonstrating the tension between customer engagement and providing accurate price estimates up front.


Platform Monetization and Unintended Consequences on its Ecosystem: Evidence from a Two-sided Market for Books (R&R, Management Science) [SSRN]

(with Kai Zhu and Qiaoni Shi)

How can a platform capture the value it creates for its users without damaging its ecosystem? In this study, we leverage a natural experiment on Goodreads.com to examine the potential intended and unintended consequences of monetizing a popular promotional program run by the platform: Goodreads Giveaways.

Participating in this program was free for authors and publishers till January 2018, after which Goodreads enacted a policy change and began to charge a fixed participation fee. We collect large-scale data to analyze both the supply side (i.e., authors and publishers) and demand side (i.e., consumers) response to this monetization policy. We document several novel insights about the consequences of monetization that are above and beyond the traditional concern of network effects. Specifically, we find that Goodreads’ monetization policy (i) increases supply concentration by increasing the representation of Big 5 publishers in the Giveaways marketplace, (ii) decreases product diversity by reducing participation from niche genres, and (iii) results in worse matches between consumers and products as measured by book ratings. Our findings highlight a more subtle and complex view of evaluating monetization and suggest that platforms need to counterbalance these effects by offering more flexible and nuanced incentive structures for different players in its ecosystem.


selected Works in progress

-The Causal Impact of Recommender Clicks

(with George Knox)


-When More Is Too Much: Effect of Interacting Information Signals on Consumer Ratings

(with Roshini Sudhaharan)

Recent/upcoming conference presentations:

resting papers awaiting revival :)

-Bayesian inference in dynamic models of online reputation systems

(with Amin Rahimian and Narendra Mukherjee )

Online reputation systems are an essential component of electronic commerce platforms. However, despite their prevalence, online ratings are subject to selection biases since the decision to leave a rating depends on the specific consumer and their circumstances. There are a number of hidden parameters governing such selection biases but it is difficult to infer them directly from observed ratings given the complexity of reputation systems. In this work, we first propose a generative model that accounts for various behavioral phenomena behind online rating generation (e.g., cost to leaving a rating or herding). We then build upon recent advances in  likelihood-free/simulation-based Bayesian inference using deep learning to infer the hidden parameters of the generative model in a scalable manner. The inference engine only takes the time series of ratings as input, and therefore can be used to model correlations of inferred cost parameters with various product features. As a preliminary proof of concept, we apply our model to a dataset of 450,000 product reviews submitted on Amazon.com. We find that the cost to leaving a negative review is much greater than a positive review, and a baseline level of bandwagon effects (in the form of herding) are present for the majority of products. Gaining a better understanding of the dynamics of reputation systems, namely, the conditions under which ratings are submitted, is crucial for marketers, brand managers, and designers of digital platforms, who can leverage this information to stimulate further reviews and better manage user generated content. Working code is available on https://github.com/narendramukherjee/reputation-systems/tree/master/snpe and the docker image containing the dependencies for the code is on https://hub.docker.com/r/nmukherjee/reputation-systems-snpe

-The Role of Digital Knowledge Management Tools in Emerging Marketplaces: Evidence from an intervention in West Bengal, India

(with Somprakash Bandyopadhyay and Sneha Bhattacharyya)

Conventional marketplaces, particularly in developing countries, often involve transactions of goods and services carried out in accordance to implicit socio-economic and institutional prescriptions, thus excluding subsistence/bottom of pyramid producers from carrying out profitable exchanges. Our aim in this paper is to explore the extent to which the introduction of digital marketplaces can address these issues and enhance market participation in the context of rural craft producers in India. To this end, we design a two-tier intervention framework: the first component focuses on creating a digital platform to connect rural artisans with consumers and entrepreneurs worldwide, enabling collaboration and co-creation of handicraft products. Subsequently, the second component focuses on imparting digital marketplace literacy and product innovation training to our target group. We conduct our intervention over 40 weeks with staggered roll-out to cover hundreds of rural artisans from Birbhum, West Bengal, and measure key metrics such as market competence and performance over time. We find a positive and significant impact of the intervention on all measured dimensions, reflecting improvements in skills as well as downstream market performance. However, there are several implementation challenges and socio-political factors that need to be addressed in order to sustain this enhancement, which we touch upon from an ethnographic perspective.



Presentations

Presentation: 18th ACM Conference on Economics and Computation, 2017


GMT20211014-120044_Recording_1920x1080.mp4

Presentation: EQMS (European Quant Marketing Seminar), 2021

Older projects