IMDB Reviews x Box Office Revenue
By Madhumitha Dev, Nikitha Ravichandran, Sanyam Doshi, Sreekanth Nallamali, and Yi Jia Chen
May 5, 2024
In today's world, movie reviews and ratings are very important in helping people decide what movies to watch. With websites like IMDb, people look at these reviews a lot before spending their time and money on a movie. Our project looked at whether these ratings actually affect how much money a movie makes at the box office, which is a big way to measure a movie's success. By analyzing data from 2019, the year right before the COVID-19 pandemic disrupted the movie business, we wanted to understand the connection between how positive or negative the reviews were, the ratings, and how well the movies did at the box office. Could understanding this relationship help movie companies figure out better ways to attract audiences as the industry recovers from the pandemic?
To explore the relationship between film reviews and box office success, we formulated an initial hypothesis: Do ratings and reviews impact box office revenue? To test this, we gathered a dataset titled “Reviews of movies released in 2020” from Kaggle, which provided us with essential elements for our analysis—movies, ratings, review summary, review detail, spoiler tags, and helpfulness tags. We paired this with box office revenue data for movies released in 2019 from Box Office Mojo to ensure a comprehensive dataset.
To delve deeper into this question, we specifically focused on data from the year 2019. To broaden our analysis and minimize potential biases of COVID-19, we expanded our dataset to include films and their reviews from 2015 to 2019, and discover the suggestions for the current movie industry to recapture the strategy. Among these, we zeroed in on the top 200 films from 2019 that attracted the most reviews. In our analysis of how the spoiler tag might influence the perceived helpfulness of a review, we introduced a dummy variable—helpful percentage—calculated from the number of people who found a review helpful. This approach allows us to quantitatively assess the impact of reviews on movie-going decisions and, by extension, on box office revenues.
For the 2019 movie reviews, we employed sentiment analysis tools, including the VADER and VScore in R, to evaluate the emotions expressed in the review summaries and detailed comments. This analysis provided us with compound average scores, along with positive, neutral, and negative scores for each review.
We then used the compound scores to perform a linear regression to explore the relationship between the sentiment of the reviews and the movie ratings for 2019. The results showed statistical significance, indicating a positive correlation between the rating and sentiment score. This suggests that ratings are strongly influenced by the emotional tone of the reviews; specifically, movies with more positive reviews tended to have higher ratings, while those with more negative reviews had lower ratings. These findings provide substantial evidence to reject the null hypothesis, which shows that sentiment has no effect on movie ratings.
Fig 1: Relationship between ratings and sentiment compound score for the year 2019
To investigate whether ratings influence a movie's box office revenue, we conducted a regression analysis to explore the relationship between the sentiment scores of reviews and box office earnings. Our findings indicated no significant correlation, suggesting that revenue generation is not directly influenced by review sentiment or ratings. Although the model did not reach statistical significance at the 5% level, it showed marginal significance at the 10% level.
Fig 2: Relationship between ratings and world-wide revenue for the year 2019
This result implies that while there is some indication of a connection between the average compound sentiment score and total revenue, the evidence is not robust enough to conclusively demonstrate that such a relationship exists under strict statistical criteria. This analysis highlights the complexity of predicting box office success and suggests that factors other than just review sentiment may play a more significant role in influencing movie revenues.
Is there any impact on revenue due to ratings if we split the movie list of 2019 as popular and unpopular?
Even among films that are generally not well-received (unpopular), those that achieve higher ratings tend to generate more revenue than their lower-rated counterparts. This observation is crucial for producers and marketers within the film industry, suggesting that enhancements in quality that lead to improved ratings could also potentially boost financial outcomes.
Fig 3: Relationship between ratings and world-wide revenue for the Unpopular movies of year 2019
However, our analysis found no significant impact of ratings on the total revenue of popular movies. This indicates that while ratings may affect the financial performance of less popular films, they do not necessarily translate to significant revenue changes for already popular ones.
Fig 4: Relationship between ratings and world-wide revenue for the popular movies of year 2019
Given these findings, stakeholders in the film industry should consider other factors that might more significantly influence revenue. These include marketing strategies, star power, the timing of the release, genre popularity, and the competitive landscape. Understanding and optimizing these aspects could be more effective in driving financial success than focusing solely on improving ratings.
Is there any impact on revenue due to ratings over years?
Average ratings do not significantly impact worldwide revenue, as seen in previous years.
Other factors (marketing efforts, film genre, seasonal release timings, or competing films) could be more pivotal in driving revenue.
Stakeholders in the film industry should consider these other variables more seriously when attempting to predict financial success.
Fig 5: Relationship between ratings and world-wide revenue for the year 2015
Fig 6: Relationship between ratings and world-wide revenue for the year 2016
Fig 7: Relationship between ratings and world-wide revenue for the year 2017
Fig 8: Relationship between ratings and world-wide revenue for the year 2018
Key Findings:
From the regression we found that over the time period of 5 years (2015-2019) ratings was not the only factor impacting box office revenue of the movies. We were still able to find a positive impact of ratings on the revenue of unpopular films.
People find reviews helpful irrespective of the spoiler tag
The users may not generally prioritize spoiler presence over other elements of a review, such as its content, clarity, or the insight it provides into the film or product being reviewed.
Although there is no direct impact on the revenue due to ratings, people still review the movie and there is a community interaction seen. From a marketing perspective, film makers can leverage this connection and understand what kind of content people prefer to watch as entertainment.
Analysis of percentage of people who found reviews helpful between two groups: reviews without a spoiler tag (0) and reviews with a spoiler tag (1) over the time period of 2015 to 2019
Fig 9: Impact of spoiler tag on review helpfulness for 2015
Fig 10: Impact of spoiler tag on review helpfulness for 2016
Fig 11: Impact of spoiler tag on review helpfulness for 2017
Fig 12: Impact of spoiler tag on review helpfulness for 2018
Fig 13: Impact of spoiler tag on review helpfulness for 2019
Understanding Box Plots: Insights into Review Helpfulness
When we look at box plots, we can gain valuable insights into the data they represent. In this case, we're analyzing box plots that show the perceived helpfulness of reviews, with and without spoilers, over multiple years.
Let's start with the box itself. The box represents the middle 50% of the data. Across most years, this middle 50% falls between the 25th and 50th percentiles for both types of reviews – those with spoilers and those without. This tells us that a moderate level of helpfulness was perceived for reviews, regardless of whether they contained spoilers or not.
Next, let's look at the line inside the box – this is the median. In our analysis, the median for both types of reviews hovers around the 35-40% mark across multiple years. This suggests that users generally found reviews to be moderately helpful, whether they contained spoilers or not.
One interesting observation is the changing width of the box for reviews with spoilers. In 2017, the box became much wider, spanning from the 25th to the 75th percentile. This indicates greater variability in how helpful people found reviews with spoilers that year. However, in 2018, the box narrowed again, returning to a range similar to previous years.
It's also worth noting that in most years, there were no visible outliers or extreme data points. This suggests a consistent perception of helpfulness without any reviews being viewed as significantly more or less helpful than the majority.
In summary, these box plots provide insights into the perceived helpfulness of reviews over time. They highlight the general consistency in how users viewed reviews, with and without spoilers, across multiple years. The moderate level of perceived helpfulness remained relatively stable, with some variations in the variability of responses for reviews with spoilers.
The Importance of Quality Reviews
Have you ever wondered what makes a review truly helpful? Is it the presence or absence of spoilers, or something more? Our analysis of review helpfulness over a five-year period has revealed some interesting insights.
Consistent Patterns across Years
One of the key findings from our analysis is that the median and the interquartile range (IQR) of review helpfulness remain stable over time, regardless of whether the reviews contain spoilers or not. This suggests that spoiler tags do not significantly influence how helpful a review is perceived to be.
The Real Impact: Content Quality
Instead, our findings indicate that the actual content of reviews – their clarity, depth, and insight – is more impactful in determining their helpfulness. Readers seem to value well-written, informative reviews that provide genuine value, rather than being solely focused on the presence or absence of spoilers.
Implications for Reviewers and Content Platforms
Focus for Reviewers
For reviewers, the key takeaway is to prioritize content quality over spoiler management. By focusing on delivering clear, insightful analysis, reviewers can provide real value to readers and enhance the overall experience.
Strategies for Content Platforms
Content platforms, on the other hand, should consider enhancing the user experience by promoting features that highlight the quality and informativeness of reviews, rather than concentrating solely on the presence of spoilers.
A Shift towards Substantial Content
These findings advocate for a shift towards prioritizing substantial and informative content in reviews to truly engage and assist readers. By emphasizing content quality, both reviewers and platforms can contribute to a more enriching and valuable experience for everyone involved.
Additional Findings
It's worth noting that our analysis also found that while ratings may not directly impact a movie's box office revenue, people continue to engage with and review films. This community interaction presents an opportunity for filmmakers to understand what kind of content people prefer as entertainment, potentially informing their future projects.
Conclusion
At the end of the day, what truly resonates with movie-goers isn't just a number rating or whether a review drops spoilers. It's the quality of insight and analysis that a review provides. Our research shows that over the years, people have found reviews helpful regardless of spoiler tags. What matters most is whether the review offers a clear, in-depth perspective that enriches the viewer's understanding of the film.
For reviewers, this means prioritizing well-crafted, informative content over obsessing about spoilers. Don't get me wrong - avoiding major plot reveals is still courteous. But the real value lies in providing nuanced critique, analyzing themes, dissecting performances, etc. Thoughtful, substantial reviews are what engage readers and elevate the discourse around cinema.
Similarly, review platforms would do well to highlight reviews that demonstrate high-quality writing and genuine insight, rather than just flagging spoiler-free ones. This aligns with what audiences actually appreciate - reviews that make them think differently or gain new perspectives on films.
Ultimately, while ratings and reviews don't directly translate to box office billions, they facilitate a collective conversation around movies that creators cannot ignore. Filmmakers would be wise to tap into this dialogue, using it as a barometer for what resonates with audiences on a deeper level beyond just numbers. Those heated debates and personal testimonies about a film's impact provide fertile ground for understanding what stories people crave.
So let's move beyond reductive rating scores and shift towards nurturing a culture of richer, more substantive criticism. Because at its core, that's what movie reviews should really be about - not just celebrating or picking apart, but elucidating the singular journey that great film can take us on.