Research Overview

Support for Social Welfare Policies

Is there a general support for the welfare state attitude? One we can observe across countries and time? In a study of public opinion during the 1990s in five countries (Breznau 2010), I find some confirmatory evidence for a latent attitude that encompasses support for government provision of health, old-age, family and educational support including both price regulation and subsidies. 

Using different data from many more countries spanning the over three decades, I again find confirmatory evidence for a similar underlying attitude toward government provision of social welfare, or what scholars often label 'the welfare state' (Breznau 2019)

I also look at how existing levels of inequality, presumably as a result of varying social policies, shape public preferences for redistribution. The basic theory is that more inequality should push the public to shift toward preferences for more government redistribution. However, in looking at within-country associations both raw and adjusting for other variables, I see no generalizable effect in my join work with Carola Hommerich (Breznau and Hommerich 2019).

Public Opinion & Social Policy Outcomes

Motivated by a basic theory of governance that public preferences shape policy outcomes, I have been researching the hypothetical impact of opinion on policy since my Master's studies. Findings by Brooks and Manza (2006) particularly motivated me, because they reported a partial correlation coefficient that was positive and NHST significant for opinion from the International Social Survey Program predicting Social Spending. 

As part of my matriculation a supervisor suggested that I computationally replicate their results. I was unable to do so, and in the process I discovered they made a model misspecification (Breznau 2015). They forgot to include the main effect in an interaction between welfare regime type and public opinion. My work on this study was a key moment compelling me into the open science movement. 

My 'multiverse' assessment is below in Figure 3 (from the paper) that I used to conclude that Brooks & Manza's model misspecification led to a statistical anomaly.

In my replication, I used a multiverse analysis method (although this method did not have a name at the time) to demonstrate that they made a misspecification. David Weakleim (2016) published a comment to my Brooks & Manza replication, suggesting an alternate model, where legal institutions rather than welfare state regime is the better variable. When he ran a model this way, he came back to a statistically significant NHST that the partial correlation coefficient suggesting a positive effect of opinion on policy. This an a publication by Bernhard Kittel (2006) showing totally different results in welfare state research under similar-but-different model specifications particularly sparked my interest in meta-science. 

I continue to work on the relationship of public opinion and social policy. Building on the thermostatic model concept by Soroka and Wlezien (2010), I theorize that public opinion and social policy have a simultaneous feedback association. From our observational perspective, they are constantly feeding back into each other, so as to create the appearance of simultaneous causality. This led to a budding theory and development of a test model shown below (Breznau 2016, 2018). 

Open & Meta-Science

Simultaneously with my frustrations trying to replicate Brooks & Manza, and seeing how unstable results are to model specification (Breznau 2015). I started to question the norms and rent-seeking motives that saturated scientific research since at least the 1940s. 

I submitted my replication of Brooks & Manza to the American Sociological Review, where they published their original flawed study. One reviewer was very clear, intimating that: 'This is not interesting. Show us something new'. The editors agreed, and to this day there is not comment from Brooks & Manza publicly, nor any movement to retract the article. I have not personally called for the retraction, because I believe this should come from the original authors or the community. 

In my graduate studies both in the USA and Germany, the way to get published was promoted among us from our supervisors and course instructors. The message was clear: 'If your results do not match your theory and hypothesis, the rewrite the front end of the paper to predict what you found'. At the time I had no idea that HARKing (hypothesizing after results are known) is a way to explain potentially unique and uninterpretable results as a reliable finding. This HARKing is a key reason we are in a replicability crisis across all behavioral and social sciences. 

As the published paper is the key 'currency of our trade' (to quote a former mentor), we as academics are sometimes willing to do anything to try and get something published. By doing this we place status-seeking above science. This is what Aage B. Sørensen (1996) defines as a practice that causes "ego-mania" and "much destruction" and a practice labeled by Bruno Frey (2003) "Publishing as Prostitution". Profit-seeking publishing firms have capitalized on this status-seeking phenomenon in academia and have themselves contributed much destruction to the scientific enterprise. Elsevier has been one of the most draconian. We are bound in a system of paying double-rent for our own science. The universities and funding agencies pay for our research and simultaneously pay for access to this research in published format. 

My Brooks & Manza experience was not at all unique. Scholars in sociology and across disciplines are reluctant to share their replication materials. Their status could be at stake, they were not trained to develop reproducible workflows and have too much other work to attend to. Reproducibility and transparency are not the norm in the social and behavioral sciences. This is changing, and I am actively promoting this change. This was summarized in my article "Does Sociology Need Open Science?" in 2021. I teach courses and workshops in open science (materials available on OSF) and recently published an article on how to teach replication (Bauer et al. 2024). I also started a blog called 'Crowdid' where I could quickly output positions or findings relating to open science, such as outing a fake journal, using AI for open science, the role of software in irreproducibility, a close look at Sci-Hub, and much more (full list on my Public Science subpage).