Research
Publications
Berry, W. D., Fording, R. C., & Crofoot, J. K. (2023). Assessing a New Measure of State Policy Mood: Response to Lagodny, Jones, Koch, and Enns. State Politics & Policy Quarterly, 23(4), 373-377.
This article presents a short summary of the conclusions we report in a longer manuscript (available in our Supplementary Material) subjecting Lagodny et al.’s new measure of state policy mood to the same set of face validity and construct validity tests we applied earlier to Enns and Koch’s measure. We encourage readers to read this longer manuscript, which contains not only the conclusions herein, but also the evidence justifying these conclusions, before accepting or rejecting any claims we make. Our results show that the characteristics of Enns and Koch’s measure that led us to be doubtful that it is valid are also present in Lagodny et al.’s new measure – leaving us just as doubtful that Lagodny et al.’s measure is valid. Moreover, the low correlation between Lagodny et al.’s measure and Enns and Koch’s measure, combined with evidence from replications of seven published studies that the two measures frequently yield quite different inferences about the impact of policy mood on public policy, indicate that Lagodny et al.’s claim that both their measure and Enns and Koch’s measure are valid is wrong; either neither measure is valid, or one is valid and the other is not. Moreover, extending the replications to include not only Lagodny et al.’s and Enns and Koch’s measures, but also Berry et al.’s measure and Caughey and Warshaw’s measure of mass economic liberalism, shows that each of the four measures yields a substantive conclusion about the effect of policy mood that is dramatically different than each of the other three measures. This suggests that the goal of developing a measure of state policy mood that would be widely accepted as valid remains elusive.
Berry, W. D., Fording, R. C., Hanson, R. L., & Crofoot, J. K. (2021). "The Validity of the Enns and Koch, and Berry et al. Measures of State Policy Mood: Continuing the Debate." State Politics & Policy Quarterly, 1-12.
Abstract: Enns and Koch question the validity of the Berry, Ringquist, Fording, and Hanson measure of state policy mood and defend the validity of the Enns and Koch measure on two grounds. First, they claim policy mood has become more conservative in the South over time; we present empirical evidence to the contrary: policy mood became more liberal in the South between 1980 and 2010. Second, Enns and Koch argue that an indicator’s lack of face validity in cross-sectional comparisons is irrelevant when judging the measure’s suitability in the most common form of pooled cross-sectional timeseries analysis. We show their argument is logically flawed, except under highly improbable circumstances. We also demonstrate, by replicating several published studies, that statistical results about the effect of state policy mood can vary dramatically depending on which of the two mood measures is used, making clear that a researcher’s measurement choice can be highly consequential