Play to Learn
Goal(s): Learn about the Hypothesis Testing Decision Matrix. Reject the null when p <= alpha. Retain the null when p > alpha. Â Discover the probabilistic nature of hypothesis testing. Include experience with effect sizes and sample sizes.
How: View ten sets of research results. Half the time, the null hypothesis will be true for all ten samples. The other half of the time, the research hypothesis will be true for one of the samples. Evaluate the evidence (i.e., p-value for a two-tailed single sample t-test), and then determine which, if any, of the samples to reject. Explore the impact of increasing the effect size and sample size on Type I and Type II Errors.
Site: P2L.io
Reject the null hypothesis when the p-value is less than or equal to the alpha level (e.g., p <= .05).
Retain the null hypothesis when the p-value is greater than the alpha level (e.g., p > .05).
When the null hypothesis is true, the correct decision is to retain the null hypothesis. It would be a Type I Error to reject a true null hypothesis.
When the null hypothesis is false, the correct decision is to reject the null hypothesis. It would be a Type II Error to retain a false null hypothesis.
Demonstration
Resource/Options
This HTML applet was co-developed with ChatGPT 5 through a guided iterative development process.