Common Errors in Statistics
A good reference for common errors is Common Errors in Statistics and How to Avoid Them (Good). Along with listing common errors, it also offers suggestions for how to avoid them.
Another useful reference is Statistics as Principled Argument (Abelson).
The 22 Most Common Mistakes Made During Statistical Analysis
Website Statistics Done Wrong
Related: