• Notes, online textbooks, articles and glossaries
  • My own notes plus some other things I found interesting.
  • Slides for an Introductory Biostatistics course I teach.
    
  • Resources for SPSS users.
  • Resources for Stata users.
    
  • Resources for useRs (i.e., users of R).
  • Free online file converter.  This tool uses the rio package for R.  At the time of this writing, it included the following formats:  CSV, Excel 2007 or later, JSON, R, SAS (CSV + SAS code), SPSS, Stata & tab-delimited.
    
  • Statistics & epidemiology resources for medical students & clinicians.
  • Links for students in Health Research Methodology (HRM) courses (at McMaster University):
    • HRM-743: Meta-analysis & Systematic Reviews.
    • HRM-751: Observational & Analytic Research Methods.
  • Online statistics textbooks and reference manuals. This is a very comprehensive list compiled by John C. Pezzulo, Associate Professor in the Departments of Pharmacology and Biostatistics, Georgetown University, Washington, DC. Includes links to:
    • HyperStat, a very good online textbook by David Lane.
    • Introductory Statistics: Concepts, models, and applications, another good online texbook by David W. Stockburger, Emeritus Professor of Psychology, Missouri State University.
    • StatPrimer: An online, public-domain biostatistics instructional manual by B. Gerstman.
  • Handbook of Biological Statistics, by John H. MacDonald, University of Delaware.
  • R Companion for the Handbook of Biological Statistics, by Salvatore S. Mangiafico.
    
  • Statistics by Jim.  A statistics blog by Jim Frost, who works for a "major statistical software company".  (He doesn't say which company, but he also posts on the Minitab Blog.  I leave you to draw your own conclusions.) 
    
  • Principals, Properties & Assumptions of Statistical Methods.  These short summaries were extracted from a statistics course for biologists by Bob Brightwell and Bob Dransfield.
  • Karl Wuensch's Statistical Resources.
  • Jonathan Templin's statistics course materials -- click on Course Websites and select a topic.
  • Mike Clark's course materials -- for stats courses he taught in the Psychology Dept at University of North Texas.  Mike's current website can be viewed here.
    
  • Statistics FAQs from UCLA's Institute for Digital Research and Education.  Includes general FAQs and FAQs geared to particular statistical software packages.
  • The Analysis Factor.  Check out this nice statistics blog founded by Karen Grace-Martin. 
    
  • Statistical Horizons Blog.  Includes posts by Paul Allison, Andrew Hayes, Kristopher Preacher, and others.
    
  • The Data & Decision Lab, Department of Psychology, University of Montana.
    
  • Statistics Learning Centre Videos.  Short videos on a range of statistical topics.  I've only viewed a couple (one on confidence intervals, and one on hypothesis testing), and thought the material was explained very clearly.  Unfortunately, the video on hypothesis testing directed viewers to use Excel to perform the analysis.  Using Excel for serious statistical analysis is not recommended.  See the following pages, for example.
  • Using Excel for Statistical Analysis -- Caveats
  • Spreadsheet Addiction
    
  • On the accuracy of statistical procedures in Microsoft Excel 2007. [PDF]
    
  • Statistics FAQ from the MRC Cognition and Brain Sciences Unit.  (Several of the items address questions about SPSS.)
    
  • Online Statistics: A Multimedia Course of Study. This is an introductory-level statistics book. The material is presented both as a standard textbook and as a multimedia presentation. The book features interactive demonstrations and simulations, case studies, and an analysis lab.
  • Notes for Research Methods and Statistics PESS202, from the School of Psychology, University of New England.
    
  • Interactive Web Apps.  These nice apps have graphs that update with clicks on buttons or sliders. Each explores a different statistical topic and allows results to be saved. Topics include:  Exploratory analysis, regression, distributions, sampling distributions, one sample, two samples, and re-sampling.
    
  • Biostatistics links from GraphPad.com:
    • Basic
    • Advanced
  • Carl Schwarz's homepage. Carl is from the Department of Statistics and Actuarial Science at Simon Fraser University in BC, Canada. His page has links to some great resources for statistics students, including course notes and practice questions.  Stat-201 (formerly called Stat-301) may be of most interest to students in introductory stats classes.
    
  • Measures of Effect Size
  • Psychometrica.de -- A nice page with notes & calculators for many common measures of effect size
    
  • Psychological Statistics: Notes for an introductory stats course by M. Plonsky, University of Wisconsin - Stevens Point.
  • Fundamental Statistics:  An online textbook written by Bryan Burnham.  It provides an introduction to statistics that should be accessible to students enrolled in various scientific disciplines, but is geared primarily toward students in the behavioral sciences. 
    
  • Lecture Notes on Statistics and Data Analysis with Vista. I don't know anything about Vista (which is some kind of compter program), but the lecture notes look pretty good. They were developed for introductory stats for psychology.
  • Jason Newsom's page. Includes links to notes on basic statistics, structural equation modeling (SEM), and multi-level modeling. Also has data sets used for examples.
  • Statistical Methods for Research Workers, by Sir Ronald A Fisher. Part of the Classics in the History of Psychology page. Click here for the complete list of statistical & methodological books or articles.
  • Statistical Methods for Agricultural Research.  This nice electronic book is reminiscent of classic textbooks on various ANOVA (and related) designs.  Thanks to the folks at the Indian Agricultural Statistics Research Institute for making it freely available.
    
  • PA 765 Statnotes: An Online Textbook, by G. David Garson, NC State University.
  • Richard Williams' page. Has links to pages for various stats courses (with lots of PDF files of notes).
  • Visual Statistics with Multimedia.
  • Modelling Categorical Data: Loglinear Models and Logistic Regression. Notes by Brendan Halpin, Dept of Government and Society, Limerick University, Ireland.
  • Notes on Generalized Linear Models, by Germán Rodríguez, Princeton University.
  • Stat 501 - Regression Methods.  A nice online book on regression methods by Derek Young.
  • Advanced Biostatistics Seminar on Model Selection.  Thanks to Joe Cavanaugh for this nice set of notes.
    
  • Phil Ender's class notes.
  • Introduction to Research Design & Statistics
  • Linear Statistical Models
  • Multivariate Analysis
  • Applied Categorical & Nonnormal Data Analysis
    
  • Marie Davidian's class notes.
    
  • Data Analysis dot Calm.  Notes and manuscripts by Robert C. Gardner, Professor Emeritus, Department of Psychology, University of Western Ontario.
    
  • Statistical resources from the Center for the Study of Health and Risk Behaviors, University of Washington.
  • Lecture notes for GLM/regression
  • Multilevel models -- basic and advanced issues
    
  • Count regression and zero-inflated models
  • Clinical trials methodology
  • Count regression and zero-altered models for longitudinal data
  • Causal models for mediation analyses
  • Dave Collett's homepage. Collett has authored books on time to event analysis and analysis of binary data. His wesite includes notes on:
    • Generalised Linear Models
    • Time to event analysis
    • Probability & Statistical Methods
    • Human Epidemiology
  • Learning Modules from the Centre for Multilevel Modelling, University of Bristol.
  • Multilevel Modeling -- This website consolidates in one location multilevel modeling materials previously maintained on the various websites of textbook authors Ronald H. Heck (University of Hawaii at Manoa), Scott L. Thomas (Claremont Graduate University) and Lynn N. Tabata (University of Hawaii at Manoa). Content focuses on graduate-level courses, seminars, presentations, resources, their published books, and topics of interest.
  • Time Series for Macroeconomics and Finance.  A free online textbook on time series analysis.
    
  • Alan McLean's commentary on the hypothesis testing controversy. In April 2000, Alan McLean posted to one of the stats newsgroups a couple of messages concerning the hypothesis testing controversy. I find his commentary to be very sensible and refreshing, which cannot be said for much of what one reads concerning this topic.
  • When does Correlation Imply Causation? Selected contributions from a discussion, on the EDSTAT list (and newsgroup sci.stat.edu), about the phrase "correlation does not imply causation". The opening post is by Dr. Karl Wuensch.
  • The Analysis of Observations with Applications in Atmospheric Science. An online texbook by William A. Cooper with chapters by Thomas W. Schlatter, Tzvi Gal-Chen, and David B. Parsons. The primary objective of this text is to provide a broad background in the methodology of experimental research. Most areas are not covered in great depth, and it is expected that it will be necessary for readers to delve deeper into topics like spectral analysis or the techniques of fitting non-linear parameters before these will become comfortable tools. However, the course should provide a good introduction to the range of approaches available, so that an experimenter can then pursue applicable possibilities in more depth.
  • Concepts and Applications of Inferential Statistics. This is a free, full-length, and occasionally interactive statistics textbook. It is a companion site of VassarStats, a website for statistical computation.
  • Multivariate Statistics: A Practical Guide. A practical guide to the use of selected multivariate statistical techniques. Written by Mike Wulder, Research Scientist, Canadian Forest Service.
  • Introduction to the Exploration of Multivariate Biological Data, by János Podani. 
    
  • 0-Introduction
  • 1-Sampling, Data Types
  • 2-Data Transformation
  • 3-Distance, Similarity
  • 4-Partitions
  • 5-Hierarchical Clustering
  • 6-Cladistics
  • 7-Ordination
  • 8-Matrix Rearrangement
  • 9-Comparisons
  • Appendix A - Data
  • Appendix B - Programs
  • Appendix C - Matrices
  • References
  • Index
    
  • Exploratory Factor Analysis -- a book manuscript by Ledyard Tucker and Robert MacCallum.
    
  • The Data Analysis BriefBook. The BriefBook is a condensed handbook, or an extended glossary, written in encyclopedic format, covering subjects in statistics, computing, analysis, and related fields. It intends to be both introduction and reference for data analysts, scientists and engineers.
  • Virtual Laboratories in Probability and Statistics. Web-based resources for students and teachers of probability and statistics. Looks like a nice site.
  • Health Statistics Tools of the Trade. Statistical Measurements, Data Analysis, Charts and Graphs, and Data Collection/Processing.
  • Statistics glossary by Valerie J. Easton and John H. McColl.
  • Regression Models for Discrete and Limited Dependent Variables. By Michael R. Frone, Research Institute on Addictions, Buffalo, New York.
  • Ordination Methods for Ecologists. Includes a glossary of ordination-related terms. The simplest definition [of ordination] is "Putting Things in Order"; (Wartenberg et al. 1987, Peet et al. 1988, Jackson and Somers 1991, Palmer 1993). The origin of the term "ordination" in ecology is attributed to Goodall (1954).
  • StatSoft Inc.'s Electronic Stats Textbook
  • Basic Statistics for Clinicians: A series of 4 articles published in the Canadian Medical Association Journal.
    1. Hypothesis testing.
    2. Interpreting study results: confidence intervals.
    3. Assessing the effects of treatment: measures of association.
    4. Correlation and regression.
  • British Medical Journal's Statistics Notes. A series of short articles on the use of statistics in the medical literature.
  • British Medical Journal's Topic Collections.
  • BMJ Books
    • Statistics at Square One.
    • Epidemiology for the Uninitiated.
    • How to read a paper.
  • British Medical Journal's Statistics at Square One. Chapters on:
    1. Data display and summary
    2. Mean and standard deviation
    3. Populations and samples
    4. Statements of probability and confidence intervals
    5. Differences between means: Type I and Type II errors and power
    6. Differences between percentages and paired alternatives
    7. The t-tests
    8. The chi-squared tests
    9. Exact probability test
    10. Rank score tests
    11. Correlation and regression
    12. Survival analysis
    13. Study design and choosing a statistical test
  • Sifting the evidence--what's wrong with significance tests? Another BMJ article.
  • Statistical Methods in Cancer Research -- a 4-volume series published by the International Agency for Research on Cancer.
  • Volume I - The analysis of case-control studies
  • Volume II - The Design and Analysis of Cohort Studies
  • Volume III - The Design and Analysis of long-term animal experiments
  • Volume IV - Descriptive Epidemiology
    
  • Jerry Dallal's Little Handbook of Statistical Practice.
  • John Uebersax's Statistical Methods for Rater Agreement. This site is a resource for the analysis of agreement among raters, diagnostic tests, observers, judges or experts. It contains background discussion on different methods, examples, references, software, and information on recent methodological developments.
  • Technical briefs from the Analytical Methods Committee of the Royal Society of Chemistry.  (I found this site when looking for information on confidence intervals for bounded parameters--see Brief number 26A.)
  • Journal of Physiology Statistical Perspectives series.  But note:
  • An article by Hopkins et al (2011) identifies some problems with the Drummond et al (2011) articles.
  • Drummond et al's response.
  • Statistics for Experimental Biologists.
    
• Practice problems & tutorials on the web
  • Sample questions (with answers) suitable for an intoductory statistics class. Site maintained by Carl Schwarz, Department of Statistics & Actuarial Sciences, Simon Fraser University.
  • DASL: The Data and Story Library. DASL (pronounced "dazzle") is an online library of datafiles and stories that illustrate the use of basic statistics methods. We hope to provide data from a wide variety of topics so that statistics teachers can find real-world examples that will be interesting to their students. Use DASL's powerful search engine to locate the story or datafile of interest.
  • The Claremont Colleges' Web Interface for Statistics Education: Has links to tutorials, glossaries, on-line journals, statistics applets, discussion groups, etc.
  • David Lane's practice problems. No answers provided for this set.
  • Addison Wesley Longman's Internet Projects for Introductory Statistics
  • John Pezzulo's links to interactive demonstrations & tutorials
  • Rice Virtual Lab in Statistics. Includes an online stats book, simulations & demonstrations, case studies, and analysis tools. Thanks to David Lane for letting me know about this site.
  • WISE: Web Interface for Statistics Education.  Includes applets, tutorials, and so on.  Looks like a nice site.
    
  • SAS tutorial
• Data archives
  • Statistical Reference Datasets. The purpose of this project is to improve the accuracy of statistical software by providing reference datasets with certified computational results that enable the objective evaluation of statistical software.
  • J. Puranen's comprehensive list of statistical datasets.
  • JSE Data Archive
  • The Data and Story Library
  • OzDASL - Australasian Data and Story Library
  • Rdatasets - An archive of datasets distributed with R.
  • Selected data sets from publications by Martin Bland.
  • Statistical data sets from the UMassAmherst website.
  • Data Science Central.
    
• Other useful websites about statistics
  • Read statistical newsgroups with Google Groups. For basic information about newsgroups in general, see the Google Groups Help page.
    • sci.stat.consult
    • sci.stat.edu
    • sci.stat.math
    • comp.soft-sys.stat.spss
  • David Howell's Statistical Home Page. David Howell is the author of the popular textbook Statistical Methods for Psychology. Includes some additional material not in the book. Here a couple of pages I've found particularly helpful:
    • A method for handling missing data.
    • Chi-square test of association with ordinal data
  • Gary McClelland's homepage. Gary co-authored the book Data Analysis: A Model Comparison Approach with Charles Judd. His statistics page has lots of useful stuff about the book, data sets, practice problems, etc.
  • John C. Pezzullo's StatPages.org.  This site contains a wealth of useful links to calculators, notes, etc.
    
  • Jerry Dallal's homepage. Jerry's site includes the following:
    • Little Handbook of Statistical Practice
    • Software page
    • Randomization plans. Generators to
      1. randomize each subject to a single treatment by using the method of randomly permuted blocks
      2. create random permutations of treatments for situations where subjects are to receive all of the treatments in random order
      3. generate a random permutation of integers (which is useful for selecting a sample without replacement).
  • Resources from GraphPad.com:
    • Basic and advanced biostatistics links. Includes links to online stats books, and recommendations for printed books.
    • QuickCalcs: Online calculators for scientists.
    • Resource Library: Articles and recommendations on data analysis, biostatistics and nonlinear regression.
  • Robert Newcombe's page. Robert Newcombe is a Reader in Medical Statistics in the Department of Epidemiology, Statistics and Public Health at University of Wales College of Medicine. His research interests include
    • Confidence intervals for proportions, differences between proportions and related quantities.
    • Designs for multi-treatment crossover studies.
    • Role of prior information in the diagnostic process.
  • Michael Friendly's Statistics and Statistical Graphics Resources. This page provides an annotated, topic-based collection of available resources for statistics, statistical graphics, and computation related to research, data analysis and teaching, now containing over 580 links.
  • American Statistical Association website.
  • Journal of Statistical Education (JSE) homepage.
  • Clay Helberg's Statistics on the Web (lots of links to other stats sites here, although some of them are old and broken)
  • J. Puranen's list of links related to Statistics Education - Online Statistical teaching material, courses , handouts, exercises, articles, datasets, other lists of links, etc.
  • St@tServ: Statistics & Data Analysis Information Server
  • Steve Simon's STATS page. STATS = Steve's attempt to teach statistics. Includes Steve's FAQ page, Ask Professor Mean.
  • Eric Weisstein's World of Mathematics. Includes a nice section on Probability & Statistics.
  • Second Moment: Applied statistics for academia and industry.
  • RM Web: Website of the Research Methods Division of the Academy of Management.
  • Powpow's del.icio.us statistics page.
  • Alexandar J. Shackman's Quantitative Methods Resources.
  • Bayesian-Inference.  From the website:  "Bayesian-Inference.com is a resource for many aspects of Bayesian inference, because Bayesian inference is the way it should be. Here you will find everything from an introduction to Bayesian inference, to informational resources, consulting services, computers and software, merchandise, forums, and much more."
    
• Online calculators & free programs
  • Online stats calculators, and links to some online textbooks. This is a very comprehensive list.
  • GraphPad QuickCalcs: Free online calculators for scientists.
  • Statistics Calculators by Daniel Soper.  Free calculators in 29 categories.
    
  • Quick-R.  Rob Kabacoff created this website for both current R users, and experienced users of other statistical packages (e.g., SAS, SPSS, Stata) who would like to transition to R.
    
  • Optimal Design Software -- a software package developed by Stephen Raudenbush and colleagues to help researchers plan group-randomized trials, also called setting-level experiments.
    
  • Professor Hossein Arsham's JavaScript Calculators.
    
  • StatTools.  A collection of statistical programs used in clinical research and quality assurance.
  • Power & Sample Size Calculators
    
  • Sealed Envelope Power Calculators -- calculators for superiority, equivalence and non-inferiority trials with either binary or continuous outcome variables.
  • PS: An interactive Windows 95/98 program for calculating power and sample size. Written by William D Dupont and Dale Plummer of the Vanderbilt University Medical Center.
  • Rollin Brant's Home Page. Includes a few sample size calculations:
    • Comparing a mean to a known value
    • Comparing means of 2 independent samples
    • Comparing a proportion to a known value
    • Comparing proportions for 2 independent samples
  • Power and Sample Size Programs -- a list maintained by the UCSF Department of Epidemiology & Biostatistics.
  • Stat Trek. Take the drudgery out of statistical computations. Computing probabilities, combinations, permutations, and factorials has never been easier. Simply click on the item that you want to use. Each online tool features clear instructions and examples; so you won't lose time getting up to speed.
  • EpiData: A free database programme (small in size 1.2Mb) for simple or programmed data entry and data documentation. Export of data includes value and variable labels for Stata, SAS or SPSS.
  • Ziad El-Khatib's introduction to Epidata.
    
  • R at Loyalty Matrix: A site that promotes and supports the use of R, the open source data analysis & graphics software system.
  • EasyReg Internaltional: Free Econometrics Software for Easy Regression Analysis, by Herman J. Bierens. Incldes the following:
    • single-equation models
    • multliple-equation models
    • user-defined nonlinear models
    • linear, logit, probit, multinomial logit, poisson, binomial logit & probit, negative binomial logit & probit, tobit, time series, and much more.
  • WebStat is freely available data analysis software for use over the World Wide Web.
    • All the data analysis tools for introductory statistics
    • Easy to use, written with the novice in mind
    • Step by step guidance through data analysis procedures
    • A wide range of methods for importing data, even over the WWW!
    • Graphics > pie charts, histograms, boxplots, scatterplots and more
    • Numerics > summary statistics, t-tests, regression, ANOVA and more
    • Save and print results from your Web browser
  • FACTOR.  A free program for doing exploratory factor analysis (EFA).
    
  • Jerry Dallal's statistical software. Includes programs for sample size calculation, and The Statistician's Swiss Army Knife.
  • Alan Miller's Fortran Software. Logistic Regression; TOMS algorithms; Special code for F and NAS compilers; Miscellaneous other code; Applied Statistics Algorithms.
  • Bill Miller's OpenStat Homepage. Bill Miller is a retired professor of Industrial Technology who found that a lot of students could not afford to purchase a commercial statistics package. He decided producing a free statistics package was a good way to keep myself entertained during his retirement.
  • John Crawford's computer program page. This page contains a series of computer programs that implement a variety of psychometric and statistical methods for use by clinical neuropsychologists and clinical psychologists. Includes programs for testing the difference between independent and dependent correlations.
  • G.A.S.P. - Globally Accessible Statistical Procedures. Includes data analysis procedures and educational procedures. Nice site.
  • Online metric converter.
  • Free software (executable or code) from the M.D. Anderson Cancer Center.
  • Data linkage software.
  • Febrl - freely extensible biomedical record linkage.  Free software "designed to undertake probabilistic data cleaning (or standardisation) and record linkage."
  • LinkageWiz.  A commercial product, but free for use with data sets containing up to 2,000 records.
    
  • O-matrix homepage. O-Matrix is a MATLAB-compatible interactive analysis and visualization tool that combines the programming flexibility and performance of a compiled language with the ease of use and functionality of an integrated environment. The light version of O-matrix is quite comprehensive, and completely free. I've found it useful for solving matrix algebra equations.
  • John Maindonald's Web Page: Notes and datasets for R and S-Plus.
  • ROC analysis programs by Professor Charles Metz, from the University of Chicago Department of Radiology. You may find The magnificent ROC website useful too. It provides a good introduction to the topic, complete with some neat applets. Thanks to Sacha Dubois for alerting me to this site.
  • 2x2 tables
    • DAG-Stat: Diagnostic & AGreement Statistics. This is a freely available Excel workbook, written by Andrew MacKinnon. It provides a comprehensive range of statistics calculable from 2x2 tables that are useful in evaluating diagnostic tests and interrater agreement.
    • Online exact tests for 2x2 contingency tables
  • Jim Steiger's homepage, where you can access course materials, download selected publications, and download software created by Dr. Steiger and associates, including the following programs:
    • NDC - A Noncentral Distribution Calculator that performs noncentrality interval estimation for the noncentral T, noncentral F, and noncentral Chi-Square distributions. NDC is a stand-alone Windows application.
    • MULTICORR: A DOS program for testing pattern hypotheses on correlations. Want to test whether a group of correlations are all zero? Want to compare matrices of correlations over time? Want to test for circumplex structure? Look no further.
    • R2: A DOS program for confidence interval estimation, power calculation, and sample size estimation for the squared multiple correlation. You are unlikely to find these capabilities anywhere else.
  • Free meta-analysis software...
    • My own meta-analysis programs: Three programs that implement the procedures described by Fleiss (1993).
    • David B. Wilson's meta-analysis stuff. Includes PowerPoint presentations and macros for SPSS, Stata, and Sas.
    • Meta-analysis programs by Ralf Schwarzer:
      • the analysis of exact probabilities (p values) as suggested by Rosenthal
      • the analysis of effect sizes d, following the methods of either Glass or of Hedges and Olkin
      • the analysis of effect sizes r as recommended by Hunter, Schmidt, and Jackson
    • EasyMA: Free software for meta-analysis of 2x2 tables, developed in the Department of Clinical Pharmacology of the cardiological hospital in Lyon, France.
    • SDCalc_v4.xls: An Excel workbook that computes the SD from either the SE of the mean, or a confidence interval. Thanks to Sacha Dubois for providing this handy little tool.
  • Statistical add-ons for Excel. There are some well-documented problems with Excel's statistical functions. Several add-on stats modules are available that circmuvent some of those problems, however. Two of these are listed below.
    • Analyse-it. Analyse-it includes 14-parametric & 17-non-parametric statistical functions including multiple linear regression analysis, ANOVA, & chi-square statistics, plus a specialized statistical package for clinical method evaluation & validation. Inexpensive student versions and FREE trial versions are available.
    • Rodney Carr's XLStatistics. XLStatistics is a set of Microsoft Excel (ver 5+) workbooks for statistical analysis of data designed to replace and enhance the tools provided with Excel's Data Analysis Toolbox addin. The workbooks are designed to implement a step-by-step guide to the statistical analysis of data (this guide appears commonly as a flow chart in many texts). The set is designed to make data analysis easy. Full version costs $30 Australian. A FREE version also available.

Last modified on 18-Feb-2018