Books

METHODS - on line books, manuals, guides to research methods and evaluation. 

   

Most of these sites describe social research methods, or evaluation methods, including survey methods, qualitative methods.   These are listed in 2 main sections: General Methods, and Evaluation.  Many of the evaluation guides are also general methods guides.  Each section is further subdivided into academic sites, government sites, or private organization or individual sites.  This organization is used because there are a lot of sites, and this was one way to organize them.  Within sections, site are listed in no particular order.

I General Research Methods sites

Government

Statistics: Power from data.   http://www.statcan.gc.ca/edu/power-pouvoir/toc-tdm/5214718-eng.htm   has sections describing data collection methods, questionnaires. 

Academic sites

Anol Bhattacherjee  Social Science Research: Principles, Methods, and Practices   http://scholarcommons.usf.edu/oa_textbooks/3/   from 2012

Blackstone, Amy.  Principles of Sociological Inquiry – Qualitative and Quantitative Methods  

https://open.umn.edu/opentextbooks/BookDetail.aspx?bookId=139  Dr. Blackstone is from University of Maine

Grand Canyon University, Center for Innovation in Research and Teaching  https://cirt.gcu.edu/research  click on "Prepare" for a couple of sets of tutorials or modules on a wide variety of research methods, including surveys, focus groups, and more.

Horne, Christopher. A quick, free, somewhat easy-to-read introduction to empirical social science research methods.  https://scholar.utc.edu/oer/1/   April 2018

Rajiv Jhangiani, Kwantlen Polytechnic University, I-Chant Chiang, Quest University Canada, Research Methods in Psychology – 2nd Canadian Edition, Pub Date: 2015  

https://open.umn.edu/opentextbooks/BookDetail.aspx?bookId=431  

Susan Losh   http://myweb.fsu.edu/slosh/index.html   teaches research methods   http://myweb.fsu.edu/slosh/MethodsOverview.html    introduction to different methods, eg, surveys, focus groups, some less structured methods.

PPA 696 Research Methods  http://www.csulb.edu/~msaintg/ppa696/696menu.htm#PPA 696   very nice overview on different research methods. Last updated in 2001.   

Paul C. Price, Rajiv S. Jhangiani, and I-Chant A. Chiang  Research Methods in Psychology  https://opentextbc.ca/researchmethods/   2015

  

On line research methods   http://www.restore.ac.uk/orm/site/home.htm   From the National Center for Research Methods. Aimed at understanding how to do research on line.

Institute for Health and Work, Guide to Evaluating the Effectiveness of Strategies for Preventing Work Injuries   http://www.iwh.on.ca/evaluating-safety-programs   chapters on planning, designing, analysing, methods for evaluation. From 2001.

This OpenStax book, Introduction to Sociology   http://openstaxcollege.org/textbooks/introduction-to-sociology   has a chapter outlining research methods. Heather Griffiths, Nathan Keirns, others, 2015

Private organizations or people

Center for Local Economic Strategies   http://www.cles.org.uk/publications/research-methods-handbook/   Research Methods Handbook, Stuart MacDonald & Nicola Headlam. 2009. Good overview of many different kinds of research methods.

A Complete Guide to Quantitative Research Method, by Manu Bhatia, June 11, 2018.   https://blog.socialcops.com/academy/resources/quantitative-research-methods/   A nice guide, with lots of sub topics built in. 

s-cool sociology methods  http://www.s-cool.co.uk/a-level/sociology/methods   brief descriptions of different methods such as participant observation, experiments, sampling, comparative methods, and secondary data analysis. This is at s-cool,   http://www.s-cool.co.uk/    then click on A level methods, then sociology, then methods. I didn't see a date or author.

Trochim, William M. The Research Methods Knowledge Base,   http://www.socialresearchmethods.net/kb/index.htm  . General research methods text, with chapters on topics such as survey construction, sampling, and a chapter on evaluation.  If its a method, its probably here. Last updated in 2006

II: Evaluation: how to, approaches, manuals, guides

These also often include research methods as well.

Managing evaluations

Good Practice Guidelines  https://www.evaluation.org.uk/professional-development/good-practice-guideline/   "The Guidelines for Good Practice in Evaluation represent a set of principles for action in evaluation"

The Program Manager's Guide to Evaluation, Second Edition  https://www.acf.hhs.gov/opre/resource/the-program-managers-guide-to-evaluation-second-edition  from 2010. From a managers perspective

Making evaluations matter: A practical guide for evaluators.  http://library.wur.nl/WebQuery/wurpubs/405451   by Cecile Kusters with Simone van Vugt, Seerp Wigboldus, Bob Williams and Jim Woodhill. 2011. Published from Centre for Development Innovation, Wageningen University & Research centre, Wageningen, The Netherlands.

Better Evaluation. Manage Evaluation. http://www.betterevaluation.org/en/plan/manage_evaluation  

A guide for project M&E   https://www.ifad.org/evaluation/reports/guide   from IFAD. "This Guide has been written to help project managers and M&E staff improve the quality of M&E" 2002.

Steps in managing an evaluation project   http://www.dpc.nsw.gov.au/programs_and_services/policy_makers_toolkit/evaluation_toolkit   The Toolkit takes you through seven steps for planning and implementing a program evaluation project.

W.K. Kellogg Foundation Evaluation Handbook   http://www.wkkf.org/   The Kellogg Foundation is an organization that gives grants, and this handbook is "written primarily for project directors who have direct responsibility for the ongoing evaluation of W.K. Kellogg Foundation-funded projects"  so a lot of it is an overview of evaluation, the processes involved, and of important considerations in making decisions about the evaluation process.  Not exactly a "how-to", but a comprehensive guide to decisions involved in the evaluation process. At present, the url is here   http://www.wkkf.org/resource-directory/resource/2010/w-k-kellogg-foundation-evaluation-handbook   but they keep changing the url. As of 1/27/18, they say this was last revised in 2017, but you also have to give your name and email address to get the book.

Academic sites    

Power of Proof: An Evaluation Primer   http://tacenters.emory.edu/resources/products_tools/tobacco/power-of-proof/   from Emory University, Rollins School of Public Health. No date given.

The Center for Program Evaluation and Research   http://programeval.ucdavis.edu/index.html   has some nice pamphlets, presentations and videos. No date given.   

Monitoring and Evaluation: How and How Well Objectives are Being Reached   http://cec.vcn.bc.ca/cmp/modules/mon-int.htm   Phil Bartle, PhD. Written for community empowerment. 2011.

School of Geography and the Environment has this page  http://www.geog.ox.ac.uk/research/technologies/projects/monitoringandevaluation/  Monitoring and Evaluation for Sustainable Communities: Phase 1.  The section "Monitoring and Evaluation Resources" has this "Guide to Monitoring and Evaluation", which is "A 60 page guide to conducting your own Monitoring and Evaluation. Topics include: Deciding what to M&E; Planning your M&E; Information collection methods; Overview of resources; and useful interviews for questions and surveys."

Cooperative extension resources

Rutgers Cooperative Extension publications   http://njaes.rutgers.edu/pubs/subcategory.asp?cat=11&sub=70  2002, 2003. lists the following publications, A Step-By-Step Guide to Developing Questionnaires and Survey Research Procedures for Program Evaluation & Research, Choosing a Data Collection Method for Survey Research, Maximizing Response Rate and Controlling Nonresponse Error in Survey Research, and Choosing Appropriate Research Methods to Evaluate Educational Programs. These are all short (2-3 page) pdf files.

    If above link doesn't work, try   http://njaes.rutgers.edu/pubs/default.asp   then click on Educational Design and Program Evaluation then Rutgers Cooperative Extension

             

Univ of Wisconsin Cooperative Extension publications   has this set of eval docs   https://learningstore.uwex.edu/Search.aspx?m=6&c=234   and these sections: Collecting and analyzing data   http://learningstore.uwex.edu/Collecting-Analyzing-Data-C237.aspx   and Designing evaluation   http://learningstore.uwex.edu/Designing-Evaluations-C238.aspx    Some of these are from 1996.

 

Government sites

From the UK

Green Book, Appraisal and Evaluation in Central Government   https://www.gov.uk/government/publications/the-green-book-appraisal-and-evaluation-in-central-governent   "This new edition of the Green Book, Appraisal and Evaluation in Central Government, incorporates revised guidance, to encourage a more thorough, long-term and analytically robust approach to appraisal and evaluation. It is relevant to all appraisals and evaluations."  Last updated 2016

From Canada

Centre of Excellence for Evaluation (CEE)   http://www.tbs-sct.gc.ca/cee/index-eng.asp   not exactly a how to, but according to their website "The CEE provides functional leadership, including advice and guidance in the conduct, use and advancement of evaluation practices across the federal government."  They have policies and standards on evaluation, and these

Theory-Based Approaches to Evaluation: Concepts and Practices

and

Supporting Effective Evaluations: A Guide to Developing Performance Measurement Strategies

From the USA

  

CDC Evaluation Working Group http://www.cdc.gov/eval/index.htm  This site is about the CDC Evaluation Working Group and its efforts to promote program evaluation at the CDC.  See especially their "highlights of a framework for program evaluation", and their links page which is a comprehensive list of links to evaluation guidelines produced by various CDC programs.

CDC also has these 

*   Wisewoman Program Evaluation Toolkit  https://www.cdc.gov/wisewoman/evaluation_toolkit.htm  Key concepts, brief guides

*   Introduction to program evaluation for public health programs: A self-study guide.  http://www.cdc.gov/eval/guide/   some more basics. 2011.

*   Introduction to Program Evaluation for Comprehensive Tobacco Control Programs   http://www.cdc.gov/tobacco/tobacco_control_programs/surveillance_evaluation/evaluation_manual/index.htm   another general methods guide. 2001.

*   Program evaluation manuals   http://www.cdc.gov/tb/programs/Evaluation/default.htm   several listed here. One is TB Program Evaluation Handbook: Introduction to Program Evaluation, 2006

           

National Network of Libraries of Medicine   https://nnlm.gov/neo/professional-development/guides    has this "Collecting and Analyzing Evaluation Data" from 2013.

 

Identifying and Implementing Educational Practices Supported By Rigorous Evidence: A User Friendly Guide. From the US Department of Education Institute of Educational Sciences   http://ies.ed.gov/ncee/pubs/evidence_based/evidence_based.asp   This guide offers tools to educational practitioners that help distinguish practices supported by rigorous evidence from those that are not." This is mainly about randomized control trials. 2003   

Also see some technical publications   http://ies.ed.gov/ncee/tech_methods/  

"Technical Methods Report: Statistical Power for Regression Discontinuity Designs in Education Evaluations" 2008

"What to Do When Data Are Missing in Group Randomized Controlled Trials" 2009

Also see this one

"Random Assignment in Program Evaluation and Intervention Research: Questions and Answers" here   http://ies.ed.gov/ncee/pdf/20035001.pdf   2003

   

Pink Book-Making Health Communication Programs Work   http://www.cancer.gov/publications/health-communication   has a chapter on evaluation (stage 4) and a chapter on research methods. No date given.

From Australia

Planning and Evaluation Wizard    http://www.flinders.edu.au/medicine/sites/pew/pew_home.cfm                 

Evaluation Guide   http://www.treasury.wa.gov.au/uploadedFiles/Treasury/Program_Evaluation/evaluation_guide.pdf   The government of Western Australia, 2015

Private organizations or people

Impact Evaluation

Impact Evaluation of Development Interventions: A Practical Guide. White, Howard. Raitzer, David A. December 2017. Asian Development Bank.   

https://www.adb.org/publications/impact-evaluation-development-interventions-practical-guide   

InterAction has a couple of manuals about impact evaluation   http://www.interaction.org/resources/training   by Patricia Rogers, Burt Perrin, Michael Bamberger.  For example, Introduction to Impact Evaluation, by Patricia Rogers, is from 2012.

Unicef has briefs and videos  https://www.unicef-irc.org/KM/IE/impact_1.php   Overview of Impact Evaluation, by Patricia Rogers, 2014

Impact Evaluation http://go.worldbank.org/2DHMCRFFT2  explains a lot and has key readings, links to their methods page

And World Bank has this  http://go.worldbank.org/IT69C5OGL0   Impact Evaluation Toolkit

Better Evaluation Impact Evaluation Series   http://betterevaluation.org/en/resources/guide/unicef_impact_evaluation_series  

Other

Annie E. Casey Foundation has some evaluation guides like this one:  The Need for Self-Evaluation: Using Data to Guide Policy and Practice (summary)  http://www.aecf.org/resources/the-need-for-self-evaluation/   no date given.

Asian Development Bank.   http://www.adb.org/site/evaluation/methods-guidelines     includes this, from 2015,  Guidelines for the Preparation of Country Assistance Program Evaluations and Country Partnership Strategy Final Review Validations, and this from 2016, Guidelines for the Evaluation of Public Sector Operations

Basic Guide to Program Evaluation   http://managementhelp.org/evaluation/program-evaluation-guide.htm   Written by Carter McNamara, PhD, this is an on line guide to program evaluation, which describes many of the methods used, for example, surveys, interviewing, focus groups, and other methods.  This site also has many useful links.  No date given.

Better Evaluation   http://betterevaluation.org/   "An international collaboration to improve evaluation practice and theory by sharing information about options (methods or tools) and approaches."  Has stuff about methods and a lot more.

    One recent blog entry is "7 Strategies to improve evaluation use and influence". Parts 1 and 2 are from January and February 2018. Part 1 is here  http://www.betterevaluation.org/en/blog/strategies_for_improving_evaluation_use_and_influence  

Design, Monitoring and Evaluation for Peacebuilding has an online field guide   http://dmeforpeace.org/online-field-guide   which is not exactly a guide by itself, but has a bunch of documents by other people about various aspects of evaluation. For example, one presentation is Process Evaluation. The University of Texas at Austin.  http://www.dmeforpeace.org/resource/process-evaluation/   

EvalPartners has this page  http://www.evalpartners.org/library/selected-books   a virtual library of books about evaluation.

IFAD Evaluation   https://www.ifad.org/evaluation/overview    Includes an evaluation manual on methods and issues. 2015. https://www.ifad.org/evaluation/policy_and_methodology/overview  

 

Also see   https://www.ifad.org/evaluation/reports/guide/tags/1880189   A guide for project M&E, 2002.

Julian King has a book about assessing value for money (VfM) in international development programmes.  https://www.julianking.co.nz/downloads/  According to the site, this combines "evaluation practice with concepts from economic evaluation to respond to donor requirements for accountability and good resource allocation"

McCreary Center.  Asking Questions That Matter   http://www.mcs.bc.ca/evaluation_resources    This toolkit aims to increase understanding evaluation, develop the skills to prepare an evaluation plan, and provide tools to carry out an evaluation of a local community project.  2012.

OECD DAC Guidelines and Reference Series   http://www.oecd-ilibrary.org/development/dac-guidelines-and-reference-series_19900988   has a few publications:

Evaluating Peacebuilding Activities in Settings of Conflict and Fragility, 2012

Quality Standards for Development Evaluation, 2010

Tobacco Control Evaluation Center  http://tobaccoeval.ucdavis.edu/index.html  has a lot of pamphlets on specific topics, methods of doing evaluation. Some brief, some quite extensive.

Tools 4 Development   http://www.tools4dev.org/category/resources/how-to-guides/  and here  http://www.tools4dev.org/category/skills/monitoring-evaluation/    has many guides about how to do research and evaluation. A few of the docs are:

How to get informed consent, 2016

How to create a monitoring and evaluation (M&E) system – step-by-step guide, 2014

University of Kansas Community Toolbox   http://ctb.ku.edu/en/table-of-contents   includes a couple of chapters on evaluation, including introduction and methods. Started in 1996, but in continuous development, up through 2016, and still going.

Wisconsin Coalition Against Sexual Assault  http://www.wcasa.org/pages/Evaluation.php   "Here you will find a variety of resources, guides, webinars, worksheets, and learning activities that will assist in building evaluation systems."  Not exactly a "book". Kind of a collection of pamphlets obtained from other sites.

UNDP methodological publications http://www.undp.org/evaluation/  

Handbook on Planning Monitoring and Evaluating for Development Results   http://web.undp.org/evaluation/guidance.shtml#handbook   from 2009

A companion guide to the handbook on planning monitoring and evaluating for development results for programme units and evaluators.   http://web.undp.org/evaluation/guidance.shtml#outcome   from 2011

Barbara O. Wynn, Arindam Dutta, Martha I. Nelson,  Challenges in Program Evaluation of Health Interventions in Developing Countries.   http://www.rand.org/pubs/monographs/MG402/   The authors provide an overview of various approaches, methodologies, and issues related to program evaluation for health projects in developing countries. 2005

World Bank has these

Evaluation Wiki  https://dimewiki.worldbank.org/wiki/Main_Page  lots of general info on doing evaluation, methods of data collection, data cleaning, research design, analysis, publication, etc.

Monitoring and Evaluation (M&E): Some Tools, Methods and Approaches  here   From 2004.

Morra Imas, Linda G.; Rist, Ray C.. 2009. The Road to Results : Designing and Conducting Effective Development Evaluations. World Bank. © World Bank.  

https://openknowledge.worldbank.org/handle/10986/2699   

Zall Kusek, Jody; Rist, Ray C.. 2004. Ten Steps to a Results-Based Monitoring and Evaluation System : A Handbook for Development Practitioners. Washington, DC: World Bank. © World Bank.   https://openknowledge.worldbank.org/handle/10986/14926   

Last checked and edited 1/28/2018