Skip to main content

Evaluation Implementation:

Data Collection

Assessing community needs and readiness

Wilder Research, 2014 — A toolkit for working with communities to determine the most appropriate approaches for assessing community needs and readiness.

ATOD Community Readiness Survey

MN Department of Human Services, 2010 — A tool developed by the MN Department of Human Services, Alcohol and Drug Abuse Division, for measuring community readiness for ATOD prevention efforts, as well as an article describing the validation of the tool.

Community assessments: Using data to guide program selection and implementation

Wilder Research, 2010 — Describes five general steps involved in a community assessment and describes real-life examples from Wilder of putting each step into practice.

Smart Measurement: Tools and tips for capturing results

Wilder Research, 2010 — Tip sheet that describes how to define and measure your program's outcomes. From Wilder Research program evaluation workshop series held on May 14, 2010 at Wilder Center.

Smart Measurement: Tools and tips for capturing results

Wilder Research, 2010 — PowerPoint presentation about defining research questions, indicators, outcomes, and ways to measure them. Presentation from Wilder Research program evaluation workshop series held on May 14, 2010 at Wilder Center.

Data collection guide

Wilder Research, 2009 — Guides readers through the process of collecting new data, including choosing the most appropriate data collection strategy and what instrument to use. The guide also includes tips for administering a survey and for conducting an interview.

Evaluation Support Website

University of Arizona Cooperative Extension , 2009 — This website was created to provide concrete resources for increasing the evaluation capacity of CYFAR programs. There is information on evaluation design, data collection, analyisis, presentation and ethics. It also includes a logic model building tool, survey building tool and several interactive learning modules. You need to register for a free account to use the logic model and survey builders.

Obtaining informed consent

Wilder Research, 2009 — Defines informed consent and introduces different types of consent. Samples of student, passive parent, and active parental consent forms are provided.

Survey Says: The role of surveys in your evaluation

Wilder Research, 2009 — Fact sheet on when to use a survey, confidentiality considerations, and tips for design.

Evaluation primer: Setting the context for a community anti-drug coalition evaluation

Community Anti-Drug Coalitions of America, 2008 — Provides the basic tools to develop a comprehensive evaluation plan and create and implement a local evaluation.

Introduction to process evaluation in tobacco use prevention and control

Centers for Disease Control and Prevention, 2008 — Guide to help design and implement valid, reliable process evaluations for tobacco use prevention and control programs. The report defines process evaluation and describes the rationale, benefits, key data collection components, and program evaluation management procedures. It also discusses how process evaluation links with outcome evaluation and fits within an overall approach to evaluating comprehensive tobacco control programs.

Program evaluation: Essential tips for doing it right

Wilder Research, 2008 — Identifies important things to consider when planning an evaluation, including what you hope to accomplish and choosing the most appropriate information gathering strategies.

Conducting interviews: Tips for conducting program evaluation

Wilder Research, 2007 — Introduces different types of interviews, and describes and presents tips for the different parts of an interview.

Does it measure up?: Tips for conducting program evaluation

Wilder Research, 2007 — Presents some of the issues most often encountered in evaluation, possible solutions, and guidelines for selecting data collection tools.

Writing good surveys: Tips for conducting program evaluation

Wilder Research, 2007 — Provides recommendations for developing and using surveys. Addresses issues such as question order, writing effective questions, and formatting, plus provides tips on getting a good response rate.

Gathering Information: Tips for conducting program evaluation

Wilder Research, 2006 — Tip sheet for developing a data collection plan, including the advantages and disadvantages of various collection methods.

General guideline for conducting interviews

Free Management Library, Authenticity Consulting, LLC, 2006 — This website provides practical tips about types of question topics, sequence and wording of questions, and conducting the interview.

Documenting outcomes in tobacco control programs

Cooperative Extension of the University of Wisconsin-Extension, 2005 — Guide for tobacco-free coalitions to measure the outcomes of their work. Provides practical procedures and tools based on best practices in community-based tobacco control. In addition to an overview of evaluation, the guide includes logic models, data collection plans, and case studies on smoke-free environments, reducing and preventing youth tobacco use, and treating tobacco addiction.

Reducing alcohol problems on campus: A Guide to planning and evaluation

Task Force on College Drinking, 2002 — Presents a five-step process for implementation of effective prevention planning and evaluation with the goal of maximizing the impact of prevention strategies and measuring impact.

The 2002 user-friendly handbook for project evaluation

National Science Foundation, 2002 — Basic guide to evaluation for those who want to learn about what evaluation can do and how to do an evaluation. The report is divided into four major sections: evaluation and types of evaluation, the steps in doing an evaluation, an overview of quantitative and qualitative data collection methods, and strategies that address culturally responsive evaluation.

Introduction to program evaluation for comprehensive tobacco control programs

Centers for Disease Control and Prevention, 2001 — This guide for planning and implementing evaluation activities includes information on planning, engaging stakeholders, evaluation design, and using findings.

Framework for program evaluation

Centers for Disease Control and Prevention, 1999 — Presents the steps in program evaluation practice and standards for effective evaluation.

Evaluation handbook

W.K. Kellogg Foundation, 1998 — This often-cited resource provides a framework for thinking about evaluation and outlines a blueprint for designing and conducting evaluations, either independently or with the support of an external evaluator/consultant.

Selecting the right tool: A Compendium of alcohol and other drug assessment and evaluation instruments

U.S. Department of Education’s Higher Education Center for Alcohol and Other Drug Abuse and Violence Prevention, 1998 — Covers the important issues to consider when selecting data collection instruments and the leading instruments used in the postsecondary prevention field. More than 20 instrument samples are included.

Collecting evaluation data: an overview of sources and methods

University of Wisconsin-Extension, 1996 — Describes sources of evaluation information and methods for collecting information about an evaluation.

Developing and using questionnaires

U.S. General Accounting Office, 1993 — This in-depth paper provides rationales for determining when questionnaires should be used to accomplish your objectives. It also describes how to plan, design, and use a questionnaire in conducting a population survey.

Understanding evaluation: The Way to better prevention programs

Westat, Inc., 1993 — Describes the "how and why" of program evaluation and outlines the steps involved, working from the premise that many useful evaluations can be conducted by program staff who may not have formal training in evaluation.

Basics for survey development

Office of Juvenile Justice and Delinquency Prevention, 1989 — Quick online suggestions to guide the development of survey questions.

Evaluating program outcomes

Child Welfare Information Gateway, No Date — Provides links to information and resources to help at various stages of the evaluation process. Topics include evaluating program outcomes, planning for evaluation, evaluation design, collecting and analyzing data, and using evaluation results.

SAMHSA’s National Outcome Measures, from SAMHSA’s Measures & Instruments Resource

Substance Abuse and Mental Health Services Administration, No Date — List of measures and instruments related to substance abuse prevention, including a profile that describes target population, reliability, validity and measure questions.