Evaluation Process & Support

What Is Evaluation?

Evaluation uses data to take a careful look at how well programs, policies, or organizations are working and how efficiently they use resources. Evaluations provide practical insight into what results programs achieve, how they achieve them, and why. They can examine an entire program or focus on specific initiatives within a program.

Evaluations follow a systematic, mutually agreed-on plan that typically includes:

1. Determining the goal

  • What is the evaluation question?
  • What decisions will the evaluation inform?

2. Applying appropriate methods

  • What quantitative or qualitative methods will be used?
  • How will we increase confidence that the program is having the intended effect?

3. Making results useful

  • How will results be communicated?
  • How can the organization use the findings to make improvements?

 

Before conducting a full evaluation, agencies should assess whether a program can be evaluated reliably and credibly. An evaluability assessment examines program readiness for evaluation based on:

  • Available data and measurement systems
  • Whether evaluation is worthwhile based on likely benefits, costs, and outcomes
  • Which evaluation type is most appropriate given program age, logic model, scope, and scale

Each evaluation type serves an important role in evidence building.

Programs at Logic Model or Outputs stage: 

  • Consider formative or process evaluations to examine implementation integrity, identify areas for improvement, and determine readiness for more rigorous evaluation

Programs at Outcomes stage: 

  • Pursue outcome evaluations to assess whether program participants experience desired changes

Programs ready for Evidence Framework advancement: 

  • Collaborate with independent evaluators (university researchers, research organizations) to conduct impact evaluations using experimental or quasi-experimental designs

High-quality impact evaluations enable agencies to describe programs as reaching the "Evidence" step in the Tennessee Evidence Framework and justify inclusion in evidence-based budgeting activities.

OEI provides comprehensive support to help agencies build quality program evidence.

Funding Opportunities

  • Financial support for rigorous program evaluations
  • Investment in evidence building across Learning Agenda priorities

Technical Assistance

  • Evaluation planning guidance
  • Methodology consultation
  • Data collection strategy support

Evaluation Design Consultation

  • Assistance selecting appropriate evaluation type
  • Support developing evaluation plans
  • Guidance on measuring outcomes effectively

External Partner Identification

  • Connection with university researchers
  • Matching with qualified evaluation firms
  • Facilitation of research partnerships

Results Dissemination Planning

  • Guidance on sharing findings  effectively
  • Support for translating results into actionable recommendations
  • Assistance with incorporating findings into program improvement

State agencies interested in evaluation support should contact OEI Research.

Email: OEI.Research@tn.gov

In your email, please include information about:

  • The program or initiative to be evaluated
  • Key questions you hope to answer and/or the decisions you are trying to make
  • Timeline and any relevant deadlines
  • Current data collection or measurement systems

Some helpful resources and tools are linked below.  Please contact OEI.Research@tn.gov with any questions.

As the community of practice develops, training sessions on the evaluation process, planning evaluations, and working with external evaluators may be recorded and posted here.