Who we are    What we do    Our Projects    Our Products    Links to Resources   
  | |  Introduction  | |   MFH Initiative Evaluation  | |   School Policy Project  | |   Project LEaP  | |   Best Practices  | |  
  | |  National Networks  | |  

Project LEaP: Linking Evaluation and Practice in Tobacco Control

Project Background and Objectives
In 2003, the Center for Tobacco Policy Research (CTPR) conducted a rigorous process evaluation examining the effects of funding reductions on eight state tobacco control programs. The project was organized into two phases:
  1. Evaluation of the programs; and
  2. Dissemination of results.

The primary objectives of the project were:

  • To examine how state tobacco control programs were affected by challenging and unstable state financial environments.
  • To test the effectiveness of different dissemination strategies.

The Project LEaP conceptual model shows that program environment, resources, and capacity are integral parts of program sustainability. It is the interaction of these three components that create a sustainable program and produce positive program outcomes.

State Selection

Eight states (Michigan, Indiana, Nebraska, Oregon, Minnesota, Florida, North Carolina, New Mexico) were asked to participate in the evaluation. States were identified based on meeting one of the three funding criteria:

  1. Received a 25% or greater reduction in funding;
  2. Experienced a threat of a 25% or greater reduction; or
  3. No reduction or threat occurred.

Other criteria were also considered, including:

  • geographic location,
  • presence of tobacco agriculture, and
  • lead agency status (department of health or independent agency) .
Phase 1: Evaluation of the Programs

The data collection for the evaluation consisted of both a program background survey completed by the lead agency and in-depth interviews with key tobacco control partners in each of the eight states. Interviews were conducted both in-person and by phone and covered a variety of topics, including:

  • The financial and political climates of the state;
  • The effect of state climates on tobacco control program funding and implementation;
  • The organizational capacity of the tobacco control partners;
  • Relationships among tobacco control partner agencies;
  • Tobacco-related disparities; and
  • The CDC’s Best Practices guidelines.

A preliminary analysis was conducted from the interviews and key points from these findings were compiled into Rapid Response Reports (RRR) for each state. These reports were distributed to the partner agencies six to eight weeks after data collection was completed.

Phase 2: Dissemination of Results
To test the effectiveness of different dissemination strategies, the states were assigned to one of four groups:
  • Print materials only (Florida and New Mexico)
  • Print materials and targeted website (Minnesota and Michigan)
  • Print materials and interactive workshop (Oregon and Nebraska)
  • Print materials, targeted website, and interactive workshop (North Carolina and Indiana)

To guide the development of dissemination materials, a focus group was conducted with all eight state tobacco control program managers. A pre-/post web-based evaluation survey was administered to test the effectiveness of the dissemination strategies and examine how the project results were being used by partners.

Print materials

A series of five reports were developed for each state based on the Project LEaP conceptual model. The reports presented the evaluation results in the following areas: executive summary, program environment, program resources, program capacity, and program sustainability. The report series was mailed to every individual participating in the project.

Targeted Website

A targeted website was developed for four states (Michigan, Indiana, North Carolina, and Minnesota). The websites contained state-specific evaluation results in the same five areas as the print materials and enabled viewers to print PDF versions of these materials. The website also contained a tell-a-friend feature and general polling questions that allowed respondents to vote and see the aggregated results immediately. The web link was sent out via email to introduce the website to program partners in each of the four states.

Interactive Workshop

The evaluation results were presented in a one-day workshop for partners in four states (Nebraska, Oregon, North Carolina, and Indiana). The workshop focused on two primary areas: the strength of the tobacco control network in the state and the program’s level of sustainability. Evaluation results regarding these two areas were shared with the workshop participants to engage them in an open discussion about how they could use the results in their own program planning. These discussions facilitated the development of short-term action plans during the workshop. Participants identified the top three priorities for the program and then came to consensus on how to begin addressing these priorities in the next six months.

Products