Style Sheet for Evaluation Design Assignment
Due Dec. 12
Please provide me with a one page proposal for your topic by March 21. The proposal
should provide a brief description of the program and the problem it was designed to
address. It should also include your preliminary ideas as to how you will measure
the problem and the change in that problem that would represent the outcome of interest.
The importance of a well-designed evaluation cannot be overstated. Attempting to evaluate a program without a clear sense of purpose, direction, and methods not only results in a waste of time and resources, but will likely result in a poor quality or even useless evaluation.. The purpose of this assignment is for you to design (and present) a program evaluation for the program of your choosing. The program may be administered by any public sector or nonprofit agency. You will likely need to have access to program documents as well as people involved in running the program whom you can ask questions, so keep that in mind in selecting your program. Your paper should include both a plan for conducting a process or implementation evaluation, and for assessing the program impact. It should also inlcude the following elements:
| A complete description of the program, its activities, subobjectives, intended
outcomes |
| The history of and context for the program development; e.g., where and by whom was
it initiated, what problem was it intended to address, why was this particular approach to
addressing the problem taken? |
| The question(s) and issues that the evaluation will be designed to answer or
address. Remember that the focus should be on how you would get the
information to answer these questions, not the answers themselves. For
example, you should describe how you would go about finding out whether a program
was implemented according to the original plan, rather than discussing whether it was or
not. |
| The estimated resources (inlcuding number of staff, amount of time, and expertise)
required to complete the evaluation. |
| The data required to answer the evaluation questions, including method of data
collection and alternative sources of data. |
| The feasibility of obtaining these data, and any anticipated problems in getting
them and shortfalls in them (e.g., missing data). |
| A discussion of program variables and how they are or will be operationalized and
measured (e.g., treatment, subobjectives, outcomes of interest). |
| The type of design for impact analysis (see Mohr table 4.1) and potential threats
to internal and external validity. Be sure to indicate where your measures of
results and the counterfactual will come from. |
Your grade will be based on the extent to which your design has
| Defined and posed appropriate evaluation questions. |
| Developed methodologies for answering those questions. |
| Formulated a plan for collecting necessary data that anticipates and addresses
problems that are likely to be encountered in collecting those data. |
| Included a detailed analysis plan that will ensure the questions you pose are
answered to the best extent possible. |
| Is well-organized, and written in a clear and concise manner. |