Workshop on Advanced Impact Evaluation for Evidence-Based Development

Development programs and policies are typically designed to create change to the target beneficiaries. Whether or not these changes are achieved is a crucial public policy question but one that is not often examined. Impact evaluation assesses the changes that can be attributed to a particular intervention, such as a project, program, or policy, both the intended ones, as well as ideally the unintended ones.

This course is designed to equip the participants with adequate skills to conduct rigorous impact evaluations for their interventions. The course covers all aspects of planning, designing, and implementing an impact evaluation. By the end of the course the participants will be experts who can carry out impact assessment assignments for their organizations or as consultants.

Target Participants

This course is targeted at researchers, project staff, managers, development practitioners, policy makers in government, NGOs and development organizations who want to determine the impact of their interventions.

Course Duration       10 Days

Course Objectives

By the end of this course the participants will be able to:

• Learn about theories and practices of impact evaluation
• Learn about evaluation problem: Attribution, selection and placement biases
• Understand IE designs: randomized, quasi and non-experimental
• Conduct a rigorous impact evaluation of a project
• Conduct sampling and power calculation
• Learn and practice econometric techniques for impact evaluation
• Carry out impact data analysis
• Report and disseminate impact evaluation findings

Course Outline

Overview of M&E Fundamentals for Impact Evaluation

• Results Framework
• M&E Project Indicators
• Logical Framework
• Performance Evaluation

Introduction to Impact Evaluation

• Defining impact evaluation
• Deciding whether to evaluate
• Attribution in impact evaluation
• Contribution vs attribution

Determining points of Impact Evaluation

• Types of evaluation questions
• Theories of Change
• The results chain
• Evaluation hypothesis
• Impact evaluation indicators

Counterfactuals in Impact Evaluation

• Causal reference
• Comparison groups and counterfactuals
• Estimating counterfactual in impact evaluation
• Impact Evaluation when a Comparison and Baseline Data are not available

Impact Evaluation Designs

• Experimental Design
• Randomized Control Trials
• Quasi experimental designs
• Regression Discontinuity
• Difference-in-Difference
• Propensity Score Matching

Sampling in Impact Evaluation

• Sampling techniques in Impact Evaluation
• Sample size calculation,
• Sampling weight
• Statistical power
• Constructing valid comparison groups

Data Collection in Impact Evaluation

• Determining What Data are Needed
• Data Sources
• Designing a Survey
• Managing the Data Collection

Quantitative Data Analysis for Impact Evaluation

Introduction to Statistical Data Analysis in Impact Evaluation

• Understanding the foundations of Data Analysis in Impact Evaluation
• Data Management
• Descriptive Analysis in Impact Evaluation
• Inferential Analysis in Impact Evaluation

Randomized Impact Evaluation

• Statistical Design of Randomization
• Impacts of Program Placement
• Impacts of Program Participation
• Capturing Both Program Placement and Participation
• Measuring Spillover Effects

Propensity Score Matching Technique (PSM)

• Introduction to PSM
• Application of PSM in Impact Evaluation
• Constructing propensity scores
• Matching Analysis
• Common support

Difference in Difference Method

• What is DID?
• Application of DID in Impact Evaluation
• Estimating DID estimator
• DID for Cross-Sectional Data
• Balancing Tests

Qualitative Approaches in Impact Evaluation

• Introduction to qualitative data analysis
• Qualitative data analysis techniques in Impact Evaluation
• Triangulation with quantitative data

Producing and Disseminating Impact Evaluation Findings

• Impact Evaluation Plan
• Impact Evaluation Reports
• Impact Evaluation Findings Dissemination Plan

Using Impact Evaluation in Policy Formulation

• Policy Evaluation Frameworks
• Policy Recommendations from Impact Evaluations
• Influencing Policy Decisions
• Case Studies

Certification

Upon successful completion of this training, participants will be issued with a Macskills Training and Development Institute Certificate

Training Venue

Training will be held at Macskills Training Centre. We also tailor make the training upon request at different locations across the world.

Airport Pick Up and Accommodation

Airport pick up and accommodation is arranged upon request.

Terms Of Payment

Payment should be made to Macskills Development Institute bank account before the start of the training and receipts sent to our email.