Evaluating Community Impact 2016, Hamilton ON

Submitted by Tamarack on November 14, 2016 - 11:10am


DAY ONE CURRICULUM – Tuesday, November 15, 2016


Welcome and Opening of the Community

Welcome Presentation Slides

Module #1: The Dynamic Nature of Community Change and Impact

What is the “it” we are trying to evaluate? What are the implications of defining communities as “complex adaptive systems”??  What are the implications for developing, implementing, adapting and evaluating community change strategies? We need a strong grasp of these foundational ideas before we explore how we can assess our efforts to evaluate community impact. 

Presentation Slides: The Dynamic Nature of Community Change

Module #2: Measurement 101

While some people continue to believe that that primary challenge in evaluating community change is to find “quantitative” data to “measure” outcomes, experienced social innovators and evaluators employ qualitative and quantitative data for multiple reasons. These include  understanding the nature of complex problems, surface possible solutions, and to track progress and change. This module provides a framework for understanding the use of qualitative and quantitative data in development. 

Presentation Slides: Measurement 101


Module #3 Designing Evaluations that are Used 

Sometimes you need to go slow before you go fast. While many community change practitioners are eager to get to discussions of measurements and tools, it is important that they lay the groundwork for a robust evaluation process before they get into the micro-mechanics of the work. 

In this module, we’ll explore four critical pre-conditions for evaluating community change: clarifying your intervention, sorting out the role of evaluation users and evaluators, developing an evaluation scope of work and embracing some guidelines for developing good evaluations.

 Presentation Slides: Designing Evlauations that are Used

Presentation Materials: 

- Aide Action

- Designing Evaluation

Module #4: Peer Consulting Process 

This is our ninth Evaluating Community Impact workshop and we are going to respond to feedback from many participants to find new and innovative ways for them to connect on their evaluation change. In this module, we will be using the Troika exercise.

Presentation Slides: Peer Consulting Process

Troika Exercise: http://www.liberatingstructures.com/8-troika-consulting


DAY TWO CURRICULUM – Wednesday, November 16



Day Two - Full Powerpoint Slides

Module #5 Topic Population Level Change 

The ultimate goal of many would-be change makers is to ‘move the needle’ on complex community issues (e.g. high school graduation rates). While it is not always easy to measure population level changes – and even harder to link a group’s activities to these longer term changes – it is still important to have this as . This module will the value of population level data in informing and tracking the progress of community change efforts, three types of data strategies for , and the different role of strategists, implementers, and evaluation-researchers in 

Presentation Slides: Population Level Change


Additional Module: Strategy Continuum

Presentation Slides

Module #6: Evaluating Systems Change

In order to move the needle on population-level outcomes, social innovators need to re-shape the (in)formal systems that shape those outcomes.  Programmatic interventions, on their own, are insufficient. In this module, we will explore several key concepts and frameworks for thinking about, planning and evaluating system changes

Presentation Slides:

- Public Awareness

- Mapping Social Networks

- Outcome Mapping

- Policy Change


Module #7: Contribution Analysis        

This session will introduce participants to the concept and practice of contribution analysis, a systematic approach to assessing the “contribution” of the activities of local roundtables and networks to changes in their community.  It includes a general introduction to the questions of contribution, the steps of contribution analysis, and the opportunity to play with several techniques of contribution analysis.

Presentation Slides: Contribution Analysis

Booklet: Contribution Analysis


Module #8: Systems Change Methods Carousel  

In this module, we will explore three different methods to assess different aspects of systems change using a carousel method.  Specifically, participants will learn about three methods : understanding, influencing and evaluating policy change, building a public awareness profile for communicating evaluation results and building social networks and social capital.  

Presentation Slides: Ripple Effect Monitoring

- Outcome Harvesting

PresentationMost Significant Change

Handout: Most Significant Change

Presentation: Outcomes Diary

Handout: Outcomes Diary



DAY THREE CURRICULUM – Thursday, November 17



Day Three: Full PowerPoint Slides 


Module #9: Collective Impact & Shared Measurement 

Collective Impact is an important new framework for communities that seek to move the needle on a complex community issue.  One of the core elements of collective impact is shared measurement where partners agree to a core set of measures which are designed to track positive and consistent progress at scale.  The development of a shared measurement framework will be explored in this module.  As well, the module will discuss both the benefits of a shared measurement practice and the challenges in this approach.  Finally, the module will explore the critical importance of building in learning and sense-making strategies in a shared measurement approach.

Presentation Slides: Shared Measurement

Collective Impact 3.0 Article

Module #10: Evaluating Community Capacity

A group’s progress on moving the needles on a complex issue depend as much on its members capacity to have tough conversations about the nature of the problem and possible solutions, make decisions about priorities, coordinate and sustain implementation efforts, and adapt their approach to reflect new learnings and shifts in context. This module explores different tools to assess the health of a collaboration.

Presentation Slides: Evaluating Community Capacity

Module #11: Evaluating Readiness - Self Assessment

The previous 10 modules in this workshop examined different issues and methods related to evaluating community impact. This module explores the value in carrying out an assessment of your groups capacity to carry out an evaluation in general, reviews several key resources in the area, and provides participants an opportunity to assess their home group’s evaluation capacity and surface areas for improvement.

Presentation: Evaluating Readiness

Handout / Tool: Diagnostic

Module #12: Synthesizing our Learning 

In this interactive module, learning participants will synthesize the key evaluation themes that have been presented during the last three days.  They will be asked to reflect on each of the modules and determine how these lessons can be applied to their community change context.  Using a synthesis tool, from the book, Gamestorming – A Playbooks for Innovators, Rulebreakers and Changemakers by David Gray, Sunni Brown and James Macanufo, participants will work in learning pods to create a visual representation of our time together.  

Presentation Slides: Synthesizing our Learning


Key Themes and Learning Review 

12 modules in 3 days is a lot of material.  In this module, we’ll review the highlights of each, point out some new resources, and give you time to sort through how you will begin to use your learnings in your own community.  

Presentation Summary Slides: Synthesizing our Learning

-Resource at a Glance: Policy Change

-Resource at a Glance: Capturing and Making Sense of Outcomes

-Resource at a Glance: Collective Impact

-Resource at a Glance: Developing Evaluations that are Used

-Resource at a Glance: Framework for Change

-Resource at a Glance: Phases of Collaborative Change Efforts

-Resource at a Glance: Network Mapping

-Resource at a Glance: MSC Stories