Summary of Learning: Evaluating Community Impact

Submitted by Kirsti Battista on February 20, 2015 - 10:31am

Please note: Resources from the Mississauga workshop will be uploaded as they become available.

Day 1 - February 23 - Setting the Foundations 

Welcoming the Learning Community

Facilitated by Liz Weaver, Vice-President, Tamarack – An Institute for Community Engagement  & Mark Cabaj, President, Here to There Consulting


Module #1:  The Dynamic Nature of Community Change

Facilitated by Mark Cabaj, President, Here to There Consulting 

What is the “it” we are trying to evaluate? What do we mean by communities as complex adaptive systems? What are the dynamics of community change?  What are the various approaches to getting community impact?  We need a strong understanding of the nature of community change before we can and develop effective strategies.


Module #2:  Building Your Community Change Story

Facilitated by Mark Cabaj, President, Here to There Consulting & Liz Weaver, Vice-President, Tamarack - An Institute for Community Engagement

In this module, we’ll explore four critical pre-conditions for evaluating community change: clarifying your intervention, sorting out the role of evaluation users and evaluators, developing an evaluation scope of work and embracing some guidelines for developing good evaluations.

  

Module #3:  Designing Evaluations that are Used 

Facilitated by Mark Cabaj, President, Here to There Consulting 

In this module, we’ll explore four critical pre-conditions for evaluating community change: clarifying your intervention, sorting out the role of evaluation users and evaluators, developing an evaluation scope of work and embracing some guidelines for developing good evaluations.

Module #4:  Splash and Ripple Methods Carousel  

In this module, we will explore the limitations of traditional evaluation practices in identifying outcomes and explore practical resources, from the simple to the sophisticated, that you might use in your own work.

  

 

Day 2 - February 24 – Capturing Community Change 

Module #5:  Population Level Change & Shared Measurement

Facilitated by Liz Weaver, Vice-President, Tamarack – An Institute for Community Engagement 

This module will explore the different strategies for collecting and using data on ‘population’ level changes as well as the role that individual agencies can contribute to support this process through shared measurement 


Module #6: Evaluation and Narratives

Facilitated by Jennifer LaFontaine, Community Story Strategies

This module will explore how we can use personal stories to demonstrate impact, capture unexpected results, and share the values that drive our work.

 

Module #7:  Evaluating Systems Change

Facilitated by Mark Cabaj, President, Here to There Consulting with Sara Earl, YMCA GTA

In order to move the needle on population-level outcomes, social innovators need to re-shape the (in)formal systems that shape those outcomes.  In this module, we will interview Sarah Earl, former Senior Program Officer of the International Development Research Corporation (IDRC), and now Director of Research of Program Development at the YMCA of Toronto, about her extensive experience in evaluating system changes in Canada and abroad, and surface several key tips for workshop participants.


Module #8: Systems Change Methods Carousel

In this module, we will explore three different systems change methods using a carousel method.  Specifically, participants will learn about three methods which are critical to evaluation and learning practices including understanding, influencing and evaluating policy change, building a public awareness profile for communicating evaluation results and building social networks and social capital.   

  Policy Changewith Mark Cabaj

 Outcome Mapping with Sara Earl


Network Mapping for Collective Impact
with Robyn Kalda and Penny
Scott

 

 

Day 3 – February 25 - Moving Toward Use

Module #9:  Contribution Analysis

Facilitated by Mark Cabaj, President, Here to There Consulting

Data does not speak for itself. People must interpret it, draw conclusions, make judgements and finally recommendations This module will explore the extraordinary role that cognitive biases/mental models play in how the diverse members of a community change effort interpret evaluation findings and a variety of different techniques to strengthen participatory sense-making. 


Module #10:  Evaluating Community Change Groups

Facilitated by Liz Weaver,Vice-President, Tamarack – An Institute for Community Engagement

This module will review the typical types of community change models, the types of evaluation questions that are useful to explore, and several models for collaborative self-assessment.


 Module #11:  Synthesizing our Learning

Facilitated by Liz Weaver, Vice-President, Tamarack – An Institute for Community Engagement  & Mark Cabaj, President, Here to There Consulting

In this interactive module, learning participants will synthesize the key evaluation themes that have been presented during the last three days.  They will be asked to reflect on each of the modules and determine how these lessons can be applied to their community change context.  Using a synthesis tool, from the book, Gamestorming – A Playbooks for Innovators, Rulebreakers and Changemakers by David Gray, Sunni Brown and James Macanufo, participants will work in learning pods to create a visual representation of our time together. 

 

 Module #12:  Key Themes and Learning Review: What, So What, Now What? 

Facilitated by Mark Cabaj, President, Here to There Consulting

Twelve modules in three days is a lot of material.  In this module, we’ll review the highlights of each module, point you to some new resources, provide some time for you to sort through how you will begin to use your learnings once you return to your community.

 

 Closing the Learning Community

Facilitated by Liz Weaver, Vice-President, Tamarack – An Institute for Community Engagement  & Mark Cabaj, President, Here to There Consulting

 

 

 

 

Attachment
Size
resource_at_a_glance_policy_change.pdf414.55 KB
network_weaver_checklist_by_roles.pdf111.09 KB
resource_at_a_glance_capturing_and_making_sense_of_outcomes.pdf741.92 KB
resource_at_a_glance_framework_for_change.pdf179.5 KB
resource_at_a_glance_outcomes_diary.pdf231.17 KB
resource_at_a_glance_phases_of_collaborative_change_efforts.pdf571.25 KB
resource_at_a_glance_policy_change.pdf414.55 KB
resource_at_a_glance_developing_evaluations_that_are_used.pdf531.96 KB
2010_03_usaid_-_tips_03_preparing_and_evaluation_scope_of_work.pdf281.29 KB
assessingevaluationquestionchecklist.pdf337.32 KB
different_purposes_of_evaluation.pdf204.59 KB
innoweave-developingauserprofile-20130414-p1.pdf166.08 KB
innoweave-evaluatoroptions-20130414-p1.pdf133.42 KB
innoweave-riskassessmentandmitigationworksheet-20130414-p1.pdf133.33 KB
innoweave-traditionalvscomplexitybased-20130419-p1_2.pdf107.3 KB
the_developmental_evaluation_diagnostic.pdf782.08 KB
eci_toronto_opening__welcome.pdf1.1 MB
eci_toronto_module_1_dynamic_nature_of_community_change.pdf2.96 MB
eci_toronto_module__2_building_your_community_change_strategy.pdf1.67 MB
eci_toronto_module_3_developing_evaluations_that_are_used_autosaved.pdf2.4 MB
eci_toronto_module_4_outcome_harvesting.pdf941.47 KB
eci_toronto_module_4_ripple_effect_mapping.pdf1.18 MB
eci_toronto_module_4_outcomes_diary.pdf1009.69 KB
eci_toronto_module_4_introduction_to_splash_and_ripple_carousel.pdf1.22 MB
eci_toronto_module_5_pop_level_change.pdf1.91 MB
eci_toronto_module_7_evaluating_systems_change_with_sarah_earl.pdf1.59 MB
eci_toronto_module_8_evaluating_policy_change.pdf2.09 MB
eci_toronto_module_9_contribution_analysis.pdf2.01 MB
eci_toronto_module_10_eval_your_community_change_group.pdf833.45 KB
eci_toronto_module_12__synthesizing_our_learning.pdf749.66 KB
2015feb_eci_networkmapping_final.pdf2.15 MB