Boyle Heights


Local L&E Overview 

The purpose of this wiki-BHC Learning Site is to collect information on local Learning and Evaluation (L&E) efforts at Building Healthy Communities (BHC) sites.  This information will allow BHC sites to better understand each other’s work and to identify where to go for self-directed peer learning and exchange.

This wiki-BHC Learning site responds to input heard from local learning staff, Hub Managers, and Programs Managers that additional information is needed on evaluation strategies being used across sites to better connect and to facilitate peer learning.  

The wiki site collects, stores, and shares information that can be accessed by local BHC staff for learning purposes.  The hope is that local L&E teams will be able to seek out peers at other sites to exchange information on evaluation design, evaluation challenges and lessons.  By facilitating this type of exchange, it is hoped that sites build evaluation capacity through peer sharing and that the wiki-site provides added value to local L&E teams and to respective BHC sites.

Directions:  Local learning and evaluation staff are welcome to complete this tool.  Please share information with your Hub Manager and Program Manager prior to submission.  Enter your responses into the blank spaces of the below tables.  It is essentially a “fill-in-the-blank” form.  

For all questions with pre-defined response options, you may mark “X” in the cell that corresponds to your response or you may type additional details in the space provided.  For all open-ended questions please provide as much explanation as you feel another local L&E staff member, Program Manager, or Hub Manager would need to grasp where your site is at. Please note that answers to questions 1, 2, and 3 are required and other questions are optional.

To fill out this form, log in to the site and click on the “Edit Page” icon, which looks like a pencil, in the upper right corner of this page. Then click on the information in the box you wish to edit and make any needed changes. Click “save” when finished.



Site

 Boyle Heights    

Person Completing Tool

 Susana Bonis

Email Address

 susana.bonis@cgu.edu

Phone Number

 818-613-6346

Date Tool Completed

 7/24/16



  

1.  Do you have an L&E team at your site?

Yes

 X

No

 

 

2.  Briefly describe the current L&E structure at your site.


The L & E for BHBHC is Leap & Associates.  In line with a developmental evaluation approach, one member of Leap & Associates is present regularly at all major meetings of BHBHC and is part of its Shared Leadership Team.  Additional members of Leap & Associates participate in data collection efforts like case studies.

 

3.  Describe your site’s current L&E approach, including your L&E design and measurement focus should it be developed at this time.

 Developmental evaluation, participatory evaluation, and theory-driven evaluation are the three approaches that guide the work of BHBHC.  A learning and evaluation plan was completed in the summer of 2015.  Key stakeholders, including residents and member organizations, were involved in the development of this plan.  They are also involved in the implementation of the plan, and the dissemination of results.  BHBHC has developed a logic model to guide its work, along with strategy charts to guide its collective campaigns.  The logic model and strategy charts, in conjunction with the theory of change of the Building Healthy Communities initiative, guides this plan.  The primary data collection methods included in the plan are case studies, surveys, performance measurement tracking tools, focus groups and interviews, narrative analysis, and summaries of regular collaborative-wide reflection and learning sessions.

 

4.  Does your L&E team attend BHC-related workgroup/action team meetings, community events, etc.?

Yes

 X

No

 

We don’t currently have an L&E team.

 


5.  Do you have an L&E team member assigned to each BHC workgroup/action team to track ongoing work?

Yes

 X

No

 

We don’t currently have an L&E team.

 

 

6.  How often does the L&E team communicate with the Program Manager at your site?  Please mark all that apply.

Weekly

 X

Bi-weekly

 X

Monthly

 X

Quarterly

 X

Bi-annually

 X

Informally

 X

Other

 


7.  How often does the L&E team communicate with the Hub Manager at your site?   Please mark all that apply.

Weekly

 

Bi-weekly

 

Monthly

 

Quarterly

 

Bi-annually

 

Informally

 

Other 

The site does not have a Hub manager, only Hub staff.  Communication between the L & E partner and Hub staff is as frequent as communication between the L & E partner and the Program Manager.

 

Please indicate your level of agreement with the following four statements.

Statement

Strongly disagree

Disagree

Neither agree nor disagree

Agree

Strongly agree

8.  Our L&E team has been engaged in organizational development efforts at our site.

 

 

 

 

 X

9.  Our site’s evaluation design has the flexibility to adapt to changes in the policy environment and our related work as needed (e.g. benchmarks and indicators can be modified as the project evolves).

 

 

 

 

 X

10.  Our site has tools and methods for evaluating the unique and dynamic nature of policy work.

 

 

 

 X

 

11.  Our site has regularly updated and/or revisited the original logic model and community action plan.

 

 

 

 

 X

 

12.  If your site has developed reports related to learning and evaluation efforts, please list the title of each report below and upload each document to the Learning Document Library at (https://sites.google.com/site/tcelearningevaluation/products-services).

 

Report title

Report uploaded to library? (Y/N)

 

 

 

 

 

 

 

 

 

13.  What evaluation tools/assessment tools are currently being administered at your site?  Please list all tools that you have used within the last 12 months in the below table and upload each tool to the Learning Document Library at (https://sites.google.com/site/tcelearningevaluation/products-services).

 

Name of tool

Purpose of tool

How were findings used or applied?

Report uploaded to library? (Y/N)

TCE Policy Inventory

Identifying policy goals and wins

Results are used in communications about results and for learning

 N

TCE Collaboration Tool

Assessing collaboration

Results are used for learning to strengthen the collaborative

 N

 

 

 

 

 

 

 

 

 

14.  Please describe how you currently and regularly engage BHC partner agencies/orgs/grantees in evaluation efforts.  If you do not, please share barriers to engaging this stakeholder group.


BHBHC has consciously built a culture of evaluative inquiry into the collaborative.  It helps to have a member of the L & E team as part of the Shared Leadership Team and present at many collaborative meetings.  This permits regular engagement between all stakeholders (organizations, grantees, and residents) and the L & E. 

Beginning three years ago, BHBHC created a space dedicated to learning and reflection:  the Advance.  Advances are held every other month for three hours (at least six a year).  Initially, the Advance was a space focused on organizational development of the collaborative.  Now that the L & E plan has been adopted, the Advance has become much more of a space for organizational learning.


15.  Please describe how you currently and regularly engage residents in evaluation efforts.  If you do not, please share barriers to engaging this stakeholder group.

 

The L & E on site is bilingual and can communicate with Spanish-speaking members of the collaborative.  The L & E has engaged residents through interviews and focus groups.  A relational approach has been more effective in engaging residents.  The L & E also attends community events to help build trust with residents.


 

16.  Please briefly describe how you may be building evaluation capacity within your site.

 

In the past, evaluation capacity was built in the area of logic models.  Before reviewing the logic model for the site as a whole, member organizations received a workshop on logic models and then one-on-one coaching in developing their own logic models.  Currently, capacity is built through participation in L & E efforts.  For example, the creation of the L & E plan lasted from January to August 2015.  Collaborative members worked during three Advances to develop an L & E plan.  Along the way, they learned about key elements of an evaluation plan, the importance of identifying stakeholder priorities, identifying indicators of success, and different methods of data collection, among other information.  As evaluation capacity needs are identified, BHBHC has the learning space and the expertise to address development.

 

17.  What evaluation models or frameworks have been useful for your site?

(Example FSG Collective Impact Framework, Community Action Plan)

Evaluation model or framework

How have you used it?

 

Metrics that Matter for Building, Scaling, and Funding Social Movements (M. Pastor)

 

To help identify indicators of success

 

A Guide to Measuring Advocacy and Policy (Annie E. Casey Foundation)

 

To help identify indicators of success

 

 

 

 

 

18.  What stage is your L&E team at with respect to the following evaluation components? Please mark the box underneath the number that best matches your assessment.

 

1

Forming

2

3

Developing

4

5

Mature

Planning & evaluation design

 

 

 

 X

 

Implementation of the evaluation design

 

 

 X

 

 

Using data for learning & continuous improvement

 

 

 

 X

 

Sharing out evaluation results with diverse audiences

 

 

 X

 

 

 

19.  Please describe an evaluation-related challenge that your site is currently working to resolve. Please briefly describe the problem, your approach to finding a solution, and any additional resources or expertise that would help your site.

 We do not have any specific evaluation challenges at this time.

 

20.  Is there anything else you would like to share?

 No, thank you.

 


Comments