1.  Do you have an L&E team at your site?

Yes

 X

No

2.  Briefly describe the current L&E structure at your site.

The L&E team is comprised of a Sacramento based consulting firm, LPC Consulting Associates, Inc., the TCE Project Manager and Hub Manager. The evaluation team has remained constant since the first years of the initiative, and has the benefit of established relationships with most of the individuals involved in the S. Sacramento BHC initiative. The L&E Team meets annually to discuss the evaluation tasks for the upcoming year, and maintains frequent communication throughout the year to revise the evaluation as necessary to accommodate for the always shifting initiative. 

3.  Describe your site’s current L&E approach, including your L&E design and measurement focus should it be developed at this time.

The L&E approach is based on teamwork and flexibility. We take pride in developing relationships with the grantees and contractors in order to foster a cooperative spirit where evaluation is used to better programs as opposed to focusing on the flaws or missteps of program implementation. Elements of the L&E design and measurement are both static and fluid. The evaluation always includes an analysis of: (1) the ways in which residents are engaged in the initiative, (2) the number of residents engaged, (3) a review of Action Team attendance and accomplishments, and (4) indicator tracking. However, due to the ever changing nature of the initiative, the evaluation also includes fluid components that evolve over time to track elements of the initiative as they arise. For example, as Action Teams develop campaigns the evaluation will incorporate a case study to tell the story of the campaign development and outcomes achieved through advocacy. In addition, we are introducing social network analysis into the evaluation this year, and will continue to include this element in some capacity for future evaluation efforts. 

4.  Does your L&E team attend BHC-related workgroup/action team meetings, community events, etc.?

Yes

 X

No

We don’t currently have an L&E team.

5.  Do you have an L&E team member assigned to each BHC workgroup/action team to track ongoing work?

Yes

 X

No

We don’t currently have an L&E team.

6.  How often does the L&E team communicate with the Program Manager at your site?  Please mark all that apply.

Weekly

 X

Bi-weekly

Monthly

Quarterly

Bi-annually

Informally

Other

7.  How often does the L&E team communicate with the Hub Manager at your site?   Please mark all that apply.

Weekly

 X

Bi-weekly

Monthly

Quarterly

Bi-annually

Informally

Other

Statement

Strongly disagree

Disagree

Neither agree nor disagree

Agree

Strongly agree

8.  Our L&E team has been engaged in organizational development efforts at our site.

 X

9.  Our site’s evaluation design has the flexibility to adapt to changes in the policy environment and our related work as needed (e.g. benchmarks and indicators can be modified as the project evolves).

 X

10.  Our site has tools and methods for evaluating the unique and dynamic nature of policy work.

 x

11.  Our site has regularly updated and/or revisited the original logic model and community action plan.

 x

Report title

Report uploaded to library? (Y/N)

 South Sacramento BHC Year One Evaluation Report 

 y

 South Sacramento BHC Year Two Evaluation Report 

 y

 South Sacramento BHC Year Three Evaluation Report 

 y

 South Sacramento BHC Year Four Evaluation Report 

 y

Name of tool

Purpose of tool

How were findings used or applied?

Report uploaded to library? (Y/N)

 Ongoing Services Log

 To capture how grantees are engaging residents on an ongoing basis, and the number of residents engaged.

 We track resident engagement by a series of categories that are reported in the yearly evaluation report.

 Y

 Event Log 

To capture how grantees are engaging residents on an infrequent basis, and the number of residents engaged.

 We track resident engagement by a series of categories that are reported in the yearly evaluation report.

 Y

 Resources Leveraged

 Grantees track how they are using their work in the BHC to leverage other resources, e.g, grants, donations, in-kind services. 

 The data is provided to the TCE Project Manager who works with the evaluation team to keep a running list. Some of the data has been reported in site-based evaluation reports, and reports the Project Manger submits to TCE. 

 Y

14.  Please describe how you currently and regularly engage BHC partner agencies/orgs/grantees in evaluation efforts.  If you do not, please share barriers to engaging this stakeholder group.

We collect evaluation data from the BHC grantees on a bi-monthly basis (see evaluation tools uploaded to the Learning Document Library). The evaluation team provides bi-annual updates about the evaluation at the All Grantee Convenings. In addition, grantees are asked to review draft reports/case studies that pertain to their programs or campaigns.  

15.  Please describe how you currently and regularly engage residents in evaluation efforts.  If you do not, please share barriers to engaging this stakeholder group.

 We have tried, and continue to try, to engage residents in evaluation efforts. Unfortunately we have had little success. Residents are typically engaged in the BHC through a grantee program or service. Many residents do not have time to complete surveys, or participate on focus groups, or do understand how the grantee program connects to the BHC. We do have a number of residents engaged in the Action Team campaigns, which we plan on focusing attention on in the upcoming year. This may provide an additional opportunity for us to engage residents in evaluation.  

16.  Please briefly describe how you may be building evaluation capacity within your site.

We have a bi-monthly log system to track information from the grantees. We work with the grantees individually to bring them up to speed on our data reporting tools, or we work with them to adapt what we need from their internal reporting. Many times grantees have relayed that collecting data for us has shown them the importance of collecting data for future grant opportunities, and to demonstrate process measures for other funders. Many grantees use our tools for their own tracking beyond BHC because they understand the importance of collecting data and participating in the local evaluation. 

In addition, we are lucky to have evaluation contract to evaluate individual grantee programs. Through those evaluations we have created a series of tools that the organizations continue to use beyond the evaluation contract. 

17.  What evaluation models or frameworks have been useful for your site?

(Example FSG Collective Impact Framework, Community Action Plan)

Evaluation model or framework

How have you used it?

 FSG Collective Impact 

We have used collective impact indicators to inform collaborative assessments and evaluation report recommendations.

 Social Network Analysis 

 We are in the process of administering a social network analysis survey to understand the overall network. 

18.  What stage is your L&E team at with respect to the following evaluation components? Please mark the box underneath the number that best matches your assessment.

1

Forming

2

3

Developing

4

5

Mature

Planning & evaluation design

 x

Implementation of the evaluation design

 x

Using data for learning & continuous improvement

 x

Sharing out evaluation results with diverse audiences

 x

19.  Please describe an evaluation-related challenge that your site is currently working to resolve. Please briefly describe the problem, your approach to finding a solution, and any additional resources or expertise that would help your site.

20.  Is there anything else you would like to share?