Local L&E Overview
The purpose of this wiki-BHC Learning Site is to collect information on local Learning and Evaluation (L&E) efforts at Building Healthy Communities (BHC) sites. This information will allow BHC sites to better understand each other’s work and to identify where to go for self-directed peer learning and exchange.
This wiki-BHC Learning site responds to input heard from local learning staff, Hub Managers, and Programs Managers that additional information is needed on evaluation strategies being used across sites to better connect and to facilitate peer learning.
The wiki site collects, stores, and shares information that can be accessed by local BHC staff for learning purposes. The hope is that local L&E teams will be able to seek out peers at other sites to exchange information on evaluation design, evaluation challenges and lessons. By facilitating this type of exchange, it is hoped that sites build evaluation capacity through peer sharing and that the wiki-site provides added value to local L&E teams and to respective BHC sites.
Directions: Local learning and evaluation staff are welcome to complete this tool. Please share information with your Hub Manager and Program Manager prior to submission. Enter your responses into the blank spaces of the below tables. It is essentially a “fill-in-the-blank” form.
For all questions with pre-defined response options, you may mark “X” in the cell that corresponds to your response or you may type additional details in the space provided. For all open-ended questions please provide as much explanation as you feel another local L&E staff member, Program Manager, or Hub Manager would need to grasp where your site is at. Please note that answers to questions 1, 2, and 3 are required and other questions are optional.
To fill out this form, log in to the site and click on the “Edit Page” icon, which looks like a pencil, in the upper right corner of this page. Then click on the information in the box you wish to edit and make any needed changes. Click “save” when finished. Site | Central Santa Ana | Person Completing Tool | Jacqueline Tran | Email Address | jackie.tran@gmail.com | Phone Number | (310) 592-7238 | Date Tool Completed | November 11, 2016
|
|
1. Do you have an L&E team at your site? | Yes | X | No | |
2. Briefly describe the current L&E structure at your site. | The L&E team with the Central Santa Ana BHC is comprised of a consultant from CSULB's Center for Health Equity Research (CHRE), the TCE program manager and hub staff. The consultant evaluator works with all the hub staff and campaign co-facilitators to support learning and evaluation efforts. |
3. Describe your site’s current L&E approach, including your L&E design and measurement focus should it be developed at this time. | Current L&E support to Central Santa Ana is new in this year (2016). Prior to us joining the team the Hub was working with external consultants on evaluating accomplishments/successes and challenges/opportunities for improvement with the mid-year point for the initiative. Focus groups, interviews, and surveys were collected from residents (adult and youth), organizational partners and key stakeholders. The hub is also working on an archive of accomplishments and media pieces for the campaigns since the inception of the initiative. Currently all members have participated in a Results Based Accountability (RBA) process to better document the impacts of the work of the BHC. Each work group has facilitated trainings and dialogues to determine key goals, indicators of change/measures of impact, goal statements and strategies to help document and bring shared vision to the campaign work. Indicators of change include individual and population level measures leveraging existing resources such as CHIS and CHKS and local partners who are capturing process measures on campaign efforts. The evaluation consultant attends the steering committee/general assembly, work group, and committee meetings to provide support with data collection and data resources. The evaluation consultant meets regularly with the Program Manager and hub staff to discuss learning and evaluation needs and updates.
|
4. Does your L&E team attend BHC-related workgroup/action team meetings, community events, etc.? | Yes | X | No | | We don’t currently have an L&E team. | |
5. Do you have an L&E team member assigned to each BHC workgroup/action team to track ongoing work? | Yes | X | No | | We don’t currently have an L&E team. | |
6. How often does the L&E team communicate with the Program Manager at your site? Please mark all that apply. | Weekly | | Bi-weekly | X | Monthly | | Quarterly | | Bi-annually | | Informally | | Other | |
7. How often does the L&E team communicate with the Hub Manager at your site? Please mark all that apply. | Weekly | | Bi-weekly | | Monthly | | Quarterly | | Bi-annually | | Informally | | Other | Bi-weekly check-in meetings and throughout as needed on various efforts |
Please indicate your level of agreement with the following four statements. Statement | Strongly disagree | Disagree | Neither agree nor disagree | Agree | Strongly agree | 8. Our L&E team has been engaged in organizational development efforts at our site. | | | | | X | 9. Our site’s evaluation design has the flexibility to adapt to changes in the policy environment and our related work as needed (e.g. benchmarks and indicators can be modified as the project evolves). | | | | |
X | 10. Our site has tools and methods for evaluating the unique and dynamic nature of policy work. | |
X | | | | 11. Our site has regularly updated and/or revisited the original logic model and community action plan. | | | | X | |
12. If your site has developed reports related to learning and evaluation efforts, please list the title of each report below and upload each document to the Learning Document Library at (https://sites.google.com/site/tcelearningevaluation/products-services). Report title | Report uploaded to library? (Y/N) | | | | | | | | |
13. What evaluation tools/assessment tools are currently being administered at your site? Please list all tools that you have used within the last 12 months in the below table and upload each tool to the Learning Document Library at (https://sites.google.com/site/tcelearningevaluation/products-services). Name of tool | Purpose of tool | How were findings used or applied? | Report uploaded to library? (Y/N) | | | | | | | | | | | | | | | | |
14. Please describe how you currently and regularly engage BHC partner agencies/orgs/grantees in evaluation efforts. If you do not, please share barriers to engaging this stakeholder group. | By participating in work group meetings and attending the steering committee/general assembly to engage all members and to provide report backs on any developed materials/reports. |
15. Please describe how you currently and regularly engage residents in evaluation efforts. If you do not, please share barriers to engaging this stakeholder group. | Ongoing communication and feedback to and with all members through various meetings. |
16. Please briefly describe how you may be building evaluation capacity within your site. | Trainings are planned for 2017 to help increase evaluation capacity within the BHC with work groups and organizational partners. Trainings may focus on how to conduct a needs assessment, reviewing and pulling appropriate data for campaign efforts, power analysis, and other topics as will be defined. |
17. What evaluation models or frameworks have been useful for your site? (Example FSG Collective Impact Framework, Community Action Plan) | Evaluation model or framework | How have you used it? | Collective Impact Framework | This has been used to help develop the collective action plan among the three work groups | Socio-ecological model | Used to help identify goals and strategies to influence and impact sustainable change | | | | |
18. What stage is your L&E team at with respect to the following evaluation components? Please mark the box underneath the number that best matches your assessment. | | 1 Forming | 2 | 3 Developing | 4 | 5 Mature | Planning & evaluation design | | | X | | | Implementation of the evaluation design | | | X | | | Using data for learning & continuous improvement | | |
| X | | Sharing out evaluation results with diverse audiences | |
| X | | |
19. Please describe an evaluation-related challenge that your site is currently working to resolve. Please briefly describe the problem, your approach to finding a solution, and any additional resources or expertise that would help your site. | The greatest challenge is enough time to gather data and resources to help support the various efforts within each campaign area. In particular, finding specific information and data on Central Santa Ana - specifically the BHC zone can be challenging. We've been working closely with local evaluators, TCE, the city of Santa Ana (staff in manager's office) and UCI to help support local campaign efforts with local data, to leverage resources through academic partners to provide student support, and thought leadership around campaign efforts. In the past, the Hub and its members have also worked with UCI to help support campaign efforts by conducting BHC zone specific assessments and reports. |
20. Is there anything else you would like to share? | |
|
|
|