Formative and Summative Evaluation

There are three main components of the Transformational Change Project (TCP): Practice Curriculum, Leadership Development, and Performance Process. The Transformational Change Leadership Team (TCLT) developed five data collection instruments to measure the progress of the TCP. The data collection instruments were designed so they could be used beyond the TCP. The Exit Interview and Focus Group are for the Practice Curriculum. The Pre-Post Interview and Instructor Preparedness Questionnaire are for the Leadership Development program. The Post-Performance Survey is for the Performance Process.

Some of the data collection instruments were designed to be implemented when specific criteria were met. For example, we have not collected data with the Exit Interview since it can only be used if someone leaves and agrees to participate in an Exit Interview. Data were collected from two of the five instruments that were developed (Focus Group and Post-Performance Survey). In order to provide a better representation of the progress of the TCP, field observations notes were included in the analysis of data and were used to support conclusions and recommendations.

Analysis of Post-Performance Survey

The data that has been collected thus far indicates positive results, but more data is needed to gain a better understanding of the views of external stakeholders. Additionally, there is no baseline data to compare the current data to since this is the first time PASACAT has collected formal feedback from clients.

Analysis of Focus Group

One of the major themes of the focus group was the enthusiasm for the changes occurring not only in the curriculum but other aspects of PASACAT. Members were excited to see an entirely new Board of Directors get elected and more children join the Junior company. TCLT members reported that membership felt that PASACAT was moving in a positive direction. Members were hesitant about giving critiques on the curriculum, but one person did state that they would like to see more variety in the dances and music they learn. Most of the performance pieces we practice are the theatrical dances that are frequently requested by clients. Although it is essential to have a mastery of the dances that support the income for the company, members would also like to practice other dances that clients do not typically request.