Quick Links:
All teachers participating in the CSAwesome research project or program evaluation project should watch this webinar (left) to learn more about how to meet requirements and how to submit data.
Research Participants: Start at 0:00 - End X:YZ
Program Evaluation: Start at X:YZ - End X:YZ
During the PD, the research team and PD Facilitator will work with teachers to collect and submit data. Teachers do NOT need to contact CSAwesome to inform them requirements have been met.
The CSAwesome Project collects the following data:
DURING THE PD
Pre-PD survey -- Qualtrics survey link sent directly to teachers via email
Pre-test -- Built into the Runestone course
Post-PD survey -- Qualtrics survey link sent directly to teachers via email
Post-test -- Built into the Runestone course
Teachers do NOT need to contact CSAwesome to inform them requirements have been met. This information will be collected and verified by the research team and PD Facilitators.
PD Certificate of Completion Requirements:
Attend a minimum number of synchronous meetings each week
Complete a minimum number of unit lesson reflections (minimum 1 per week)
Complete a minimum of Runestone programming challenges and reading assignments per week (minimum of 1 per week)
Receive a total average of 80% on the Runestone programming challenges and reading assignments
Complete pretest - no minimum score required
Complete posttest - no minimum score required
PD requirements will be assigned and verified by PD Facilitators.
DURING THE ACADEMIC YEAR
Teacher End of Course survey -- Issued during the academic year after the course has ended, Qualtrics link sent directly to the teacher via email
Optional: If sampled, teachers may have an opportunity to participate in interview(s) during the PD and academic year. Teachers will receive an additional $50.00 incentive for each interview completed.
Teachers do NOT need to contact CSAwesome to inform them requirements have been met. This information will be collected and verified by the research team.
Submit teacher data -- pre-survey, post-survey, pre-test, post-test, end of course survey (completed after academic year course has ended)
Receive PD certificate of completion -- attend a minimum number of meetings, complete a minimum number of unit lesson reflections, complete and receive a minimum score on Runestone programming assignments
Optional teacher interviews -- Additional stipends will be awarded if teacher is sampled and participates
Student data will be collected and shared with the CSAwesome Team via the Student Information spreadsheet (more information in the next section).
Note: Teachers will also be asked to complete a Teacher End of Course survey. The survey is issued during the academic year after the course has ended. A Qualtrics link will be sent directly to the teacher via email by the research team.
Permission Forms - Click to Show More
Distributed by the teacher either electronically or hardcopy. Learn more here (link).
If issued electronically, the teacher distributes and the CSAwesome research team validates in teacher SIS.
If issued via hardcopy, the teacher distributes, collects, and validates in their SIS.
Pre Survey - Click to Show More
Built into Runestone course. Assigned by the teacher. Exported with Runestone logfile. Teachers should plan to follow-up with those students that do not complete and send reminders as needed.
Pre- and Post-Test - Click to Show More
The pre- and post-tests are built into the Runestone course but need to be activated and assigned by the teacher. The teacher shares score with the research team via their assigned SIS.
How to Set-up Pre and Post-test in Runestone
Instruction Video Here (link):
1.) Log into Runestone and access the custom course your students use
2.) Navigate to Instructors page
3.) Under Assignment create the pre- or post-test
4.) Click Problems and find the established pre- or post-test under the correct course units
5.) Click Save
How to Collect Student’s Grades for the Pre and Post-test in Runestone
Instruction Video Here (link) - Start at 2:03:
1.) Log into Runestone and access the course your students use
2.) Navigate to the Instructors page
3.) Under Grading, choose pre- and/or post-test as an assignment
4.) Un-check the deadline (“work submitted before” box)
5.) Click Autograde and Display Totals button
6.) Navigate to Admin or Student Progress tabs and click Gradebook
7.) Filter by assignment (pre- or post-test)
8.) Add student’s grade to your Student Information Spreadsheet
Student End of Course Survey - Click to Show More
The survey link and individual student tokens are shared with the teacher by the research team via the SIS. The teacher is responsible for distributing to students and the CSAwesome research team validates who has and has not completed. Student end of course surveys should be issued to the students within the last 1-2 weeks of your course. Please be sure to issue these surveys before the course has ended.
Learn how to distribute to students here: Surveys & Tests (link)
Runestone Logfile - Click to Show More
The Runestone Logfile is downloaded by the teacher after the course has ended and is shared with the research team.
How to Download Runestone Logfile
1.) Login to your custom course on Runestone
2.) Click on the Person Icon to go to the Instructor's Page
3.) Click on the Download Log button
4.) Save the csv file on your computer
5.) Upload the downloaded document to your research folder or email the file directly to research@csawesome.org
AP CSA Score - Click to Show More
If you already have a College Board professional account:
Go to scores.collegeboard.org and log in
To be able to access score reports at scores.collegeboard.org, teachers need to have done the audit and have a College Board professional account. Typically, this is completed at the beginning of the academic year.
Access your AP CSA class scores
Share scores in your assigned SIS
If you do not have or do not know if you have a College Board professional account:
Review College Board: How to Access Score Reports for Educators (link)
Follow the steps above
If you need additional help, there are resources here: Instructions & Tips (link)
The "Gradebook" refers to the Google Drive folder that has been assigned to you. The Gradebook contains your Student Information spreadsheet.
The "Student Information Spreadsheet" or SIS is the Google Sheet that is shared only with you and the CSAwesome research team. This is where you will share student assignment information and access survey tokens for students.
CSAwesome will create an SIS spreadsheet for you and will share it once available.
The links below are only accessible to the individual teacher and the research team. We will NOT grant access to any other class folders. You will only be able to see your Gradebook and SIS. Do NOT change the Sharing settings on your folder.
Having difficulty accessing your Gradebook? Contact csawesome@css.edu
We will share the SIS with you and you will add student data throughout the academic year.
Review the short video here (link) to learn what the Student Information Spreadsheet (SIS) is and how teachers can share research data with the research team.
To edit, make sure that you are logged into an email account that has access.
Instructor Resources Tab/Sheet
When you first access your SIS you will see an "Instructor Resources" tab/sheet. This includes information about how to get started and external links to access additional information about requirements.
Section 1 Tab/Sheet
The "Section 1" tab/sheet, and any additional section tabs you may create, is where you will upload and share student data. You should add your class list as soon as possible. We need student's first and last names on file to link to permission forms, the data you upload, and to create tokens for our survey.
Note: This tab/sheet also asks for you to enter your Runestone Class Name and to collect your students' Runestone username.