The administrative services preparation program sponsor has an effective system by which the candidate’s performance is guided, assisted, and evaluated in each field experience. In this system, at least one field/clinical supervisor and at least one program supervisor provide complete, accurate, and timely feedback to the candidate, including constructive suggestions for improvement.
The institution identifies individual program staff responsible for:
1) implementing the CalAPA, and
2) documenting the administration processes for all CalAPA activities/cycles.
The program requires all faculty and staff providing instructional and/or supervisory services to candidates within the program to become knowledgeable about:
1) the CalAPA cycles, rubrics, and scoring, and
2) how the CalAPA is implemented within the program, so that they can appropriately prepare candidates for the assessment and also use CalAPA data for program improvement purposes.
8A: Administration of the California Administrator Performance Assessment (CalAPA)
Video
For purposes of implementing any video requirement, candidates must be able to record interactions with faculty, staff, and PK-12 students.
The program assures that each school or district where the candidate is completing fieldwork has a media release for all who are videotaped on file.
The program requires candidates to affirm that the candidate has followed all applicable video policies for any CalAPA task requiring a video, and maintains records of this affirmation for a full Accreditation cycle.
Materials and Data
The program assures that candidates understand the appropriate use of materials submitted as part of their CalAPA responses, the appropriate use of their individual performance data, and privacy considerations relating to the use of candidate data.
The program maintains program level and candidate level CalAPA data, including individual and aggregate results of candidate performance over time, and retains the data for one Accreditation cycle. The program documents the use of these data for Commission reporting, accreditation, and program improvement purposes.
Retake Appeal Process
All programs have a clearly defined written appeal policy regarding CalAPA retakes and informs candidates about the policy prior to enrollment in the program.
Local Scoring Option
The program may choose to have their candidate’s submission scored by their own calibrated faculty through the CalAPA centralized scoring structure.
lf the program participates in the CalAPA local scoring option, the program coordinates with the assessment developer to identify the local assessors who train and calibrate, who may then score CalAPA submissions from the program’s candidates.
8B: Candidate Preparation and Support
The administrator preparation program assures that each candidate receives clear and accurate information about the nature of the tasks within the CalAPA and the passing score standard for the assessment. The program provides multiple formative opportunities for candidates to prepare for the CalAPA activities/cycles. The program assures that candidates understand that all responses to the CalAPA submitted for scoring must represent the candidate’s own work. For candidates who are not successful on the assessment, the program provides appropriate remediation support and guidance on resubmitting cycle components to the assessment developer.
(1) The program implements as indicated below the following support activities for candidates.
These activities constitute required forms of support for candidates within the CalAPA process:
Providing candidates with access to assessment guides and other explanatory materials about the CalAPA and expectations for candidate performance on the assessment.
Explaining CalAPA cycles and scoring rubrics.
Engaging candidates in formative experiences aligned with the CalAPA (e.g., analyzing data, facilitating collaborative professional learning, and coaching for improved instruction).
Providing candidates who are not successful on the assessment with additional support focusing on understanding the cycle(s) and rubric(s) on which the candidate was not successful as well as on understanding what needs to be resubmitted for scoring and the process for resubmitting responses for scoring.
These activities constitute acceptable, but not required forms of support for candidates within the CalAPA process:
Guiding discussions about the CalAPA cycles and scoring rubrics.
Providing support documents such as advice on making good choices about what to use within the assessment responses.
Using CalAPA scoring rubrics on assignments outside of the ones the candidate will submit for scoring.
Asking probing questions about the candidate’s draft CalAPA responses, without providing direct edits or specific suggestions about the candidate’s work.
Assisting the candidate in understanding how to use the program’s electronic platform in connection with the assessment platform.
Arranging technical assistance for any video portion of the assessment.
These activities constitute unacceptable forms of support for candidates within the CalAPA process:
Editing a candidate’s official materials prior to submission and/or prior to resubmission (for candidates who are unsuccessful on the assessment).
Providing specific critique of the candidate’s responses that indicates alternative responses, prior to submission for official scoring and/or prior to resubmission (for candidates who are unsuccessful on the assessment).
Telling a candidate which video clips to select for submission.
Uploading candidate CalAPA responses (written responses or video entries) on public access websites, including social media.
(2) The program provides candidates with timely feedback on formative assessments and experiences in preparation for the CalAPA. The feedback includes information relative to the candidate’s demonstration of competency on the domains of the California Administrator Performance Expectations (CAPE).
(3) The program provides opportunities for candidates who are not successful on the assessment to receive remedial assistance, to prepare them to retake the assessment. The program recommends only candidates who have met the passing score on the CalAPA for a preliminary administrative services credential and have met all credential requirements.
8C: Assessor Qualifications, Training, and Scoring Reliability
The preliminary programs identify potential assessors for the CalAPA centralized scoring option who are then trained, and when calibrated, selected by the Commission’s assessment developer to participate in scoring the CalAPA. For programs electing to use the CalAPA local scoring option, the program identifies potential assessors based on selection criteria established by the assessment developer. The assessment developer is responsible for training, calibration and scoring reliability for all assessors in both local and centralized scoring options. All potential assessors must pass the assessment developer’s initial training and calibration prior to scoring and must remain calibrated throughout the scoring process.