Co-led all the psychometric operations for the PISA 2022 survey with Dr. Fred Robin (ETS) and Dr. Peter van Rijn (ETS Global)
Being agile to responding to COVID-19 outbreak across countries
Improving the multistage adaptive testing designs for Mathematics domain
Studying background questionnaire innovation
Co-led all the psychometric operations for the PISA 2018 survey
Introduced multistage adaptive testing design for Reading domain through simulation studies with Dr. Kentaro Yamamoto (ETS)
Operationalized machine-supported coding system for scoring constructed response items in PISA with Dr. Kentaro Yamamoto (ETS)
Led the "Item Response Theory and Population Modeling in Large-scale Assessments" Workshop for PISA National Project Managers with Dr. Eugenio Gonzalez (ETS)
Took an increasingly prominent role since the PISA 2015 survey
Transition to the computer-based assessments led by Prof. Matthias von Davier (Boston College) and Dr. Kentaro Yamamoto (ETS)
As a junior staff, contributed to writing technical reports
Close collaboration with all ETS teams involved (leadership, content and platform developers; psychometricians and data analysts)
Close collaboration with WESTAT (USA), DIPF (Germany), ACT (USA), OECD (France), and participating countries and economies
Development of the assessment designs for Field Trial and Main Survey
Development of the analysis plans for Field Trial and Main Survey
Development and implementation of machine-supported coding system (MSCS)
Review and approval of data yield, human scoring reliability, data quality, classical item analyses, and student and item timing statistics
Implementation, review, and approval of Item Response Theory (IRT)-based scaling
Participate in the instrument development by responding to inquiries from countries and the OECD as well as content experts
Development, extensive review, and approval of plausible value generation (i.e., population modeling or IRT-LRM) responding to design innovations
Preparation, review, and finalization of all relevant documentations and communication with the OECD including
Writing technical reports and technical memos (appendix)
Providing IRT scaling and population modeling training sessions
Presentations at the Technical Advisory Group (TAG) meetings
Presentations at the Subject Matter Expert Group (SMEG) meetings
Preparation for the National Project Managers (NPM) meetings
Preparation for the Program Governing Board (PGB) meetings