Vitae
EDUCATION
Ph.D. in Psychometrics and Quantitative Psychology, Fordham University, February 2016
M.A. in Psychometrics and Quantitative Psychology, Fordham University, August 2014
M.A. in Cognitive Psychology, Hebrew University of Jerusalem, June 1995
B.Sc. (Bachelor of Science) in Mathematics and Psychology, Hebrew University of Jerusalem,
-Additional minor is philosophy of science, June 1992
DISSERTATION
Title “Self-Adapted Test as Formative Assessment: Effects of Feedback and Scoring on Engagement and Performance”
Advisor Dr. David Budescu, Fordham University
Committee Dr. Charlie Lewis, Fordham University and Educational Testing Service
Dr. Ying Liu, Dr. Barry Rosenfeld, & Dr. Chaitra Nagaraja, Fordham University
Dr. Isaac Bejar, Educational Testing Service
AREAS OF SPECIALIZATIONS
Large-scale assessment and accountability systems
Formative assessment and diagnostic models
Self-Adapted Testing
Learning Progressions in Mathematics
Validity and Evidence-Centered-Design
Cognitive Labs
Reward Systems
RESEARCH EXPERIENCE
Chief Psychometrician & Director of Research 09/2019 – present
The Center for Educational Technology (CET), Tel-Aviv, Israel
Leading the psychometrics team
Adaptive Learning Specialist/Researcher 05/2017 – 09/2019
ACTNext, by ACT, Inc., Iowa City, Iowa
Leading a project to develop an adaptive learning and assessment system for science literacy and inquiry skills
Senior Research Associate 02/2011 – 03/2015
Educational Testing Service (ETS), Princeton, NJ
Led projects around development of innovative simulation-based assessment; examine the effect of scaffolding within a simulation
Led a project around developing an innovative scoring method (concept-based categorical scoring) based on learning progressions
Co-led and collaborate on a project funded by IES to develop cognitively-based mathematics assessment for the middle-school grades (based on learning progressions)
Developed learning progressions in mathematics aligned to the Common Core State Standards (CCSS), around core mathematics concepts (linear function, equality and variable, proportional reasoning, rational numbers) in collaboration with content experts
Provided support to item development of various projects and programs (e.g., IARPA, PIACC, Praxis)
Started as Senior Research Assistant (02/2011), was promoted to Research Associate (09/2011), and later to Senior Research Associate (09/2014)
Manager of Research and Development Projects 03/2009 – 06/2010
Center for Educational Technology (CET), Tel-Aviv, Israel
Led the development of an innovative diagnostic language assessment for middle school students
Designed and managed research projects to support and improve existing programs
Provided psychometric support to the large-scale accountability testing (similar to the NAEP program in the US); produced item-analysis reports based on classical test theory; provided feedback and guidance to item writers; arranged and facilitated expert panels around establishing content validation for the tests; arranged and facilitated standard setting meetings using Item-response model for item difficulty; wrote and reviewed technical and research reports involving psychometric analyses, test reliability and validity; led and presented results to internal and external committees, etc.
Started as Psychometrics Specialist and was promoted to Manager of R&D projects within the psychometric group (12/2009)
Research Consultant 01/2000 – 06/2008
Self-employed, Jerusalem, Israel
Provided guidance, data analysis, and report to various agencies, including but not limited to
Research studies of math literacy among Ethiopian immigrants for the Brookdale Institute
An evaluation study of a pre-school math intervention for the Israeli Education Ministry in collaboration with Harvard University (Digi-block program, by prof. Elon Kohlberg)
Survey of student satisfactory at the pre-academic programs in all the colleges in Israel, for the Governing Board of Education (The “Second Chance Project”)
Development of an Emergent-Literacy tool (in Hebrew and Arabic) for pre-school children for the Israeli Education Ministry
Research Scientist 08/1990 – 12/1999
National Institute for Testing and Evaluation (NITE), Jerusalem, Israel
Conducted research studies around the validity of the large-scale admission test for universities in Israel – the Psychometric Entrance Test (PET)
Led and managed the examinee’s satisfaction survey; designed the survey, analyzed the data, and wrote periodic reports
Design and conducted extensive evaluation study of preparatory programs for higher education
Lead of Essay Rating program, including leading the training and calibration process, as well as overseeing and managing the rating procedure and data analysis
Served as a consultant for outside agencies, including the Israeli Health Ministry
Served as a consultant for the creation of new assessments (e.g., admission exam to graduate school in psychology)
Member of the team who developed the quantitative section of the Psychometric Entrance Exam; wrote math items and constructed the full math test based on item analysis
Started as an item writer (08/1990), was promoted to Lead of Essay Rating (04/1992), and later promoted to research scientist (01/1994), while continuing to lead the essay rating program
Research Assistant 10/1993 – 06/1995
Hebrew University of Jerusalem, Jerusalem, Israel
Participated as RA in studies in decision making, specifically wishful thinking and cognitive biases with Prof. M. Bar-Hillel, as part of cognitive internship
Conducted research study on concept of randomness with Prof. R. Falk
Conducted research study on emergent literacy and early math concepts of kindergarten children with Prof. E. Teubal
Participated as reviewer and assistant to various studies of language and thinking with Prof. I.M. Schlesinger
RESEACH METHODS AND PROCEDURES
Classical Test Theory and Item Response Theory; Univariate and multivariate statistics (including, but not limited to, ANOVA/MANOVA, multiple linear regression, PCA, EFA/CFA, logistic regression, log-linear transformations, SEM, hierarchical linear modeling, mixture modeling, correspondence analysis). Experience in working with large datasets and assessment data; Proficient in SAS, SPSS, and R; experience with LISREL, and M+.
TEACHING EXPERIENCE
Lecturer
"Introduction to Psych Statistics w/Lab” for psychology graduate students (Psych 6802)
Fordham University Fall 2016
“Statistics for Psychology” for undergraduate students (Psych2000)
Fordham University 2015-2016
“Evaluation and Measurement of Math Skills and Knowledge”
Haifa University, Israel Fall 2010
“Principles of Learning”
David Yalin Teachers College, Israel 1993-1994
Teaching Assistant / Lab Lecturer
“Statistics for Psychology” for undergraduate students (Psych2000)
Fordham University Fall 2015
“Psychometrics and Tests Theory”
Hebrew University of Jerusalem, Israel 1994-1996
“Statistical Methods in Psychology” (requirement course for year 2 of undergrads)
Hebrew University of Jerusalem, Israel 1993-1995
“Statistical Reasoning in Psychology” (requirement course for year 1 of undergrads)
Hebrew University of Jerusalem, Israel 1992-1993
Teacher
Remedial Mathematics for drop-out high-school students
Ort Community College, Israel 1997-1998
Hebrew for visiting students (part of study abroad program in the Rothberg International School)
Hebrew University of Jerusalem, Israel 1987-1992
Arabic for soldiers
Intelligence Corps, Israeli Defense Forces, Israel 1985-1986
Workshop Leading
“Basic Concepts of Test Theory” (a series of 3 lectures to all the employees of the center)
The Center for Technology in Education, Israel 2009
“Foundations of Test Theory and Background of the National Institute for Testing and Evaluation” (a series of 6-8 lectures for new employees)
National Institute for Testing and Evaluation, Israel 1997-2000
ACADEMIC AWARDS
2015 Travel award to present dissertation at the SMEP conference in Los Angeles, CA
2015 Travel award to present dissertation at the IA-CAT conference in Cambridge, England 2014 The Honor Society of Phi Kappa Phi - Fordham University chapter 2013 The Honor Society of Phi Kappa Phi - Fordham University chapter
1990 Department of psychology Dean Excellence Award Hebrew University of Jerusalem, Israel
GRANT WRITING EXPERIENCE
2014 Proposal to NSF: Designing Tools to Support Equity and Access to Quality Mathematics for Underserved Students (PI- G. Baxter, scope of $3,000,000)
2013 Proposal to IES to conduct a three year study of Teachers’ Response to Learning-Progression Based Evidence in Mathematics - MAThVisN (about $1,500,000).
2012 Proposal to the EU to conduct a three year study of Mathematics Literacy in Early Childhood (about 2,000,000 euro).
ADDITIONAL TRAINING
2013 Cognitive Diagnostic Models – two-day workshop, Maryland University
2012 Mixed Models using M+ Training, ETS
2011 Structural Equation Modeling (SEM) Training, ETS
2011 Nvivo Beginner & Advanced, ETS (2-day training)
PROFESSIONAL ACTIVITIES
Membership:
American Educational Research Association (AERA)
National Council of Measurement in Education (NCME)
Northeastern Educational Research Association (NERA)
Society of Multivariate Experimental Psychology (SMEP)
Israeli Society of Psychometric (ISPA) a.k.a. אפי
Service to the field:
Reviewer EDM conference, 2021
Reviewer ATP standards, 2020
Reviewer ACP journal submission, 2020
Reviewer MBR journal submission, 2020
Reviewer NCME conference, 2019
Reviewer AERA conference, 2019
Reviewer ISPA conference, 2017, 2019, 2020
Reviewer SMEP conference, 2016
Reviewer NERA conference, 2012
Reviewer, ETS Technical Paper Review, 2013
Reviewer, ETS Poster session, 2013
Reviewer, ETS, PEAr series, 2013
