Publications

Books & Book Chapters

Bulut, O., & Cui, Y. (2021). Validating the findings of a survey research study. In U. Luhanga & A. G. Harbaugh (Eds.), Basic elements of survey research in education: Addressing the problems your advisor never told you about. Charlotte, NC: Information Age Publishing.

Desjardins, C. D., & Bulut, O. (2018). Handbook of educational measurement and psychometrics using R. Boca Raton, FL: CRC Press.


UPDATE: A review of our book inThe American Statistician: https://www.tandfonline.com/doi/full/10.1080/00031305.2019.1676110

Gierl, M. J., Bulut, O., & Zhang, X. (2018). Using computerized formative testing to support personalized learning in higher education: An application of two assessment technologies. In R. Zheng (Ed.), Digital technologies and instructional design for personalized learning (pp. 99-119). Hershey, PA: IGI Global. doi:10.4018/978-1-5225-3940-7.ch005

Refereed Journal Articles

  • Yildirim-Erbasli, S. N., & Bulut, O. (In press). The impact of students' test-taking effort on growth estimates in low-stakes educational assessments. Educational Research and Evaluation. doi:10.1080/13803611.2021.1977152

  • Bulut, O. (In press). Beyond multiple-choice with digital assessments. eLearn Magazine. doi:10.1145/3472394

  • Gao, Y., Zhai, X., Cui, Y., Xin, T., & Bulut, O. (2021). Re-validating a learning progression of buoyancy for middle school students. Research in Science Education. Advance online publication. doi:10.1007/s11165-021-10021-x

  • Daniels, V., Ortiz, S., Sandhu, G., Lai, H., Yoon, M., Bulut, O., & Hillier, T. (2021). Effect of detailed OSCE score reporting on learning and anxiety in medical school. Journal of Medical Education and Curricular Development, 8, 1-8. doi:10.1177/2382120521992323

  • Shin, J., Chen, F., Lu, C., & Bulut, O. (2021). Analyzing students’ performance in computerized formative assessments to optimize teachers' test administration decisions using deep learning frameworks. Journal of Computers in Education. Advance online publication. doi:10.1007/s40692-021-00196-7 Download

  • Bulut, O., Gorgun, G., & Yildirim-Erbasli, S. N. (2021). Estimating explanatory extensions of dichotomous and polytomous Rasch models: The eirm package in R. Psych, 3(3), 308-321. doi:10.3390/psych3030023 Download

  • Bulut, O., Cormier, D. C., Aquilina, A. M., & Bulut, H. C. (2021). Age and sex invariance of the Woodcock-Johnson IV Tests of Cognitive Abilities: Evidence from psychometric network modeling. Journal of Intelligence, 9(3), 1-16. doi:10.3390/jintelligence9030035 Download

  • Shin, J., & Bulut, O. (2021). Building an intelligent recommendation system for personalized test scheduling: A reinforcement learning approach. Behavior Research Methods. Advance online publication. doi:10.3758/s13428-021-01602-9 Abstract

  • Poth, C., Bulut, O., Aquilina, A., & Otto, S. (2021). Using data mining for rapid complex case study descriptions: Example of public health briefings during the onset of the COVID-19 pandemic. Journal of Mixed Methods Research, 15(3), 348-373. doi:10.1177/15586898211013925 Download

  • Bulut, O., & Kennedy, K. E. (2021). Measuring and understanding public awareness of fetal alcohol spectrum disorders in Alberta, Canada. Journal of Public Health. Advance online publication. doi:10.1007/s10389-021-01550-w Abstract

  • Bulut, H. C., & Bulut, O. (2021). K. Sijtsma and A. L. Van Der Ark: A review of "Measurement Models for Psychological Attributes". Psychometrika, 86(2), 514-517. doi: 10.1007/s11336-021-09758-1 Download

  • Butterfuss, R., Kendeou, P., McMaster, K. L., Orcutt, E., & Bulut, O. (2021). Question timing, language comprehension, and executive function in inferencing. Scientific Studies of Reading. Advance online publication. doi:10.1080/10888438.2021.1901903 Abstract

  • Bulut, O., & Kim, D. (2021). The use of data imputation when investigating dimensionality in sparse data from computerized adaptive tests. Journal of Applied Testing Technology, 22(2), 1-13. Download

  • Gorgun, G., & Bulut, O. (2021). A polytomous scoring approach to handle not-reached items in low-stakes assessments. Educational and Psychological Measurement. Advance online publication. doi:10.1177/0013164421991211 Download

  • El Hassar, B., Poth, C., Gokiert, R., & Bulut, O. (2021). Toward an evidence-based approach to building evaluation capacity. The Canadian Journal of Program Evaluation(36)1, 82-94. doi: 10.3138/cjpe.69191 Download

  • Georgiou, G. K., Bulut, O., Dunn, K., Naglieri, J., & Das, J. P. (2021). Examining the relation between PASS cognitive processes and superior reading and mathematics performance. Psychology in the Schools, 58, 252–267. doi:10.1002/pits.22442 Abstract

  • Bulut, O. (2021). Test review of the Young Children’s Achievement Test-Second Edition. In J. F. Carlson, K. F. Geisinger, & J. L. Jonson (Eds.), The twenty-first mental measurements yearbook (pp. 873-878). Lincoln, NE: Buros Center for Testing.

  • Brown, G. T. L., Alqassab, M., Bulut, O., & Xiao, J. (2020). Item impact as the source of differential item functioning in small samples: Evaluation with MIMIC-PA and MIMIC-interaction approaches. Psychological Test and Assessment Modeling, 65(4), 429-448. Download

  • Bulut, O., Cutumisu, M., Singh, D., & Aquilina, A. M. (2020). Guidelines for generating effective feedback from e-assessments. Hacettepe University Journal of Education, 35(Special Issue), 60-72. doi:10.16986/HUJE.2020063705 Download

  • Bulut, O., Cormier, D. C., & Shin, J. (2020). An intelligent recommender system for personalized test administration scheduling with computerized formative assessments. Frontiers in Education, 5, 1-11. doi: 10.3389/feduc.2020.572612 Download

  • Violato, E., King, S., & Bulut, O. (2020). A multi-method exploratory study of health professional students’ experiences with compliance behaviours. BMC Medical Education, 20(359), 1-10. doi:10.21203/rs.3.rs-37019/v3 Download

  • Flanagan, A., Cormier, D. C., & Bulut, O. (2020). Achievement may be rooted in teacher expectations: Examining the differential influences of ethnicity, years of teaching, and classroom behaviour. Social Psychology of Education, 23(6), 1429-1448. doi: 10.1007/s11218-020-09590-y Download

  • St-Amand, J., Bowen, F., Bulut, O., Cormier, D., Janosz, M., & Girard, S. (2020). Le sentiment d’appartenance à l’école: Validation d’un modèle théorique prédisant l’engagement et le rendement en mathématiques d’élèves du secondaire. Teachers & Teaching: International Journal in Education, 28(2), 89-105. doi: 10.18162/fp.2020.530 Download

  • Kendeou, P., McMaster, K., Butterfuss, R., Kim, J., Slater, S., & Bulut, O. (2020). Development and validation of the Minnesota Inference Assessment. Assessment for Effective Intervention. Advance online publication. doi: 10.1177/1534508420937781 Abstract

  • Shin, J., Bulut, O., & Gierl, M. J. (2020). Development practices of trusted AI systems among Canadian data scientists. International Review for Information Ethics, 28, 1-10. Download

  • Bulut, O., Xiao, J., Rodriguez, M. C., & Gorgun, G. (2020). An empirical investigation of factors contributing to item nonresponse in self-reported bullying instruments. Journal of School Violence, 19(4), 539-552. doi: 10.1080/15388220.2020.1770603 Abstract

  • Desjardins, C. D., & Bulut, O. (2020). profileR: An R package for profile analysis. The Journal of Open Source Software, 5(47), 1941. doi: 10.21105/joss.01941 Download

  • Xiao, J., & Bulut, O. (2020). Evaluating the performances of missing data handling methods in ability estimation from sparse data. Educational and Psychological Measurement, 80(5), 932-954. doi: 10.1177/0013164420911136 Abstract

  • Bulut, O., & Desjardins, C. D. (2020). Profile analysis of multivariate data: A brief introduction to the profileR package. Retrieved from psyarxiv.com/sgy8m. doi: 10.31234/osf.io/sgy8m Download

  • Liou, P.-Y., & Bulut, O. (2020). The effects of item format and cognitive domain on students’ science performance in TIMSS 2011. Research in Science Education, 50(1), 99-121. doi: 10.1007/s11165-017-9682-7 Abstract

  • Shin, J., Bulut, O., & Gierl, M. J. (2020). The effect of the most-attractive-distractor location on multiple-choice item difficulty. Journal of Experimental Education, 88(4), 643-659. doi:10.1080/00220973.2019.1629577 Abstract

  • Bulut, O., & Yavuz, H. C. (2019). Educational data mining: A tutorial for the rattle package in R. International Journal of Assessment Tools in Education, 6(5), 20-36. doi: 10.21449/ijate.627361 Download

  • Daniels, L. M., & Bulut, O. (2019). Students’ perceived usefulness of computerized percentage-only vs. descriptive score reports: Associations with motivation and grades. Journal of Computer Assisted Learning, 36(2), 199-208. doi: 10.1111/jcal.12398 Abstract

  • Bulut, O., Cutumisu, M., Aquilina, A. M., & Singh, D. (2019). Effects of digital score reporting and feedback on students’ learning in higher education. Frontiers in Education, 4(65), 1-16. doi: 10.3389/feduc.2019.00065 Download

  • Chen, F., Yang, H., Bulut, O., Cui, Y., & Xin, T. (2019). Examining the relation of personality factors to substance use disorder by explanatory item response modeling of DSM-5 symptoms. PLoS ONE,14(6), 1-17. Download

  • Stanke, L., & Bulut, O. (2019). Explanatory item response models for polytomous item responses. International Journal of Assessment Tools in Education, 6(2), 259–278. doi: 10.21449/ijate.515085 Download

  • Celik, H., & Bulut, O. (2019). Examining Turkish adults’ recalled experiences of their father’s presence. Journal of Family Issues, 40(9), 1224–1251. doi: 10.1177/0192513X19835879 Abstract

  • Cormier, D. C., Van Norman, E. R., Cheong, C., Kennedy, K. E., Bulut, O., & Mrazik, M. (2019). Mastering standardized cognitive assessment scoring procedures: How much is enough? Canadian Journal of School Psychology, 34(3), 215-233. doi: 10.1177/0829573518765010 Abstract

  • Kan, A., Bulut, O., & Cormier, D. C. (2018). The impact of item stem format on the dimensional structure of mathematics assessments. Educational Assessment, 24(1), 13-32. doi: 10.1080/10627197.2018.1545569 Abstract

  • Korukcu, O., Bulut, O., & Kukulu, K. (2018). From experiences to expectations: A quantitative study on the fear of childbirth among multigravida women. Archives of Psychiatric Nursing. Advanced online publication. doi: 10.1016/j.apnu.2018.11.002 Abstract

  • Arce-Ferrer, A. J., & Bulut, O. (2018). Effects of data collection designs in the comparison of computer-based and paper-based tests. The Journal of Experimental Education, 87(4), 661-679. doi: 10.1080/00220973.2018.1507986 Abstract

  • Bulut, O., & Cormier, D. C. (2018). Validity evidence for progress monitoring with Star Reading: Slope estimates, administration frequency, and number of data points. Frontiers in Education, 3(68), 1-12. doi: 10.3389/feduc.2018.00068 Download

  • Liu, R., Huggins-Manley, A. C., & Bulut, O. (2018). Retrofitting diagnostic classification models to responses from IRT-based assessment forms. Educational and Psychological Measurement, 78(3), 357-383. doi: 10.1177/0013164416685599 Abstract

  • McCabe, E., Gross, D. P., & Bulut, O. (2018). Procedures to develop a computerized adaptive test to assess patient-reported physical functioning. Quality of Life Research, 27(9), 2393-2402. doi: 10.1007/s11136-018-1898-0 Abstract

  • Bulut, O., & Cutumisu, M. (2018). When technology does not add up: ICT use negatively predicts mathematics and science achievement for Finnish and Turkish students in PISA 2012. Journal of Educational Multimedia and Hypermedia, 27(1), 25-42. Abstract

  • Bulut, O., Lei, M., & Guo, Q. (2018). Item and testlet position effects in computer-based alternate assessments for students with disabilities. International Journal of Research & Method in Education, 41(2), 169-183. doi: 10.1080/1743727X.2016.1262341 Abstract

  • Cormier, D. C., Bulut, O., Singh, D., Kennedy, K. E., Wang, K., Heudes, A., & Lewka, A. J. (2018). A systematic examination of the linguistic demand of cognitive test directions administered to school-age populations. Journal of Psychoeducational Assessment, 36(4), 337-353. doi: 10.1177/0734282916678336 Abstract

  • Cutumisu, M., & Bulut, O. (2017). Problem-solving attitudes and gender as predictors of academic achievement in mathematics and science for Canadian and Finnish students in the PISA 2012 assessment. Journal of Educational Multimedia and Hypermedia, 26(4), 325-342. Abstract

  • Bulut, O., & Suh, Y. (2017). Detecting DIF in multidimensional assessments with the MIMIC model, the IRT likelihood ratio test, and logistic regression. Frontiers in Education, 2(51), 1-14. doi: 10.3389/feduc.2017.00051 Download

  • Bulut, O., & Sünbül, Ö. (2017). Monte Carlo simulation studies in item response theory with the R programming language. Journal of Measurement and Evaluation in Education and Psychology, 8(3), 266-287. doi: 10.21031/epod.305821 Download

  • Cormier, D. C., Bulut, O., McGrew, K. S., & Singh, D. (2017). Exploring the effects of Cattell-Horn-Carroll (CHC) cognitive abilities underlying mathematics achievement. Applied Cognitive Psychology, 31(5), 530-538. doi: 10.1002/acp.3350 Abstract

  • Gierl, M. J., Bulut, O., Guo, Q., & Zhang, X. (2017). Developing, analyzing, and using distractors for multiple-choice tests in education: A comprehensive review. Review of Educational Research, 87(6), 1082-1116. doi: 10.3102/0034654317726529 Abstract

  • Bulut, O., Guo, Q., & Gierl, M. J. (2017). A structural equation modeling approach for examining position effects in large-scale assessments. Large-Scale Assessments in Education, 5(8), 1-20. Download

  • Lee, S., Bulut, O., & Suh, Y. (2017). Multidimensional extension of multiple indicators multiple causes models to detect DIF. Educational and Psychological Measurement, 77(4), 545-569. doi: 10.1177/0013164416651116 Abstract

  • Arce-Ferrer, A. J., & Bulut, O. (2017). Investigating separate and concurrent approaches for item parameter drift in 3PL IRT equating. International Journal of Testing, 17(1), 1-22. doi: 10.1080/15305058.2016.1227825 Abstract

  • Bulut, O., Davison, M. L., & Rodriguez, M. C. (2017). Estimating between-person and within-person subscore reliability with profile analysis. Multivariate Behavioral Research, 52(1), 86-104. doi: 10.1080/00273171.2016.1253452 Abstract

  • Bellibas, M. S., Bulut, O., & Gedikli, S. (2017). Investigating professional learning communities in Turkish schools: The effects of contextual factors. Professional Development in Education, 43(3), 353-374. doi:10.1080/19415257.2016.1182937 Abstract

  • Yaylaci, T., Cicchetti, D., Rogosch, F. A., Bulut, O., & Hetzel, S. R. (2017). The interactive effects of child maltreatment and the FK506 binding protein 5 gene (FKBP5) on dissociative symptoms in adolescence. Development and Psychopathology, 29(3), 1105-1117. doi: 10.1017/S095457941600105X Abstract

  • Cormier, D. C., McGrew, K. S., Bulut, O., & Funamoto, A. (2017). Revisiting the relations between the WJ IV measures of Cattell-Horn-Carroll (CHC) cognitive abilities and reading achievement during the school-age years. Journal of Psychoeducational Assessment, 35(8), 731-754. doi: 10.1177/0734282916659208 Abstract

  • Cormier, D. C., Bulut, O., McGrew, K. S., & Frison, J. (2016). The role of Cattell-Horn-Carroll (CHC) cognitive abilities in predicting writing achievement during the school age years. Psychology in the Schools, 53(8), 787–803. doi: 10.1002/pits.21945 Abstract

  • Van Boekel, M., Bulut, O., Stanke, L., Zamora, J. P. R., Jang, Y., Kang, Y., & Nickodem, K. (2016). Effects of participation in school sports on academic and social functioning. Journal of Applied Developmental Psychology, 46, 31-40. Abstract

  • Latifi, S., Bulut, O., Gierl, M. J., Christie, T., & Jeeva, S. (2016). Differential performance on national exams: Evaluating item and bundle functioning methods using English, mathematics, and science assessments. Sage Open, 6(2), 1-14. Download

  • Korukcu, O., Bulut, O., & Kukulu, K. (2016). Psychometric evaluation of the Wijma Delivery Expectancy/Experience Questionnaire version B. Health Care for Women International, 37(5), 550-567. Abstract

  • Shojaee, M., Bulut, O., & Shahidi, M. (2016). Examining psychometric properties of the Kutcher Adolescent Depression Scale (KADS-11) using multidimensional item response theory. International Journal of Current Research, 8(3), 27120-27131. Download

  • Bellibas, M. S., Bulut, O., Hallinger, P., & Wang, W. C. (2016). Developing a validated instructional leadership profile of Turkish primary school principals. International Journal of Educational Research, 75, 115-133. doi:10.1016/j.ijer.2015.10.002 Abstract

  • Bulut, O. (2015). Applying item response theory models to Entrance Examination for Graduate Studies: Practical issues and insights. Journal of Measurement and Evaluation in Education and Psychology, 6(2), 313-330. Download

  • Bulut, O. (2015). An empirical analysis of gender-based DIF due to test booklet effect. European Journal of Research on Education, 3(1), 7-16. Download

  • Bulut, O., Palma, J., Rodriguez, M. C., & Stanke, L. (2015). Evaluating measurement invariance in the measurement of developmental assets in Latino English language groups across developmental stages. Sage Open, 5(2), 1-18. Download

  • Kan, A., & Bulut, O. (2015). Examining the language factor in mathematics assessments. Journal of Education and Human Development, 4(1), 133-146. Download

  • Kan, A., & Bulut, O. (2014). Crossed random-effect modeling: Examining the effects of teacher experience and rubric use in performance assessments. Eurasian Journal of Educational Research, 57, 1-28. Download

  • Korukcu, O., Bulut, O., Bayram, Z., Tuzcu, A., & Turkmen, H. O. (2014). An adaptation of Leymann Inventory of Psychological Terror to health sciences programs in Turkey. Anatolian Journal of Psychiatry, 15(4), 335-342. Download

  • Kan, A., & Bulut, O. (2014). Examining the relationship between gender DIF and language complexity in mathematics assessments. International Journal of Testing, 14(3), 245-264. Abstract

  • Gumus, S., Bulut, O., & Bellibas, M. S. (2013). The relationship between principal leadership and teacher collaboration in Turkish primary schools: A multilevel analysis. Education Research and Perspectives, 40, 1-29. Download

  • Bulut, O., & Kan, A. (2012). Application of computerized adaptive testing to Entrance Examination for Graduate Studies in Turkey. Eurasian Journal of Educational Research, 49, 61-80. Download

  • Bulut, O., Delen, E., & Kaya, F. (2012). An SEM model based on PISA 2009 in Turkey: How does the use of technology and self-regulation activities predict reading scores? Procedia - Social and Behavioral Sciences, 64, 564-573. Download

  • Kaya, F., Delen, E., & Bulut, O. (2012). Test Review: Shipley-2 Manual. Journal of Psychoeducational Assessment, 30(6), 593-597. Download

  • Delen, E., & Bulut, O. (2011). The relationship between students’ exposure to technology and their achievement in science and math. TOJET: The Turkish Online Journal of Educational Technology, 10(3), 311-317. Download

Conference Proceedings

  • Bulut, O., & Cutumisu, M. (2017). When technology does not add up: ICT use negatively predicts mathematics and science achievement for Finnish and Turkish students in PISA 2012. In J. Johnston (Ed.), Proceedings of EdMedia: World Conference on Educational Media and Technology 2017 (pp. 935-945). Waynesville, NC: Association for the Advancement of Computing in Education (AACE). Download

  • Cutumisu, M., & Bulut, O. (2017). Problem-solving attitudes and gender as predictors of academic achievement in mathematics and science for Canadian and Finnish students in the PISA 2012 assessment. In J. Johnston (Ed.), Proceedings of EdMedia: World Conference on Educational Media and Technology 2017 (pp. 728-738). Waynesville, NC: Association for the Advancement of Computing in Education (AACE). Download

  • Delen, E., & Bulut, O. (2011). The relationship between students' exposure to technology and their achievement in science and math. Proceedings of the International Educational Technology Conference (IETC) 2011 (pp. 1171-1176). Sakarya, Turkey.

Manuscripts Under Review

  • Bulut, O., & Poth, C. N. (Under review). Toward rapid assessment of communication consistency: Exploring the usefulness of sentiment analysis on public health briefings during the COVID-19 pandemic. Manuscript submitted for publication.

  • Bulut, O., & Yavuz, H. C., Ilgun Dibek, M., & Sahin Kursad, M. (Under review). The effects of providing students with disabilities with revision opportunities in alternate assessments. Manuscript submitted for publication.

  • Rinaldi, C. M., Bulut, O., Muth, T., & Di Stasio, M. (Under review). The Influence of parenting dimensions and junior high school students' involvement in bullying. Manuscript submitted for publication.

  • Xiao, J., & Bulut, O. (Under review). Item selection with collaborative filtering in on-the-fly multistage adaptive testing. Manuscript submitted for publication.

  • Gao, Y., Zhai, X., Bulut, O., & Cui, Y. (Under review). Understanding problem-solving styles in technology-rich environments: An application of log data analysis. Manuscript submitted for publication.

  • Gao, Y., Cui, Y. Bulut, O., & Zhai, X. (Under review). Diagnosing adults' web navigation strategies: Differences between information-locating and information-evaluating tasks. Manuscript submitted for publication.

  • Bulut, H. C., Arikan, S., & Bulut, O. (Under review). Gender and language differences in online reading comprehension: Item properties matter. Manuscript submitted for publication.

  • Kilmen, S., & Bulut, O. (Under review). Group differences in the Emotion Regulation During Test-Taking Scale: An item response theory approach. Manuscript submitted for publication.

  • Hachem, M., Gorgun, G., Chu, M-W., & Bulut, O. (Under review). Social and emotional variables as predictors of students’ perceived cognitive competence and academic performance. Manuscript submitted for publication.

  • Violato, E., King, S., & Bulut, O. (Under review). Conformity, obedience, and the better than average effect in health professional students. Manuscript submitted for publication.

  • McGarvey, L., Bulut, O., & Guo, Q. (Under review). Predictors of mathematics performance: A large-scale longitudinal comparison of pre- and post-2007 cohorts in Alberta. Manuscript submitted for publication.

  • Lu, C., & Bulut, O. (Under review). The impact of cultural orientation on students’ attitudes towards collaborative problem solving: An explanatory item response modeling approach. Manuscript submitted for publication.

  • Lu, C., Bulut, O., Demmans Epp, C., & Gierl, M. J. (Under review). Examining the impact of LMS usage on short-term and long-term academic outcomes. Manuscript submitted for publication.

  • Bulut, H. C., & Bulut, O. (Under review). Item wording effects and reading achievement: Does removing careless respondents help? Manuscript submitted for publication.

  • Yildirim-Erbasli, S. N., & Bulut, O. (Under review). Designing predictive models for early prediction of students’ test-taking engagement in computerized formative assessments. Manuscript submitted for publication.

  • Firoozi, T., Shin, J., Bulut, O., & Gierl, M. J. (Under review). The effect of option similarity on the Item difficulty of a reading comprehension test: An application of word embedding techniques. Manuscript submitted for publication.

  • Yildirim-Erbasli, S. N., & Bulut, O. (Under review). Real-time assessment and feedback with conversation-based assessments. Manuscript submitted for publication.

  • Tilstra, M., Tiwari, I., Niwa, L., Campbell, S., Nielson, C., Jones, A., Osornio Vargas, A., Bulut, O., Quemerais, B., Salma, J., Whitfield, K., & Yamamoto, S. (Under review). Risk and resilience: How is the health of older adults and immigrant people living in Canada impacted by climate- and air pollution-related exposures? Manuscript submitted for publication.

  • Cormier, D. C., Bulut, O., McGrew, K. S., & Kennedy, K. (Under review). Linguistic influences on cognitive test performance: Examinee characteristics are more important than test characteristics. Manuscript submitted for publication.