Publications

~2024~

• Lu, C.,  Bulut, O., Epp, Carrie Demmans, & Gierl, M. J. (2024). Impacts of engagement on academic outcomes in technology-enhanced learning. Distance Education. doi:10.1080/01587919.2024.2373297 Abstract

• Bulut, O., Wongvorachan, T., He, S., & Lee, S. (2024). Enhancing high-school dropout identification: A collaborative approach integrating human and machine insights. Discover Education, 3, Article 109. doi:10.1007/s44217-024-00209-4 Download

• Bulut, O., Casabianca, J. M., Slater, S. C., Jiao, H., Song, D., Ormerod, C. M., Fabiyi, D. G., Ivan, R., Walsh, C., Rios, O., Wilson, J., N., S., Wongvorachan, T., Liu, J. X., Tan, B., & Morilova, P. (2024). The rise of artificial intelligence in educational measurement: Opportunities and ethical challenges. ArXiv. doi:10.48550/arXiv.2406.18900 Download

• Tan, B., Armoush, N., Mazzullo, E., Bulut, O., & Gierl, M. J. (2024). A review of automatic item generation techniques leveraging large language models. EdArXiv. doi:10.35542/osf.io/6d8tj Download

• Gorgun, G., & Bulut, O. (2024). Exploring quality criteria and evaluation methods in automated question generation: A comprehensive survey. Education and Information Technologies. Advanced online publication. doi:10.1007/s10639-024-12771-3 Download

• Wongvorachan, T., Bulut, O., Liu, J. X., & Mazzullo, E. (2024). A comparison of bias mitigation techniques for educational classification tasks using supervised machine learning. Information,15(6), 326. doi:10.3390/info15060326 Download

• Sayin, A., & Bulut, O. (2024). The difference between estimated and perceived item difficulty: An empirical study. International Journal of Assessment Tools in Education, 11(2), 368–387 doi:10.21449/ijate.1376160 Download

• Bulut, H. C., Bulut, O., & Clelland, A. (2024). A psychometric network analysis approach for detecting item wording effects in self-report measures across subgroups. Field Methods. Advanced online publication. doi:10.1177/1525822X241247444 Download

• Poth, C., Wongvorachan, T., Bulut, O., & Otto, S. (2024). Adaptive case study-mixed methods design practices for researchers studying complex phenomena. Journal of Mixed Methods Research,18(3), 292-303. doi:10.1177/15586898241250217 Download

• Madland, C., Irvine, V., DeLuca, C., & Bulut, O. (2024). Developing the technology-integrated assessment framework. The Open/Technology in Education, Society, and Scholarship Association Journal, 4(1), 1–19. doi:10.18357/otessaj.2024.4.1.63 Download

• Madland, C., Irvine, V., DeLuca, C., & Bulut, O. (2024). Technology-integrated assessment: A literature review. The Open/Technology in Education, Society, and Scholarship Association Journal, 4(1), 1–48. doi:10.18357/otessaj.2024.4.1.57 Download

• Bulut, O., Gorgun, G., & He, S. (2024). Unsupervised anomaly detection in sequential process data: Insights from PIAAC problem-solving tasks. Zeitschrift für Psychologie, 232(2), 74-94. doi:10.1027/2151-2604/a000558 Abstract

• Liu, J. X., Bulut, O., & Johnson, M. D. (2024). Examining position effects on students’ ability and test-taking speed in the TIMSS 2019 problem solving and inquiry tasks. Psychology International, 6(2), 492-508. doi:10.3390/psycholint6020030 Download

• Bulut, O. (2024). Psycho-educational assessments: Theory and practice. Journal of Intelligence,12(3), 31. doi:10.3390/jintelligence12030031 Download

~2023~

• Bulut, O., & Gorgun, G. (2023). Utilizing response time for scoring the TIMSS 2019 problem solving and inquiry tasks. PsyArXiv. doi:10.31234/osf.io/zc98s Download

• Firoozi, T., Bulut, O., & Gierl, M. J. (2023). Language models in automated essay scoring: Insights for the Turkish language. International Journal of Assessment Tools in Education, 10(Special Issue), 149-163. doi:10.21449/ijate.1394194 Download

• Mazzullo, E., Bulut, O., Wongvorachan, T., & Tan, B. (2023). Learning analytics in the era of large language models. Analytics, 2(4), 877-898. doi:10.3390/analytics2040046 Download

• Bulut, O., Gorgun, G., & Karamese, H. (2023). Incorporating test-taking engagement into multistage adaptive testing design for large-scale assessments. Journal of Educational Measurement. Advanced online publication. doi:10.1111/jedm.12380 Download

• Naeim, M. Y., Bulut, O., & Tan, B. (2023). Predicting reading comprehension performance based on student characteristics and item properties. Studies in Educational Evaluation, 79, 101309. doi:10.1016/j.stueduc.2023.101309 Abstract

• Cankaya, O., Rohatyn-Martin, N., Leach, J., Taylor, K., & Bulut, O. (2023). Preschool children’s loose parts play and the relationship to cognitive development: A review of the literature. Journal of Intelligence, 11(8), 151. doi:10.3390/jintelligence11080151 Download

• Bulut, O., Shin, J., Yildirim-Erbasli, S. N., Gorgun, G., & Pardos, Z. A. (2023). An introduction to Bayesian knowledge tracing with pyBKT. Psych, 5(3), 770-786. doi:10.3390/psych5030050 Download

• Clelland, A., Bulut, O., King, S., & Johnson, M. D. (2023). Examining the associations between personal protective equipment, training, policy, and acute care workers’ psychological distress during the COVID-19 pandemic. Psych, 5(3), 802-813. doi:10.3390/psych5030053 Download

• Gorgun, G., & Bulut, O. (2023). Incorporating test-taking engagement into the item selection algorithm in low-stakes computerized adaptive tests. Large-Scale Assessments in Education, 11, Article 27. doi:10.1186/s40536-023-00177-5 Download

• Archer, E., Bulut, O., Zenisky, A., Grover, R., & Randall, J. (2023). Editorial for online assessment for humans: Advancements, challenges and futures for digital assessment. Frontiers in Education, 8(1230623). doi:10.3389/feduc.2023.1230623 Download

• Yildirim-Erbasli, S. N., Bulut, O., Demmans Epp, C., & Cui, Y. (2023). Conversation-based assessments in education: Design, implementation, and cognitive walkthroughs for usability testing. Journal of Educational Technology Systems, 52(1), 27–51. doi:10.1177/00472395231178943 Download

• Yildirim-Erbasli, S. N., & Bulut, O. (2023). Conversation-based assessment: A novel approach to boosting test-taking effort in digital formative assessment. Computers & Education: Artificial Intelligence, 4, 100135. doi:10.1016/j.caeai.2023.100135 Download

• Bulut, O., Gorgun, G., Wongvorachan, T., & Tan, B. (2023). Rapid guessing in low-stakes assessments: Finding the optimal response time threshold with random search and genetic algorithm. Algorithms, 16(2), 89. doi:10.3390/a16020089 Download

• Kilmen, S., & Bulut, O. (2023). Scale abbreviation with recursive feature elimination and genetic algorithms: An illustration with the test emotions questionnaire. Information,14(2), 63. doi:10.3390/info14020063 Download

• Wongvorachan, T., He, S., & Bulut, O. (2023). A comparison of undersampling, oversampling, and SMOTE methods for dealing with imbalanced classification in educational data mining. Information, 14(1), 54. doi:10.3390/info14010054 Download

• McGrew, K. S., Schneider, W. J., Decker, S. L., & Bulut, O. (2023). A psychometric network analysis of CHC intelligence measures:  Implications for research, theory and interpretation of broad CHC scores "beyond g”. Journal of Intelligence, 11(1), 19. doi:10.3390/jintelligence11010019 Download

• Rinaldi, C. M., Bulut, O., Muth, T., & Di Stasio, M. (2023). The influence of parenting dimensions and junior high school students' involvement in bullying. Journal of School Violence, 22(2), 183-197. doi:10.1080/15388220.2022.2162534 Abstract

• Bulut, O., Gorgun, G., Yildirim-Erbasli, S. N., Wongvorachan, T., Daniels, L. M., Gao, Y., Lai, K. W., & Shin, J. (2023). Standing on the shoulders of giants: Online formative assessments as the foundation for predictive learning analytics models. British Journal of Educational Technology, 54(1), 19-39. doi:10.1111/bjet.13276 Download

• Bulut, O., Bulut, H. C., Cormier, D. C., Ilgun Dibek, M., & Sahin Kursad, M. (2023). The effects of providing students with revision opportunities in alternate assessments. Educational Assessment, (28)1, 48-63. doi:10.1080/10627197.2022.2138322 Abstract

• Bulut, H. C., Bulut, O., & Arikan, S. (2023). Evaluating group differences in online reading comprehension: The impact of item properties. International Journal of Testing, 23(1), 10-33. doi:10.1080/15305058.2022.2044821 Abstract

~2022~

• Bulut, O. (2022). Editorial: Special issue on artificial intelligence, machine learning, and natural language processing applications in education. Journal of Applied Testing Technology, 23(Special Issue 1), 1-3. Download

• Firoozi, T., Bulut, O., Demmans Epp, C., Abadi, A. N., & Barbosa, D. (2022). The effect of fine-tuned word embedding techniques on the accuracy of automated essay scoring systems using neural networks. Journal of Applied Testing Technology, 23(Special Issue 1), 21-29. Download

• Gorgun, G., & Bulut, O. (2022). Identifying aberrant responses in intelligent tutoring systems: An application of anomaly detection methods. Psychological Test and Assessment Modeling, 64(4), 359-384. Download

• Wongvorachan, T., Bulut, O., Tsai, Y.-S., & Lindner, M. A. (2022). Improving student feedback literacy in e-assessments: A framework for the higher education context. Trends in Higher Education, 1(1), 16-29. doi:10.3390/higheredu1010002 Download

• Salma, J., Tilstra, M., Tiwari, I., Nielsen, C., Whitfield, K., Jones, A., Osornio Vargas, A., Bulut, O., & Yamamoto, S. (2022). Listening to older adults’ perspectives on climate change: A focus group study. International Health Trends and Perspectives, 2(3), 1-15. doi:10.32920/ihtp.v2i3.1697 Download

• Bulut, O., & Yildirim-Erbasli, S. N. (2022). Automatic story and item generation for reading comprehension assessments with transformers. International Journal of Assessment Tools in Education, 9(Special Issue), 72-87. doi:10.21449/ijate.1124382 Download

• Wongvorachan, T., Lai, K. W., Bulut, O., Tsai, Y.-S., & Chen, G. (2022). Artificial intelligence: Transforming the future of feedback in education. Journal of Applied Testing Technology, 23(Special Issue 1), 95-116. Download

• Violato, E., Bulut, O., & King, S. (2022). The initial evaluation of a scale for measuring interprofessional perspective taking. Available at http://ssrn.com/abstract=4197308 Download

• Yurekli, H., Yiğit, Ö. E., Bulut, O., Lu, M., & Öz, E. (2022). Exploring factors that affect student well-being during the COVID-19 pandemic: A comparison of data mining approaches. International Journal of Environmental Research and Public Health, 19(18), 11267. doi:10.3390/ijerph191811267 Download

• Hachem, M., Gorgun, G., Chu, M-W., & Bulut, O. (2022). Social and emotional variables as predictors of students’ perceived cognitive competence and academic performance. Canadian Journal of School Psychology, 37(4), 362–384. doi:10.1177/08295735221118474 Download

• Xiao, J., & Bulut, O. (2022). Item selection with collaborative filtering in on-the-fly multistage adaptive testing. Applied Psychological Measurement, 46(8), 690–704. doi:10.1177/01466216221124089 Download

• Bulut, O., Cormier, D. C., & Yildirim-Erbasli, S. N. (2022). Optimized screening for students at-risk in mathematics: A machine learning approach. Information, 13(8), 400. doi:10.3390/info13080400 Download

• Bulut, O., Shin, J., & Cormier, D. C. (2022). Learning analytics and computerized formative assessments: An application of Dijkstra’s shortest path algorithm for personalized test scheduling. Mathematics, 10(13), 2230. doi:10.3390/math10132230 Download

• Bulut, O., & Poth, C. N. (2022). Rapid assessment of communication consistency: Sentiment analysis of public health briefings during the COVID-19 pandemic. AIMS Public Health, 9(2), 293-306. doi:10.3934/publichealth.2022020 Download

• Bulut, O., & Kennedy, K. E. (2022). Measuring and understanding public awareness of fetal alcohol spectrum disorders in Alberta, Canada. Journal of Public Health, 30, 1693–1700. doi:10.1007/s10389-021-01550-w Abstract

• Tilstra, M. H., Nielsen, C. C., Tiwari, I., Jones, C. A., Vargas, A. O., Quemerais, B., Bulut, O., Salma, J., & Yamamoto, S. S. (2022). Exploring socio-environmental effects on community health in Edmonton, Canada to understand older adult and immigrant risk in a changing climate. Urban Climate, 44, 101225. doi:10.1016/j.uclim.2022.101225 Abstract

• Gao, Y., Zhai, X., Bulut, O., Cui, Y., & Sun, X. (2022). Examining humans' problem-solving styles in technology-rich environments using log file data. Journal of Intelligence, 10(3), 38. doi:10.3390/jintelligence10030038 Download

• Ulitzsch, E., Yildirim-Erbasli, S. N., Gorgun, G., & Bulut, O. (2022). An explanatory mixture IRT model for careless and insufficient effort responding in self-report measures. British Journal of Mathematical and Statistical Psychology, 75(3), 668-698. doi:10.1111/bmsp.12272 Download

• Kilmen, S., & Bulut, O. (2022). Group differences in the Emotion Regulation During Test-Taking Scale: An explanatory item response modeling approach. Current Psychology. Advance online publication. doi:10.1007/s12144-022-03202-y Abstract

• Yildirim-Erbasli, S. N., & Bulut, O. (2022). Designing predictive models for early prediction of students’ test-taking engagement in computerized formative assessments. Advance online publication. Journal of Applied Testing Technology. Download

• Buyukkidik, S., & Bulut, O. (2022). Analyzing the effects of test, student, and school predictors on science achievement: An explanatory IRT modeling approach. Journal of Measurement and Evaluation in Education and Psychology, 13(1), 40-53. doi:10.21031/epod.1013784 Download

• Bulut, H. C., & Bulut, O. (2022). Item wording effects in self-report measures and reading achievement: Does removing careless respondents help? Studies in Educational Evaluation, 72, 101126. doi:10.1016/j.stueduc.2022.101126 Abstract

• Cormier, D. C., Bulut, O., McGrew, K. S., & Kennedy, K. (2022). Linguistic influences on cognitive test performance: Examinee characteristics are more important than test characteristics. Journal of Intelligence, 10(1), 8. doi: 10.3390/jintelligence10010008 Download

• Gao, Y., Cui, Y., Bulut, O., Zhai, X., & Chen, F. (2022). Examining adults' web navigation patterns in multi-layered hypertext environments. Computers in Human Behavior, 129, 107142. doi:10.1016/j.chb.2021.107142 Abstract

• Shin, J., & Bulut, O. (2022). Building an intelligent recommendation system for personalized test scheduling: A reinforcement learning approach. Behavior Research Methods, 54, 216–232. doi:10.3758/s13428-021-01602-9 Abstract

• Shin, J., Chen, F., Lu, C., & Bulut, O. (2022). Analyzing students’ performance in computerized formative assessments to optimize teachers' test administration decisions using deep learning frameworks. Journal of Computers in Education, 9, 71–91. doi:10.1007/s40692-021-00196-7 Download

• Butterfuss, R., Kendeou, P., McMaster, K. L., Orcutt, E., & Bulut, O. (2022). Question timing, language comprehension, and executive function in inferencing. Scientific Studies of Reading, 26(1), 61-78. doi:10.1080/10888438.2021.1901903 Abstract

• Violato, E., King, S., & Bulut, O. (2022). Conformity, obedience, and the better than average effect in health professional students. Canadian Medical Education Journal, 13(1), 55-64. doi:10.36834/cmej.71970 Download

~2021~

• Bulut, O., Gorgun, G., & Yildirim-Erbasli, S. N. (2021). Estimating explanatory extensions of dichotomous and polytomous Rasch models: The eirm package in R. Psych, 3(3), 308-321. doi:10.3390/psych3030023 Download

• Bulut, O., Cormier, D. C., Aquilina, A. M., & Bulut, H. C. (2021). Age and sex invariance of the Woodcock-Johnson IV Tests of Cognitive Abilities: Evidence from psychometric network modeling. Journal of Intelligence, 9(3), 1-16. doi:10.3390/jintelligence9030035 Download

• Bulut, O., & Kim, D. (2021). The use of data imputation when investigating dimensionality in sparse data from computerized adaptive tests. Journal of Applied Testing Technology, 22(2), 1-13. Download

• Bulut, O. (2021). Test review of the Young Children’s Achievement Test-Second Edition. In J. F. Carlson, K. F. Geisinger, & J. L. Jonson (Eds.), The twenty-first mental measurements yearbook (pp. 873-878). Lincoln, NE: Buros Center for Testing.

• Bulut, O. (2021). Beyond multiple-choice with digital assessments. eLearn Magazine, 2021(Special Issue), 1-10. doi:10.1145/3472394 Download

• Yildirim-Erbasli, S. N., & Bulut, O. (2021). Conversation-based assessments: Real-time assessment and feedback. eLearn Magazine, 12, Article 1. doi:10.1145/3495533 Abstract

• Tilstra, M., Tiwari, I., Niwa, L., Campbell, S., Nielson, C., Jones, A., Osornio Vargas, A., Bulut, O., Quemerais, B., Salma, J., Whitfield, K., & Yamamoto, S. (2021). Risk and resilience: How is the health of older adults and immigrant people living in Canada impacted by climate- and air pollution-related exposures? International Journal of Environmental Research and Public Health, 18(20), 10575. doi:10.3390/ijerph182010575 Download

• Yildirim-Erbasli, S. N., & Bulut, O. (2021). The impact of students' test-taking effort on growth estimates in low-stakes educational assessments. Educational Research and Evaluation, 26(7-8), 368-386. doi:10.1080/13803611.2021.1977152 Abstract

• Gao, Y., Zhai, X., Cui, Y., Xin, T., & Bulut, O. (2021). Re-validating a learning progression of buoyancy for middle school students. Research in Science Education. Advance online publication. doi:10.1007/s11165-021-10021-x Download

• Daniels, V., Ortiz, S., Sandhu, G., Lai, H., Yoon, M., Bulut, O., & Hillier, T. (2021). Effect of detailed OSCE score reporting on learning and anxiety in medical school. Journal of Medical Education and Curricular Development, 8, 1-8. doi:10.1177/2382120521992323 Download

• Poth, C., Bulut, O., Aquilina, A., & Otto, S. (2021). Using data mining for rapid complex case study descriptions: Example of public health briefings during the onset of the COVID-19 pandemic. Journal of Mixed Methods Research, 15(3), 348-373. doi:10.1177/15586898211013925 Download

• Bulut, H. C., & Bulut, O. (2021). K. Sijtsma and A. L. Van Der Ark: A review of "Measurement Models for Psychological Attributes". Psychometrika, 86(2), 514-517. doi: 10.1007/s11336-021-09758-1 Download

• Gorgun, G., & Bulut, O. (2021). A polytomous scoring approach to handle not-reached items in low-stakes assessments. Educational and Psychological Measurement, 81(5), 847-871. doi:10.1177/0013164421991211 Download

• El Hassar, B., Poth, C., Gokiert, R., & Bulut, O. (2021). Toward an evidence-based approach to building evaluation capacity. The Canadian Journal of Program Evaluation(36)1, 82-94. doi:  10.3138/cjpe.69191 Download

• Georgiou, G. K., Bulut, O., Dunn, K., Naglieri, J., & Das, J. P. (2021). Examining the relation between PASS cognitive processes and superior reading and mathematics performance. Psychology in the Schools, 58, 252–267. doi:10.1002/pits.22442 Abstract

• Kendeou, P., McMaster, K., Butterfuss, R., Kim, J., Slater, S., & Bulut, O. (2021). Development and validation of the Minnesota Inference Assessment. Assessment for Effective Intervention, 47(1), 47-52. doi: 10.1177/1534508420937781 Abstract

~2020~

• Bulut, O., Cutumisu, M., Singh, D., & Aquilina, A. M. (2020). Guidelines for generating effective feedback from e-assessments. Hacettepe University Journal of Education, 35(Special Issue), 60-72. doi:10.16986/HUJE.2020063705 Download

• Bulut, O., Cormier, D. C., & Shin, J. (2020). An intelligent recommender system for personalized test administration scheduling with computerized formative assessments. Frontiers in Education, 5, 1-11. doi: 10.3389/feduc.2020.572612 Download

• Bulut, O., Xiao, J., Rodriguez, M. C., & Gorgun, G. (2020). An empirical investigation of factors contributing to item nonresponse in self-reported bullying instruments. Journal of School Violence, 19(4), 539-552. doi: 10.1080/15388220.2020.1770603 Abstract

• Bulut, O., & Desjardins, C. D. (2020). Profile analysis of multivariate data: A brief introduction to the profileR package. Retrieved from psyarxiv.com/sgy8m. doi: 10.31234/osf.io/sgy8m Download

• Brown, G. T. L., Alqassab, M., Bulut, O., & Xiao, J. (2020). Item impact as the source of differential item functioning in small samples: Evaluation with MIMIC-PA and MIMIC-interaction approaches. Psychological Test and Assessment Modeling, 65(4), 429-448. Download

• Violato, E., King, S., & Bulut, O. (2020). A multi-method exploratory study of health professional students’ experiences with compliance behaviours. BMC Medical Education, 20(359), 1-10. doi:10.1186/s12909-020-02265-4 Download

• Flanagan, A., Cormier, D. C., & Bulut, O. (2020). Achievement may be rooted in teacher expectations: Examining the differential influences of ethnicity, years of teaching, and classroom behaviour. Social Psychology of Education, 23(6), 1429-1448. doi: 10.1007/s11218-020-09590-y Download

• St-Amand, J., Bowen, F., Bulut, O., Cormier, D., Janosz, M., & Girard, S. (2020). Le sentiment d’appartenance à l’école: Validation d’un modèle théorique prédisant l’engagement et le rendement en mathématiques d’élèves du secondaire. Teachers & Teaching: International Journal in Education, 28(2), 89-105. doi: 10.18162/fp.2020.530  Download

• Shin, J., Bulut, O., & Gierl, M. J. (2020). Development practices of trusted AI systems among Canadian data scientists. International Review for Information Ethics, 28, 1-10. Download

• Desjardins, C. D., & Bulut, O. (2020). profileR: An R package for profile analysis. The Journal of Open Source Software, 5(47), 1941. doi: 10.21105/joss.01941 Download

• Xiao, J., & Bulut, O. (2020). Evaluating the performances of missing data handling methods in ability estimation from sparse data. Educational and Psychological Measurement, 80(5), 932-954. doi: 10.1177/0013164420911136  Abstract

• Liou, P.-Y., & Bulut, O. (2020). The effects of item format and cognitive domain on students’ science performance in TIMSS 2011. Research in Science Education, 50(1), 99-121. doi: 10.1007/s11165-017-9682-7 Abstract

• Shin, J., Bulut, O., & Gierl, M. J. (2020). The effect of the most-attractive-distractor location on multiple-choice item difficulty. Journal of Experimental Education, 88(4), 643-659. doi:10.1080/00220973.2019.1629577 Abstract

~2019~

• Bulut, O., & Yavuz, H. C. (2019). Educational data mining: A tutorial for the rattle package in R. International Journal of Assessment Tools in Education, 6(5), 20-36. doi: 10.21449/ijate.627361 Download

• Bulut, O., Cutumisu, M., Aquilina, A. M., & Singh, D. (2019). Effects of digital score reporting and feedback on students’ learning in higher education. Frontiers in Education, 4(65), 1-16. doi: 10.3389/feduc.2019.00065 Download

• Daniels, L. M., & Bulut, O. (2019). Students’ perceived usefulness of computerized percentage-only vs. descriptive score reports: Associations with motivation and grades. Journal of Computer Assisted Learning, 36(2), 199-208. doi: 10.1111/jcal.12398 Abstract

• Chen, F., Yang, H., Bulut, O., Cui, Y., & Xin, T. (2019). Examining the relation of personality factors to substance use disorder by explanatory item response modeling of DSM-5 symptoms. PLoS ONE,14(6), 1-17. Download

• Stanke, L., & Bulut, O. (2019). Explanatory item response models for polytomous item responses. International Journal of Assessment Tools in Education, 6(2), 259–278. doi: 10.21449/ijate.515085 Download

• Celik, H., & Bulut, O. (2019). Examining Turkish adults’ recalled experiences of their father’s presence. Journal of Family Issues, 40(9), 1224–1251. doi: 10.1177/0192513X19835879 Abstract

• Cormier, D. C., Van Norman, E. R., Cheong, C., Kennedy, K. E., Bulut, O., & Mrazik, M. (2019). Mastering standardized cognitive assessment scoring procedures: How much is enough? Canadian Journal of School Psychology, 34(3), 215-233. doi: 10.1177/0829573518765010 Abstract

~2018~

• Bulut, O., & Cormier, D. C. (2018). Validity evidence for progress monitoring with Star Reading: Slope estimates, administration frequency, and number of data points. Frontiers in Education, 3(68), 1-12. doi: 10.3389/feduc.2018.00068 Download

• Bulut, O., & Cutumisu, M. (2018). When technology does not add up: ICT use negatively predicts mathematics and science achievement for Finnish and Turkish students in PISA 2012. Journal of Educational Multimedia and Hypermedia, 27(1), 25-42. Abstract

• Bulut, O., Lei, M., & Guo, Q. (2018). Item and testlet position effects in computer-based alternate assessments for students with disabilities. International Journal of Research & Method in Education, 41(2), 169-183. doi: 10.1080/1743727X.2016.1262341 Abstract

• Kan, A., Bulut, O., & Cormier, D. C. (2018). The impact of item stem format on the dimensional structure of mathematics assessments. Educational Assessment, 24(1), 13-32. doi: 10.1080/10627197.2018.1545569 Abstract

• Korukcu, O., Bulut, O., & Kukulu, K. (2018). From experiences to expectations: A quantitative study on the fear of childbirth among multigravida women. Archives of Psychiatric Nursing. Advanced online publication. doi: 10.1016/j.apnu.2018.11.002 Abstract

• Arce-Ferrer, A. J., & Bulut, O. (2018). Effects of data collection designs in the comparison of computer-based and paper-based tests. The Journal of Experimental Education, 87(4), 661-679. doi: 10.1080/00220973.2018.1507986 Abstract

• Liu, R., Huggins-Manley, A. C., & Bulut, O. (2018). Retrofitting diagnostic classification models to responses from IRT-based assessment forms. Educational and Psychological Measurement, 78(3), 357-383. doi: 10.1177/0013164416685599 Abstract

• McCabe, E., Gross, D. P., & Bulut, O. (2018). Procedures to develop a computerized adaptive test to assess patient-reported physical functioning. Quality of Life Research, 27(9), 2393-2402. doi: 10.1007/s11136-018-1898-0 Abstract

• Cormier, D. C., Bulut, O., Singh, D., Kennedy, K. E., Wang, K., Heudes, A., & Lewka, A. J. (2018). A systematic examination of the linguistic demand of cognitive test directions administered to school-age populations. Journal of Psychoeducational Assessment, 36(4), 337-353. doi: 10.1177/0734282916678336 Abstract

~2017~

• Bulut, O., & Suh, Y. (2017). Detecting DIF in multidimensional assessments with the MIMIC model, the IRT likelihood ratio test, and logistic regression. Frontiers in Education, 2(51), 1-14. doi: 10.3389/feduc.2017.00051 Download 

• Bulut, O., & Sünbül, Ö. (2017). Monte Carlo simulation studies in item response theory with the R programming language. Journal of Measurement and Evaluation in Education and Psychology, 8(3), 266-287. doi: 10.21031/epod.305821 Download 

• Bulut, O., Guo, Q., & Gierl, M. J. (2017). A structural equation modeling approach for examining position effects in large-scale assessments. Large-Scale Assessments in Education, 5(8), 1-20. doi:10.1186/s40536-017-0042-x  Download 

• Bulut, O., Davison, M. L., & Rodriguez, M. C. (2017). Estimating between-person and within-person subscore reliability with profile analysis. Multivariate Behavioral Research, 52(1), 86-104. doi: 10.1080/00273171.2016.1253452 Abstract

• Cutumisu, M., & Bulut, O. (2017). Problem-solving attitudes and gender as predictors of academic achievement in mathematics and science for Canadian and Finnish students in the PISA 2012 assessment. Journal of Educational Multimedia and Hypermedia, 26(4), 325-342. Abstract 

• Cormier, D. C., Bulut, O., McGrew, K. S., & Singh, D. (2017). Exploring the effects of Cattell-Horn-Carroll (CHC) cognitive abilities underlying mathematics achievement. Applied Cognitive Psychology, 31(5), 530-538. doi: 10.1002/acp.3350 Abstract

• Gierl, M. J., Bulut, O., Guo, Q., & Zhang, X. (2017). Developing, analyzing, and using distractors for multiple-choice tests in education: A comprehensive review. Review of Educational Research, 87(6), 1082-1116. doi: 10.3102/0034654317726529 Abstract

• Lee, S., Bulut, O., & Suh, Y. (2017). Multidimensional extension of multiple indicators multiple causes models to detect DIF. Educational and Psychological Measurement, 77(4), 545-569. doi: 10.1177/0013164416651116 Download

• Arce-Ferrer, A. J., & Bulut, O. (2017). Investigating separate and concurrent approaches for item parameter drift in 3PL IRT equating. International Journal of Testing, 17(1), 1-22. doi: 10.1080/15305058.2016.1227825 Abstract 

• Bellibas, M. S., Bulut, O., & Gedikli, S. (2017). Investigating professional learning communities in Turkish schools: The effects of contextual factors. Professional Development in Education, 43(3), 353-374. doi:10.1080/19415257.2016.1182937 Abstract 

• Yaylaci, T., Cicchetti, D., Rogosch, F. A., Bulut, O., & Hetzel, S. R. (2017). The interactive effects of child maltreatment and the FK506 binding protein 5 gene (FKBP5) on dissociative symptoms in adolescence. Development and Psychopathology, 29(3), 1105-1117. doi: 10.1017/S095457941600105X Abstract

• Cormier, D. C., McGrew, K. S., Bulut, O., & Funamoto, A. (2017). Revisiting the relations between the WJ IV measures of Cattell-Horn-Carroll (CHC) cognitive abilities and reading achievement during the school-age years. Journal of Psychoeducational Assessment, 35(8), 731-754. doi: 10.1177/0734282916659208 Abstract

~2016~

• Cormier, D. C., Bulut, O., McGrew, K. S., & Frison, J. (2016). The role of Cattell-Horn-Carroll (CHC) cognitive abilities in predicting writing achievement during the school age years. Psychology in the Schools, 53(8), 787–803. doi: 10.1002/pits.21945 Abstract

• Van  Boekel, M., Bulut, O., Stanke, L., Zamora, J. P. R., Jang, Y., Kang, Y., & Nickodem, K. (2016). Effects of participation in school sports on academic and social functioning. Journal of Applied Developmental Psychology, 46, 31-40. Abstract 

• Latifi, S., Bulut, O., Gierl, M. J., Christie, T., & Jeeva, S. (2016). Differential performance on national exams: Evaluating item and bundle functioning methods using English, mathematics, and science assessments. Sage Open, 6(2), 1-14. Download 

• Korukcu, O., Bulut, O., & Kukulu, K. (2016). Psychometric evaluation of the Wijma Delivery Expectancy/Experience Questionnaire version B. Health Care for Women International, 37(5), 550-567. doi:10.1080/07399332.2014.943838 Abstract

• Shojaee, M., Bulut, O., & Shahidi, M. (2016). Examining psychometric properties of the Kutcher Adolescent Depression Scale (KADS-11) using multidimensional item response theory. International Journal of Current Research, 8(3), 27120-27131. Download 

• Bellibas, M. S., Bulut, O., Hallinger, P., & Wang, W. C. (2016). Developing a validated instructional leadership profile of Turkish primary school principals. International Journal of Educational Research, 75, 115-133. doi:10.1016/j.ijer.2015.10.002 Abstract

~2015 or Earlier~

• Bulut, O. (2015). Applying item response theory models to Entrance Examination for Graduate Studies: Practical issues and insights. Journal of Measurement and Evaluation in Education and Psychology, 6(2), 313-330. Download 

• Bulut, O. (2015). An empirical analysis of gender-based DIF due to test booklet effect. European Journal of Research on Education, 3(1), 7-16. Download 

• Bulut, O., Palma, J., Rodriguez, M. C., & Stanke, L. (2015). Evaluating measurement invariance in the measurement of developmental assets in Latino English language groups across developmental stages. Sage Open, 5(2), 1-18. Download 

• Kan, A., & Bulut, O. (2015). Examining the language factor in mathematics assessments. Journal of Education and Human Development, 4(1), 133-146. Download 

• Kan, A., & Bulut, O. (2014). Crossed random-effect modeling: Examining the effects of teacher experience and rubric use in performance assessments. Eurasian Journal of Educational Research, 57, 1-28. Download 

• Korukcu, O., Bulut, O., Bayram, Z., Tuzcu, A., & Turkmen, H. O. (2014). An adaptation of Leymann Inventory of Psychological Terror to health sciences programs in Turkey. Anatolian Journal of Psychiatry, 15(4), 335-342. Download 

• Kan, A., & Bulut, O. (2014). Examining the relationship between gender DIF and language complexity in mathematics assessments. International Journal of Testing, 14(3), 245-264. Abstract 

• Gumus, S., Bulut, O., & Bellibas, M. S. (2013). The relationship between principal leadership and teacher collaboration in Turkish primary schools: A multilevel analysis. Education Research and Perspectives, 40, 1-29. Download 

• Bulut, O., & Kan, A. (2012). Application of computerized adaptive testing to Entrance Examination for Graduate Studies in Turkey. Eurasian Journal of Educational Research, 49, 61-80. Download  

• Bulut, O., Delen, E., & Kaya, F. (2012). An SEM model based on PISA 2009 in Turkey: How does the use of technology and self-regulation activities predict reading scores? Procedia - Social and Behavioral Sciences, 64, 564-573. Download 

• Kaya, F., Delen, E., & Bulut, O. (2012). Test Review: Shipley-2 Manual. Journal of Psychoeducational Assessment, 30(6), 593-597. Download 

• Delen, E., & Bulut, O. (2011). The relationship between students’ exposure to technology and their achievement in science and math. TOJET: The Turkish Online Journal of Educational Technology, 10(3), 311-317. Download

• Madland, C., Irvine, V., DeLuca, C., & Bulut, O. (2024). Evolving our understanding of technology-integrated assessment: A review of the literature and development of a new framework. OTESSA Conference Proceedings, 4(1), 1-10. doi:10.18357/otessac.2024.4.1.393 Download

• Bulut, O., Gorgun, G., & Tan, B. (2024). Item difficulty and response time prediction with large language models: An empirical analysis of USMLE items. In E. Kochmar, M. Bexte, J. Burstein, A. Horbach, R. Laarmann-Quante, A. Tack, V. Yaneva, & Z. Yuan (Eds.), Proceedings of the 19th Workshop on Innovative Use of NLP for Building Educational Applications (BEA 2024) (pp. 522–527), Mexico City, Mexico. Association for Computational Linguistics. doi:10.7939/r3-0xjn-2446 Download

• Gorgun, G., & Bulut, O. (2024). Current evaluation methods are a bottleneck in automatic question generation. In Proceedings of the 2024 AAAI Conference on Artificial Intelligence, PMLR 257, (pp. 3-8). Vancouver, BC, Canada. Download

• Bulut, O., Gorgun, G., Tan, B., Wongvorachan, T., Yildirim-Erbasli, S. N., & Clelland, A. (2023). Self-regulated learning through online formative assessments: The effects of assessment frequency and participation on student performance. In P. Blikstein, J. Van Aalst, R. Kizito, & K. Brennan (Eds.), Proceedings of the 17th International Conference of the Learning Sciences (pp. 1406-1409), Montreal, QC, Canada: International Society of the Learning Sciences. Download 

• Yildirim-Erbasli, S. N., Demmans Epp, C., Bulut, O., & Cui, Y. (2023). Design and evaluation of a conversational agent for formative assessment in higher education. In P. Blikstein, J. Van Aalst, R. Kizito, & K. Brennan (Eds.), Proceedings of the 17th International Conference of the Learning Sciences (pp. 194-201), Montreal, QC, Canada: International Society of the Learning Sciences. Download

• Yildirim-Erbasli, S. N., & Bulut, O. (2023). Innovating assessment with conversational agents: A technology-enhanced approach to formative assessments. Proceedings of the IEEE International Conference on Advanced Learning Technologies (pp. 331-335), Orem, UT. doi:10.1109/ICALT58122.2023.00103 Abstract

• Wongvorachan, T., & Bulut, O. (2022). Feedback generation through artificial intelligence. In A. Bozkurt, T. Greene, & V. Irvine (Eds.), Proceedings of the Open/Technology in Education, Society, and Scholarship Association (OTESSA) Conference, 2(1), 1-9. doi:10.18357/otessac.2022.2.1.125 Download

• Bulut, O., MacIntosh, A., & Walsh, C. (2022). Leveraging natural language processing for quality assurance of a situational judgement test. In M. M. Rodrigo, N. Matsuda, A. I. Cristea, & V. Dimitrova (Eds.), Artificial intelligence in education. Posters and late breaking results, workshops and tutorials, industry and innovation Tracks, practitioners’ and doctoral consortium (pp. 84-88). Lecture Notes in Computer Science, vol 13356. Springer, Cham. doi:10.1007/978-3-031-11647-6_14 Download

• Gorgun, G., & Bulut, O. (2022). Considering disengaged responses in Bayesian and deep knowledge tracing. In M. M. Rodrigo, N. Matsuda, A. I. Cristea, & V. Dimitrova (Eds.), Artificial intelligence in education. Posters and late breaking results, workshops and tutorials, industry and innovation Tracks, practitioners’ and doctoral consortium (pp. 591-594). Lecture Notes in Computer Science, vol 13356. Springer, Cham. doi:10.1007/978-3-031-11647-6_122 Download

• Shin, J., Bulut, O., & Pinto, W. N. (2022). E-learning preparedness: A key consideration to promote fair learning analytics development in higher education.  In A. Mitrovic & N. Bosch (Eds.), Proceedings of the 15th International Conference on Educational Data Mining, (pp. 673–678). Durham, UK: International Educational Data Mining Society. doi:10.5281/zenodo.6853111 Download

• Walsh, C., MacIntosh, A., Bulut, O., & Shin, J. (2022). What are we measuring?: A topic modeling framework to map professionalism aspects to responses in a situational judgment test. In A. Wise, R. Martinez-Maldonado, & I. Hilliger (Eds.), Proceedings of the 12th International Conference on Learning Analytics & Knowledge (LAK22) (pp. 39-41). Society for Learning Analytics Research (SoLAR). Download 

• Bulut, O., & Cutumisu, M. (2017). When technology does not add up: ICT use negatively predicts mathematics and science achievement for Finnish and Turkish students in PISA 2012. In J. Johnston (Ed.), Proceedings of EdMedia: World Conference on Educational Media and Technology 2017 (pp. 935-945). Waynesville, NC: Association for the Advancement of Computing in Education (AACE). Download 

• Cutumisu, M., & Bulut, O. (2017). Problem-solving attitudes and gender as predictors of academic achievement in mathematics and science for Canadian and Finnish students in the PISA 2012 assessment. In J. Johnston (Ed.), Proceedings of EdMedia: World Conference on Educational Media and Technology 2017 (pp. 728-738). Waynesville, NC: Association for the Advancement of Computing in Education (AACE). Download 

• Delen, E., & Bulut, O. (2011). The relationship between students' exposure to technology and their achievement in science and math. Proceedings of the International Educational Technology Conference (IETC) 2011 (pp. 1171-1176). Sakarya, Turkey.

• Bulut, O., Gorgun, G., & Yildirim-Erbasli, S. N. (Under review). The impact of frequency and stakes of formative assessment on student achievement in higher education: A learning analytics study. Manuscript submitted for publication.

• Bulut, O., Yildirim-Erbasli, S. N., Ulitzsch, E., & Gorgun, G. (Under review). Measuring consumers’ financial well-being: Uncovering the causes and consequences of careless and insufficient effort in self-report responses. Manuscript submitted for publication.

• Yildirim-Erbasli, S. N., Bulut, O., Demmans Epp, C., & Cui, Y. (Under review). Advancing students’ assessment experiences with conversational agents. Manuscript submitted for publication.

• Gorgun, G., & Bulut, O. (Under review). Using instruction-tuned large-language models to evaluate automatically generated questions: A feasibility study. Manuscript submitted for publication. 

• Tan, B., & Bulut, O. (Under review). Exploring the utility of response time profiles in predicting student performance in the TIMSS 2019 problem solving and inquiry tasks. Manuscript submitted for publication. 

• Liu, X., Bulut, O., Cui, Y., & Gao, Y. (Under review). Uncovering adults’ problem-solving patterns from process data with Hidden Markov model and network analysis. Manuscript submitted for publication. 

• Öz, E. Bulut, O., Cellat, Z. F., & Yürekli, H. (Under review). Stacking: An ensemble learning approach to predict student performance in PISA 2022. Manuscript submitted for publication. 

• Shin, J., Bulut, O., & Pinto Junior, W. N. (Under review). Investigating student preparedness and biases in learning analytics for online learning. Manuscript submitted for publication.

• Domnich, I., Bulut, O., Mori, B. A., & Evenden, M. L. (Under review). What’s bugging you? A survey of producer perspectives on entomology extension in agriculture in Alberta, Canada. Manuscript submitted for publication.

• Kim, M., Ahmed, N., Akdemir, K., Wong, S., & Bulut, O. (Under review). Children’s perspective-taking and decision-making on forests and land use. Manuscript submitted for publication.

• Mazzulo, E., Salma, J., Walsh, C. A., Au, A., Sidani, S., Agrawal, S., Bulut, O., & Guruge, S. (Under review). Neighborhood influences on loneliness in immigrant older adults in Alberta, Canada. Manuscript submitted for publication.

• Lu, C., & Bulut, O. (Under review). Does higher endorsement with collaboration lead to better performance on collaborative problem solving?: An explanatory item response approach to cross-cultural comparisons. Manuscript submitted for publication.

• Tan, B., Bulut, O., Ho, C., & Kovacs Burns, K. (Under review). Validating a self-evaluation tool for persons with spinal cord injury to monitor their transitions in care, health, function, and quality of life: Reliability, validity, and utility. Manuscript submitted for publication.

• Meng, R., Xu, J., Luo, Y., Miller, C. B., Henry, A. L., Bulut, O., Marques, D. R., Mastrotheodoros, S., Li, X., Fan, L., Jia, Y., Xu, S., Zhang, J., Tong, X., Ying, Y., Yang, N., Liu, T., Lian, F., Ma, H., Lix, L. M., & Espie, C. A. (Under review). Detecting the psychometric performance of the Sleep Condition Indicator in Chinese community integrating exploratory graph analysis and confirmatory factor analysis. Manuscript submitted for publication.

• He, S., Bulut, O., & Cui, Y. (Under review). Preschooler’s initial planning time on problem-solving performance across task difficulties: Insights from mobile log data. Manuscript submitted for publication.

• He, S., Bulut, O., Cui, Y., & Wongvorachan, T. (Under review). Uncovering dimensions of learning management system event logs: Insights from exploratory factor analysis, psychometric network analysis, and consensus hierarchical clustering. Manuscript submitted for publication.