Presentations
INVITED TALKS
Bulut, O. (2023, April). Beyond adaptive testing: Adaptive item recommendation with process data. Invited talk given at ETS Process Data SIG. Download
Bulut, O. (2022, November). From adaptive testing to personalized adaptive testing: Applications of machine learning algorithms. Invited talk given at the Twentieth Annual MARC Conference. Download
Bulut, O. (2022, January). Process data for better psychometrics: Lessons learned from response time and clickstream data. Invited talk given at ETS Process Data SIG. Download
Bulut, O. (2021, April). Overcoming human error with AI-powered assessments. Invited talk given at Beyond Multiple Choice: Assessment Challenges of Our New Decade. Download
Bulut, O. (2020, September). To test or not to test? An intelligent recommender system for personalized test scheduling. Invited talk given at AI for Society's Our University, Our Work: Artificial Intelligence Around Campus event, Edmonton, AB, Canada. Download
Bulut, O. (2019, June). Artificial intelligence and the future of education. Invited talk given at the International Eurasian Educational Research Congress, Ankara, Turkey. Download
Bulut, O. (2019, March). Integrating technology into educational assessments. Invited talk given at the Dunlop Conference, Edmonton, AB, Canada. Download
Bulut, O. (2018, December). Using computer technologies to generate multiple-choice items and score constructed-response items [In Turkish]. Invited talk given at Gazi University, Ankara, Turkey. Download
Bulut, O. (2015, November). Profile analysis of multivariate data using the profileR package. Invited talk given at the University of Iceland, Reykjavík, Iceland. Download
Bulut, O. (2015, November). Online learning opportunities. Invited talk given at the University of Akureyri, Akureyri, Iceland. Download
~2024~
Svetina Valdivia, D., Bulut, O., Withrow, A., & Walsh, P. (2024, August). Impact of reversals in categories on IRT model fit and parameter recovery. Poster to be presented at the annual meeting of the American Psychological Association, Seattle, WA.
Hunt, T. E., Waldron, M. B. K., Tejada, J., Kotera, Y., Sari, M. H., Asanjarani, F., Ashraf, F., Muwonge, C. M., Popa,I-L., Bagdasar, O., Gabriel, F., Kojima, Y., Vione, K. C., Sheffield, D., Bulut, O., & Marmolejo-Ramos, F. (2024, July). Numbers without borders: A comparative study of mathematics anxiety and its predictive factors. Paper presented at the 4th International Conference Opportunities and Challenges of Building Mathematical Resilience, Coventry, UK.
Bulut, O., Clelland, A.C., & Wongvorachan, T. (2024, June). Identifying the predictors of mathematics performance and math anxiety in Canada: An educational data mining approach. Paper presented at the annual meeting of the Canadian Society for the Study of Education, Montreal, QC.
Bulut, O., Shin, J., & Pinto Junior, W. N. (2024, April). Towards fair learning analytics: An application of the Seldonian algorithm. In Q. He (Chair), Incorporating multiple data sources to explore group strategy variations. Paper presented at the annual meeting of the National Council on Measurement in Education, Philadelphia, PA.
Bulut, O., Gorney, K., & Yildirim-Erbasli, S. N. (2024, April). Joint modeling of ability and test-taking effort with multidimensional nested logit model. In B. Arslan (Chair), Unpacking test-taker (dis)engagement: Innovative approaches to enhance validity. Paper presented at the annual meeting of the National Council on Measurement in Education, Philadelphia, PA.
Gorgun, G., & Bulut, O. (2024, April). Using large language models for evaluating item quality in large-scale assessments. In S. Dai (Chair), Innovations and practices of AI and language models in large-scale assessments. Paper presented at the annual meeting of the National Council on Measurement in Education, Philadelphia, PA.
Firoozi, T., Bulut, O., & Gorgun, G. (2024, April). Text augmentation for enhancing the accuracy of automated essay scoring. In H. Jiao & X. Zhai (Chairs), Tackling challenges in automated scoring: Data augmentation, multilingualism, and feedback mechanisms. Paper presented at the annual meeting of the National Council on Measurement in Education, Philadelphia, PA.
Liu, X., Bulut, O., Gao, Y., & Cui, Y. (2024, April). Uncovering test-takers’ problem-solving patterns through Hidden Markov models and network analysis. Paper presented at the annual meeting of the National Council on Measurement in Education, Philadelphia, PA.
Clelland, A.C., & Bulut, O. (2024, April). Using network psychometrics to identify wording effects in a socioemotional skills survey. Paper presented at the annual meeting of the National Council on Measurement in Education, Philadelphia, PA.
Tan, B., Armoush, N., Bulut, O., Mazzullo, E., & Gierl, M. (2024, April). Leveraging pre-trained large language models for automatic item generation: A scoping review. Paper presented at the annual meeting of the National Council on Measurement in Education, Philadelphia, PA.
Mazzullo, E., Bulut, O., Tan, B., & Wongvorachan, T. (2024, April). How can large language models revolutionize learning analytics? Paper presented at the annual meeting of the National Council on Measurement in Education, Philadelphia, PA.
Wongvorachan, T., Bulut, O., & Gorgun, G. (2024, April). Evaluating dimensionality in non-cognitive measures: Exploratory vs. hierarchical exploratory graph analysis. Paper presented at the annual meeting of the National Council on Measurement in Education, Philadelphia, PA.
Clelland, A.C., & Bulut, O. (2024, April). A network psychometrics approach to explore Canadian students’ collaborative skills. Poster presented at the annual meeting of the American Educational Research Association, Philadelphia, PA.
Jones, A., Bulut, O., Dick, B., Pham, A., & Hall, M. (2024, April). Burnout amongst Canadian physiotherapists during the COVID-19 pandemic: A national survey. Paper presented at the Canadian Physiotherapy Association Congress, Vancouver, BC.
Vo, K., & Bulut, O. (2024, March). AI-assisted talk: A narrative review on the new social and conversational landscape. Poster presented at the Spring Symposium Series of the Association for the Advancement of Artificial Intelligence, Stanford, CA.
Vo, K., & Bulut, O. (2024, March). Social smarts with tech sparks: Harnessing LLMs for youth socio-emotional growth. Poster presented at the Spring Symposium Series of the Association for the Advancement of Artificial Intelligence, Stanford, CA.
Ferede, S., Akdemir, K., Ahmed, N., Jin, Q., MacKay, J., Wong, S., Bulut, O., & Kim, M. (2024, March). Knowledge, perspectives, and decision making on climate change in science classrooms. Poster presented at the Celebrating Socially Transformative Research and Teaching Event at the University of Alberta, Edmonton, AB.
Connolly, D., Morris, H., Staines, A., Piggott, B., Cottrell-McDermott, C., Hyshka, E., Taylor, M., Bulut, O., Issa, T., Collins, Z., & Salvalaggio, G. (2024, March). Adjusting harm reduction services to meet the needs of people who consume drugs through inhalation in central Edmonton. Poster presented at the Alberta College of Family Medicine's Family Medicine Summit, Banff, AB.
Gorgun, G., & Bulut, O. (2024, February). Current evaluation methods are a bottleneck in automatic question generation. Poster presented at the Workshop on AI for Education: Bridging Innovation and Responsibility at the AAAI Annual Conference on AI, Vancouver, BC.
~2023~
Yürekli, H., & Bulut, O. (2023, November). Unveiling hidden patterns in students’ reading achievement through data mining. Paper presented at the 7th International Researchers, Statisticians, and Young Statisticians Congress, Yildiz Technical University, Istanbul, Türkiye.
Bulut, O. (2023, October). Large language models in educational assessment. Panel talk given at the Empowering Learners for the Age of AI Online Conference.
Ivan, R., MacIntosh, A., Bulut, O., Shin, J., Musolino, G. M., Traywick, L. S., Salamh, P. A., Condo, M. P., & Herringer, C. N. (2023, October). Ethical AI in health professions education: Co-creating an ethical framework to ensure responsible AI use. Paper presented at the annual Physical Therapy Education Leadership Conference, Philadelphia, PA.
Yildirim-Erbasli, S. N., & Bulut, O. (2023, July). Innovating assessment with conversational agents: A technology-enhanced approach to formative assessments. Paper presented at the 23rd IEEE International Conference on Advanced Learning Technologies, Orem, UT.
Bulut, O., & Gorgun, G. (2023, June). Utilizing response time for scoring the TIMSS 2019 problem solving and inquiry tasks. Paper presented at the IEA International Research Conference (IEA IRC), Dublin, Ireland.
Bulut, O., Gorgun, G., Tan, B., Wongvorachan, T., Yildirim-Erbasli, S., & Clelland, A. (2023, June). Self-regulated learning through online formative assessments: The effects of assessment frequency and participation on student performance. Paper presented at the annual meeting of the International Society of the Learning Sciences, Montréal, QC.
Yildirim-Erbasli, S. N., Demmans Epp, C., Bulut, O., & Cui, Y. (2023, June). Design and evaluation of a conversational agent for formative assessment in higher education. Paper presented at the annual meeting of the International Society of the Learning Sciences, Montréal, QC.
Rinaldi, C., Keys, K., Bulut, O., Gokiert, R., & Howe, N. (2023, June). From puzzles to put away: Examining affect and responsiveness in parent-toddler interactions across different task contexts. Poster presented at the annual conference of the Jean Piaget Society, Madrid, Spain.
Steele, B. J., Sidney, B., Menard, K., Bulut, O., Lowe, S., Pabayo, R., & Yamamoto, S. (2023, June). Development and initial validation of the ACCLIMATES surveillance tool: Assessing climate change-related chronic disease vulnerability in Alberta, Canada. Poster presented at the annual meeting of the Society for Epidemiologic Research, Portland, OR, USA.
Bulut, O., MacIntosh, A., & Walsh, C. (2023, April). Utilizing NLP techniques for collecting validity evidence for a situational judgement test. Paper presented at the annual meeting of the National Council on Measurement in Education, Chicago, IL.
Bulut, O., Yildirim-Erbasli, S. N., He, S., Tan, B., & Gao, Y. (2023, April). Adaptive item recommendation using process data and examinee background characteristics. In Q. He & O. Bulut (Chairs), Empowering process data for data-informed decision-making in measurement. Paper presented at the annual meeting of the National Council on Measurement in Education, Chicago, IL.
Gorgun, G., Bulut, O., & Wongvorachan, T. (2023, April). Detecting rapid guessing: In search of the optimal response time threshold. In E. Ulitzsch & J. Rios (Chairs), Methodological advances in detecting and accounting for noneffortful responding. Paper presented at the annual meeting of the National Council on Measurement in Education, Chicago, IL.
Yildirim-Erbasli, S. N., Bulut, O., & Cui, Y. (2023, April). Conversation-based assessments: Enhancing students' experiences of formative assessment via human-like interaction. Paper presented at the annual meeting of the National Council on Measurement in Education, Chicago, IL.
Bulut, H. C., & Bulut, O. (2023, April). Exploring added-value of response times for low-stakes assessments with nested logit models. Paper presented at the annual meeting of the National Council on Measurement in Education, Chicago, IL.
Gorgun, G., Wongvorachan, T., Tan, B., & Bulut, O. (2023, April). Predicting item difficulty from students’ response behaviors. Paper presented at the annual meeting of the National Council on Measurement in Education, Chicago, IL.
Goodrich, S., & Bulut, O. (2023, April). Dynamic, on-the-fly, and hybrid multistage testing with the bi-factor model. Paper presented at the annual meeting of the National Council on Measurement in Education, Chicago, IL.
Kilmen, S., Bulut, O., & Shin, J. (2023, April). Creating short forms of psychological scales: Semantic similarity matters. Poster presented at the annual meeting of the National Council on Measurement in Education, Chicago, IL.
Yildirim-Erbasli, S. N., Gorgun, G., & Bulut, O. (2023, April). Automatic item paraphrasing to avoid the repetitive use of the same items. Paper presented at the annual meeting of the National Council on Measurement in Education, Chicago, IL.
Sayin, A., & Bulut, O. (2023, April). Estimating item difficulty: What variables do subject matter experts use? Paper presented at the annual meeting of the National Council on Measurement in Education, Chicago, IL.
He, S., Wongvorachan, T., Bulut, O., & Lai, K.-W. (2023, March). Identifying early warning indicators for high school dropouts. Paper presented at the annual meeting of the National Council on Measurement in Education, Chicago, IL.
Tan, B., Bulut, O., Gorgun, G., & Wongvorachan, T. (2023, March). Mining textual features of questions to predict item parameters. Poster presented at the annual meeting of the National Council on Measurement in Education, Chicago, IL.
Wongvorachan, T., He, S., Lai, K. W., & Bulut, O. (2023, March). A comparison of sampling methods for imbalanced classifications in educational datasets. Poster presented at the annual meeting of the National Council on Measurement in Education, Chicago, IL.
Wongvorachan, T., Bulut, O., Gorgun, G., & Tan, B. (2023, March). Random search algorithm to identify response time thresholds for rapid guessing. Paper presented at the annual meeting of the National Council on Measurement in Education, Chicago, IL.
Rinaldi, C., Martinovich, V., Durber, C., & Bulut, O. (2023, March). Mothers’ and fathers’ parenting and involvement reports from preschool to first grade. Poster presented at the Society for Research in Child Development Biennial Meeting, Salt Lake City, Utah.
~2022~
MacIntosh, A., Walsh, C., & Bulut, O. (2022, August). Using natural language processing to understand the multidimensionality of professionalism through a constructed-response situational judgement test. Paper presented at the Ottawa 2022 conference.
Wongvorachan, T., Poth, C., Bulut, O., & Otto, S. (2022, August). Leveraging open data sources in mixed methods research. Paper presented at the biennial global conference of the Mixed Methods International Research Association (MMIRA).
Shin, J., Bulut, O., & Pinto, W. N. (2022, July). E-learning preparedness: A key consideration to promote fair learning analytics development in higher education. Paper presented at the Educational Data Mining Conference, Durham, UK.
Bulut, O., MacIntosh, A., & Walsh, C. (2022, July). Leveraging natural language processing for quality assurance of a situational judgement test. Paper presented at the annual meeting of the Artificial Intelligence in Education, Durham, UK.
Gorgun, G., & Bulut, O. (2022, July). Considering disengaged student behavior in Bayesian and deep knowledge tracing. Poster presented at the annual meeting of the Artificial Intelligence in Education, Durham, UK.
Ulitzsch, E., Yildirim-Erbasli, S. N., Gorgun, G. & Bulut, O. (2022, July). An explanatory mixture IRT model for careless and insufficient effort responding in self-report measures. Paper presented at the annual meeting of the Psychometric Society, Bologna, Italy.
McCabe, E., Gross, D. P., & Bulut, O. (2022, June). Improving the efficiency of patient-reported outcome measurement: Procedures for developing a computerized adaptive test to assess physical functioning. Paper presented at the annual conference of the Canadian Association for Health Services and Policy Research.
Bulut, O., & Wongvorachan, T. (2022, May). Feedback generation through artificial intelligence. Paper presented at the annual meeting of Open/Technology in Education, Society, and Scholarship Association (OTESSA).
Hachem, M., Gorgun, G., Chu, M-W., & Bulut, O. (2022, April). Social and emotional variables as predictors of students’ perceived cognitive competence and academic performance. Paper presented at the uLead Summit of Educational Leadership, Banff, AB.
Deforge, K., Seitz, P., Bulut, O., Chu, M-W., Gorgun, G., & Hachem, M. (2022, April). Giving students a voice: A measure of students’ socio-emotional wellbeing to optimize learning for all students. Paper presented at the uLead Summit of Educational Leadership, Banff, AB.
Bulut, O., & Yildirim-Erbasli, S. N. (2022, April). Detecting careless responses with the rapid guessing-slow responding method. Paper presented at the annual meeting of the National Council on Measurement in Education, San Diego, CA.
Bulut, H. C., & Bulut, O. (2022, April). A network psychometrics approach for detecting item wording effects across subgroups. Paper presented at the annual meeting of the National Council on Measurement in Education, San Diego, CA.
Gorgun, G., & Bulut, O. (2022, April). A smarter CAT: Integrating engagement into the CAT item selection algorithm. Paper presented at the annual meeting of the National Council on Measurement in Education, San Diego, CA.
Firoozi, T., Abadi, A. N., Demmans Epp, C., Bulut, O., & Barbosa, D. (2022, April). The effect of word vector representation and linguistic features on the accuracy of automated essay scoring systems using neural networks. Paper presented at the annual meeting of the National Council on Measurement in Education, San Diego, CA.
Yildirim-Erbasli, S. N., Gorgun, G., Gao, Y., & Bulut, O. (2022, April). Sequential pattern mining to understand time management strategies in online courses. Poster presented at the annual meeting of the National Council on Measurement in Education, San Diego, CA.
Ulitzsch, E., Yildirim-Erbasli, S. N., Gorgun, G. & Bulut, O. (2022, April). An explanatory mixture IRT model for careless responding in survey data. Paper presented at the annual meeting of the National Council on Measurement in Education, San Diego, CA.
Tobias, A. D., Cutumisu, M., & Bulut, O. (2022, April). Estimating classification accuracy and decision consistency with classdecision. Paper presented at the annual meeting of the American Educational Research Association, San Diego, CA.
Wongvorachan, T., Clelland, A., Gorgun, G., Bulut, O. (2022, April). Identifying the predictors of mathematics anxiety and performance in Canada: An educational data mining approach. Poster presented at the 14th Annual Graduate Student Research Showcase: Exploring Horizons (University of Alberta), Edmonton, AB, Canada.
Nielsen, C., Tilstra, M., Bulut, O., Vargas, A. O., & Yamamoto, S. (2022, April). Community climate change health tool for populations experiencing higher vulnerability. Paper presented at the Geodesign Summit.
Bulut, O., Yildirim-Erbasli, S. N., Gorgun, G., Gao, Y., Wongvorachan, T., Lai, K. W., & Shin, J. (2022, March). Leveraging online formative assessments to enhance predictive learning analytics models. Paper presented at the International Conference on Learning Analytics and Knowledge (LAK2022).
Walsh, C., MacIntosh, A., Bulut, O., & Shin, J. (2022, March). What are we measuring?: A topic modeling framework to map professionalism aspects to responses in a situational judgment test. Poster presented at the International Conference on Learning Analytics and Knowledge (LAK2022).
Wongvorachan, T., Lai, K. W., Bulut, O., Tsai, Y.S., Chen, G. (2022, February). The application of artificial intelligence in educational feedback. Poster presented at Reverse Expo 2022 (University of Alberta), Edmonton, AB, Canada.
Yildirim-Erbasli, S. N., & Bulut, O. (2022, January). A conversational agent to measure student learning: Conversation-based assessment. Poster presented at the Advancing Assessment and Evaluation Conference (AAEC).
Wongvorachan, T., Lai, K.W., Bulut, O., Tsai, Y. S. (2022, January). Feedback literacy framework in the e-assessment context. Poster presented at the Advancing Assessment and Evaluation Conference (AAEC).
Gorgun, G. & Bulut, O. (2022, January). Customizing item selection with engagement in computerized-adaptive tests. Poster presented at the Advancing Assessment and Evaluation Conference (AAEC).
~2021~
Bulut, O., & Yildirim-Erbasli, S. (2021, November). Real-time assessment and feedback for real-time learning. Paper presented at the Beyond Multiple Choice Conference.
Yildirim-Erbasli, S. N., & Bulut, O. (2021, October). Automatic story generation for reading comprehension. Poster presented at the annual meeting of the National Council on Measurement in Education (NCME) Special Conference on Classroom Assessment.
Tilstra, M., Nielsen, C., Tiwari, I., Azizali, S., Jones, A., Quemerais, B., Vargas, A. O., Bulut, O., Salma, J., Yamamoto, S. (2021, August). Exploring community-level health impacts of extreme temperatures and air pollution in older adult and immigrant populations living in Edmonton, AB. Poster presented at the annual conference of the International Society for Environmental Epidemiology. Abstract
Nielsen, C. C., Tilstra, M., Bulut, O., Vargas, A. R. O, & Yamamoto, S. (2021, August). The intersection of climate-related health outcomes and urban environmental characteristics using spatiotemporal data science. Paper presented at the annual conference of the International Society for Environmental Epidemiology. Abstract
Nielsen, C. C., Tilstra, M., Bulut, O., Vargas, A. R. O, & Yamamoto, S. (2021, June). Spatiotemporal hot spot associations of climate-related health and urban environment. Paper presented at the annual conference of the Canadian Association of Geographers.
Tilstra, M., Nielsen, C., Tiwari, I., Jones, A., Quemerais, B., Vargas, A. O., Bulut, O., Salma, J., & Yamamoto, S. (2021, June). Characterizing local climate change vulnerability: Impacts of climatic and air pollution exposures on older adults and immigrants in Edmonton, Alberta. Paper presented at the annual meeting of the Canadian Society for Epidemiology and Biostatistics.
Philippot, C. M., Antoniuk, A., Cormier, D. C., Yildirim-Erbasli, S. N., & Bulut, O. (2021, June). Opening the vault: Using a projective measure to access the financial attitudes of young people. Poster presented at the annual national conference of the Canadian Psychological Association, Montreal, QC.
Antoniuk, A., Philippot, C. M., Cormier, D. C., Yildirim-Erbasli, S. N., & Bulut, O. (2021, June). Measuring financial literacy: Investing in positive financial futures. Poster presented at the annual national conference of the Canadian Psychological Association, Montreal, QC.
Bulut, O., Cormier, D. C., & Shin, J. (2021, June). The end of one-size-fits-all testing: Personalizing test schedules with recommender systems. Paper presented at the annual meeting of the National Council on Measurement in Education.
Gorgun, G., Yildirim Erbasli, S. N.,& Bulut, O. (2021, June). An application of explanatory IRT to predict factors contributing to rapid guessing. Paper presented at the annual meeting of the National Council on Measurement in Education.
Yildirim Erbasli, S. N., Gorgun, G., & Bulut, O. (2021, June). Detecting careless responses: A new method utilizing response time and accuracy. Paper presented at the annual meeting of the National Council on Measurement in Education.
Gao, Y., Bulut, O., & Cui, Y. (2021, June). Diagnosing adult information problem solving strategy by mining clickstream data. Paper presented at the annual meeting of the National Council on Measurement in Education.
Gao, Y., Xiaoming, Z., Bulut, O., & Cui, Y. (2021, June). Understanding problem-solving styles in technology-rich environments by log data analysis. Poster presented at the annual meeting of the National Council on Measurement in Education.
Bulut, H. C., Arikan, S., & Bulut, O. (2021, June). Student and item characteristics in online reading comprehension: Polytomous explanatory IRT modeling. Paper presented at the annual meeting of the National Council on Measurement in Education.
Firoozi, T., Shin, J., Bulut, O., & Gierl, M. J. (2021, June). The effect of option similarity on the item difficulty of a reading comprehension test: An application of word embedding techniques. Paper presented at the annual meeting of the National Council on Measurement in Education.
Hachem, M., Gorgun, G., Chu, M.-W., & Bulut, O. (2021, June). Social and emotional variables as predictors of students’ cognitive competence and academic performance. Paper presented at the annual meeting of the Canadian Society for the Study of Education.
~2020~
Bulut, O., & Lee, S. (2020, April). Early detection of high school dropout: A deep learning approach with Keras. The annual meeting of the National Council on Measurement in Education, San Francisco, CA. [Conference canceled due to COVID-19]
Cormier, D. C., Bulut, O., & Stickney, E. (2020, April). Using machine learning approaches to optimize screening for mathematics difficulties. The annual meeting of the National Council on Measurement in Education, San Francisco, CA. [Conference canceled due to COVID-19]
Gao,. Y., Erbasli, S. N. Y., & Bulut, O. (2020, April). Comparison of the performance of feature selection methods in predicting bullying behaviors. The annual meeting of the National Council on Measurement in Education, San Francisco, CA. [Conference canceled due to COVID-19]
Lu, C., Bulut, O., Epp, C. D., & Gierl, M. J. (2020, April). Identifying online learning behaviors using log data from learning management systems. The annual meeting of the National Council on Measurement in Education, San Francisco, CA. [Conference canceled due to COVID-19]
Shin, J., Chen, F., Lu, C., & Bulut, O. (2020, April). Automating test administration decisions in computerized formative assessment. The annual meeting of the National Council on Measurement in Education, San Francisco, CA. [Conference canceled due to COVID-19]
Kim, J., Bulut, O., McMaster, K. L., & Kendeou, P. (2020, April 17-21) Development and initial validation of the Minnesota Inference Assessment [Poster Session]. The annual meeting of the American Educational Research Association, San Francisco, CA http://tinyurl.com/rl4kc7r [Conference canceled due to COVID-19]
Kennedy, K. E., & Bulut, O. (2020, May). Examining the measurement properties of the 2017 What Albertans Know about Fetal Alcohol Spectrum Disorders Survey. The annual convention of the Canadian Psychological Association, Montreal, QC. [Conference canceled due to COVID-19]
Rinaldi, C. M., Bulut, O., Walker, M, & Beeby, A. M. (2020, May). The stability of parenting in early childhood. The annual convention of the Canadian Psychological Association, Montreal, QC. [Conference canceled due to COVID-19]
Rinaldi, C. M., Muth, T., Bulut, O., & Di Stasio, M. (2020, May). Parenting influences on bullying in adolescence. The annual convention of the Canadian Psychological Association, Montreal, QC. [Conference canceled due to COVID-19]
~2019~
Parilla, R., Wijayathilake, M., Bulut, O., & Nag, S. (2019, July). Impact of symbol and child characteristics on Akshara recognition. Poster presented at the annual meeting of Society for the Scientific Study of Reading, Toronto, ON, Canada.
Xiao, J., & Bulut, O. (2019, June). The performance of missing data imputation methods to estimate ability parameters. Paper presented at the annual meeting of the Canadian Society for the Study of Education, Vancouver, BC, Canada.
Shin, J., Bulut, O., & Gierl, M. J. (2019, May). Development practices of trusted AI systems among Canadian data scientists. Paper presented at the AI, Ethics and Society Conference, Edmonton, AB, Canada.
McCabe, E., Gross, D. P., & Bulut, O. (2019, May). Development of a computerized adaptive test to assess patient-reported physical functioning. Paper presented at the World Confederation for Physical Therapy Congress, Geneva, Switzerland.
Georgiou, G. K., Bulut, O., & Dunn, K. (2019, April). A neurocognitive approach to the identification of superior readers and mathematicians. Poster presented at the annual Joseph R. Royce Psychology Research Conference, Edmonton, AB, Canada.
Ortiz, S., Daniels, V. J., Lai, H., Yoon, M., Bulut, O., & Hillier, T. (2019, April). Effect of detailed OSCE score reporting on student learning. Paper presented at the Canadian Conference on Medical Education, Niagara Falls, ON, Canada.
Odell, B., Galovan, A., Bulut, O., & Cutumisu, M. (2019, April). Using novel structural equation models to explore the effect of technology on mathematics for students in the Program for International Student Assessment 2015. Paper presented at the annual meeting of the American Educational Research Association, Toronto, ON, Canada.
Bulut, O., Celik, H., & Lei, M. (2019, April). Understanding response processes in noncognitive measures with explanatory item response modeling. Paper presented at the annual meeting of the National Council on Measurement in Education, Toronto, ON, Canada. Download
Bulut, O., & Cutumisu, M. (2019, April). ExamVis: A score reporting system for visual communication of test results. In O. Bulut (Chair), Communicating assessment results: How to inform decision-making in education. Paper presented at the annual meeting of the National Council on Measurement in Education, Toronto, ON, Canada.
Daniels, L. M., Bulut, O., & Gierl, M. J. (2019, April). Immediate score reporting: Pausing to consider the motivational and emotional consequences for students. In O. Bulut (Chair), Communicating assessment results: How to inform decision-making in education. Paper presented at the annual meeting of the National Council on Measurement in Education, Toronto, ON, Canada.
Cetin-Berber, D. D., Bulut, O., & Huggins-Manley, A. C. (2019, April). Nominal response model to address missingness in multistage adaptive testing. Poster presented at the annual meeting of the National Council on Measurement in Education, Toronto, ON, Canada.
Xiao, J., Bulut, O., & Rodriguez, M. C. (2019, April). Nonresponse issue in noncognitive measures: Validity approach using explanatory item response modeling. Paper presented at the annual meeting of the National Council on Measurement in Education, Toronto, ON, Canada. Download
Xiao, J., & Bulut, O. (2019, April). The performance of recursive partitioning methods for dealing with missing responses. Poster presented at the annual meeting of the National Council on Measurement in Education, Toronto, ON, Canada.
Lu, C., & Bulut, O. (2019, April). Does valuing collaboration lead to greater success in collaborative problem solving? Paper presented at the annual meeting of the National Council on Measurement in Education, Toronto, ON, Canada.
Wagner, K., Kendeou, P., McMaster, K. L., & Bulut, O. (2019, April). Development of a technology-based tool for assessing inference making in young children. Paper presented at the annual meeting of American Educational Research Association, Toronto, ON, Canada.
Wagner, K., Kendeou, P., McMaster, K., & Bulut, O. (2019, February). Creating a technology-based assessment of early inferencing. Poster presented at the Pacific Coast Research Conference, San Diego, CA.
~2018~
Büyükkıdık, S., Bakırarar, B., & Bulut, O. (2018, September). Comparing the performance of data mining methods in classifying successful students with scientific literacy in PISA 2015. Paper presented at the International Congress on Measurement and Evaluation in Education and Psychology, Prizren, Kosovo.
Bulut, O., Aquilina, A., & Singh, D. (2018, July). An interactive score reporting system for improving the quality of formative feedback. Paper presented at the International Testing Commission Conference, Montreal, QC, Canada.
Bulut, O., Cutumisu, M., Singh, D., & Aquilina, A. (2018, July). Guidelines for generating effective feedback from computer-based assessments. Paper presented at the International Testing Commission Conference, Montreal, QC, Canada.
Yavuz, H. C., Bulut, O., Ilgun Dibek, M., & Sahin Kursad, M. (2018, July). Providing revision opportunities in alternate assessments: An application of sequential IRT. Paper presented at the International Testing Commission Conference, Montreal, QC, Canada.
Ilgun Dibek, M., Bulut, O., Sahin Kursad, M., & Yavuz, H. C. (2018, July). Should students with disabilities have multiple opportunities in answering items? Paper presented at the International Testing Commission Conference, Montreal, QC, Canada.
Cormier, D. C., Kennedy, K. E., & Bulut, O. (2018, June). The influence of linguistic demand on cognitive test performance: An integrated model. Paper presented at the International Congress of Applied Psychology (ICAP), Montreal, QC, Canada.
Flanagan, A., Cormier, D. C., & Bulut, O. (2018, June). Teachers’ expectations matter: Implications for Canadian students of different ethnic groups. Paper presented at the International Congress of Applied Psychology (ICAP), Montreal, QC, Canada.
Flanagan, A., Cormier, D. C., Bulut, O., & Antoniuk, A. (2018, June). Tis the season to regress academically? Winter seasonal effects on academic achievement. Paper presented at the International Congress of Applied Psychology (ICAP), Montreal, QC, Canada.
Aquilina, A., Bulut, O., & Cormier, D. C. (2018, June). An examination of child and adolescent sex differences within general and broad CHC cognitive abilities. Poster presented the International Congress of Applied Psychology (ICAP), Montreal, QC, Canada.
Kennedy, K. E., Cormier, D. C., Pei, J., Mattson, D., Bulut, O., & Rasmussen, C. (2018, June). Understanding challenges to progress monitoring: Key findings from the Mathematics Interactive Learning Experience (MILE). Paper presented at the International Congress of Applied Psychology (ICAP), Montreal, QC, Canada.
Gierl, M. J., Bulut, O., Guo, Q., & Zhang, X. (2018, April). Developing, analyzing, and using distractors for multiple-choice medical testing: A comprehensive review. Paper presented at the Canadian Conference on Medical Education, Halifax, NS, Canada.
Bulut, O. (2018, April). The influence of culture and historical practice on the makeup and technical quality of national school accountability models. Invited talk at the annual meeting of the American Educational Research Association, New York, NY.
Shin, J., Bulut, O., & Gierl, M. (2018, April). Examining the effect of best distractor location on item difficulty. Poster presented at the annual meeting of the National Council on Measurement in Education, New York, NY.
Lei, M., Bulut, O., & Jang, H. (2018, April). Detecting multidimensional differential item functioning. Poster presented at the annual meeting of the National Council on Measurement in Education, New York, NY.
Rodriguez, M. C., Bulut, O., Cabrera, J., & Palma, J. (2018, April). Response processes in noncognitive measures: Validity evidence from explanatory item response modeling. Paper presented at the annual meeting of the National Council on Measurement in Education, New York, NY.
Palma, J., Bulut, O., Cabrera, J., & Kang, Y. (2018, April). Measurement invariance in noncognitive measures: Validity approach using explanatory item response modeling. Poster presented at the 2018 annual meeting of the National Council on Measurement in Education, New York, NY.
~2017~
McCabe, E., Gross, D. P., & Bulut, O. (2017, November). Developing computerized adaptive tests to improve the efficiency of patient-reported outcome assessment: Clinically feasible procedures. Poster presented at the 2017 Spotlight on Research Breakfast and Symposium. Glenrose Rehabilitation Hospital & University of Alberta. Edmonton, AB, Canada.
Bulut, O., & Cormier, D. (2017, August). A large-scale progress monitoring application with computerized adaptive testing. Paper presented at the International Association for Computerized Adaptive Testing Conference, Niigata, Japan.
Gierl, M. J., & Bulut, O. (2017, August). Generating rationales to support formative feedback in adaptive testing. Paper presented at the International Association for Computerized Adaptive Testing Conference, Niigata, Japan.
Bulut, O., & Cutumisu, M. (2017, June). When technology does not add up: ICT use negatively predicts mathematics and science achievement for Finnish and Turkish students in PISA 2012. Paper presented at the EdMedia 2017 - World Conference on Educational Media & Technology, Washington, DC.
Cutumisu, M., & Bulut, O. (2017, June). Problem-solving attitudes and gender as predictors of academic achievement in mathematics and science for Canadian and Finnish students in PISA 2012. Paper presented at EdMedia 2017 - World Conference on Educational Media & Technology, Washington, DC.
Lei, M., Jang, H., & Bulut, O. (2017, April). Detecting multidimensional differential item functioning. In Psychometric issues in multidimensional IRT. Paper presented at the annual meeting of the National Council on Measurement in Education, San Antonio, TX.
Bulut, O., Gierl, M. J., Guo, Q., & Zhang, X. (2017, April). The Achilles' heel of multiple-choice items: Distractors. Paper presented at the annual meeting of the National Council on Measurement in Education, San Antonio, TX.
Tang, W., Guo, Q., & Bulut, O. (2017, April). Using structural equation modeling to examine position effects in 2PL IRT model. Paper presented at the annual meeting of the National Council on Measurement in Education, San Antonio, TX.
Liu, R., Huggins-Manley, A.C., Bulut, O. (2017, April). Retrofitting vs. developing assessments for diagnostic purposes: two lessons learned. Paper presented at the annual meeting of the National Council on Measurement in Education, San Antonio, TX.
Liu, R., Huggins-Manley, A. C., Bulut, O. (2017, April). Retrofitting diagnostic classification models to responses from IRT-based assessment forms. Paper presented at the annual meeting of the American Educational Research Association, San Antonio, TX. [Invited presentation as the best presentations from regional associations]
Nickodem, K., Van Boekel, M., Vue, K., Rodriguez, M. C., Bulut, O., Zamora, J. R. P., Kang, Y., & Jang, K. (2017, April). Investigating the role of support in athletes’ and non-athletes’ academic achievement: An SEM approach. Paper presented at the annual meeting of the American Educational Research Association, San Antonio, TX.
Kang, Y., Van Boekel, M., Bulut, O., Nickodem, K., Zamora, J. R. P., Vue, K., Jang, K., & Rodriguez, M. C. (2017, April). Interaction among gender, race/ethnicity, and school sports participation in youth development. Paper presented at the annual meeting of the American Educational Research Association, San Antonio, TX.
Bulut, O., Cormier, D., & Gierl, M. J. (2017, March). Visualizing formative feedback from computer-based assessments. Poster presented at the ENGAGE Research Poster Fair at the University of Alberta, Edmonton, AB. doi:10.7939/R3XD0R90H
~2016~
Liu, R., Huggins-Manley, A.C., Bulut, O. (2016, November). Retrofitting diagnostic classification models to responses from IRT-based assessment forms. Paper presented at the annual meeting of the Florida Educational Research Association, Lakeland, FL. (Won the best paper award)
Bulut, O., Guo, Q., & Gierl, M. J. (2016, July). Examining position effects in large-scale assessments using an SEM approach. Paper presented at the International Test Commission conference, Vancouver, BC, Canada.
Bulut, O. (2016, July). Criterion-related validity of subscores in high school diploma examinations. In Continuous testing: Psychometric challenges and opportunities. Paper presented at the International Test Commission Conference, Vancouver, BC, Canada.
Desjardins, C. D., & Bulut, O. (2016, June). Profile analysis of multivariate data using the profileR package. Poster presented at the R User Conference, Stanford, CA.
Palma, J., Van Boekel, M., & Bulut, O. (2016, April). After-school participation and the association with developmental outcomes. In Using developmental skills and supports to improve youth outcomes. Paper presented at the annual meeting of The Society for the Psychological Study of Social Issues, Minneapolis, MN.
Bulut, O., Hou, X., & Lei, M. (2016, April). Examining testlet-position effects of reading passages in computer-based assessments. In Psychometric issues in alternate assessments. Paper presented at the annual meeting of National Council on Measurement in Education, Washington, DC.
Lei, M., & Bulut, O. (2016, April). Impact of cumulative drift on parameter and ability estimates in alternate assessments. In Psychometric issues in alternate assessments. Paper presented at the annual meeting of National Council on Measurement in Education, Washington, DC.
Stanke, L., Bulut, O., Rodriguez, M. C., & Palma, J. (2016, April). Investigating linear and nonlinear item parameter drift with explanatory IRT models. Paper presented at the annual meeting of National Council on Measurement in Education, Washington, DC.
Bulut, O., Lei, M., Kaplan, M., & Cormier, D. (2016, April). Understanding nonresponse behaviors of students with disabilities in alternate assessments. Paper presented at the annual meeting of American Educational Research Association, Washington, DC.
Liou, P.-Y., & Bulut, O. (2016, April). Item format, cognitive domain, and gender interaction in TIMSS 2011 science results. Paper presented at the annual meeting of American Educational Research Association, Washington, DC.
Nickodem, K., Van Boekel, M., Stanke, L., Palma, J., Vue, K., Bulut, O., Kang, Y., Chang, Y.-F., & Rodriguez, M. C. (2016, April). LGB students and school sports: A positive youth development approach. Paper presented at the annual meeting of American Educational Research Association, Washington, DC.
Cormier, D., Bulut, O., Niileksela, C. R., Singh, D., Funamoto, A., & Schneider, J. (2016, February). Revisiting the relationship between CHC abilities and academic achievement. Symposium presented at the annual meeting of National Association of School Psychologists, New Orleans, LA.
Cormier, D., Singh, D., & Bulut, O. (2016, February). Linguistic demand of cognitive test directions across commonly used batteries. Paper presented at the annual meeting of National Association of School Psychologists, New Orleans, LA.
~2015~
Bellibas, M. S., Bulut, O., & Gedik, S. (2015, September). Exploring professional learning communities in Turkish schools. Paper presented at the annual meeting of the European Conference on Educational Research, Budapest, Hungary.
Lei, M., & Bulut, O. (2015, June). Item parameter and score scale stability in alternate assessments. In Validity of the next-generation assessments for all students. Paper presented at the annual meeting of the National Conference on Student Assessment, San Diego, CA.
Bulut, O., Lee, S., & Suh, Y. (2015, April). Detecting DIF in multidimensional data using MIMIC and IRT-LR-DIF. Poster presented at the annual meeting of National Council on Measurement in Education, Chicago, IL.
Bulut, O., Van Boekel, M., Stanke, L., Zamora, J. P., Nickodem, K., Vue, K., Chang, Y., Latterell, N., & Rodriguez, M. C. (2015, April). Effects of participation in school sports on academic and social outcome variables. Paper presented at the annual meeting of American Educational Research Association, Chicago, IL.
Stanke, L., & Bulut, O. (2015, April). A crossed-classified explanatory partial credit model. Paper presented at the annual meeting of American Educational Research Association, Chicago, IL.
~2014~
Lee, S., Suh, Y., & Bulut, O. (2014, July). Multidimensional extension of multiple indicator multiple cause models to detect DIF. Poster presented at the annual meeting of the Psychometric Society, Madison, WI.
Lei, M., & Bulut, O. (2014, June). Dimensionality of alternate assessments. In Improving the technical quality of alternate assessments. Symposium conducted at the National Conference on Student Assessment, New Orleans, LA.
Bulut, O. (2014, April). Examining subscore reliability within the multidimensional IRT framework. Paper presented at the annual meeting of the National Council on Measurement in Education, Philadelphia, PA. (Won the Alicia Cascallar Award for best paper by an early career scholar)
Bulut, O., & Lei, M. (2014, April). Investigating the unidimensionality assumption in alternate assessments. Paper presented at the annual meeting of American Educational Research Association, Philadelphia, PA.
Bulut, O., Van Boekel, M., Zamora, J. R., Stanke, L., & Rodriguez, M. C. (2014, April). Investigating the effects of school sports on academic and social outcomes.Paper presented at the annual meeting of American Educational Research Association, Philadelphia, PA.
Zamora, J. R. P., Van Boekel, M., Stanke, L., Vue, Y. F., Cabrera, J. C., Chang, Y., Latterell, N., Karl, S. R., Rodriguez, M. C., & Bulut, O. (2014, April). Examining after school activities: Do breadth and intensity matter? Poster presented at the annual meeting of American Educational Research Association, Philadelphia, PA
~2013~
Sullivan, A. L., Bulut, O., & Sadeh, S. S. (2013, August). Psychiatric medication use among adolescents with disabilities. Poster presented at the American Psychological Association Convention, Honolulu, HI.
Bulut, O. & Kan, A. (2013, April). Assessing the impact of item type on dimensional structure of mathematics assessments. Paper presented at the annual meeting of the National Council on Measurement in Education, San Francisco, CA.
Bulut, O., & Kan, A. (2013, April). Examining the relationship between gender DIF and item type using explanatory IRT. Poster presented at the annual meeting of the National Council on Measurement in Education, San Francisco, CA.
Stanke, L., Palma, J., Bulut, O., & Rodriguez, M. C. (2013, April). Investigating measurement invariance assumptions using item parameter drift across grade levels and ELL groups. Paper presented at the annual meeting of the National Council on Measurement in Education, San Francisco, CA.
Bulut, O., Stanke, L., Rodriguez, M. C., Zamora, J. R. P., Vue, Y. F., & Cabrera, J. C. (2013, April). Examining item parameter drift as a source of construct shift. Paper presented at the annual meeting of the American Educational Research Association, San Francisco, CA.
Kan, A., & Bulut, O. (2013, April). Examining the language factor in mathematics tests using explanatory item response modeling. Paper presented at the annual meeting of the American Educational Research Association, San Francisco, CA.
Vue, Y. F., Stanke, L., Zamora, J. R. P., Cabrera, J. C., Bulut, O., Latterel, N., & Rodriguez, M. C. (2013, April). Using school climate to positively develop youth. Paper presented at the annual meeting of the American Educational Research Association, San Francisco, CA.
Canbazoglu, S., Bulut, O., Guzey, S., Demirelli, H., & Durak, N. (2013, April). Evaluation of the technological pedagogical content knowledge (TPACK) framework using structural equation modeling. Paper presented at the annual meeting of the American Educational Research Association, San Francisco, CA.
Kaya, F., Bulut, O., & Delen, E. (2013, April). Does the use of different test booklets trigger DIF? Paper presented at the annual meeting of the American Educational Research Association, San Francisco, CA.
Yaylaci, T. F., Bulut, O., Rogosch, F. A., & Cicchetti, D. (2013, April). The interactive effects of child maltreatment and the FKBP5-Gene on dissociative symptoms. Poster presented at Society for Research in Child Development Biennial Meeting, Seattle, WA.
~2012~
Bulut, O., Delen, E., & Kaya, F. (2012, November). A multilevel analysis of the relationship between types and location of universities and students’ math performance in Turkey. Paper presented at the annual meeting of the Association for Educational Assessment - Europe, Berlin, Germany.
Bulut, O., Delen, E. & Kaya, F. (2012, November). Teacher education reforms and PISA. Paper presented at the annual meeting of the Association for Educational Communications and Technology, Louisville, KY.
Bulut, O., Delen, E., & Kaya, F. (2012, July). An SEM model based on PISA 2009 in Turkey: How does the use of technology and self-regulation activities predict reading scores? Paper presented at the annual meeting of the International Educational Technology Conference, Taoyuan, Taiwan.
Bulut, O. (2012, April). Measurement invariance with normal and non-normal ordinal data: A Monte Carlo comparison of model estimators. Paper presented at the annual meeting of the National Council on Measurement in Education, Vancouver, British Columbia, Canada.
~2011~
Delen, E., & Bulut, O. (2011, May). The relationship between students’ exposure to technology and their achievement in science and math. Paper presented at the International Educational Technology Conference, Istanbul, Turkey.
Bulut, O. (2011, April). Examining item-position effects within reading Items: the LLTM approach. Poster presented at the annual meeting of the American Educational Research Association, New Orleans, LA.
Bishop, S., Liasou, D., Bulut, O., Seo, D., & Bishop, K. L. (2011, April). Modeling erasure behavior: Issues when using marginal sums and item-level data in erasure analysis.Paper presented at the annual meeting of the National Council on Measurement in Education, New Orleans, LA.
Bishop, S., Liasou, D., Bulut, O., Seo, D., & Stearns, M. (2011, April). Application and comparison of alternative procedures in erasure analysis. Paper presented at the annual meeting of the National Council on Measurement in Education, New Orleans, LA.