The purpose of this course is to show the importance of educational research to instructional designers. Instructional designers need to be up-to-date on the most current research in order to apply it when developing instruction and conducting research of their own. It is important instructional designers be able to ensure that research is both reliable and valid for the scholarship of teaching and learning.
SMART Objectives:
Learners will be able to identify 2 forms of validity by the end of this course
Learners will be able to identify 2 forms of reliability by the end of this course
Learners will be able to describe the importance a research for instructional designers
Reliability occurs when you get the same results after repeated tests (Salkind, 2016). In educational research we observe variables that we assign scores in order to make inferences and test hypothesis. A test is reliable when it can produce consistent results which is important in order to establish good measurement practices. There are two important types of reliability to know:
Test-Retest Reliability measures how stable a test is after some amount of time (Salkind, 2016). This would include testing students before an educational intervention as well as after to test how well they improved and how effective the educational intervention was.
Inter-Rater Reliability measures the consistency between different raters in a study (Salkind, 2016). In a qualitative study consistency between multiple researchers who are observing participants and evaluating them is critical to establish reliability.
Validity occurs when a test or instrument that we're using actually measures what we need it to measure (Salkind, 2016). Validity refers to the results of a test and is often defined in the context of how the test is utilized (Salkind, 2016). We do not consider validity in terms of all or none but rather in terms of high or low (Salkind, 2016). There are two important types of validity to know:
Content Validity indicates how much a test represents all the items from the universe which it is drawn (Salkind, 2016). This is usually established with expert opinion (Salkind, 2016).
Construct Validity is the extent to which test results are related to an underlying set of variables (Salkind, 2016). This is how we can determine the extent to which a speed test actually measures speed or a comprehension test actually measures comprehension.
Study: Zhang, H., Goh, S. H. L., Wu, X. V., Wang, W., & Mörelius, E. (2019). Prelicensure nursing students' perspectives on video-assisted debriefing following high fidelity simulation: A qualitative study. Nurse education today, 79, 1-7.
The point of this study was to do qualitative research on pre-licensure nursing students’ experiences with Video-assisted Debriefing (VAD) following a high-fidelity stimulation (Zhang et al., 2019). There is a fair amount of evidence that suggests that VAD is beneficial however there is a lack of research on students’ attitudes as it pertains to VAD (Zhang et al., 2019). The researcher asserts that it is important to know the perspectives and attitudes of the learners’ involvement with VAD for effective learning (Zhang et al., 2019). The study found that nursing students thought the VAD worked well with the verbal debriefing and improved their attitudes and behaviors through the simulation (Zhang et al., 2019). Ultimately the study proof that VAD enhanced the awareness, attitudes, and behaviors of the nursing students through the simulation however since research on this phenomenon is sparse further research is necessary to explain why (Zhang et al., 2019). The implication of this study is that VAD is beneficial for simulation-based learning especially when students are familiarized with the fact that they will be observed to mitigate their anxiety.
Study: Ghanaat Pisheh, E. A., NejatyJahromy, Y., Gargari, R. B., Hashemi, T., & Fathi, A. E. (2019). Effectiveness of clicker‐assisted teaching in improving the critical thinking of adolescent learners. Journal of Computer Assisted Learning, 35(1), 82–88. https://doi-org.ezproxy.libraries.wright.edu/10.1111/jcal.12313
The purpose of this study was to examine the effect of clickers in teaching critical thinking to young students (Ghanaat Pisheh, NejatyJahromy, Gargari, Hashemi, & Fathi-Azar, 2018). Critical thinking has been shown to be elevated by the assistance of technology so the researchers wanted to explore if that held true for student response systems, or clickers (Ghanaat Pisheh, NejatyJahromy, Gargari, Hashemi, & Fathi-Azar, 2018). Previous research into the use of clickers in the classrooms only examined performance at the time while the other half the time focusing on the viewpoints of educators and/or students (Ghanaat Pisheh, NejatyJahromy, Gargari, Hashemi, & Fathi-Azar, 2018). Previous studies also focused primarily on collegiate level education, leading the researchers to investigate the effect of clickers at lower levels of education (Ghanaat Pisheh, NejatyJahromy, Gargari, Hashemi, & Fathi-Azar, 2018). Ultimately the study showed that clickers had a significant effect on the cord outcomes of a critical thinking test, but only for students on the lower side of the performance spectrum (Ghanaat Pisheh, NejatyJahromy, Gargari, Hashemi, & Fathi-Azar, 2018). The implication of this study is that clickers are useful for low performing grade school children possibly due to the fact that the anonymous response and eliminates the fear of failure
Ghanaat Pisheh, E. A., NejatyJahromy, Y., Gargari, R. B., Hashemi, T., & Fathi, A. E. (2019). Effectiveness of clicker‐assisted teaching in improving the critical thinking of adolescent learners. Journal of Computer Assisted Learning, 35(1), 82–88. https://doi-org.ezproxy.libraries.wright.edu/10.1111/jcal.12313
Salkind, N. J. (2016). Exploring research. Boston, Mass: Pearson Education Limited.
Zhang, H., Goh, S. H. L., Wu, X. V., Wang, W., & Mörelius, E. (2019). Prelicensure nursing students' perspectives on video-assisted debriefing following high fidelity simulation: A qualitative study. Nurse education today, 79, 1-7.