comparing student perception and student performance in "jigsaw" classroOm: learning anatomy of digestive system
Maša Miščević, BSc
Ph.D. student
PSGIDP and Department of Neuroscience
As Physiological Sciences students in undergraduate or graduate level, we are taught the physiology we are actively living. What if we take charge of our learning and apply "the protégé effect: when we teach, we learn" (the Roman philosopher Seneca) to understand anatomy of the digestive system? Scroll down to learn more!
"School of Athens." Fresco by Raphael (1509-1511). For more information, visit: https://mymodernmet.com/school-of-athens-raphael/ and https://artincontext.org/the-school-of-athens-raphael/
Course set-up:
PSIO 202 (Human Anatomy and Physiology II) is Fall/Spring/Summer Semester lecture + laboratory course format- this projects is based on the laboratory portion.
Required for Physiological Sciences majors, but there are students from other STEM and health professions majors.
It is expected that students come with a basic knowledge in biological sciences (and have passed PSIO 201 (Human Anatomy and Physiology I) with a grade B or higher).
In-person.
Each lab section has 24 students maximum, and each teaching assistant (TA) usually has two sections. Final grade is determined by the total number of points collected throughout the semester. All assessments are summative (lecture exams, lab quizzes and lab practicals), and each modality of summative assessment carries a different number of points.
Laboratory sessions are primarily lecture- based and are 2 hours and 50 minutes long.
Lab #7: The Anatomy of Digestive System
This is seventh (7th) laboratory session of the semester in the third block (Block #3) of the course (excluding days of the practical).
In the Spring Semester, it usually falls in the middle of the semester and mid-March.
It is followed by the lecture material on the physiology of the digestive system.
Following learning objectives only include what was explored in this TAR project, and do not include the entire scope of the lecture material covered in the 2 min 50 hour laboratory session. They will be assessed through pre- and post-lab assessments, as described in the "Methods" section.
Learning Objectives (LOs):
LO#1: Name and locate the layers and sphincters of the four major organs of the gastrointestinal (GI) tract on the anatomical models.
LO#1a. Draw the four major organs of the gastrointestinal (GI) tract and list their layers and sphincters.
LO#2: Describe the function of the layers and sphincters in the four major organs of the gastrointestinal (GI) tract using the framework of movement and mechanical digestion and the GI tract-specific terminology.
LO#3: Recognize and name the organs of the gastrointestinal (GI) tract and accessory organs on a histology slide.
LO#3a. Identify characteristics of each organ on the histology slides that will help distinguish them in the future, independent of the histological slide itself.
Learning objectives (LOs) were prioritized based on the level of prior knowledge needed to achieve each outcome. In physiological sciences, structure usually equals function, so for example, in order to describe how layers and sphincters in the four major organs of the gastrointestinal (GI) tract aid in the basic function of this system, students first need to name, locate, and label these layers and sphincters.
"Jigsaw" Method
The "jigsaw" method refers to a classroom group work modality which requires students to interact with and understand the key concepts of their assigned material on a topic, so that they can teach it to another group of students. This active learning strategy highlights the importance of teamwork, develops empathy, and increases quality of oral and written communication. (1) It has been found to be useful to students in the physiological sciences while learning complex concepts. (2, 3, 4) The following example shows how this method was implemented in this TAR project.
References:
1 Luis Manuel Tobaja Márquez, Julia Gil Llinás, Francisco Solano Macías. Collaborative learning: Use of the JIGSAW technique in mapping concepts of physics. Problems of Education in the 21st Century 75(1):92-101. February 2017. (PDF) Collaborative learning: Use of the jigsaw technique in mapping concepts of physics
2 Bhandari B, Mehta B, Mavai M, Singh YR, Singhal A. Jigsaw Method: An
innovative way of cooperative learning in physiology. Indian J Physiol Pharmacol.
2017;61(3):315-21.
3Veena Bhaskar Sampangi Rame Gowda et al., Co-operative Learning by Jigsaw in Biochemistry.
4 Suman Sharma, Sangita Chauhan, Manjinder Kaur. (2019). Introduction and Assessment of Jigsaw Method of Teaching on Challenging Topics in Physiology for First Year Medical Students. International Journal of Physiology, 7(4), 238–245. https://doi.org/10.37506/ijop.v7i4.99
TAR Question:
How do student feelings towards learning the anatomy of the digestive tract in PSIO 202 lab in a “jigsaw" method setting compare to their performance on short pre- and post-lab summative assessments on this lab content?
PROJECT GOAL
To introduce an alternative in-class learning method and compare change in pre- to post-lab assessment scores to student rating of the method. This comparison will give us a better understanding how to bridge the gap (if such exists) between students' perceived knowledge and their actual intrinsic understanding of the content.
METHODS
The following assessments were given to two laboratory sections, each led by a different Teaching Assistant (TA). One laboratory section was labeled as a "Control Group (Lecture-based Teaching Approach, LTA)" and the other one as "Jigsaw Group (Experimental-based Teaching Approach, ETA)". I led the former laboratory session, with the assistance of their teaching assistant (TA) and their undergraduate preceptor.
Change in pre- to post-lab assessment scores was assessed by short pre- (Assessment 1) and post-lab (Assessment 2) summative assessments in a form of a five (5) minute quizzes. Both groups completed both assessments, with the caveat that ETA group was allowed to use their notes to complete Assessment 2. The format of Assessments (1) and (2) followed the quiz guidelines established by the course director (e.g. a mix of question modalities: multiple choice, fill in the blank, etc.) and included wording from the learning objectives (LOs). The questions resembled questions to be expected on all laboratory graded assessments (e.g. quiz following the lecture and the practical at the end of each block). There was a total number of nine (9) questions, and each was worth one (1) point, for a total of nine (9) points.
The four (4) criteria for student rating of the method are:
1) student confidence to teach others;
2) student ability to define key ideas from the lab session;
3) how useful this learning strategy is for learning the concepts of this lab session and
4) student preference for this learning strategy over a traditional lecture.
These criteria were assessed in a form of post-lab survey with a Likert scale and free response.
All assessments used in this project are posted below.
ANALYSIS METHODS
Calculating percentage (%) of participants per Likert scale subgroup: (total number of responses for a Likert scale category/total number of students who took the survey)* 100%
Percentages were rounded to a whole number.
When making conclusions on overall agreement/disagreement in each Figure, "agreement/preference" was calculated as a sum of "agree" and "strongly agree" percentages, while "disagreement/lack of preference" was calculated as a sum of "disagree" and "strongly disagree" percentages. Otherwise, separate values are reported.
Calculating percent (%) correct answers: (total number of correct answers/total number of points)*100
Calculating fold change: (Assessment 2 percent correct answers/Assessment 1 percent correct answers)-1
RESULTS
Table 1. A list of survey questions assessed for four (4) different criteria across two groups. Each question was categorized based on how its answer supports teaching method rating criteria.
Figure 1. An overview of Control Group (LTA) Likert scale distribution across the questions. Here, it is observed that students generally feel confident in their knowledge of the key concepts (Q1, 96%) and find lecture materials useful to prepare for the future quizzes and practicals (Qs 2,3,4,5: 95%, 86%, 95% and 90%, respectively). However, they are split in agreement whether they prefer this learning strategy: 59% agrees they do, while 41% is not sure or disagreed at either levels of disagreement (Q6). Sample size: twenty-two (22) students.
Figure 2. Student question response breakdown based on the four (4) criteria for the Control Group (LTA) to rate lecture-based teaching approach and perceived knowledge. These results suggest that students have a high perception of their knowledge using the lecture-based teaching method, but are relatively indecisive if they prefer such method of learning.
Figure 3. An overview of Jigsaw Group (ETA) Likert scale distribution across the questions. Here, more distribution of agreement options from the Likert scale is observed across the questions. Generally, students do not feeling confident in their knowledge of the key concepts (Q1, 48%) or find the lecture materials or the learning strategy introduced useful (Qs 2,5: 63%, and 55%, respectively), but will be using the lecture materials to prepare for the future quizzes and practicals (Qs 3,4: 74%, and 77%, respectively). When it comes to preference for this learning method over the traditional lecture, student response to trend more not being sure (Q6, 45%) or not prefering it as much compared to portion of them that did (Q6: unsure: 45%, disagree vs agree: 32% vs 23%). Sample size: twenty-three (23) students.
Figure 4. Student question response breakdown based on the four (4) criteria for the Jigsaw Group (ETA) to rate experimental-based teaching approach and perceived knowledge. These results suggest that students do not have a high perception of their knowledge using the jigsaw-based teaching method (panels B and C), but are relatively confident in their skill to teach others (panel A). They generally are indifferent or do not prefer this active learning method over a traditional lecture.
Figure 5. Percent correct answers on pre- (Assessment 1) and post-assessments (Assessment 2) and fold change between Control Group (LTA) and Jigsaw Group (ETA). All datasets were graphed as Mean with SEM. Non-parametric Wilcoxon Matched Pairs Signed Rank Test was used to determine statistical difference between the Assessments 1 and 2 within each group in panel A. Control Group pre-/post-assessment (mean ± SEM): 82.08±3.45%, 2.96%, respectively. Jigsaw Group pre-/post-assessment (mean ± SEM): 78.39±3.39%, 70.22±4.92%, respectively. p-value for Control Group (LTA) = 0.44, Jigsaw Group (ETA) = 0.13, panel A. Non-parametric Mann-Whitney Test was used to determine statistical difference between Assessments 1 and 2 between each groups in panel A, and fold change between each group in panel B. Control Group (LTA) vs Jigsaw Group (ETA), Assessment 1 (mean ± SEM): 0.0325±0.0842%. Control Group (LTA) vs Jigsaw Group (ETA), Assessment 2 (mean ± SEM): -0.0826±0.0721%. p-value for Control Group (LTA) vs Jigsaw Group (ETA), Assessment 1 = 0.36; Control Group (LTA) vs Jigsaw Group (ETA), Assessment 2 = 0.16, panel A. p-value for fold change between each group = 0.31. p-value <0.05 is considered statistically significant difference. Sample size for Control Group (LTA): twenty-four (24) students; Jigsaw Group (ETA): twenty-three (23) students.
DISCUSSION
The key results which will help us decide if TAR question is answered are:
There is no statistically significant difference in performance (as measured by the fold change between Assessments 1 and 2) between the student group who was taught the concepts of anatomy of the digestive system through a lecture-based teaching approach versus the one being taught through an experimental-based teaching approach ("jigsaw" method). (Figure 5B.) Interestingly, students in the jigsaw group (ETA) overall stayed consistent with the performance on the post-lab assessment, which could be contributed to their ability to use their notes if so desired. (Figure 5A.) Since there is no record of how many students actually did use their notes in this group, or a comparison of performance of ETA group students who used their notes versus the ones who have not, this is a potential confounding factor. It would be interesting to see how the ability to use notes in a post-assessment correlates to perceived knowledge.
In somewhat contrast to the result above, students in the control group (LTA) have more self-perceived knowledge compared to the jigsaw group (ETA), as demonstrated in Figures 2A-4B and 2B-4C by increased percentage of "agree" and "strongly agree" statements sum. This can easily be explained by be the fact that jigsaw student group (ETA) uses to them an unfamiliar learning method, which can lower self-esteem and perceived knowledge on the topic. This is especially true as this student group is put "on the spot" do not only learn their assigned key concepts in ~twenty (20) minutes, but also demonstrate it to their peers right after. Because of a confounding factor mentioned above, it is not clear whether their actual performance is better than their perceived knowledge.
In addition, jigsaw group (ETA) expressed somewhat more "dislike" towards the introduced active method of learning (Figure 4D.), while the control group was somewhat split on their decision towards the lecture-based teaching approach (Figure 2C.). These are valuable results as they point out that it takes more than a sudden introduction to a new teaching method to get students out of their "lecture style comfort zone".
So, do these key findings answer the TAR question: "How do student feelings towards learning the anatomy of the digestive tract in PSIO 202 lab in a “jigsaw" method setting compare to their performance on short pre- and post-lab summative assessments on this lab content?" They do (Key Results 1 and 2), albeit not to an extent wanted, due to some of the factors mentioned above. Do we have a better understanding how to bridge the gap (if such exists) between students' perceived knowledge and their actual intrinsic understanding of the content? Yes, to an extent. Clearly, Key Result 3 suggests a need for an introduction of an alternative teaching/learning method to lecture-based teaching approach in if not only in the laboratory session dedicated to anatomy of the digestive system, possibly in PSIO 202 laboratory as a whole. However, there is a caveat- the same results suggest that introduction of such approach should be done gradually, and with the teaching assistant (TA) students are assigned to at the beginning of the semester.
LESSONS LEARNED
Creating, executing, and completing this TAR project was a very valuable experience and lesson in project management and navigation when it does not all go according to plan. I feel more confident to continue not only learning, but actively creating learner-centered spaces, because this opportunity gave me a framework to refer to when planning such efforts. I also appreciate more the value of pre-assessments, as they really do drive the comparative nature of this and similar projects. Something I would like to continue learning is how to improve the relationship between qualitative data collection process and that data being informative for the question(s) being asked, and qualitative data analysis.
If I were to complete this same project again, I would improve several key aspects of it:
I would have ensured that the method rating criteria is supported by the same number of questions that describe whether that criteria has been fulfilled or not. Currently, some criteria has only one survey question associated with it, while same has many (e.g. Criteria 4 is described by Likert scale for Q6, while Criteria 3 has many Qs describing it).
I would have asked students to write a code name on both of their summative assessments and completed surveys to more accurately link the rating spectrum with the summative assessment scores (for example, to compare how well students who highly or negatively rated the learning method performed on both summative assessments).
I would have included more free response questions to understand why students prefer one teaching method over the other, to explain why they felt or did not feel confident in their perceived knowledge, as well as to actually demonstrate they do know what the key concepts by writing them out, and not just complete the assessments.
Teach the TAs how to implement some aspects of this active learning technique throughout the semester before implementing the whole technique to avoid a sudden change of teaching/learning modality.
Teach the TAs how to implement this active learning technique to avoid a "stranger danger" effect by being an unfamiliar face to students.
RESOURCES
Open image(s) in new tab to see the full version!
Pre-Lab Assessment
Post-Lab Assessment
Control Group (lecture-based teaching approach, LTA)
Jigsaw Group (experimental-based teaching approach, ETA)
If you would like a PDF/Office Microsoft Word version of any of these documents, please see my contact information below!
About the author
Maša, a Serbian native, is a third year Ph.D. student (soon to be candidate!) in Physiological Sciences Graduate Interdisciplinary Program (PSGIDP) and Department of Neuroscience, studying how a specific neuronal population in amygdala (the part of the brain associated with emotional processing) responds to gut hormones secreted in response to satiation signaling throughout meal consumption. She is very passionate about creating learner-centered academic space and guidance for not only graduate students, but undergraduate students as well, which starts with projects like this! She already has a few in mind which she will be working on creating proposals for over the summer, so please reach out if you are interested in collaboration. In her free time, Maša likes to dance social Latin dances, explore local bookstores and coffee shops through urban hiking, and learn about art and art history.
Contact information: mmiscevic@arizona.edu
PSGIDP Website: https://physiological-sciences.arizona.edu/people-0/phd-students
Department of Neuroscience Website: https://neurosci.arizona.edu/people/graduate-students