Chemistry Education Research Graduate Student & PostDoc
Professional Development Conferences
(Miami University)

2019 Conference

Plenary Speakers & Workshop Leaders

Stacey Lowery Bretz, Miami University

Conference Organizer

Christopher Bauer, University of New Hampshire

Member, Project Advisory Board

Thomas Holme, Iowa State University & Editor-in-Chief Designate, Journal of Chemical Education

Reviewing Papers for the Journal of Chemical Education

Participants will be provided access to a short CER manuscript, read it, evaluate it, and submit their comments prior to arriving at the conference. After submitting a review, the user will be able to access the overall rating and the comments from fellow reviewers. During the workshop, the single-blind and double-blind review processes will be described. Reviews of the sample manuscripts will be discussed from the context of making an editorial decision and from the context of reading and interpreting reviews returned to the authors by the Journal. Facts and myths about publication in the Journal of Chemical Education will be discussed.

Resa Kelly, San Jose State University

Member, Project Advisory Board

Scott Lewis, University of South Florida

Member, Project Advisory Board

Kristen Murphy, University of Wisconsin-Milwauee & Director, ACS Examinations Institute

Peer Review & Assessment at ACS Exams

Exam committees for ACS Exams follow a process for exam development that includes test specifications through item writing, editing and selection.  This assessment workshop will be a “mini-exam development experience” where we will go through the process of developing an exam replicating a similar model to that which we use for ACS Exams. Included in this workshop will be:

The committee structure inherently includes peer review at all steps of test development including analyzing items statistics.  Included beyond an exam committee experience will be how to use link this process to classroom and programmatic assessment efforts.

Sam Pazicni, University of Wisconsin-Madison

Towards Achieving Equity: Exploring Cognitive Compensation in General Chemistry

Factors that contribute to success in chemistry courses, or in mastery of chemical concepts, can inform pedagogical strategies in chemistry classrooms. It is important, however, that pedagogical strategies be informed not by solely focusing on students with perceived inadequacies (i.e., a deficit model, “fixing” the student), but by exploring classroom norms/structures that support the equitable learning and assessment of all students (i.e., an achievement model). For example, when the assessment structure of a biology course was changed to minimize high-stakes exams and rewards, the achievement gap between female and male students decreased.1 We are surveying factors that could mitigate another known achievement gap in General Chemistry, that between students of low and high prior chemistry knowledge. Prior knowledge is a key factor in popular learning theories (e.g., meaningful learning and information processing theory) and is known to have a marked effect on course learning outcomes generally2. The effect of prior knowledge on achievement has also been characterized in introductory chemistry courses3. This contribution will explore the potential for two cognitive factors (motivation and structure building) to compensate for low prior knowledge in General Chemistry courses. By compensate4, we mean that there is a level of these factors at which low prior knowledge students achieve similarly to high prior knowledge students. We conjecture that if the chemistry education community had knowledge of what factors decreased the achievement gap between low and high prior knowledge students (i.e., compensate for low prior chemistry knowledge), further targeted work could be done to adjust course norms/structures accordingly to take advantage of (and further test) these factors. 

1. Cotner, S.; Ballen, C.J. PLoS One 2017, 12 (12), e0189610.

2. (a) Dochy, F.; Sengers, M.; Buehl, M. M. Rev. Educ. Res. 1999, 69(2), 145–186; (b) Shapiro, A. M. Am. Educ. Res. J. 2004, 41 (1), 159–189.

3. (a) Seery, M. K. Chem. Educ. Res. Pract. 2009, 10(3), 227–232; 

(b) Pyburn, D. T.; Pazicni, S.; Benassi, V. A.; Tappin, E. E. Chem. Educ. Res. Pract. 2013, 14(4), 524–541.

4. O’Reilly, T.; McNamara, D. Am. Educ. Res. J. 2007, 44(1), 161–196.

Norbert Pienta, University of Georgia & Editor-in-Chief, Journal of Chemical Education

Reviewing Papers for the Journal of Chemical Education

Participants will be provided access to a short CER manuscript, read it, evaluate it, and submit their comments prior to arriving at the conference. After submitting a review, the user will be able to access the overall rating and the comments from fellow reviewers. During the workshop, the single-blind and double-blind review processes will be described. Reviews of the sample manuscripts will be discussed from the context of making an editorial decision and from the context of reading and interpreting reviews returned to the authors by the Journal. Facts and myths about publication in the Journal of Chemical Education will be discussed.

Dawn Rickey, Program Officer, National Science Foundation

How to Support Your Research Program and Your Colleagues via NSF Proposal Writing and Reviewing

The National Science Foundation (NSF) is a major source of funding to support chemistry education research projects. Each NSF proposal must be reviewed by at least three experts from outside NSF. (There are some exceptions to this, such as conference proposals requesting less than $50,000.) Reviewing NSF proposals is an excellent opportunity for professional development that helps prospective Principal Investigators (PIs) learn how to write strong proposals. In addition, reviewing proposals serves NSF and the nation (by contributing expertise used to decide which proposals should be funded with the tax payers money), as well as the colleagues whose proposals you review (by providing valuable feedback to improve both awards and declinations).

Prior to the CER GSPD conference, you will receive information about NSF programs that support chemistry education research (and STEM education more broadly), guidance for reviewing NSF STEM education proposals, and two proposals to review. (The proposals you will read have been previously considered by NSF, and the PIs gave their permission for workshop participant to see them.) 

During the workshop, we will hold a mock panel review meeting in which the two proposals you reviewed will be discussed. Then we will have a meta-discussion of the process and a Q&A session.

Ginger Shultz, University of Michigan

Tracking Student Communication about Science Content during Peer Review

Peer review is known to support a variety of learning outcomes including critical thinking, reading skills, and writing skills and is often used as a strategy to more actively engage students during writing assignments. However, instructors and students alike are skeptical about the quality of feedback provided by students.  Our research group studied the capacity of students to provide meaningful feedback on the accuracy of science content when reviewing each other’s writing.  We qualitatively analyzed student writing on a variety of topics along with the comments provided by peers. Using these data we tracked misconceptions through the peer review and revision process.  These studies revealed that students were capable of giving accurate feedback on a variety of science topics, which was then successfully used to improve content accuracy during revision.  Student interviews support these findings and indicate that students valued the feedback they received as well as the process of analyzing the writing of others.

Marilyne Stains, University of Virginia

Closing the Research-Practice Gap in STEM Education by Investigating Faculty

National initiatives to improve undergraduate science education build upon decades of research and development of effective instructional practices for science, technology, engineering, and mathematics (STEM) postsecondary classrooms. These evidence-based instructional practices (EBIPs) promote students’ conceptual understanding and attitudes toward STEM, with the greatest impacts observed among women and members of underrepresented groups. By improving retention rates and attracting a more diverse student population to the sciences, these practices can help address the national need to educate STEM-literate graduates and advance workforce development goals. The challenge is fostering their effective use on a national scale. Successful instructional reform requires STEM faculty engagement, yet we know little about them. We need to better understand faculty’s knowledge base for teaching, instructional practices and the relationship between the two as well as how these characteristics evolve under varying reform environments and departmental constraints. Results of this foundational research are critical to ensure the success of current and future national and local STEM instructional reform efforts. In this talk, we will describe our efforts in addressing this extensive gap in the literature.

Ellen Yezierski, Miami University

Let’s Up Our Game: Improving Quantitative Methods and Reporting in CER

This workshop aims to improve participants’ awareness of best and not-so-good practices in conducting quantitative research and behavioral statistics reporting in CER. Participants will “play” with simulated data sets, explore research examples, and discuss ways to contribute to the advancement of our field, specifically in conducting and reporting on quantitative studies in CER.

Amelia Anderson-Wile, Ohio Northern University

Dr. Anderson-Wile will be on sabbatical in the Bretz CER Group during fall 2019.

Graduate Students & PostDoc Attendees

Tim Abell, Postdoctoral Researcher, University of Massachusetts-Boston (Advisor: Tim Abell)

Investigating Teachers’ Emphases when Planning Formative Assessments

Assessment portfolios have been used to gain insight into teachers assessment practices. In our study 6 teachers in 2017-2018 and 8 teachers from 2018-2019 went through a year long professional development program which included 9 sessions. Throughout the year the teachers submitted four formative assessment (FA) portfolios. The FA portfolios included a blank copy of the FA, the teacher’s goal for using the FA, their expectations of the students’ performances on the FA, and examples of student work and the feedback that was provided to the student. Preliminary findings related to what the teachers emphasize about chemistry will be presented.

Mercy Adoma Fosu, Ph.D. Candidate, South Dakota State University (Advisor: Tanya Gupta)

Technology-based Culturally Relevant Education (CRE) in chemistry teaching and learning

Despite the use of student-centered practices, the relevance of chemistry concepts and principles remains a challenge for most students. Part of this problem is the disconnection with what students experience in their every-day life and how the material, specifically chemistry content is presented via text-books, lectures and laboratory teaching. Present study on technology-based culturally relevant education is focused on developing classroom activities and resources for students to enhance student awareness of cultural practices and to also educate students about chemistry, while emphasizing the relevance of scientific (chemistry-based) practices from a cultural and traditional standpoint. In this poster presentation, some of these technology-based activities that are being developed at South Dakota State University to achieve the goal of increasing student awareness of traditional cultural practices and the relevance of chemistry will be presented. Further, preliminary findings of the impact of CRE on student academic performance and student perceptions will also be presented.

Zahilyn Roche Allred, Postdoctoral Researcher, Florida International University (Advisor: Sonia Underwood)

Development of Multiple Assessments to Investigate Students’ Integration of Core Chemistry Ideas in Biology 

Introductory science courses at the university level can be challenging for many students. A challenge associated with these courses is the lack of explicit connections made between concepts taught among science classes. Although it is necessary for students to learn to integrate scientific knowledge from different courses meaningfully, they are often not provided opportunities to practice integrating concepts purposefully. This research focuses on the development of multiple activities that prompt students to use their chemistry concepts to explain various biological phenomena (e.g. intermolecular forces role in denaturing DNA). Preliminary findings on the development and students’ performance on these activities will be presented.    

Catherine Amoateng, Ph.D. Candidate, Miami University (Advisor: Ellen Yezierski)

Inorganic Qualitative Analysis Experiment through Digital Microscopy Detection of Precipitates

The inorganic qualitative analysis experiment has been part of the first-year chemistry laboratory course sequence for many decades but has never been updated for low level quantitative detection of cations and anions. Recently the use of a fabricated elastomer lens in conjunction with a smart phone and Image J software has permitted low ppm detection of lead as the chromate precipitate.  In this work we have employed the use of an inexpensive digital microscope to generate images of dried particles generated from small droplets of metal ions mixed with precipitating anions. Quantitative information is then extracted using Image J open source software. We envision the digital microscopic imaging methodology to have broad incorporation into physical and analytical chemistry laboratory courses as well as the first-year lab.

Jiwoo An, Ph.D. Candidate, Iowa State University (Advisor: Thomas Holme)

Development of Application to Enhance Instrumentation Learning in Chemistry Laboratories

Instruments are often in the core of many experiments students perform, from general chemistry laboratory to higher-level courses such as analytical or physical chemistry. In many instances, instruments are viewed as black boxes to students, resulting in less-than-ideal learning outcomes in a rather important aspect of science. Augmented Reality in Educational Laboratories (ARiEL) is an app aimed to bridge students with information on chemistry instruments used in laboratories. This poster will discuss the outcome of usability study and the future direction.

Emily Atieh, Ph.D. Candidate, Rutgers University (Advisor: Darrin York)

From Me to You: Changing Discourse and Teaching Behaviors of Peer Instructors

At Rutgers University, peer instructors play a vital role in our large lecture courses, with nearly a thousand hours of student facetime per semester in General Chemistry alone. These “Teaching Interns,” or TIs, receive weekly pedagogical training, which places an emphasis on student-led learning, as opposed to traditional teaching methods. Using discourse analysis, we explored whether the type of dialogue (student-centered vs. instructor-centered) changed over time. We coupled this research with both student-perceived and TI-perceived changes in teaching behavior, with the latter part providing insight as to where these changes stem from and how we can improve our training methods.

Molly Atkinson, Postdoctoral Researcher, Miami University (Advisor: Stacey Lowery Bretz)

Development of the Reaction Coordinate Diagram Inventory: Measuring Student Thinking and Confidence with Reaction Coordinate Diagrams

Reaction coordinate diagrams (RCDs) simultaneously depict both thermodynamic and kinetic information. In this research study, semi-structured interviews were conducted with second-semester general chemistry and second-semester organic chemistry students to investigate their understandings regarding the surface features of RCDs and how students decode mechanistic information from RCDs. Findings from the qualitative analyses of these interviews highlighted the challenges that both general chemistry and organic chemistry students face when interpreting RCDs and connecting surface features to reaction mechanisms. These results were used to create an assessment tool, the Reaction Coordinate Diagram Inventory (RCDI), to quantitatively measure general chemistry and organic chemistry students’ thinking and confidence with RCDs. Preliminary findings and evidence for the validity and reliability of the data generated by the inventory will be presented.

Morgan Balabanoff, Postdoctoral Researcher, University of Nebraska-Lincoln (Advisor: Alena Moon)

Analyzing Students’ Cognitive Resources in their Understanding of the Photoelectric Effect and Conceptualization of Light Behavior

Students’ understanding of light-matter interactions are central in undergraduate chemistry where they are typically introduced to fundamental concepts in first semester general chemistry. The phenomenon known as the photoelectric effect provides a means to explore students’ understanding of light behavior. Using a phenomenographic approach, our interview elicited the variety of ways that students think about the photoelectric effect. Using a cognitive resources framework, we explored multiple approaches students used to analyze light behavior. Further analysis revealed what kinds of conceptual resources students are relying on as they engage in their sense-making approach.

Nicole Baldwin, Ph.D. Candidate, University of Nevada Las Vegas (Advisor: MaryKay Orgill)

Teaching assistants’ perceptions and use of external representations when teaching acid-base titrations in introductory chemistry laboratory courses

Chemistry requires the use of diagrams and symbols to represent phenomena undetectable by human senses. Fluency in their use is essential for practicing chemists and students. Research suggests that students face significant challenges when learning from chemistry representations. It then becomes important to examine how students use representations and how they are presented by instructors. We examine the relationship between chemistry teaching assistants’ use of representations and the challenges they perceive their students have when learning acid-base titrations. Our results suggest a lack of alignment between the use of representations and the obstacles to learning chemistry concepts their students experience.

Jared Breakall, Ph.D. Candidate, Purdue University (Advisors: Roy Tasker and Marcy Towns)

What Do Undergraduate General Chemistry Instructors Consider When Creating Multiple-Choice Exams?

Multiple-choice (MC) exams are common in undergraduate general chemistry courses and are known for being difficult to construct. Although chemistry instructors are expected to be competent in the exam creation process, they typically receive little to no training in appropriate assessment design practices. Furthermore, there has been little research conducted that investigates what chemistry instructors consider when they are creating MC exams.   In this phenomenographic study, chemistry instructors participated in a three-phase interview about their MC assessment design practices. Themes were identified; preliminary results and implications from this study will be presented.

Ian Brown, Ph.D. Candidate, University of Iowa (Advisor: Renee Cole)

Promoting Active Learning in Analytical Chemistry

Faculty development workshops for teachers often fall short of the intended goals for adoption and implementation of the desired pedagogy.  My work will describe insights gained from analysis of a series of iterations of a workshop program for supporting faculty adoption of active learning pedagogies.  In particular, the way in which observations and survey results have been used to make modifications to the workshops, and the impacts of those modifications, will be discussed along with the follow-up activities and preliminary impacts.

Brittany Busby, Postdoctoral Researcher, Auburn University (Advisor: Jordan Harshman)

Are Students Able to Transfer Math Graphing Skills to Other Contexts?

General chemistry is a gateway course for STEM students, but has a high fail rate. To determine potential sources of fail rates, we conducted a study to answer the following questions: (1) Can the participants transfer math-graphing skills to other contexts, such as chemistry, physics, and economics?; and (2) Do participants recognize that they are utilizing the same mathematical skills in both math and chemistry graphing scenarios? Using a sequential mixed methods design, we found that, ultimately, students do not transfer math skills because they think in discipline specific contexts, and at a surface level.

Courtney Chatha, Ph.D. Candidate, Miami University (Advisor: Stacey Lowery Bretz)

Exploring radical polymerization and polymer solubility through the Belousov-Zhabotinskii oscillating reaction  

We are currently developing an inquiry experiment for second semester undergraduate organic chemistry students to explore radical polymerization using the Belousov-Zhabotinskii (BZ) oscillating system as a radical source. The BZ reaction allows for radical polymerization under aqueous, open air conditions after an extended induction period before oscillations being. Working with different monomers and temperature conditions, students will encounter varying induction times and polymer solubilities. Students will be asked to explain the differences in solubility by connecting the physical observations to the monomer structures.

Aaron Clark, Ph.D. Candidate, University of South Florida (Advisor: Jeff Raker)

How Students Study for Undergraduate Organic Chemistry: A Phenomenographical Perspective

Organic chemistry is known for being a hard, demanding course. Studies have considered how students learn organic chemistry, strategies employed for teaching and learning, and why ‘good’ students fail the course. ‘Good’ students are successful in their non-chemistry classes and even in general chemistry. Our qualitative investigation extends current understanding of how students learn organic chemistry by noting how prior study habits influence and limit achievement in organic chemistry. Sixteen pre/post interviews will be shared that showcase differing approaches to the course. Implications will be offered for how instructors can help students adjust their approaches to studying.

Megan Connor, Ph.D. Candidate, University of Michigan (Advisor: Ginger Shultz)

Constraints on Organic Chemistry Students’ Reasoning during IR and 1H NMR Spectral Interpretation

Promoting students’ ability to engage in discipline-specific practices is a central goal of chemistry education. Yet if instruction is to foster such ability, we must first understand students’ reasoning during these practices. This study investigated organic chemistry students’ reasoning as they evaluated the success of chemical syntheses through IR and 1H NMR spectral interpretation. Participants completed interpretation tasks followed by cued, retrospective think-aloud interviews. Interviews were analyzed qualitatively to characterize invalid assumptions and heuristics used by participants, both of which act as cognitive constraints. Findings suggest that the most problematic constraints constitute a combination of particular invalid assumptions and heuristics.

Olivia Crandell, Ph.D. Candidate, Michigan State University (Advisor: Melanie Cooper)

Causal Mechanistic Reasoning in Transformed Organic Chemistry

We suggest that students can develop a robust understanding of chemical reactivity by engaging in causal mechanistic reasoning. In the context of chemical reactivity, a causal mechanistic explanation draws on chemical principles to explain why chemical species interact in a particular way (the cause) and gives a detailed account of electron movement that transforms reactants to products (the mechanism). Participants in this study were enrolled in a transformed organic chemistry course. This poster will present data collected over two semesters of organic chemistry and reveal how student reasoning about simple nucleophilic substitution reactions evolves overtime.

Elizabeth Day, Postdoctoral Researcher, Michigan State University (Advisor: Melanie Cooper)

Transforming the Organic Chemistry Laboratory Curriculum: Engaging in Scientific Practices with Green Organic Projects

At Michigan State University, we are transforming the non-chemistry majors’ organic chemistry laboratory. The current curriculum is a traditional confirmatory organic chemistry laboratory curriculum in which students follow instructions to extract, synthesize, or analyze compounds. The transformed curriculum is a problem-based, collaborative approach to green organic chemistry laboratories. Using evidence-centered design principles, our approach is to adapt existing green laboratory exercises to incorporate scientific practices as defined by the National Research Council’s Framework for K-12 Science Education (2011). Students in this curriculum will work collaboratively on organic projects that implement green chemistry principles to solve problems (rather than simply following instructions). As part of this curriculum, we will develop assessments to measure student and teaching assistant outcomes. This presentation will discuss the first iteration of the design cycle and outline future steps.

Stephanie Feola, Ph.D. Candidate, University of South Florida (Advisor: Jennifer Lewis)

Integration of Community Derived Knowledge into the Assessment Practices of a Biochemistry Instructor

Assessment knowledge is an aspect of pedagogical content knowledge (PCK) that higher education faculty frequently access when drafting questions for quizzes and exams. However, in the new model of PCK, there is no detail about assessment knowledge and practices. To see how assessment practices are generated from community developed collective-PCK, this study focused on the integration of the biochemistry threshold concept of Physical Basis of Interaction (PBI) into a biochemistry instructor's exams. Integration of community knowledge about PBI allowed the instructor to iteratively change their exam questions to better elicit student understanding.

Sarah Fullington, Ph.D. Candidate, Miami University (Advisor: Stacey Lowery Bretz)

Students’ Ideas about Effort, Ability and Success in the Undergraduate Chemistry Laboratory

Little evidence exists in the literature to support the assertion that students learn in the laboratory or demonstrate any relationship between students’ experiences in the laboratory and their learning. This study investigates how first-year students’ mindset shapes their learning in the undergraduate chemistry laboratory. Students were sampled using the results from a 4-item instrument used to characterize students’ mindset. Students were observed in the laboratory and participated in semi-structured interviews where they were asked to explain their ideas about success, effort and ability in relation to completing laboratory experiments. Preliminary findings regarding students’ ideas and responses will be reported.

Ashley Geraets, Ph.D. Candidate, University of Central Florida (Advisor: Erin Saitta)

Providing an Authentic Instructional Experience through the Development of Rehearsal Concept Modules for a Mixed Reality Teaching Simulator

Graduate teaching assistance (GTAs) are often assigned positions as laboratory or discussion instructors. However, few chemistry GTAs are provided with formal training on effective teaching strategies. Existing models, like role-playing are designed to help build the skills necessary to implement active learning but are limited by the extent to which they can accurately replicate a realistic teaching experience. We have created rehearsal concept modules for use in a mixed-reality simulator where the GTAs practice teaching skills in a low risk environment. Findings from this research have implications for GTA professional development and a wider spread adoption of active learning techniques.

Rupa Gokal, Postdoctoral Researcher, University of Georgia (Advisor: Richard Morrison)

Comparing Exam Question Formats and Student Performance Data to Improve Assessment, Instruction, and Student Comprehension in First Semester Organic Chemistry 

Several publications in the scientific literature examine the quality of multiple-choice question construction and the ability of multiple-choice questions to accurately assess student comprehension. There is a paucity of research juxtaposing various question formats to compare their relative efficacy in assessing student mastery of specific concepts. The body of chemical education literature also lacks a comprehensive and formative discussion designed to improve organic chemistry instruction and assessment.  This study compares student responses from in-semester free response exams to those from a cumulative multiple-choice final examination written for first-semester organic chemistry at the University of Georgia.

Travis Green, Ph.D. Candidate, Bowling Green State University (Advisors: Alexis Ostrowski and Andrew Torelli)

Infrared Thermography as a Unique Visualization Tool for Chemistry Education

Infrared (IR) thermography uses false colors to visualize IR radiation. Educators can take advantage of this technology to help students monitor processes or reactions that absorb or release heat. The advantages go beyond the visual output, as any changes in the image are a result from changes in the internal energy of the system due to reactions or processes at the molecular level. This is an important concept for students to understand, and through the use of IR thermography, otherwise invisible evidence of molecular interactions can be visualized.

Rayford Harrison, Ph.D. Candidate, University of Iowa (Advisor: Renee Cole)

Characterization of Chemistry Laboratory Course Effectiveness based on the Development of Specific Student Skills

From participation in laboratory activities, students are presented with the opportunity to develop transferable skills such as written communication and applying major scientific concepts to novel contexts. Prior works have highlighted the general notion that students should develop transferable skills that will aid them in their future careers however, there has been little focus on the alignment of course expectations with respect to skill development in the chemistry laboratory curriculum. In this study, we present a method for characterizing the effectiveness of chemistry laboratory courses based on how instructional activities and course features aid student development of specific skills.

Amber Heidbrink, Ph.D. Candidate, University of Northern Colorado (Advisor: Melissa Weinrich)

Undergraduate Chemistry Professors' Perspectives of Their Students' Metacognitive Development

Metacognition is important in improving students’ conceptual understanding. Students with strong metacognitive skills are better prepared to solve problems in areas where they have minimal experience. This study illuminates current chemistry professors’ expectations of their students’ metacognitive abilities, and if and how these professors strive to promote metacognition in their students. Professors (N=17) were interviewed on their assessment practices, classroom expectations, and exercises to develop metacognition. Results discuss these professors’ awareness of metacognitive skills in their students, and how these professors perceive metacognition development in their classroom. Implications for developing instructors’ capacity to foster their students’ metacognition will be discussed.

Michelle Herridge Bailey, Ph.D. Candidate, University of Arizona (Advisor: Vicente Talanquer)

Instructor Evaluation of Written Responses to Assessment in Chemical Thinking

Instructors’ (faculty and graduate teaching assistants) feedback plays a central role in supporting student learning in general chemistry courses. Existing research indicates that the quality of instructors' feedback has a significant impact on student progress towards the learning goals. This study characterizes the types of feedback that instructors provide to students' written work on formative and summative assessments. Preliminary results of this qualitative study explore what instructors notice in student work, how they interpret what they notice, and the feedback and grading decisions that they make as result of their analysis.

Nicole James, Postdoctoral Researcher, Northern Illinois University (Advisor: Nicole LaDue)

Implementation and Effectiveness of a Collaborative Learning Program to Supplement Traditional General and Organic Chemistry Lecture Courses

Large university chemistry courses often provide lecture-based instruction. However, active learning pedagogies significantly improve student performance, particularly for underrepresented students. We present a scalable model for providing active learning opportunities to students enrolled in traditional, lecture-dominated chemistry courses. Students in these “parent” courses can elect to enroll in Collaborative Learning in Chemistry (CLiC), a supplemental 0-credit Pass/Fail course. CLiC students work in groups on practice problems in a peer-led team-learning (PLTL) and process-oriented guided inquiry learning (POGIL) inspired environment. Here we assess the improvement in CLiC student average exam scores compared to their non-CLiC peers.

James Kingsepp, Ph.D. Candidate, University of South Florida (Advisor: Scott Lewis)

Analyzing the Retention of Knowledge among General Chemistry Students

An important aspect of demonstrating student understanding is the retention of topics across time. Without retention of topics, the ability of students to employ relevant knowledge within future courses is in doubt. Six items on in-term tests were repeated verbatim on the final exam to measure retention of topics. Cluster analysis was used to describe patterns within the results.  Approximately 40% of students exhibit high level of retention and these students outperform their peers throughout the semester.  These students also exhibit greater improvement from first test to final exam than their peers.

Heena Lakhani, Ph.D. Candidate, University of Washington (Advisor: Philip Bell)

Designing Structures for Students to Navigate Between their Intuitive and Scientific Understandings: The Case of Physical and Chemical Changes 

Students’ intuitive/naïve/everyday ideas co-exist with their scientifically-aligned ideas, and learning experiences should be designed that allow students to navigate between diverse forms of reasoning. The present research seeks to understand: what are students’ intuitive ideas about physical and chemical changes in different contexts? how can metacognition help students navigate between their intuitive and scientifically-aligned ideas? what knowledge do they recruit in subsequent reasoning tasks? Through this study, I hope to understand how the process of metacognition supports students to navigate between their intuitive and scientific ideas in subsequent reasoning tasks.

Katherine Lazenby, Ph.D. Candidate, University of Iowa (Advisor: Nicole Becker)

Assessing Undergraduate Students' Epistemic Knowledge of Models

Undergraduate chemistry students use scientific models to predict and explain chemical phenomena in their chemistry courses. However, students often use scientific models heuristically and without considering how models are developed, why models are useful, or the assumptions and limitations of models. To gain a sense of how students think about the epistemological nature of scientific models, we developed assessments to examine students' reasoning about models and the process of modeling.

Dilhara Liyanage, Ph.D. Candidate, Virginia Commonwealth University (Advisor: Sally Hunnicutt)

Analysis of Divergence in Student Interactions and Argumentation in Process Oriented Guided Inquiry Learning - Physical Chemistry Classroom (POGIL - PCC)

Social network analysis of POGIL – PCC is used to probe student-student and student-instructor interactions that form the basis of learning according to social constructivism.  Sociograms are used to visualize and characterize the interactions, using measures of centrality, density, and reciprocity.  Preliminary results suggest that reciprocity and density typically increase after direct contact with the instructor and decrease after a clicker question and after whole class discussion. Ongoing coding of recording of selected student teams may help us understand the changes in interactions as related to specific physical chemistry concepts.

Jocelyn Nardo, Ph.D. Candidate, Purdue University (Advisor: Minjung Ryu)

Understanding how Preservice Elementary Teachers Negotiate their Practice-Linked Identities within a Chemistry-Content Course

Preservice Elementary Teachers (PSETs) are a population viewed deficiently by the literature as having a "lack of" science knowledge and "in need" of science intervention. To offer a new perspective, I examined 10 video-recorded, focus group interviews with PSETs undertaking a chemistry-content course. Guided under the theoretical constructs of practice-linked and disciplinary identities, I offer that PSETs author their chemistry learning in a way that is not only meaningful for their careers, but also for their everyday lives. Using narrative inquiry, I show the stories of how PSETs come to know themselves as future science teachers and current science learners.

Carine Nemr, Ph.D. Candidate, University of Toronto (Advisor: Andrew Dicks)

Problem-Solving in Organic Chemistry: Mechanistic Analysis of an “Unknown” Reaction

A guided-inquiry experiment was developed for a third-year undergraduate organic mechanisms course based on a multicomponent Passerini reaction. This reaction is not explicitly covered in the class component of the course and an experimental protocol is only provided during laboratory time. Microscale syntheses of six “unknown” compounds were optimized to rapidly generate good yields. The variety of products facilitates personalized student work during a three-hour laboratory with each reaction highlighting green chemistry principles. During the experiment, students synthesize, purify and characterize their product whilst undertaking a collaborative problem-solving exercise. Next, they analyze provided spectroscopic data to propose their “unknown” structure.

Maia Popova, Postdoctoral Researcher, University of Nebraska-Lincoln (Advisor: Marilyne Stains)

Relationship between Instructional Practices and Epistemological Beliefs of Chemistry Faculty at Research-Intensive Institutions

Previous research has reported that faculty’s beliefs about teaching affect their instructional practices in classrooms and sometimes are a barrier to reforming traditional lecture-based STEM courses. This study aims to characterize the teaching beliefs of chemistry faculty from research-intensive institutions. The interconnected model of teacher professional growth has been chosen as the theoretical framework for the study as it illustrates the complex non-linear nature of the relationships between teaching beliefs, classroom practices, student learning outcomes, and external sources of information. Nineteen assistant chemistry faculty have been interviewed using the teaching beliefs interview protocol. Categories and themes that reflect patterns in faculty’s thinking were identified through constant-comparative analysis.

Justin Pratt, Postdoctoral Researcher, University of South Florida (Advisor: Jeff Raker)

Measuring Motivation in Foundations of Inorganic Chemistry Courses: Preliminary Results

Motivation is an affective dimension shown to associate with student learning in general and organic chemistry courses. In this study, we expand work on this relationship to include the postsecondary foundation-level inorganic chemistry course. Data were collected at multiple institutional sites participating in a course transformation research project. Student motivation was measured using the Academic Motivation Scale – Chemistry (AMS-C) at the beginning and end of the semester (pre/post). This poster will focus on evidence for validity, reliability, and measurement invariance for the AMS-C data obtained from this upper-level chemistry course population.

Vanessa Ralph, Ph.D. Candidate, University of South Florida (Advisor: Scott Lewis)

Equitable Assessment Strategies for Chemistry Students of Diverse Preparation in Mathematics

An established literature base has shown a relationship between students’ math aptitude scores and success in chemistry. To achieve a better understanding of the nature of these struggles, semi-structured, think aloud interviews were conducted with chemistry students scoring in the bottom quartile of the SAT or ACT. Expectations that students of low math aptitude would struggle with mathematical operations were not realized. Implications suggest the alignment of distractors with processes for a solution rather than the numerical product of a calculation and organization of number, unit, and chemical triads may be helpful toward combating inequity in chemistry assessment.

Gil Reynders, Ph.D. Candidate, University of Iowa (Advisor: Renee Cole)

Assessing Professional Skills: Resources and Propagation

Professional skills are frequently listed as programmatic outcomes in chemistry and other STEM disciplines. However, recent reports have highlighted a lack of explicit assessment for these skills in classrooms. My research has developed resources for instructors to explicitly assess professional skills in student written work and group interactions. These resources are designed to support instructors in defining and discussing their expectations for students, providing actionable feedback to students, and reflecting on their teaching practices. The development of the materials, their effects on student learning, and the impact of propagation efforts will be discussed.

Tess Ritchie, Postdoctoral Researcher, United States Naval Academy (Advisors: Debra Dillner and Melonie Teichert)

Professional Development and Career Preparation in Chemistry Doctoral Programs 

Career development opportunities within chemistry doctoral programs have not kept pace with dynamic shifts in the career paths of their graduates, raising questions as to whether the current system of graduate education is adequately preparing students to enter a 21st-century job market. To understand what doctoral students need for a smooth career transition, we investigate which professional development (PD) opportunities are present within chemistry Ph.D programs and how they can be improved using a mixed methods approach. We hope to provide a road map that will encourage implementation of PD initiatives in order to introduce career-related activities for doctoral students.

Guizella Rocabado Delgadillo, Ph.D. Candidate, University of South Florida (Advisor: Jennifer Lewis)

Attitude Trends Reveal Gap between High-Achieving White and Hispanic Female Students in Organic Chemistry

Attitude is lower among certain minority populations and this study focused on Hispanic female students in the organic chemistry classroom. The ASCIv2 was administered and internal structure validity was investigated using measurement invariance testing for White and Hispanic female students. High and low-achieving students’ attitudes for both groups were compared. High-achieving Hispanic female students have lower attitude scores than their high-achieving White female peers. There was little attitude difference at the end of the semester between high-achieving Hispanic female students and low achieving students from both groups. Therefore, efforts to support Hispanic females should consider the attitude gap.

Jon-Marc Rodriguez, Postdoctoral Researcher, University of Iowa (Advisor: Nicole Becker)

Student Understanding of Michaelis-Menten Kinetics and Enzyme Inhibition

Student understanding regarding topics in upper-division courses, such as biochemistry, is not well represented in the literature, and published literature reviews indicate the need for more work on the teaching and learning of topics such as enzyme kinetics. Here we describe a study that investigated students’ reasoning about Michaelis-Menten enzyme kinetics and enzyme inhibition. Our qualitative study involved semi-structured interviews with second-year students enrolled in an introductory biochemistry course. Findings focus on how students used their understanding of enzyme kinetics to make connections to particulate-level phenomena. Based on our results we provide suggestions and implications for instruction.

Adam Schafer, Ph.D. Candidate, Miami University (Advisor: Ellen Yezierski)

Impact of Teacher Competency Using Evidence on the Development of Inquiry Assessments

A long-term professional development (PD) was designed and implemented which aimed to improve secondary chemistry teacher ability to develop assessments and interpret student results. Before the PD, teachers participated in interviews investigating the alignment between assessment practices and beliefs. During the PD, teachers were audio/video recorded throughout assessment development. Descriptive qualitative analysis was conducted on the teacher-generated assessments. Results from pre-interview data analyses, assessment instruments, and statements during assessment development were triangulated to better understand teachers’ considerations while generating assessments. Findings can guide the resource development for secondary chemistry teachers and influence the structure of future PD.

Lu Shi, Ph.D. Candidate, University of Nebraska-Lincoln (Advisor: Marilyne Stains)

Developing Survey in Measuring the Department Instructional Change 

Instructional change has been advocated within the last decade focusing on disseminating learner-centered instructional practices in STEM courses at the postsecondary level. One of the identified barriers for instructional change is the departmental climate around teaching. We leveraged the literature on organizational and departmental climate change to develop a theoretically-grounded survey to determine the types of climate around teaching that exist in STEM departments at postsecondary institutions. In the survey design process, cognitive interviews and confirmatory factor analysis have been done to ensure the validity of the data. The competing value model was built to explain the department climate around teaching.

Norda Stephenson, Postdoctoral Researcher, Florida International University (Advisor: Justin Carmel)

Practice Makes Proficient: Examining Students’ Proficiency in the Scientific Practices

Development of students’ proficiency in the scientific practices is as important as their proficiency in chemistry content. However, traditional teaching and assessment have been heavily content-focused to the neglect of the practices. Our work focuses on the development of tasks to assess students’ use and development of the practices. We examine how general chemistry students, exposed to two different curricula, engage with a task targeting particular practices. Results indicate that the students differ significantly in the way they engage with the task. We share these results and discuss pedagogical implications.

Ryan Stowe, Postdoctoral Researcher, Michigan State University (Advisor: Melanie Cooper)

The Impact of Core-Idea Centered Instruction on High School Students’ Understanding of Structure-Property Relationships

This study made use of a cross-sectional approach to compare the responses of three student cohorts, each instructed according to a different curriculum, on a three-part structure-properties assessment. There is a positive association between enrollment in a core-idea centered curriculum and (1) viewing Lewis structures as models, (2) representing hydrogen bonds as “between” molecules, and (3) constructing scientifically accurate, molecular-level explanations for the difference in boiling point between two substances. Our findings provide preliminary evidence that structuring high school chemistry instruction around validated progressions of core ideas supports students in relating atomic/molecular structure to properties.

Hannah Sturtevant, Postdoctoral Researcher, University of Virginia (Advisor: Lindsay Wheeler)

Student Perceptions of GTAs in an Inquiry-Based general chemistry laboratory: An exploratory study of the impact of a teaching methods course 

Key to teaching chemistry labs at many universities, graduate teaching assistants (GTAs) rarely have teaching experience. While research has shown a variety of ways to support GTAs in their teaching and has begun to demonstrate the impact of training on both TAs and students, little research explores outcomes comparing trained vs. untrained GTAs. For this study, we report student perceptions of GTAs during two different years where GTAs did and did not enroll in a teaching methods course. Our research demonstrates that this teaching methods course may promote more positive student perceptions of GTAs, particularly for male and international TAs.

Anna Szuba, Ph.D. Candidate, University of Illinois at Chicago (Advisor: Mike Stieff)

Biochemistry Students’ Understanding of Protein Structure using Molecular Visualization Software

Many biochemistry students struggle with understanding how individual amino acids interact with each other and how these interactions give rise to higher order protein structure. This research will report on students’ understanding of protein folding and its relationship to intermolecular forces and representational competence. Using verbal protocols, we analyze students’ developing understanding of protein structure to investigate (1) how students assemble knowledge when explaining intermolecular forces and (2) the relationship between student consented knowledge in the domain and representational competence. We present our emerging framework of learning challenges and design elements to address those challenges in undergraduate biochemistry instruction.

Zachary Voras, Teaching Faculty, West Chester University of Pennsylvania

Experimental Based Learning 

Courses within the Interdisciplinary Science Learning Laboratories (ISLL) at the University of Delaware use inquiry-driven laboratory experiences inspired by problem-based learning (PBL) approaches. This Experiment-Based Learning (XBL) includes multi-week laboratory modules wherein students engage in semi-structured CURE-like processes. Here, students develop informed hypotheses, conduct appropriate experiments to test those hypotheses, analyze collected data, form conclusions, and communicate results to a broader audience. Students are concurrently enrolled in general chemistry and introductory biology, offering a unique opportunity for meaningful interdisciplinary laboratory experiences that blend biological and chemical concepts. The interdisciplinary course structure and specific integrated XBL modules will be described.

Stephanie Werner, Ph.D. Candidate, University of Illinois at Chicago (Advisor: Mike Stieff)

Undergraduate Chemistry’s Representation, Retention, and Attrition of Underrepresented Groups Compared to Other Science Domains

Chemistry has a severe problem with attrition rates of underrepresented groups, but it is not known whether this problem is unique to the discipline. This research will report on the differences of representation, retention, and attrition of underrepresented groups in chemistry, physics, and biology to illustrate how different groups persist at unique rates and what factors contribute to a student’s decision to leave different STEM domains. We will analyze how students are represented differently among these disciplines, the likelihood of an underrepresented student attaining a degree, if levels of representation changed over time, and when underrepresented students leave the discipline.

Meng-Yang Matthew Yu, Ph.D. Candidate, Purdue University (Advisor: Minjung Ryu)

Learning with Failure in General Chemistry: Game On!

The general chemistry laboratory is a space for understanding chemistry concepts and practices. However, curricula structures place too much emphasis on avoiding failure. Learners’ interactions are dictated by the need to complete the experiment with efficiency and perfection. Failure in the laboratory consequently becomes a threat to be avoided as opposed to an opportunity for learning. To address this curricular limitation, I draw from video game design theories to redefine failure. I present a conceptual framework that incorporates play as freedom of choice, ownership by legitimizing learners’ experiences, and reflection to understand the metagame to rebrand failure for curricular redesign.

Hongyang (Jennifer) Zhang, Ph.D. Candidate, University of Illinois at Chicago (Advisor: Donald Wink)

Using Evidence Centered Design for Multi-dimensional Lab Reform 

The lab Analysis of Glass Cleaners is one of the lab reforming examples using multi-dimensional learning, which combines elements of disciplinary core ideas (DCI), science and engineering practices (SEP) and cross-cutting concepts (CCC).In this setting, the goals of laboratories are formulated in the form of learning performances with associated tasks and evidence of learning specifications, following the principles of evidence-centered design. This is a multi-week procedural lab, which can help students achieve multi-level learning goals. Through the learning progression, the students will not only gain deeper chemistry core knowledge, but their ability to apply the scientific practices and crosscutting concepts will also be improved and transferred to the learning in another discipline. Students’ data have been collected and analyzed using evidence statements.

This material is based upon work supported by the National Science Foundation under Grant No. 0733642. Any opinions, findings, conclusions, or recommendations expressed in this material are those of the author and do not necessarily reflect the views of the National Science Foundation.