Every single person who has, or will ever read this page has their own assumptions, opinions, biases, and beliefs about themselves and other people... but if we actually want to know something about evil, we have to carefully design research studies to test our ideas with observable evidence. Before we can get too far into the science of evil, let's clarify how we go about designing valid research on affect, behavior, and cognition.
What are some examples of how early psychologists failed to support their assumptions with legitimate research?
What are the core principles of modern psychological science?
WATCH: Quackery Gallery - "Phrenology and the Psychograph"
Here is a classic example of how early psychologists failed to support their (wild) assumptions with legitimate scientific research. You can stop the video at 2:10 (unless you're curious to see how it plays out).
READ: Psychology as a Science - From the top of the page, including the sections titled The Key Features of a Science and The Scientific Process, then stop when you reach the Psychological Approaches and Science section.
What is the difference between a research population and a research sample?
READ: Sampling Methods - only read the first section on "The Purpose of Sampling"
How do researchers use different methods and designs to test their hypotheses? Be prepared to give a few original examples of how you would use each method to collect data.
Measurement methods
Naturalistic observation
Structured observation
Self-report
Psychophysiological
Archival
Measurement timelines
Longitudinal study
Cross-sectional study
Study designs
Case study
Correlational
Controlled experiment
What are some advantages and disadvantages of each method/design?
What does it mean to operationalize a conceptual variable? Be prepared to give specific examples of how you would operationalize some aspect of affect, behavior, or cognition.
Imagine that you have been hired to determine whether mindfulness meditation is effective in reducing rage among those who have been convicted of a minor, anger-fueled crime. Having mastered psychological research methods, you know that you'll need to randomly assign the participants into two groups -- one that completes the class and another that does not. You also know that you'll need to measure their rage afterwards to see if there are any noticeable difference between the two groups.
Conceptual variables are the ideas we are interested in studying. In this case we have an intervention to randomly assign (our conceptual IV) and rage to measure (our conceptual DV). In order to actually conduct the study, of course, we have to define exactly what the intervention will involve and exactly how we are going to measure rage afterwards.
First, we need an operational definition of mindfulness meditation... which meditation will they complete? For how long, and how often? Will they do it by themselves using their cellphones, go somewhere and do it as a group? We will operationalize the IV by giving a precise definition for what does and does not count as a valid form of our conceptual variable. Listening to 30 minutes of classical music three times a day might be a reasonable operationalization for relaxing, but it wouldn't work for mindfulness meditation.
Next, we need to operationalize our DV. Do we give them a survey and ask how angry they've been feeling recently? Do we follow them around and look for specific behaviors like yelling (speaking to someone at 60 decibels or louder)? Do we have them come into a lab and intentionally frustrate them with a broken pencil and count the number of swear words they use? There are often many different ways we can operationalize the conceptual variable we're interested in, and each may have different pros and cons. The thing to keep in mind is that you want to be very precise with what you're counting or measuring so that other people looking at the same situation would come to the same measurement. If you're counting swears, which words count?
In summary, conceptual variables are the ideas we talk about and operationalizations are what we manipulate and measure in a study.
What personality characteristic do you think would predict whether or not someone returns a found wallet or keeps the $50 in it? How would you operationalize that variable to test your hypothesis?
What are some of the most common ways that mistakes in research methodology can introduce errors and biases into the data? Describe each of the following biases and how researchers can avoid them:
Demand Characteristics
Placebo Effect
Rosenthal Effect
Social Desirability
READ: Research Bias and Errors.
What does it mean to say that two variables are correlated?
How can you describe positive, negative, & curvilinear correlations?
How is the strength of that correlation expressed numerically?
Describe the nature of correlational research designs
Limitations of what we can conclude from correlations
Spurious correlations
Why do we have to be so careful about how we interpret correlations?
How do we differentiate between the independent and dependent variables?
What does it mean to randomly assign participants to experimental conditions?
Why is random assignment essential if we want to conclude that it was our manipulation of the IV that caused differences in the DV?
Referring back to the article in the previous section, what are some variables that could not (or would not) be manipulated or randomly assigned? How would we study them with a correlational design?
How would you design an experiment to determine whether watching violent movies CAUSES children to behave more aggressively when playing with others?
What are some general principles for ethical research? For each be able to explain each term and provide examples of what might constitute a violation.
Voluntary participation
Informed consent
Risk of harm
Confidentiality & anonymity
READ: Ethics in Research
No matter how true something seems based on personal experience, it might not actually be true. If we want to understand the world (rather than our biased intuition about it) we have to use a careful, objective process to observe it. The more you know about this process the better prepared you are to differentiate an opinion from a scientific fact.
After participating in our class meeting or an interactive online presentation you will be able to answer the following questions:
What is an Institutional Review Board (IRB) and how does it help ensure that research participants are treated in an ethical way?
What are the challenges of operationalizing a conceptual variable like evil? Provide specific examples of how researchers have attempted to do it.
How would you design an experiment to determine whether playing a violent video game caused people to act more aggressively afterward?
How did Anderson & Dill (2000) operationalize their IV and DV? What did they find? What allows them to make an argument for a causal link?
How are between-subjects and within-subjects experiments different? How would you design each to test a research question?
READ: Correlational designed studies determine a relationship between two variables. As it turns out, seemingly unrelated variables can be correlated with one another. If you want to see some more (and pretty amusing) examples of spurious correlations explore the linked website.
READ: If you are interested in learning more about the American Psychological Association's ethical principles you can find them here.