Overview (30%)

Your final project consists of four parts: i) Write a detailed QALMRI report on a selected empirical paper. ii) Evaluate the WEIRDness of the paper. iii) Propose a follow-up study. iv) Redefine the participant profile.

1. QALMRI Report (3x6 = 18 points)

Q: Questions

• Broad Question: Identify the broad research question addressed by the study. 

• Specific Questions: Detail the specific research questions the study aims to answer. If there are two specific questions, list both. Each should be clearly stated to reflect the precise focus of the study.
  
  

A: Alternatives

• List Alternatives: For each specific question, list at least two alternative answers or hypotheses. These alternatives should be plausible competing explanations or outcomes that the study is designed to test.
  
  

L: Logic

• Dissecting Alternatives: Explain how each alternative can be tested. Describe what observable or measurable behaviors, phenomena, or outcomes you would expect to see if a particular alternative is true. This section should link directly back to the alternatives listed and discuss the logical deductions or predictions that follow from each hypothesis.
    

M: Methods

• Participant Profile: Describe the participants' demographic and relevant background details such as age, linguistic background, or any specific characteristics relevant to the study’s focus (e.g., cognitive abilities, bilingual status).

• Materials & Stimuli: Provide a detailed description of the materials and stimuli used in the study. If visual materials or stimuli are used, describe their nature (e.g., images, videos, written text) and their role in testing the hypotheses.

• Procedure: Explain the task or tasks that participants were asked to perform. This should include a step-by-step breakdown of what participants did during the study, how they interacted with the materials, and how their responses were collected or measured.

 R: Results

• Describe Observable Results: Refer back to the Logic section. Describe the results in terms of the observable or measurable outcomes that were anticipated based on the alternatives. Focus on presenting the data and specific measurements obtained in the study, rather than conclusions or interpretations. This section should provide a clear and factual account of what was found during the study, linking these findings back to the expected outcomes as outlined in the Logic section.

I: Inferences

• Link Back to Specific Questions and Alternatives: This section is where you interpret the results in the context of the specific questions and the alternatives posed earlier. Discuss which alternative(s) the data supports or refutes.

2. (+): Diversifying Psycholinguistics - WEIRDness Evaluation (3 points)

For this part of your project, you will evaluate the WEIRDness of the original study and its implications for the generalizability of the findings:

• WEIRDness Rating: Rate the study on a scale from 1 (not WEIRD at all) to 10 (extremely WEIRD), based on the characteristics of the population used in the study and the research setting.

• Justification for WEIRDness Rating: Discuss aspects such as the demographics of the participant pool (e.g., predominantly Western, educated, industrialized, rich, and democratic societies), the cultural context, and the location of testing. Specifically address how the place of testing might affect the generalizability of the findings. Consider whether the results can be applied to populations outside of the study’s setting.

• Suggestions for Improvement: Provide detailed suggestions on how the study could be modified to reduce its WEIRDness and increase the generalizability of its findings. This might include using more diverse populations, varying locations, or different cultural settings.

3.  (+) Follow-up Study Proposal (6 points)

For this part of your project, develop a proposal for a follow-up study. This proposal should either address potential limitations of the original study or explore new questions that arise from its findings. You have two options:

A. Refine the Original Study:

1. • Keep the original research question but propose modifications to the methodology. This could involve changing the experimental conditions, using different materials or methods, or altering the participant profile (different language background, different populations).  Note: If you select this option, provide a comprehensive explanation of the revised methodology, including detailed justifications for each proposed change. The research question and alternatives can remain unchanged.
     
     

B. Propose a New Study:

1. • Formulate a new research question inspired by the "future research" suggestions typically found in the "limitations" and "General Discussion" sections of research papers. State the new question, alternatives, logic and design a method that addresses this new question, considering different variables or contexts not covered in the original study. Note: If you select this option, it is acceptable to write a less detailed Methods section (compared to Option A).
     
     

Proposal Components (keep QALM)

Please include the following elements in your proposed study:

• Question+: Clearly articulate the research question for your follow-up study. This can be an extension, a refinement, or a completely new question based on the findings and limitations of the original study.

• Alternatives+ (Two potential outcomes):

  • Describe at least two plausible outcomes of your study. These should be distinct, clearly defined, and linked to your research question, representing different theoretical implications or answers.

• Logic+ (How to discern between alternatives):

  • Explain the reasoning and scientific logic behind your experimental design. Detail how the design—through its control and experimental conditions—will help determine which alternative outcome is supported by the data.

• Methods+:

a. Participant Profile: Specify who the participants are. If suggesting changes from the original study, explain why these new participants are chosen.

b. Materials: Describe the materials you will use in your study. This could include visual, written or spoken stimuli, or any apparatus necessary for the experiment. For each condition in your experiment, provide at least one example of the stimuli. Explain why these materials are suitable for addressing your research question and how they relate to the different conditions or variables in your study.

c. Procedure: Outline the experimental procedure clearly. Detail each step of what participants will do during the study, from the instructions they receive to the tasks they perform, and how responses are collected. Be specific about how each part of the procedure helps to test your hypotheses or research questions.

4. (+): Diversifying Psycholinguistics - Defining Participants (3 points)

For your proposed follow-up study, define your participant group "native speakers of X" following the guidelines outlined in Cheng et al. (2021):

• Definition of 'Native Speakers': Provide a clear and precise definition of what constitutes a "native speaker" in the context of your study. Consider aspects such as linguistic background, age of language acquisition, cultural immersion, and any other criteria relevant to your specific research question. Provide detailed information beyond basic demographics, such as linguistic background, age, gender, or specific characteristics relevant to your study's question (e.g., bilingual speakers, individuals with specific cognitive traits).