Reading

Schmidt & Brown (2021). Evidence-Based Practice for Nurses:

• Chapter 7: Key Concepts and Principles of Quantitative Designs

Objectives:

• Discuss the significance of the key concepts of causality, control, manipulation, bias, and confounding as they relate to quantitative designs

• Define the four types of validity: statistical conclusion, internal, construct, and external

• Describe strategies to minimize the six threats to internal validity

• Identify three factors that affect statistical conclusion validity

• List five factors that affect construct validity

• Describe strategies to minimize the four threats to external validity

• Discuss ethical issues related to study validity

• Categorize study designs as retrospective, cross-sectional, repeated measures, and longitudinal or prospective designs based on the timing of data collection

Key Concepts in Quantitative Designs

• Causality

  • = the relationship between a cause and its effect

• Probability

  • = Likelihood or chance that an event will occur in a situation

• Control

  • = Ability to manipulate, regulate, or statistically adjust for factors that can affect the dependent variable

• Manipulation

  • = The ability of researchers to control the independent variable

• Confounding

  • = When extraneous variables influence the relationship between the independent and dependent variables

• Extraneous variables

  • = Factors that interfere with the relationship between the independent and dependent variables; confounding variable; Z variable

• Bias

  • = Systematic error in selection of participants, measurement of variables, and/or analysis of data that distorts the true relationship between IV and DV

• Randomization

  • = The selection, assignment, or arrangement of elements by chance

• Random Sampling

  • = Technique for selecting elements (e.g. participants, chats) whereby each has the same chance of being selected

• Random Assignment

  • = Assignment technique in which participants have an equal chance of being assigned to either the treatment or the control group

• Between-groups designs

  • = Study design where two groups of participants can be compared

• Within-groups design

  • = Comparisons are made about the same participants at two or more points in time or on two or more measures

Validity

• Study validity

  • = Ability to accept results as logical, reasonable, and justifiable based on the evidence presented

• 4 types of validity

  • 1. Statistical conclusion validity

    • = The degree that the results of the statistical analysis reflect the true relationships between the independent and dependent variables

  • 2. Internal validity

    • = The degree to which one can conclude that the independent variable produced changes in the dependent variable

  • 3. Construct validity

    • = A threat to validity when the instruments used do not accurately measure the theoretical concepts

  • 4. External validity

    • = The degree to which the results of the study can be generalized to other participants, settings, and times

Threats to Study Validity

• Threats to statistical conclusion validity

  • 1. Low statistical power

    • Type I errors

      • Occur when the researcher rejects a true null hypothesis

    • Type II errors

      • Happen when a researcher accepts a false null hypothesis, or inaccurately concludes that there is no relationship between the IV and DV when an actual relationship does exist

    • Statistical power

      • = the probability that a statistical test will be able to detect a significant relationship or difference between variables if the relationship/difference actually exists

    • Sample sizes may influence statistical power

  • 2. Low reliability of the measures

    • Instruments that are not reliable interfere with researchers' abilities to draw accurate conclusions about relationships between the IV and DV

    • When appraising research articles, assess:

      • If self-report instruments achieved an internal consistency reliability of .70 or higher

      • Test-retest reliability of .80 or higher

      • If more than one data collector was used, interrater reliability of at least .90 or higher

  • 3. Lack of reliability of treatment implementation

    • Occur if different researchers or their assistants have implemented the treatment (IV) differently to different participants or if the same researcher is inconsistent in implementing the treatment from one time to another

• Threats to internal validity

  • 1. Selection bias

    • = A threat to internal validity when the change in the dependent variable is a result of the characteristics of the participants before they entered a study

  • 2. History

    • = A threat to internal validity when the dependent variable is influenced by an event that occurred during the study

  • 3. Maturation

    • = A threat to internal validity when participants change by growing or maturing

  • 4. Testing

    • = A threat to internal validity when a pretest influences the way participants respond on a posttest

  • 5. Instrumentation

    • = A threat to internal validity when there are inconsistencies in data collection

  • 6. Mortality

    • = A threat to internal validity when there is a loss of participants before the study is completed; attrition rate

    • Attrition rate

      • = Dropout rate; loss of participants before the study is completed; threat of mortality

    • Participant burden

      • = The amount of participant effort and time required for being in a study

• • 2. Bias

    • = A systematic error in selection of participants, measurement of variables, or analysis

  • 3. Confounding

    • = A possible source of bias in a study in which an unmeasured, or extraneous, variable (the confounder) distorts the true relationship between the treatment and outcome variables

    • Often referred to as a mixing of effects because the relationship between the IV and DV is "mixed" when the effects of a confounding variable

• 5. Experimenter expectancies

  • When researchers have expected or desired outcomes in mind, they may inadvertently affect how interventions are conducted and how they interact with participants

  • Double-blind experimental designs

    • = Studies in which participants and researchers are unaware whether participants are receiving experimental interventions or standard care

• Threats to external validity

  • 1. Effects of selection

    • = Threats to external validity when the sample does not represent the population

  • 2. Interaction of treatment and selection of subjects

    • = A threat to external validity where the independent variable might not affect individuals the same way

  • 3. Interaction of treatment and setting

    • = A threat to external validity when an intervention conducted in one setting cannot be generalized to a different setting

  • 4. Interaction of treatment and history

    • = A threat to external validity when historical events affect the intervention

Quantitative Research Part 1 (28:09)

Quantitative Research Part 2 (21:30)

Quantitative Research Part 3 (16:09)