Likert scale
The following document has, first, a brief introduction to what a Likert scale is, together with some of the limitations of its usefulness.
Second you have a remarkable Likert scale drafted by Professor Ikuenobe for discussion by those teaching Principles of Thinking.
Third you have the Likert scale adopted by those who teach Comparative Religious Thought--together with the determination of what proportion of "agree" or "strongly agree" would be counted as success for each question.
Likert scaling is a bipolar scaling method, measuring either positive and negative response to a statement, for example:
Strongly disagree 2. Disagree 3. Neither agree nor disagree 4. Agree 5. Strongly agree
Sometimes Likert scales are used in a forced choice method where the middle option of "Neither agree nor disagree" is not available. Likert scales may be subject to distortion from several causes. Respondents may avoid using extreme response categories (central tendency bias); agree with statements as presented (acquiescence response bias); or try to portray themselves or their group in a more favorable light (social desirability bias).
In some cases, experts who are very knowledgeable about the subject matter might develop items on their own. Oftentimes, it is helpful to have a group of experts help brainstorm different ideas to include on a scale.
Start by creating a large pool of potential items to draw from.
Select a group of judges to score the items.
Sum the item scores given by the judges.
Calculate intercorrelations between paired items.
Eliminate items that have a low correlation between the summed scores.
Find averages for the top quarter and lowest quarter of judges and do a t-test of the means between the two. Eliminate questions with low t-values, which indicates that they score low in the ability to discriminate.
After weeding out the questions that have been deemed irrelevant or not relevant enough to include, the Likert scale is then ready to be administered.
A draft sent out by Professor Ikuenobe March 15, 2012
Assessment of Outcomes in Principles of Thinking Course
1. I learned the nature of arguments.
Strongly Agree Agree Neither Disagree Strongly Disagree
2. I learned how to construct arguments.
Strongly Agree Agree Neither Disagree Strongly Disagree
3. I learned to recognize/identify premises and conclusion in arguments.
Strongly Agree Agree Neither Disagree Strongly Disagree
4. I learned to apply the idea of reasoning to decision-making and acceptance of beliefs.
Strongly Agree Agree Neither Disagree Strongly Disagree
5. I learned to apply the idea of reasoning or arguments to problem solving.
Strongly Agree Agree Neither Disagree Strongly Disagree
6. I learned to apply the idea of reasoning and construction of arguments to writing papers.
Strongly Agree Agree Neither Disagree Strongly Disagree
7. I learned to apply the idea of reasoning or argument to reading and comprehension.
Strongly Agree Agree Neither Disagree Strongly Disagree
8. I learned to evaluate reasoning or arguments by using various methods.
Strongly Agree Agree Neither Disagree Strongly Disagree
9. I learned the distinction between deductive and inductive reasoning or arguments.
Strongly Agree Agree Neither Disagree Strongly Disagree
10. I learned how to evaluate deductive and inductive reasoning or arguments.
Strongly Agree Agree Neither Disagree Strongly Disagree
11. I learned the notion of the validity of deductive arguments.
Strongly Agree Agree Neither Disagree Strongly Disagree
12. I learned the notion of the soundness of deductive arguments.
Strongly Agree Agree Neither Disagree Strongly Disagree
13. I learned different forms or types of fallacies or errors in reasoning.
Strongly Agree Agree Neither Disagree Strongly Disagree
14. I learned to be aware of errors and fallacies and to avoid them in my own reasoning.
Strongly Agree Agree Neither Disagree Strongly Disagree
15. I learned to identify errors and fallacies in what I read and other people’s reasoning.
Strongly Agree Agree Neither Disagree Strongly Disagree
16. I learned how to critically reflect on my own reasoning.
Strongly Agree Agree Neither Disagree Strongly Disagree
17. I learned the value of critical thinking/reflection.
Strongly Agree Agree Neither Disagree Strongly Disagree
18. I learned how to be aware and mindful of one’s own reasoning and beliefs.
Strongly Agree Agree Neither Disagree Strongly Disagree
19. I learned to be skeptical, tentative, to question beliefs or ideas, and not to take them on face value.
Strongly Agree Agree Neither Disagree Strongly Disagree
20. I learned the value of engaging in inquiring to find good reasons for one’s beliefs and decision.
Strongly Agree Agree Neither Disagree Strongly Disagree
21. I learned the value of providing good and supportive reasons for one’s beliefs.
Strongly Agree Agree Neither Disagree Strongly Disagree
22. I learned the value of accepting beliefs for which there is adequate evidence, proof, or reasons.
Strongly Agree Agree Neither Disagree Strongly Disagree
23. I learned the not accept beliefs for which there is no adequate evidence, proof, or reasons.
Strongly Agree Agree Neither Disagree Strongly Disagree
24. I learned how the structure of arguments can help the clarity of my thinking or reasoning.
Strongly Agree Agree Neither Disagree Strongly Disagree
25. I learned to be aware of the factors that could prevent me from thinking or reasoning clearly.
Strongly Agree Agree Neither Disagree Strongly Disagree
Here is what the Comparative Religious Thought faculty agreed on.
1. I learned new things about a variety of religious traditions.
(a) strongly agree; (b) agree; (c) neither agree nor disagree; (d) disagree; (e) strongly disagree.
2. I found myself sometimes able to imagine myself “in the other person’s shoes” in studying different religions.
(a) strongly agree; (b) agree; (c) neither agree nor disagree; (d) disagree; (e) strongly disagree.
3. I learned that I did not have to agree in order to understand and tolerate.
(a) strongly agree; (b) agree; (c) neither agree nor disagree; (d) disagree; (e) strongly disagree.
4. If I were to find myself in a neighborhood with members of some of the religions I studied, I expect to be able to be a better neighbor because of this course.
(a) strongly agree; (b) agree; (c) neither agree nor disagree; (d) disagree; (e) strongly disagree.
5. I became more able to disagree without feeling hostility.
(a) strongly agree; (b) agree; (c) neither agree nor disagree; (d) disagree; (e) strongly disagree.
6. The understanding offered by this course of global cultural diversity is valuable for living in today’s world.
(a) strongly agree; (b) agree; (c) neither agree nor disagree; (d) disagree; (e) strongly disagree.
We also agreed to set numbers that we would regard as indicating success that start with modest expectations to start with. So success means . . .
Question 1. 80% agree or strongly agree.
Question 2. 70% agree or strongly agree.
Question 3. 70% agree or strongly agree.
Question 4. 60% agree or strongly agree.
Question 5. 60 % agree or strongly agree.
Question 6. 70% agree or strongly agree.
1. I learned new things about a variety of religious traditions.
(a) strongly agree; (b) agree; (c) neither agree nor disagree; (d) disagree; (e) strongly disagree.
2. I found myself sometimes able to imagine myself “in the other person’s shoes” in studying different religions.
(a) strongly agree; (b) agree; (c) neither agree nor disagree; (d) disagree; (e) strongly disagree.
3. I learned that I did not have to agree in order to understand and tolerate.
(a) strongly agree; (b) agree; (c) neither agree nor disagree; (d) disagree; (e) strongly disagree.
4. If I were to find myself in a neighborhood with members of some of the religions I studied, I expect to be able to be a better neighbor because of this course.
(a) strongly agree; (b) agree; (c) neither agree nor disagree; (d) disagree; (e) strongly disagree.
5. I became more able to disagree without feeling hostility.
(a) strongly agree; (b) agree; (c) neither agree nor disagree; (d) disagree; (e) strongly disagree.
6. The understanding offered by this course of global cultural diversity is valuable for living in today’s world.
(a) strongly agree; (b) agree; (c) neither agree nor disagree; (d) disagree; (e) strongly disagree.