06.   Levels of competencies in evaluation


Assessments drive learning…..! but..

Learning should be self motivated

Contents:

Homepage - OSCE and OSPE

Compiled Responses

 The Beginning

 01.   Introduction and Basics of OSPE/OSCE

 02.   Is OSPE glorified spotting.. 

  03.   How to set up OSCE and OSPE stations..

 04.   How to collect the answer-sheets in OSCE/OSPE from students.

 05.   OSCE reliability

 06.   Levels of competencies in evaluation

 07.   Practical experiences of OSPE/OSCE

 08.   OSCE in testing Communication and attitudes

  09   Should knowledge be accessed in OSCE/OSPE

 10.   Simulated patients

 11. Examiner training...a must to do...

12.   Standard setting in OSCE

 13.   Disadvantages of OSCE

 

Levels of competencies in evaluation

Sanjay Bedi :This article is quite comprehensive and covers most of the points.in
methods in Assessment.
 http://content.nejm.org/cgi/content/full/356/4/387
--
Dr Sanjay Bedi :
There are 6 general competencies in evaluation?
1.Medical Knowledge
2. Patient Care
3. Professionalism
4. Communication Skills
5. Practice-Based Learning
6. Systems-Based Learning
Stewart :I would add Humanism - be a human being as a student, resident and physician

Anshu: Interesting Stewart! But can it be taught??? And evaluated?

Barathi: Human values -Humanism can be taught by being a role model. As Stewart
observes, our students observe us more than what we anticipate and it
is alarming too.

Stewart : The question is can it be shown by the teachers and administrators.  The students are watching us, much more than we think they are.  They see how we treat them, how we treat patients, how we treat the people that work in the clinics, communities and hospitals, how we treat other teachers and health professionals.   This is how it is taught.  It is not a classroom or multiple choice question issue.  The other aspect is selection of students.  When it is based on the top 1 percent of applicants' scores on written exams, it is questionable if we are doing the best we can to bring to the profession the human caring that we profess. 
In Brazil, they don't talk about health care and patient care, they talk about giving people attention, basic attention.

They have a concept called humanization.  It works as follows, at least in theory:  Periodically, about once a month, everyone who works or learns together in the same health unit or group (nurses, doctors, pharmacists, community workers, janitors, administrators, students, residents, etc.) all sit down together and ask the following question, "What does it feel like to be a human being and work here?  to be a student here?"  What can we do to make things better here? “Everyone has an equal voice.

What do you think your students in India would say when you ask them, "What's it like to be a human being and a student at your school?"  "What would teachers say if you asked them, or physicians?

For me, raising that issue is how it is learned.  It's not always about teaching.  In this case it is about being.

Suman Singh: You have added the most important dimension in the process of learning and teaching. We need to always keep a watch on our behavior rather than the students for better things to happen.
I was just wondering we teach students to be compassionate in words but fail to demonstrate so many times in practice. During their ward round can we tell the students to just sit with the patients and simply talk and know them and not their disease and then share their experience to realize we all are human first.
Can this cultivated and make us all more empathic?

 Dinesh: We do talk about role models. That is one thing at least I know is present in our medical colleges in India. Look at ourselves how much humanism we have learnt from our role models!........................... You will definitely get a lot of memories. Another upcoming issue is the ethics, ethics is not only about physician-patient relationships, it is also about physician (teacher)-students relationships. This issue is now brinigng up humanism into limelight.
As Steward has written that humanism is something where we have to do something else, rather lecturing.
May be Anshu is right asking about is evaluation, but there are few things which are much more important than just assigning a value to them.
I dont' know exactly, but humanism has a lot of aspects, which might convey different meanings to different persons.

Bharti U: Agreed Lots of memories come to u when u are assessing how u behave with our students, Colleagues and peers it has definite relation to our role model

Stewart: Yes, I think this is something we all have to do, rather than lecture or talk about.  You are right that it is important to make time and space for it.  If your school uses portfolios for assessment, there could be a requirement for reflection about this in it.

Sanjay Bedi: OSCE in Paediatrics
http://www.med-ed-online.org/f0000027.htm

Chandrika: Hi, Thanks for the article. This article has pointed the difficulties in OSCE in paediatrics. However with planning and willingness to accept OSCE as a good tool for evaluation can enable better examinations. Most of the times in paediatrics all cases are kept in an examination room and many patients become cranky over a period of time. The parents also are unhappy. With good planning, we should be able to allot cases where the candidate is evaluated only for history taking skills .Here standardized patients (parents) or parents only can be stationed. It can be done as a question but affective domain can also be tested by an actual parent or standardized parent.  Cases where physical demonstration is required can be utilized in a planned number. It need not be OSCE exactly, could be like a MINI-CEX with more detailed evaluation points.
We as evaluators are resistant to any change in examination and herein is a problem.

Anupama: I found an interesting link in Indian Paediatrics on OSCE wherein:
-they have given a map of stations
-One station has rapid fire viva
-There are rest stations with refreshments
-References includes article of TS Sir.
 
http://www.indianpediatrics.net/may2001/may-500-513.htm

 

 

 

Discussion Summary

Introduction

Origin and evolution of OSCE

What is OSCE OSPE..

Important terminologies OSCE and OSPE

Process - OSCE and OSPE

Competencies

Advantages OSCE and OSPE

Limitation OSCE and OSPE

The final words