Principles and Practice of Applying Psychometrics in Assessment

Code

MEDI4014

School

School of Medicine

Level

4

Credits

20

Semesters

Autumn UK

Summary

In the context of assessment in medical education, students taking this module have the opportunity to learn about the post examination analysis of assessment items and its interpretation which is becoming an essential component of the examination cycle that provides valuable feedback for improving the quality of the curriculum and standards of teaching and assessment. The theoretical content of the Module will deal with Classical Test Theory (including Generalizability theory), Item Response Theory, but will also actively engage participants in practical exercises, in the classroom and in private study, in order to gain the skills necessary for the psychometric evaluation of tests.



In addition, Students will learn about the principles of the measurement and evaluation and the analytical foundations of surveys in medical and health care education. Students will learn the theoretical foundations of psychometric questionnaires and surveys.



This course is designed for those who wish to provide high-quality assessment items and determine the effectiveness of their instructional strategies in medical education assessment. In addition, by taking this course, students will be able to get a greater understanding of the construction of valid and reliable survey questionnaires for educational research purpose.
 

Target Students

2.1 OR pass at MBBS Degree is in a medical or allied healthcare professions discipline subject and/or sufficient associated work experience Students on the MMedSci, PGDip and PGCert Medical Education courses. PGCHE students Students proposed as suitable by the Head of School of Medicine.

Classes

• Four 6-hour un assigneds each week for 4 weeks
• One 6-hour seminar each week for 4 weeks

Activities may take place every teaching week of the Semester or only in specified weeks.

Assessment

• 100% In class Exam (1-hour): In class written exam 1 hour

Assessed by end of designated period

Educational Aims

Learning Outcomes

In a medical or healthcare professions education context, students will gain knowledge and understanding of:

The principles of assessment and evaluation in medical and health science education
Classical Test Theory, Generalisability Theory and Item Response Theory including Research Analysis
The principles of standard setting
Reliable assessments and questionnaires for research purposes using psychometric principles
Methods for analysing and interpreting statistical data from tests using Excel, and SPSS
Psychometric analysis of assessment for improving standard setting procedures and overall test quality
 

By the end of the course, students will be able to:
Critical apply classical test theory, generalisability theory, and item response theory including Rasch analysis in a medical education context
Critical apply a variety of standard setting techniques in a medical education context
Critically apply psychometric principles to the analysis of individual test, questionnaire and survey items to improve their psychometric properties
 

Conveners

• Professor Mohsen Tavakol