Testing the Test Using Rasch Measurement Model: Can Expert Vetting Ensure Quality of Test Items?

Barman, Arunodaya (2016) Testing the Test Using Rasch Measurement Model: Can Expert Vetting Ensure Quality of Test Items? International Medical Journal, Japan, 23 (1). pp. 55-57. ISSN 1341-2051

[img] Text
55-31Barman.pdf
Restricted to Registered users only

Download (706Kb) | Request a copy

Abstract

ABSTRACT Introduction: Item analysis using Rasch measurement model provides a way of measuring the quality of questions, assess how appropriate they are for the candidates and how well they measure their ability. Methods: Multiple choice questions generated by the subject specialists and vetted at departmental and central levels were used in assessing undergraduate medical students. Twelve questions each with five true/false responses were identified from the MCQ test items used to assess the diagnostic ability of the students. One hundred undergraduate medical students who have responded to these items were randomly selected. Scores of hundred students on the 60 items were analysed using computer software BIAS. Results: Ability of the students ranges from -.561 to 2.509 and difficulty of the items ranges from -2.948 to 2.293. Twenty one items were below the ability level of the students (-.561) and ten of them were providing very little information about the students ability. The overall person reliability was .69 and separation index was 1.50 whereas item reliability was .95 and separation index was 4.51. Conclusion: Twelve questions each with 5 true/false responses are well developed to assess the diagnostic ability of the students except ten off target responses those may be rewritten or excluded from future test.

Item Type: Article
Additional Information: Those who like to do item analysis this article may be of help to them.
Keywords: Rasch measurement model, item analysis, vetting of MCQs
Subjects: H Social Sciences > HA Statistics
Faculty / Institute: Faculty of Medicine
Depositing User: Prof Arunodaya Barman
Date Deposited: 20 Mar 2016 01:19
Last Modified: 20 Mar 2016 01:19
URI: http://erep.unisza.edu.my/id/eprint/4590

Actions (login required)

View Item View Item