↓ Skip to main content

Cut-scores revisited: feasibility of a new method for group standard setting

Overview of attention for article published in BMC Medical Education, June 2018
Altmetric Badge

Mentioned by

twitter
2 X users

Citations

dimensions_citation
4 Dimensions

Readers on

mendeley
30 Mendeley
You are seeing a free-to-access but limited selection of the activity Altmetric has collected about this research output. Click here to find out more.
Title
Cut-scores revisited: feasibility of a new method for group standard setting
Published in
BMC Medical Education, June 2018
DOI 10.1186/s12909-018-1238-7
Pubmed ID
Authors

Boaz Shulruf, Lee Coombes, Arvin Damodaran, Adrian Freeman, Philip Jones, Steve Lieberman, Phillippa Poole, Joel Rhee, Tim Wilkinson, Peter Harris

Abstract

Standard setting is one of the most contentious topics in educational measurement. Commonly-used methods all have well reported limitations. To date, there is not conclusive evidence suggesting which standard setting method yields the highest validity. The method described and piloted in this study asked expert judges to estimate the scores on a real MCQ examination that they consider indicated a clear pass, clear fail, and pass mark for the examination as a whole. The mean and SD of the judges responses to these estimates, Z scores and confidence intervals were used to derive the cut-score and the confidence in it. In this example the new method's cut-score was higher than the judges' estimate. The method also yielded estimates of statistical error which determine the range of the acceptable cut-score and the estimated level of confidence one may have in the accuracy of that cut-score. This new standard-setting method offers some advances, and possibly advantages, in that the decisions being asked of judges are based on firmer constructs, and it takes into account variation among judges.

X Demographics

X Demographics

The data shown below were collected from the profiles of 2 X users who shared this research output. Click here to find out more about how the information was compiled.
Mendeley readers

Mendeley readers

The data shown below were compiled from readership statistics for 30 Mendeley readers of this research output. Click here to see the associated Mendeley record.

Geographical breakdown

Country Count As %
Unknown 30 100%

Demographic breakdown

Readers by professional status Count As %
Student > Ph. D. Student 3 10%
Researcher 3 10%
Student > Postgraduate 3 10%
Student > Bachelor 2 7%
Professor 2 7%
Other 7 23%
Unknown 10 33%
Readers by discipline Count As %
Medicine and Dentistry 10 33%
Business, Management and Accounting 2 7%
Nursing and Health Professions 1 3%
Chemical Engineering 1 3%
Social Sciences 1 3%
Other 3 10%
Unknown 12 40%
Attention Score in Context

Attention Score in Context

This research output has an Altmetric Attention Score of 1. This is our high-level measure of the quality and quantity of online attention that it has received. This Attention Score, as well as the ranking and number of research outputs shown below, was calculated when the research output was last mentioned on 11 June 2018.
All research outputs
#17,978,863
of 23,088,369 outputs
Outputs from BMC Medical Education
#2,646
of 3,384 outputs
Outputs of similar age
#238,157
of 329,367 outputs
Outputs of similar age from BMC Medical Education
#70
of 88 outputs
Altmetric has tracked 23,088,369 research outputs across all sources so far. This one is in the 19th percentile – i.e., 19% of other outputs scored the same or lower than it.
So far Altmetric has tracked 3,384 research outputs from this source. They typically receive a little more attention than average, with a mean Attention Score of 6.4. This one is in the 17th percentile – i.e., 17% of its peers scored the same or lower than it.
Older research outputs will score higher simply because they've had more time to accumulate mentions. To account for age we can compare this Altmetric Attention Score to the 329,367 tracked outputs that were published within six weeks on either side of this one in any source. This one is in the 22nd percentile – i.e., 22% of its contemporaries scored the same or lower than it.
We're also able to compare this research output to 88 others from the same source and published within six weeks on either side of this one. This one is in the 1st percentile – i.e., 1% of its contemporaries scored the same or lower than it.