liv@beehaw.org to Technology@beehaw.orgEnglish · 2 days agoOpenEvidence Sounds Promising, but is it Reliable?medium.comexternal-linkmessage-square5fedilinkarrow-up118arrow-down10cross-posted to: technology@lemmy.world
arrow-up118arrow-down1external-linkOpenEvidence Sounds Promising, but is it Reliable?medium.comliv@beehaw.org to Technology@beehaw.orgEnglish · 2 days agomessage-square5fedilinkcross-posted to: technology@lemmy.world
minus-squarejarfil@beehaw.orglinkfedilinkarrow-up6·2 days ago When OpenEvidence took the US Medical Licensing Exam recently, it was wrong 9% of the time The passing score for USMLE is ~200 out of 300… how many “wrong times” is that? https://www.kaptest.com/study/usmle/passing-scores/
minus-squareliv@lemmy.nzlinkfedilinkarrow-up3·2 days agoWhen we look at passing scores, is there any way to quantitatively grade them for magnitude? Not all bad advice is created equal.
minus-squarejarfil@beehaw.orglinkfedilinkarrow-up2·7 hours agoThe grading is a mess. It goes about qualitative, quantitative… and statistical corrections “to make it fair”. Anyway, there is ~30% margin on the scores for passing, so chances are that 9% is better than the worst doctor who still “passed”.
The passing score for USMLE is ~200 out of 300… how many “wrong times” is that?
https://www.kaptest.com/study/usmle/passing-scores/
When we look at passing scores, is there any way to quantitatively grade them for magnitude?
Not all bad advice is created equal.
The grading is a mess. It goes about qualitative, quantitative… and statistical corrections “to make it fair”.
Anyway, there is ~30% margin on the scores for passing, so chances are that 9% is better than the worst doctor who still “passed”.