domain 18 / 64 · MOMUS · the peer, the god of blame
MOMUS
the exterior witness; what each work owes its critic.
21 reviewers on the panel · the desk marks, then stamps · sealed & live
✎ THE REVIEW DESK · the panel marks the manuscript
UNDER REVIEW · —
hover a reviewer · click to enter its sphere
✎ the panel
every reviewer, named & enterableMOM · THE PEERMOMUS · the exterior witness · 15 reviews→THE PEER REVIEWmomus · three reviewers, three opinions — measure agreement →THE REPLICATIONmomus · a published p<0.05 effect shrinks on replication →THE NULL HYPOTHESISmomus · significant ≠ true — the false-discovery rate depend→THE GOODHARTmomus · when a measure becomes a target it ceases to be a go→THE STRESS TESTmomus · load to failure — the margin matters more than the r→THE HINDSIGHTmomus · outcome bias — the critic who judges by the result h→THE STEELMANmomus · attack the strongest form, not a strawman · lit+ambe→THE BLAMEmomus · Momus found fault in perfect works — fair critique v→THE AUDITmomus · you can't check everything — sample, and report→FLEISS' κmomus · agreement for a WHOLE panel of raters, corrected for→KRIPPENDORFF'S αmomus · the most general reliability number — any raters, an→THE ICCmomus · for NUMBER ratings: share of variance that is real b→THE BLAND-ALTMANmomus · do two measurement methods AGREE? plot difference vs→CRONBACH'S αmomus · do a scale's items hang together? internal cons→KENDALL'S Wmomus · do several judges RANK a set alike? concordance in [→SPEARMAN'S ρmomus · do two reviewers' rankings move together? monot→COHEN’S κmomus · agreement beyond chance — raw agreement lies, κ subt→THE META-ANALYSISmomus · many studies pooled by inverse variance — a precise →THE FUNNELmomus · publication bias — the missing side of the funnel in→THE MULTIPLE COMPARISONSmomus · test enough true nulls and you discover noise — FWER→