Underreporting of Interrater Agreement in Diagnostic Accuracy Studies of Immunohistochemistry in Dermatopathology: A Systematic Review.
Margaryta Stoieva, Garth Fraga
✦ AI-curated · Sources linked
In 30 seconds
This systematic review examined the reporting of interobserver agreement in diagnostic accuracy studies of immunohistochemistry (IHC) in dermatopathology, analyzing 84 studies published between 2015 and 2025. The review found that 87% of studies did not report any measure of interobserver agreement, despite most reporting sensitivity and specificity. The kappa-balanced score, a composite metric, was calculable in three studies, ranging from 0.62 to 0.93.
Key findings
- 87% of the 84 studies did not report any measure of interobserver agreement.
- When reported, agreement was most commonly assessed using the Cohen kappa statistic.
- The kappa-balanced score ranged from 0.62 to 0.93 in three studies.
Why it matters
Understanding interobserver agreement is crucial for evaluating the reliability of diagnostic tests in dermatopathology. The lack of reported reproducibility metrics may lead to overestimation of diagnostic accuracy, impacting clinical decision-making.