Large-scale assessment of the effect of popularity on the reliability of research.

Based on theoretical reasoning it has been suggested that the reliability of findings published in the scientific literature decreases with the popularity of a research field. Here we provide empirical support for this prediction. We evaluate published statements on protein interactions with data fr...

Full description

Saved in:
Bibliographic Details
Main Authors: Thomas Pfeiffer, Robert Hoffmann
Format: article
Language:EN
Published: Public Library of Science (PLoS) 2009
Subjects:
R
Q
Online Access:https://doaj.org/article/ee0f6b6a4fa74cc789d0d8b7903384a2
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Based on theoretical reasoning it has been suggested that the reliability of findings published in the scientific literature decreases with the popularity of a research field. Here we provide empirical support for this prediction. We evaluate published statements on protein interactions with data from high-throughput experiments. We find evidence for two distinctive effects. First, with increasing popularity of the interaction partners, individual statements in the literature become more erroneous. Second, the overall evidence on an interaction becomes increasingly distorted by multiple independent testing. We therefore argue that for increasing the reliability of research it is essential to assess the negative effects of popularity and develop approaches to diminish these effects.