Readings - Crises in our field

Anything by John Ioannidis

Ioannidis, J. P. A. (2005). Why Most Published Research Findings Are False. PLOS Medicine, 2(8), e124. https://doi.org/10.1371/journal.pmed.0020124
Ioannidis, J. P. A. (2014). How to Make More Published Research True. PLOS Medicine, 11(10), e1001747. https://doi.org/10.1371/journal.pmed.1001747
Ioannidis, J. P. A. (2016). Why Most Clinical Research Is Not Useful. PLOS Medicine, 13(6), e1002049. https://doi.org/10.1371/journal.pmed.1002049
Ioannidis, J. P. A. (2012). Why Science Is Not Necessarily Self-Correcting. Perspectives on Psychological Science, 7(6), 645–654. https://doi.org/10.1177/1745691612464056

Szucs, D., & Ioannidis, J. P. A. (2017). Empirical assessment of published effect sizes and power in the recent cognitive neuroscience and psychology literature. PLOS Biology, 15(3), e2000797. https://doi.org/10.1371/journal.pbio.2000797
Button, K. S., Ioannidis, J. P. A., Mokrysz, C., Nosek, B. A., Flint, J., Robinson, E. S. J., & Munafò, M. R. (2013). Power failure: Why small sample size undermines the reliability of neuroscience. Nature Reviews Neuroscience, 14(5), 365–376. https://doi.org/10.1038/nrn3475

The deeper you read, the more the literature falls apart.

Yarkoni, T. (2020). The Generalizability Crisis. The Behavioral and Brain Sciences, 45, e1. https://doi.org/10.1017/S0140525X20001685
Eronen, M. I., & Bringmann, L. F. (2021). The Theory Crisis in Psychology: How to Move Forward. Perspectives on Psychological Science, 1745691620970586. https://doi.org/10.1177/1745691620970586
Lin, H., Werner, K. M., & Inzlicht, M. (2021). Promises and Perils of Experimentation: The Mutual-Internal-Validity Problem. Perspectives on Psychological Science, 16(4), 854–863. https://doi.org/10.1177/1745691620974773
Berkman, E. T., & Wilson, S. M. (2021). So Useful as a Good Theory? The Practicality Crisis in (Social) Psychological Theory. Perspectives on Psychological Science, 16(4), 864–874. https://doi.org/10.1177/1745691620969650

Pashler, H., & Harris, C. R. (2012). Is the Replicability Crisis Overblown? Three Arguments Examined. Perspectives on Psychological Science, 7(6), 531–536. https://doi.org/10.1177/1745691612463401

Spoilers: the problems are not overblown.

Simons, D. J., Shoda, Y., & Lindsay, D. S. (2017). Constraints on Generality (COG): A Proposed Addition to All Empirical Papers. Perspectives on Psychological Science, 12(6), 1123–1128. https://doi.org/10.1177/1745691617708630
Munafò, M. R., Nosek, B. A., Bishop, D. V. M., Button, K. S., Chambers, C. D., Percie du Sert, N., Simonsohn, U., Wagenmakers, E.-J., Ware, J. J., & Ioannidis, J. P. A. (2017). A manifesto for reproducible science. Nature Human Behaviour, 1(1), 1–9. https://doi.org/10.1038/s41562-016-0021
Simmons, J., Nelson, L., & Simonsohn, U. (2012). A 21-word solution. Dialogue. The Official Newsletter of the Society for Personality And Social Psychology, 26(2), 4–7. http://spsp.org/sites/default/files/dialogue_26(2).pdf