Providing a lower-bound estimate for psychology’s “crud factor”: The case of aggression

Citation

Ferguson, Christopher J. & Heene, Moritz (2021). Providing a lower-bound estimate for psychology’s “crud factor”: The case of aggression. Professional Psychology: Research and Practice.

Abstract

When conducting research on large data sets, statistically significant findings having only trivial interpretive meaning may appear. Little consensus exists whether such small effects can be meaningfully interpreted. The current analysis examines the possibility that trivial effects may emerge in large datasets, but that some such effects may lack interpretive value. When such results match an investigator’s hypothesis, they may be over-interpreted. The current study examines this issue as related to aggression research in two large samples. Specifically, in the first study, the National Longitudinal Study of Adolescent to Adult Health (AddHeath) dataset was used. Fifteen variables with little theoretical relevance to aggression were selected, then correlated with self-reported delinquency. For the second study, the Understanding Society database was used. As with Study 1, 14 nonsensical variables were correlated with conduct problems. Many variables achieved “statistical significance” and some effect sizes approached or exceeded r = .10, despite little theoretical relevance between the variables. It is recommended that effect sizes below r = .10 should not be interpreted as hypothesis supportive. (PsycInfo Database Record (c) 2021 APA, all rights reserved)

URL

https://doi.org/10.1037/pro0000386

Reference Type

Journal Article

Journal Title

Professional Psychology: Research and Practice

Author(s)

Ferguson, Christopher J.
Heene, Moritz

Year Published

2021

ISSN/ISBN

1939-1323

DOI

10.1037/pro0000386

Reference ID

5796