Use of design effects and sample weights in complex health survey data: A review of published articles using data from 3 commonly used adolescent health surveys

Citation

Bell, Bethany A.; Onwuegbuzie, Anthony J.; Ferron, John M.; Jiao, Qun; Hibbard, Susan T.; & Kromrey, Jeffrey D. (2012). Use of design effects and sample weights in complex health survey data: A review of published articles using data from 3 commonly used adolescent health surveys. American Journal of Public Health. vol. 102 (7) pp. 1399-1405 , PMCID: PMC3477989

Abstract

OBJECTIVES: We assessed how frequently researchers reported the use of statistical techniques that take into account the complex sampling structure of survey data and sample weights in published peer-reviewed articles using data from 3 commonly used adolescent health surveys.
METHODS: We performed a systematic review of 1003 published empirical research articles from 1995 to 2010 that used data from the National Longitudinal Study of Adolescent Health (n=765), Monitoring the Future (n=146), or Youth Risk Behavior Surveillance System (n=92) indexed in ERIC, PsycINFO, PubMed, and Web of Science.
RESULTS: Across the data sources, 60% of articles reported accounting for design effects and 61% reported using sample weights. However, the frequency and clarity of reporting varied across databases, publication year, author affiliation with the data, and journal.
CONCLUSIONS: Given the statistical bias that occurs when design effects of complex data are not incorporated or sample weights are omitted, this study calls for improvement in the dissemination of research findings based on complex sample data. Authors, editors, and reviewers need to work together to improve the transparency of published findings using complex sample data.

URL

http://dx.doi.org/10.2105%2FAJPH.2011.300398

Reference Type

Journal Article

Journal Title

American Journal of Public Health

Author(s)

Bell, Bethany A.
Onwuegbuzie, Anthony J.
Ferron, John M.
Jiao, Qun
Hibbard, Susan T.
Kromrey, Jeffrey D.

Year Published

2012

Volume Number

102

Issue Number

7

Pages

1399-1405

DOI

10.2105/AJPH.2011.300398

PMCID

PMC3477989

Reference ID

1509