Failure to Report Effect Sizes: The Handling of Quantitative Results in Published Health Education and Behavior Research. | Academic Article individual record
abstract

Given the American Psychological Association's strong recommendation to always report effect sizes in research, scholars have a responsibility to provide complete information regarding their findings. The purposes of this study were to (a) determine the frequencies with which different effect sizes were reported in published, peer-reviewed articles in health education, promotion, and behavior journals and (b) discuss implications for reporting effect size in social science research. Across a 4-year time period (2010-2013), 1,950 peer-reviewed published articles were examined from the following six health education and behavior journals: American Journal of Health Behavior, American Journal of Health Promotion, Health Education & Behavior, Health Education Research, Journal of American College Health, and Journal of School Health Quantitative features from eligible manuscripts were documented using Qualtrics online survey software. Of the 1,245 articles in the final sample that reported quantitative data analyses, approximately 47.9% (n = 597) of the articles reported an effect size. While 16 unique types of effect size were reported across all included journals, many of the effect sizes were reported with little frequency across most journals. Overall, odds ratio/adjusted odds ratio (n = 340, 50.1%), Pearson r/r(2) (n = 162, 23.8%), and eta squared/partial eta squared (n = 46, 7.2%) accounted for the most frequently used effect size. Quality research practice requires both testing statistical significance and reporting effect size. However, our study shows that a substantial portion of published literature in health education and behavior lacks consistent reporting of effect size.

publication outlet

Health Educ Behav

author list (cited authors)
Barry, A. E., Szucs, L. E., Reyes, J. V., Ji, Q., Wilson, K. L., & Thompson, B.
publication date
2016
publisher
keywords
  • Statistics As Topic
  • Behavioral Research
  • Data Interpretation, Statistical
  • Research
  • Odds Ratio
  • Societies, Scientific
  • Health Education
  • Periodicals As Topic
  • Apa Reporting Guidelines
  • Statistical Best Practice
  • Effect Size
  • Humans
  • Guidelines As Topic
  • Cohen’s Effect Size Benchmarks
  • Bibliometrics
  • Statistical Significance Testing
altmetric score

1.5

citation count

15

PubMed ID
27624442
identifier
184690SE
Digital Object Identifier (DOI)
start page
518
end page
527
volume
43
issue
5