journal article·2020-09-09Open access

Handling Skewed Data: A Comparison of Two Popular Methods

Hanan M. Hammouri, Roy T. Sabo, Rasha Alsaadawi, Khalid A. Kheirallah

Applied Sciences· Volume 10· Issue 18

Abstract

Scientists in biomedical and psychosocial research need to deal with skewed data all the time. In the case of comparing means from two groups, the log transformation is commonly used as a traditional technique to normalize skewed data before utilizing the two-group t-test. An alternative method that does not assume normality is the generalized linear model (GLM) combined with an appropriate link function. In this work, the two techniques are compared using Monte Carlo simulations; each consists of many iterations that simulate two groups of skewed data for three different sampling distributions: gamma, exponential, and beta. Afterward, both methods are compared regarding Type I error rates, power rates and the estimates of the mean differences. We conclude that the t-test with log transformation had superior performance over the GLM method for any data that are not normal and follow beta or gamma distributions. Alternatively, for exponentially distributed data, the GLM method had superior performance over the t-test with log transformation.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced Statistical Methods and Models · Advanced Statistical Modeling Techniques · Spectroscopy and Chemometric Analyses

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Mathematics and Statistics, Faculty of Arts and Science, Jordan University of Science and Technology, Irbid 22110, Jordan

Department of Biostatistics, School of Medicine, Virginia Commonwealth University, Richmond, VA 23298, USA

Department of Public Health, Faculty of Medicine, Jordan University of Science and Technology, Irbid 22110, Jordan

References (21)

Show source-provided references
1. Samui, P., Bui, D.T., Chakraborty, S., and Deo, R.C. (2020). A Monte Carlo approach applied to sensitivity analysis of criteria impacts on solar PV site selection. Handbook of Probabilistic Models, Butterworth-Heinemann. [1st ed.].
2. Martinez, W.L., and Martinez, A.R. (2007). Computational Statistics Handbook with Matlab, CRC Press. [2nd ed.].10.1201/b13622 ↗
3. Using simulation studies to evaluate statistical methods10.1002/sim.8086 ↗
4. Normality tests for statistical analysis: A guide for non-statisticians10.5812/ijem.3505 ↗
5. Evaluation of the normality assumption in meta-analyses10.1093/aje/kwz261 ↗
6. Log-transformation and its implications for data analysis
7. Explorations in statistics: The log transformation10.1152/advan.00018.2018 ↗
8. Hassani, H., Yeganegi, M.R., Khan, A., and Silva, E.S. (2020). The effect of data transformation on singular spectrum analysis for forecasting. Signals, 1.10.3390/signals1010002 ↗
9. The log transformation is special10.1002/sim.4780140810 ↗
10. Generalized linear models10.2307/2344614 ↗
11. McCullagh, P., and Nelder, J.A. (1989). Generalized Linear Models, CRC Press.10.1007/978-1-4899-3242-6 ↗
12. Song, L., Langfelder, P., and Horvath, S. (2013). Random generalized linear model: A highly accurate and interpretable ensemble predictor. BMC Bioinf., 14.10.1186/1471-2105-14-5 ↗
13. Nelder, J.A., and Baker, R.J. (2006). Generalized Linear Models, Wiley Online Library.10.1002/0471667196.ess0866.pub2 ↗
14. Dobson, A.J., and Barnett, A. (2008). An Introduction to Generalized Linear Models, CRC Press.10.1201/9780367807849 ↗
15. Gentle, J., Härdle, W., and Mori, Y. (2012). Generalized linear models. Handbook of Computational Statistics, Springer.10.1007/978-3-642-21551-3 ↗
16. Agresti, A. (2015). Foundations of Linear and Generalized Linear Models, John Wiley & Sons.
17. El-Shaarawi, A.H., and Piegorsch, W.W. (2013). Generalized linear models. Encyclopedia of Environmetrics, Wiley. [2nd ed.].
18. Wilcoxon-Mann-Whitney or t-test? On assumptions for hypothesis tests and multiple interpretations of decision rules10.1214/09-SS051 ↗
19. Claeskens, G., and Hjort, N.L. (2008). Model Selection and Model Averaging, Cambridge University Press.
20. Choosing among generalized linear models applied to medical data10.1002/(SICI)1097-0258(19980115)17:1<59::AID-SIM733>3.0.CO;2-7 ↗
21. Exploring the use of negative binomial regression modeling for pediatric peripheral intravenous catheterization10.7243/2053-7662-2-6 ↗