A comprehensive study on robust Poisson James–Stein estimator for outlier and multicollinearity: Simulation and applications
Source abstract
Abstract
Poisson regression models (PRMs) are widely used for analyzing count data, but their accuracy can be affected by outliers and multicollinearity, leading to unreliable parameter estimates. Outliers introduce bias and inefficiency in the estimation, while multicollinearity leads to an inflated variance and thus increases the mean squared error and weakens the coefficient reliability. The Poisson maximum likelihood estimator often performs poorly under these conditions. To address these issues, researchers have proposed biased estimators such as the Poisson ridge regression estimator and the Poisson modified ridge-type estimator. However, these methods do not effectively handle both problems at the same time. In this study, we introduce a new estimator, the robust Poisson James–Stein estimator (PMT-JSE), which incorporates transformed M-estimation to improve parameter estimation when outliers and multicollinearity are present. Theoretical conditions for its superiority are established, and a Monte Carlo simulation is conducted to compare its performance with that of existing robust estimators. The results show that PMT-JSE provides more stable and accurate estimates. In addition, two real-world applications confirm its effectiveness. Based on these findings, we recommend PMT-JSE for practitioners working with PRMs affected by outliers and multicollinearity.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Advanced Statistical Methods and Models · Statistical Distribution Estimation and Applications · Advanced Statistical Process Monitoring
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Mathematical Sciences, College of Science, Princess Nourah bint Abdulrahman University 1 , P.O. Box 84428, Riyadh 11671,
Department of Mathematics, Faculty of Science, Tanta University 2 , Tanta 31527,
Research and Innovation Center, Amoud University 3 , Borama 25263,
Department of Statistics, Faculty of Science, University of Tabuk 4 , Tabuk 71491,
Department of Statistics, Faculty of Science, University of Tabuk 5 , Tabuk,
Funding
Princess Nourah bint Abdulrahman University
References (56)
Show source-provided references
1. 2012
2. Generalized linear models10.2307/2344614 ↗
3. Modeling the effect of climatic conditions and topography on malaria incidence using Poisson regression: A retrospective study in Bannu, Khyber Pakhtunkhwa, Pakistan10.3389/fmicb.2023.1303087 ↗
4. Prevalence and determinants of pregnancy termination for childbearing women using the modified Poisson regression model: A cross-sectional study of the Tanzania Demographic and Health Survey (TDHS) 202210.1186/s12889-024-21203-3 ↗
5. Poisson regression is the best method to analyze cumulative adverse childhood experiences10.1037/spq0000686 ↗
6. A comparative study of the performance of new ridge estimators for multicollinearity: Insights from simulation and real data application10.1063/5.0236631 ↗
7. On the performance of two-parameter ridge estimators for handling multicollinearity problem in linear regression: Simulation and application10.1063/5.0175494 ↗
8. Estimation parameters using Bisquare weighted robust ridge regression BRLTS estimator in the presence of multicollinearity and outliers10.1063/1.4954633 ↗
9. Ridge regression: Biased estimation for nonorthogonal problems10.2307/1267351 ↗
10. A new class of biased estimate in linear regression10.1080/03610929308831027 ↗
11. On ordinary ridge regression in generalized linear models10.1080/03610929208830909 ↗
12. Generalized cross-validation as a method for choosing a good ridge parameter10.1080/00401706.1979.10489751 ↗
13. Some modifications for choosing ridge parameters10.1080/03610920600762905 ↗
14. On the estimation of ridge penalty in linear regression: Simulation and application10.1016/j.kjs.2024.100273 ↗
15. A Poisson ridge regression estimator10.1016/j.econmod.2011.02.030 ↗
16. On ridge estimators for the negative binomial regression model10.1016/j.econmod.2011.09.009 ↗
17. Comparative study of LASSO, ridge regression, preliminary test and Stein-type estimators for the sparse Gaussian regression model10.19139/soic-2310-5070-713 ↗
18. On the estimation of Bell regression model using ridge estimator10.1080/03610918.2020.1870694 ↗
19. On the ridge estimation of the Conway-Maxwell Poisson regression model with multicollinearity: Methods and applications10.1002/cpe.6477 ↗
20. New ridge parameter estimators for the quasi-Poisson ridge regression model10.1038/s41598-023-50085-5 ↗
21. Improved Liu estimators for the Poisson regression model10.5539/ijsp.v1n1p2 ↗
22. A new improved Liu-type estimator for Poisson regression models10.15672/hujms.1012056 ↗
23. A new adjusted Liu estimator for the Poisson regression model10.1002/cpe.6340 ↗
24. Jackknifed Liu-type estimator in Poisson regression model10.29252/jirss.19.1.21 ↗
25. A new class of Poisson ridge-type estimator10.1038/s41598-023-32119-0 ↗
26. Modified two-parameter Liu estimator for addressing multicollinearity in the Poisson regression model10.3390/axioms13010046 ↗
27. Estimating the unrestricted and restricted Liu estimators for the Poisson regression model: Method and application10.1007/s10614-020-10028-y ↗
28. A new estimator for the multicollinear Poisson regression model: Simulation and application10.1038/s41598-021-82582-w ↗
29. Kibria–Lukman hybrid estimator for handling multicollinearity in Poisson regression model: Method and application10.1155/2024/1053397 ↗
30. A modification of a method for the detection of outliers in multivariate samples10.1111/j.2517-6161.1994.tb01988.x ↗
31. 2019
32. Robust modified jackknife ridge estimator for the Poisson regression model with multicollinearity and outliers10.1016/j.sciaf.2022.e01386 ↗
33. Robust enhanced ridge-type estimation for the Poisson regression models: Application to English League Football data10.1142/s0218488524500284 ↗
34. Robust Dawoud–Kibria estimator for handling multicollinearity and outliers in the linear regression model10.1080/00949655.2021.1945063 ↗
35. Development of robust Özkale–Kaçiranlar and Yang–Chang estimators for regression models in the presence of multicollinearity and outliers10.1002/cpe.6779 ↗
36. A robust Kibria–Lukman estimator for linear regression model to combat multicollinearity and outliers10.1002/cpe.7533 ↗
37. Robust biased estimators for Poisson regression model: Simulation and applications10.1002/cpe.7594 ↗
38. Handling multicollinearity and outliers in logistic regression using the robust Kibria–Lukman estimator10.3390/axioms14010019 ↗
39. New quantile based ridge M-estimator for linear regression models with multicollinearity and outliers10.1080/03610918.2021.1884715 ↗
40. Robust estimators for generalized linear models10.1016/j.jspi.2013.09.016 ↗
41. Robust regression: Asymptotics, conjectures and Monte Carlo10.1214/aos/1176342503 ↗
42. Conditionally unbiased bounded-influence estimation in general regression models, with applications to generalized linear models10.2307/2289930 ↗
43. Modified robust ridge M-estimators for linear regression models: An application to tobacco data10.1080/00949655.2023.2202913 ↗
44. Robust variable selection via penalized MT-estimator in generalized linear models10.1080/03610926.2021.1887240 ↗
45. Robust inference for generalized linear models10.1198/016214501753209004 ↗
46. Modified ridge-type estimator to combat multicollinearity: Application to chemical data10.1002/cem.3125 ↗
47. Modified ridge-type for the Poisson regression model: Simulation and application10.1080/02664763.2021.1889998 ↗
48. On the James-Stein estimator for the Poisson regression model10.1080/03610918.2020.1775851 ↗
49. Further results on the mean square error of ridge regression10.1111/j.2517-6161.1976.tb01588.x ↗
50. Mean squared error matrix comparisons between biased estimators—An overview of recent results10.1007/bf02924687 ↗
51. Liu-type estimator for the Poisson-inverse Gaussian regression model: Simulation and practical applications10.19139/soic-2310-5070-1991 ↗
52. Tests of regression coefficients under ridge regression models10.1080/00949650008812006 ↗
53. A new linearized ridge Poisson estimator in the presence of multicollinearity10.1080/02664763.2021.1887103 ↗
54. A new Poisson Liu regression estimator: Method and application10.1080/02664763.2019.1707485 ↗
55. Biased adjusted Poisson ridge estimators-method and application10.1007/s40995-020-00974-5 ↗
56. 2021