Enhanced ridge estimators to effectively address multicollinearity challenges
Source abstract
Abstract
In this study, we introduce three new ridge estimators, referred to as AIRE1, AIRE2, and AIRE3, designed to effectively address the issue of multicollinearity in regression analysis. The performance of these estimators was compared with the Ordinary Least Squares (OLS) and existing ridge estimators using the Mean Squared Error (MSE) as a benchmark. Theoretical comparisons of estimators are not possible. We used Monte Carlo simulations to assess their performance based on MSE. Although no single estimator works best across all scenarios of multicollinearity, the findings from simulations and real-world datasets demonstrated that the proposed estimators outperformed OLS and other ridge estimators. Among all the estimators, the newly proposed AIRE1 consistently outperformed the rest, establishing itself as a reliable and effective solution for mitigating multicollinearity.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Advanced Statistical Methods and Models · Statistical Methods and Inference · Advanced Statistical Process Monitoring
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Government Degree College Achini Payan, Higher Education Department 1 , Khyber Pakhtunkhwa,
Department of Mathematics and Statistics, College of Science, Taif University 2 , Taif,
Funding
Taif University, Saudi Arabia
References (27)
Show source-provided references
1. Ridge regression: Applications to nonorthogonal problems10.1080/00401706.1970.10488635 ↗
2. Linear models10.1007/0-387-22752-0_2 ↗
3. Principal components regression in exploratory statistical research10.1080/01621459.1965.10480787 ↗
4. Generalized cross-validation as a method for choosing a good Ridge Parameter10.1080/00401706.1979.10489751 ↗
5. A variable span smoother
6. Estimation of forest above-ground biomass by geographically weighted regression and machine learning with sentinel imagery10.3390/f9100582 ↗
7. American society for quality A statistical view of some chemometrics regression tools A statistical view of some chemometrics regression tools source10.1080/00401706.1993.10485033 ↗
8. Generalized inverses, ridge regression, biased linear estimation, and nonlinear estimation10.1080/00401706.1970.10488699 ↗
9. A simulation study of ridge and other regression estimators10.1080/03610927608827353 ↗
10. A Monte Carlo study of recent ridge parameters10.1080/03610910701208619 ↗
11. Ridge regression in prediction problems: Automatic choice of the Ridge parameter10.1002/gepi.21750 ↗
12. Review and classifications of the ridge parameter estimation techniques10.15672/HJMS.201815671 ↗
13. Monte Carlo study of some classification-based ridge parameter estimators10.22237/jmasm/1493598240 ↗
14. Two-parameter ridge estimation for the coefficients of almon distributed lag model10.1007/s40995-018-0634-5 ↗
15. Generalized cross-validation for simultaneous optimization of tuning parameters in ridge regression10.1007/s40995-020-00851-1 ↗
16. Mitigating multicollinearity in regression: A study on improved ridge estimators10.3390/math12193027 ↗
17. Ridge regression: Some simulations10.1080/03610927508827232 ↗
18. Performance of some New Ridge regression estimators10.1081/SAC-120017499 ↗
19. Modified ridge regression estimators10.1080/03610926.2011.593285 ↗
20. A comparative study of the performance of new ridge estimators for multicollinearity: Insights from simulation and real data application10.1063/5.0236631 ↗
21. Ridge trace and HKB methods in ridge regression to solve multicollinearity10.1063/5.0137129 ↗
22. Quantile-based robust ridge m-estimator for linear regression model in presence of multicollinearity and outliers10.1080/03610918.2019.1621339 ↗
23. U.S. Department of Commerce · 1986
24. 2004
25. Optimum Ridge regression parameter using R-squared of prediction as a criterion for regression analysis10.2991/jsta.d.210322.001 ↗
26. Ridge regression: Biased estimation for nonorthogonal problems10.1080/00401706.1970.10488634 ↗
27. On the estimation of ridge penalty in linear regression: Simulation and application10.1016/j.kjs.2024.100273 ↗