Applying the Geostatistical Eigenvector Spatial Filter Approach into Regularized Regression for Improving Prediction Accuracy for Mass Appraisal
Source abstract
Abstract
Prediction accuracy for mass appraisal purposes has evolved substantially over the last few decades, facilitated by the evolution in big data, data availability and open source software. Accompanying these advances, newer forms of geo-spatial approaches and machine learning (ML) algorithms have been shown to help improve house price prediction and mass appraisal assessment. Nonetheless, the adoption a of ML within mass appraisal has been protracted and subject to scrutiny by assessment jurisdictions due to their failure to account for spatial autocorrelation and limited practicality in terms of value significant estimates needed for tribunal defense and explainability. Existing research comparing traditional regression approaches has tended to examine unsupervised ML methods such as Random Forest (RF) models which remain more esoteric and less transparent in producing value significant estimates necessary for mass appraisal explainability and defense. Therefore, the purpose of this study is to apply the supervised Regularized regression technique which offers a more transparent alternative, and integrate this with a more nuanced geo-statistical technique, the Eigenvector Spatial Filter (ESF) approach, to more accurately account for spatial autocorrelation and enhance prediction accuracy whilst improving explainability needed for mass appraisal exercises. By undertaking such an approach, the research demonstrates the application of this method can be easily adopted for property tax jurisdictions in a framework which is more interpretable, transparent and useable within mass appraisal given its simple and appealing approach. The findings reveal that the integration of the ESFs improves model explainability, prediction accuracy and spatial residual error compared to baseline classical regression and Elastic-net regularized regression architectures, whilst offering the necessary ‘front-facing’ and flexible structure for in-sample and out-of-sample assessment needed by the assessment community for valuing the unsold housing stock. In terms of policy and practice, the study demonstrates some important considerations for mass appraisal tax assessment and for the improvement of taxation assessment and the alleviation of horizontal and vertical inequity.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Housing Market and Economics · Land Use and Ecosystem Services · Spatial and Panel Data Analysis
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Architecture and the Built Environment, Ulster University, Newtownabbey BT37 0QB, UK
Netherlands Council for Real Estate Assessment, Waarderingskamer, 93 210 The Hague, The Netherlands
Center for Appraisal Research and Technology, Washington, DC 20009, USA
References (65)
Show source-provided references
1. An empirical evaluation of spatial regression models10.1016/j.cageo.2006.02.010 ↗
2. Matysiak, G.A. (2022, August 23). Automated Valuation Models (AVMs): A Brave New World? Paper Delivered at Wroclaw Conference, Wroclaw, Poland. Available online: https://www.researchgate.net/profile/George-Matysiak/publication/319355261_Automated_Valuation_Models_AVMs_A_brave_new_world/links/59a881a5a6fdcc2398387b61/Automated-Valuation-Models-AVMs-A-brave-new-world.pdf.
3. Čeh, M., Kilibarda, M., Lisec, A., and Bajat, B. (2018). Estimating the performance of random forest versus multiple regression for predicting prices of the apartments. ISPRS Int. J. Geo-Inf., 7.10.3390/ijgi7050168 ↗
4. Analysis of spatial autocorrelation in house prices10.1023/A:1007703229507 ↗
5. Hu, L., Chun, Y., and Griffith, D.A. (2019). A multilevel eigenvector spatial filtering model of house prices: A case study of house sales in Fairfax County, Virginia. ISPRS Int. J. Geo-Inf., 8.10.3390/ijgi8110508 ↗
6. Spatially varying coefficient models in real estate: Eigenvector spatial filtering and alternative approaches10.1016/j.compenvurbsys.2015.12.002 ↗
7. Spatial models in real estate economics10.1080/140360902760385646 ↗
8. LeSage, J.P., and Pace, R.K. (2009). Introduction to Spatial Econometrics, Chapman & Hall/CRC.10.1201/9781420064254 ↗
9. Moving window approaches for hedonic price estimation: An empirical comparison of modelling techniques10.1177/0042098008091491 ↗
10. Lagrange multiplier test diagnostics for spatial dependence and spatial heterogeneity10.1111/j.1538-4632.1988.tb00159.x ↗
11. Spatial statistics and real estate10.1023/A:1007783811760 ↗
12. Predicting house prices with spatial dependence: A comparison of alternative methods10.1080/10835547.2010.12091276 ↗
13. Real estate mass appraisal in the real estate cadastre and GIS environment
14. Multicollinearity and correlation among local regression coefficients in geographically weighted regression10.1007/s10109-005-0155-6 ↗
15. A simulation-based study of geographically weighted regression as a method for investigating spatially varying relationships10.1068/a44111 ↗
16. The effect of kernel and bandwidth specification in geographically weighted regression models on the accuracy and uniformity of mass real estate appraisal
17. Hierarchy and spatial autocorrelation effects in hedonic models
18. The potential of artificial neural networks in mass appraisal: The case revisted10.1108/13664381211274371 ↗
19. An exploration of neural networks and its application to real estate valuation10.1080/10835547.1995.12090782 ↗
20. Neural networks and non-linear statistical methods: An application to the modelling of price-quality relationships10.1016/S0305-0548(00)00096-4 ↗
21. House price prediction: Hedonic price model vs. artificial neural network10.3844/ajassp.2004.193.201 ↗
22. Neural network hedonic pricing models in mass real estate appraisal10.1080/10835547.2009.12091245 ↗
23. Heuristic principles for the design of artificial neural networks10.1016/S0950-5849(98)00116-5 ↗
24. An adaptive Neuro-Fuzzy inference system based approach to real estate property assessment10.1080/10835547.2008.12091225 ↗
25. Prediction accuracy in mass appraisal: A comparison of modern approaches10.1080/09599916.2013.781204 ↗
26. Kim, J., Lee, Y., Lee, M.H., and Hong, S.Y. (2022). A comparative study of machine learning and spatial interpolation methods for predicting house prices. Sustainability, 14.10.3390/su14159056 ↗
27. Analysis and prediction of second-hand house price based on random forest10.2478/amns.2022.1.00052 ↗
28. Afonso, B., Melo, L., Oliveira, W., Sousa, S., and Berton, L. (2019, January 15–18). Housing prices prediction with a deep learning and random forest ensemble. Proceedings of the Anais do XVI Encontro Nacional de Inteligência Artificial e Computacional, Salvador, Brazil.10.5753/eniac.2019.9300 ↗
29. Incorporating multiple linear regression in predicting the house prices using a big real estate dataset with 80 independent variables
30. Predicting property prices with machine learning algorithms10.1080/09599916.2020.1832558 ↗
31. Boosted tree ensembles for artificial intelligence based automated valuation models (AI-AVM)10.1007/s11146-021-09861-1 ↗
32. Hjort, A., Pensar, J., Scheel, I., and Sommervoll, D.E. (2022). House price prediction with gradient boosted trees under different loss functions. J. Prop. Res., Available online: https://doi.org/10.1080/09599916.2022.2070525.10.1080/09599916.2022.2070525 ↗
33. Who performs better? AVMs vs. Hedonic Models10.1108/JPIF-12-2019-0157 ↗
34. Hinrichs, N., Kolbe, J., and Werwatz, A. (2020). AVM and High Dimensional Data: Do Ridge, the Lasso or the Elastic Net Provide an ‘Automated’ Solution? FORLand Working Paper No. 22, Humboldt-Universität zu Berlin. Available online: https://www.econstor.eu/bitstream/10419/227605/1/FORLand-2020-22.pdf.
35. Determinants of house price: A decision tree approach10.1080/00420980600990928 ↗
36. Real estate price forecasting based on SVM optimized by PSO10.1016/j.ijleo.2013.09.017 ↗
37. Random forest as a generic framework for predictive modeling of spatial and spatio-temporal variables10.7717/peerj.5518 ↗
38. Assessing the spatial sensitivity of a random forest model: Application in gridded population modeling10.1016/j.compenvurbsys.2019.01.006 ↗
39. Superresolution mapping of remotely sensed image based on Hopfield neural network with anisotropic spatial dependence model
40. Spatial prediction of soil organic matter content integrating artificial neural network and ordinary Kriging in Tibetan Plateau10.1016/j.ecolind.2014.04.003 ↗
41. spatially filtered multilevel model to account for spatial dependency: Application to self-rated health status in South Korea10.1186/1476-072X-13-6 ↗
42. Combining spatial autocorrelation with machine learning increases prediction accuracy of soil heavy metals10.1016/j.catena.2018.11.037 ↗
43. Understanding place characteristics in geographic contexts through graph convolutional neural networks
44. A Moran coefficient-based mixed effects approach to investigate spatially varying relationships10.1016/j.spasta.2016.12.001 ↗
45. Prediction Accuracy for Property Tax Mass Appraisal: A comparison between regularized machine learning and the eigenvector spatial filter approach
46. Ho, J. (2022, August 25). Machine Learning for Causal Inference: An Application to Air Quality Impacts on House Prices. Available online: https://econ.washington.edu/sites/econ/files/documents/job-papers/ho_jmpaper_0.pdf.
47. Wang, D., and Li, V.J. (2019). Mass appraisal models of real estate in the 21st century: A systematic literature review. Sustainability, 11.10.3390/su11247006 ↗
48. Mass appraisal of residential apartments: An application of random forest for valuation and a CART-based approach for model diagnostics10.1016/j.eswa.2011.08.077 ↗
49. A comparison of regression and artificial intelligence methods in a mass appraisal context10.1080/10835547.2011.12091311 ↗
50. Comparing Rough Set Theory with multiple regression analysis as automated valuation methodologies
51. Random forests for multiclass classification: Random multinomial logit10.1016/j.eswa.2007.01.029 ↗
52. A mass appraisal assessment study using machine learning based on multiple regression and random forest10.1016/j.landusepol.2020.104889 ↗
53. Dimopoulos, T., and Bakas, N. (2019). Sensitivity analysis of machine learning models for the mass appraisal of real estate. Case study of residential units in Nicosia, Cyprus. Remote Sens., 11.10.3390/rs11243047 ↗
54. Yu, H., and Wu, J. (2022, August 22). Real Estate Price Prediction with Regression and Classification. CS 229 (Machine Learning) Project Final Report. Available online: http://cs229.stanford.edu/proj2016/report/WuYu_HousingPrice_report.pdf.
55. Modelling house price using ridge regression and lasso regression
56. Madhuri, C.R., Anuradha, G., and Pujitha, M.V. (2019, January 14–15). House price prediction using regression techniques: A comparative study. Proceedings of the 2019 International Conference on Smart Structures and Systems, Chennai, India. Available online: https://ieeexplore.ieee.org/document/8882834.10.1109/ICSSS.2019.8882834 ↗
57. Eigenvector spatial filtering for large data sets: Fixed and random effects approaches10.1111/gean.12156 ↗
58. House price estimation using an eigenvector spatial filtering approach10.1108/IJHMA-09-2019-0097 ↗
59. Accounting for spatial autocorrelation in linear regression models using spatial filtering with eigenvectors10.1080/00045608.2012.685048 ↗
60. Application of LASSO to the eigenvector selection problem in eigenvector-based spatial filtering10.1111/gean.12054 ↗
61. Incorporating spatial autocorrelation into house sale price prediction using random forest model10.1111/tgis.12931 ↗
62. Regularization and variable selection via the elastic net10.1111/j.1467-9868.2005.00503.x ↗
63. Griffith, D.A. (2003). Spatial Autocorrelation and Spatial Filtering: Gaining Understanding through Theory and Scientific Visualization, Springer.10.1007/978-3-540-24806-4 ↗
64. Eigenfunction properties and approximations of selected incidence matrices employed in spatial analyses10.1016/S0024-3795(00)00031-8 ↗
65. Eigenvector selection with stepwise regression techniques to construct eigenvector spatial filters10.1007/s10109-015-0225-3 ↗