Robust Parking Block Segmentation from a Surveillance Camera Perspective
Source abstract
Abstract
Parking block regions host dangerous behaviors that can be detected from a surveillance camera perspective. However, these regions are often occluded, subject to ground bumpiness or steep slopes, and thus they are hard to segment. Firstly, the paper proposes a pyramidal solution that takes advantage of satellite views of the same scene, based on a deep Convolutional Neural Network (CNN). Training a CNN from the surveillance camera perspective is rather impossible due to the combinatory explosion generated by multiple point-of-views. However, CNNs showed great promise on previous works over satellite images. Secondly, even though there are many datasets for occupancy detection in parking lots, none of them were designed to tackle the parking block segmentation problem directly. Given the lack of a suitable dataset, we also propose APKLOT, a dataset of roughly 7000 polygons for segmenting parking blocks from the satellite perspective and from the camera perspective. Moreover, our method achieves more than 50% intersection over union (IoU) in all the testing sets, that is, at both the satellite view and the camera view.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Smart Parking Systems Research · Vehicle License Plate Recognition · Video Surveillance and Tracking Methods
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Tecnologico de Monterrey, School of Engineering and Science, Monterrey 64849, Mexico
References (35)
Show source-provided references
1. Harrell, E. (2012). Violent Victimization Committed by Strangers, 1993–2010, US Department of Justice. Bureau Justice Statistics Special Reports.
2. Sevillano, X., Mármol, E., and Fernandez-Arguedas, V. (2014, January 7–10). Towards smart traffic management systems: Vacant on-street parking spot detection based on video analytics. Proceedings of the 17th International Conference on Information Fusion (FUSION), Salamanca, Spain.
3. Huang, T., Koller, D., Malik, J., Ogasawara, G., Rao, B., Russell, S., and Weber, J. (1994). Automatic Symbolic Traffic Scene Analysis Using Belief Networks. Proceedings of the Twelfth National Conference on Artificial Intelligence, American Association for Artificial Intelligence. [2nd ed.].
4. Seo, Y.W., Ratliff, N.D., and Urmson, C. (2009, January 11–17). Self-Supervised Aerial Image Analysis for Extracting Parking Lot Structure. Proceedings of the International Joint Conferences on Artificial Intelligence IJCAI, Pasadena, CA, USA.10.1109/IROS.2009.5354405 ↗
5. Sastre, R.J.L., Jimenez, P.G., Acevedo, F.J., and Bascon, S.M. (2007, January 4–7). Computer Algebra Algorithms Applied to Computer Vision in a Parking Management System. Proceedings of the 2007 IEEE International Symposium on Industrial Electronics, Vigo, Spain.10.1109/ISIE.2007.4374856 ↗
6. Weis, T., May, B., and Schmidt, C. (2006). A Method for Camera Vision Based Parking Spot Detection, SAE International.10.4271/2006-01-1290 ↗
7. Kabak, M.O., and Turgut, O. (2010). Parking spot detection from aerial images. Stanford University, Final Project Autumn 2010, Machine Learning Course CS229, Stanford University.
8. The Pascal Visual Object Classes (VOC) Challenge10.1007/s11263-009-0275-4 ↗
9. PKLot—A Robust Dataset for Parking Lot Classification The PKLot Dataset10.1016/j.eswa.2015.02.009 ↗
10. Dlib-ml: A Machine Learning Toolkit
11. Huang, C.C., Wang, S.J., Change, Y.J., and Chen, T. (April, January 31). A Bayesian hierarchical detection framework for parking space detection. Proceedings of the 2008 IEEE International Conference on Acoustics, Speech and Signal Processing, Las Vegas, NV, USA.10.1109/ICASSP.2008.4518055 ↗
12. A Hierarchical Bayesian Generation Framework for Vacant Parking Space Detection10.1109/TCSVT.2010.2087510 ↗
13. Mexas, A.H., and Marengoni, M. (2014, January 14–15). Unsupervised Recognition of Parking Lot Areas. Proceedings of the International Conference on Machine Vision and Machine Learning, Prague, Czech Republic. Paper No. 68.
14. Extraction of Parking Lot Structure from Aerial Image in Urban Areas
15. Extracting Parking Lot Structures from Aerial Photographs10.14358/PERS.80.2.151-160 ↗
16. Jung, H.G., Kim, D.S., Yoon, P.J., and Kim, J. (2006, January 13–15). Parking Slot Markings Recognition for Automatic Parking Assist System. Proceedings of the 2006 IEEE Intelligent Vehicles Symposium, Tokyo, Japan.
17. Hsieh, M.R., Lin, Y.L., and Hsu, W.H. (2017, January 22–29). Drone-Based Object Counting by Spatially Regularized Regional Proposal Network. Proceedings of the IEEE International Conference on Computer Vision (ICCV), Venice, Italy.10.1109/ICCV.2017.446 ↗
18. Murphy, K.P. (2013). Machine Learning: A Probabilistic Perspective, MIT Press.
19. Cisek, D., Mahajan, M., Dale, J., Pepper, S., Lin, Y., and Yoo, S. (2017, January 6–9). A transfer learning approach to parking lot classification in aerial imagery. Proceedings of the 2017 New York Scientific Data Summit (NYSDS), New York, NY, USA.10.1109/NYSDS.2017.8085049 ↗
20. Deep learning for decentralized parking lot occupancy detection10.1016/j.eswa.2016.10.055 ↗
21. Cordts, M., Omran, M., Ramos, S., Rehfeld, T., Enzweiler, M., Benenson, R., Franke, U., Roth, S., and Schiele, B. (2016, January 27–30). The Cityscapes Dataset for Semantic Urban Scene Understanding. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.10.1109/CVPR.2016.350 ↗
22. Semantic Segmentation of Aerial Images with an Ensemble of Cnns
23. Classification with an edge: Improving semantic image segmentation with boundary detection10.1016/j.isprsjprs.2017.11.009 ↗
24. Demir, I., Koperski, K., Lindenbaum, D., Pang, G., Huang, J., Basu, S., Hughes, F., Tuia, D., and Raska, R. (2018, January 18–22). Deepglobe 2018: A challenge to parse the earth through satellite images. Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Salt Lake City, UT, USA.10.1109/CVPRW.2018.00031 ↗
25. Long, J., Shelhamer, E., and Darrell, T. (2015, January 7–12). Fully Convolutional Networks for Semantic Segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.10.1109/CVPR.2015.7298965 ↗
26. Ronneberger, O., Fischer, P., and Brox, T. (2015). U-net: Convolutional networks for biomedical image segmentation. International Conference on Medical Image Computing and Computer-Assisted Intervention, Springer.10.1007/978-3-319-24574-4_28 ↗
27. Pereira, F., Burges, C.J.C., Bottou, L., and Weinberger, K.Q. (2012). ImageNet Classification with Deep Convolutional Neural Networks. Advances in Neural Information Processing Systems 25, Curran Associates, Inc.
28. Leibe, B., Matas, J., Sebe, N., and Welling, M. (2016). Identity Mappings in Deep Residual Networks. European Conference on Computer Vision (ECCV), Springer International Publishing.10.1007/978-3-319-46454-1 ↗
29. Lin, T.Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., and Zitnick, C.L. (2014). Microsoft coco: Common objects in context. European Conference on Computer Vision, Springer.10.1007/978-3-319-10602-1_48 ↗
30. Bengio, Y. (2012). Practical recommendations for gradient-based training of deep architectures. Neural Networks: Tricks of the Trade, Springer.10.1007/978-3-642-35289-8_26 ↗
31. Smith, L.N. (2017, January 24–31). Cyclical learning rates for training neural networks. Proceedings of the 2017 IEEE Winter Conference on Applications of Computer Vision, Santa Rosa, CA, USA.10.1109/WACV.2017.58 ↗
32. Sutskever, I., Martens, J., Dahl, G., and Hinton, G. (2013, January 17–19). On the importance of initialization and momentum in deep learning. Proceedings of the 30th International Conference on Machine Learning, Atlanta, GA, USA.
33. Wang, X., and Hanson, A.R. (1998, January 19–21). Parking lot analysis and visualization from aerial images. Proceedings of the Fourth IEEE Workshop on Applications of Computer Vision, Princeton, NJ, USA.
34. Image segmentation evaluation: A survey of unsupervised methods10.1016/j.cviu.2007.08.003 ↗
35. Altwaijry, H., Trulls, E., Hays, J., Fua, P., and Belongie, S. (2016, January 27–30). Learning to Match Aerial Images With Deep Attentive Architectures. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.10.1109/CVPR.2016.385 ↗