Taxonomy of Vectorization Patterns of Programming for FIR Image Filters Using Kernel Subsampling and New One
Source abstract
Abstract
This study examines vectorized programming for finite impulse response image filtering. Finite impulse response image filtering occupies a fundamental place in image processing, and has several approximated acceleration algorithms. However, no sophisticated method of acceleration exists for parameter adaptive filters or any other complex filter. For this case, simple subsampling with code optimization is a unique solution. Under the current Moore’s law, increases in central processing unit frequency have stopped. Moreover, the usage of more and more transistors is becoming insuperably complex due to power and thermal constraints. Most central processing units have multi-core architectures, complicated cache memories, and short vector processing units. This change has complicated vectorized programming. Therefore, we first organize vectorization patterns of vectorized programming to highlight the computing performance of central processing units by revisiting the general finite impulse response filtering. Furthermore, we propose a new vectorization pattern of vectorized programming and term it as loop vectorization. Moreover, these vectorization patterns mesh well with the acceleration method of subsampling of kernels for general finite impulse response filters. Experimental results reveal that the vectorization patterns are appropriate for general finite impulse response filtering. A new vectorization pattern with kernel subsampling is found to be effective for various filters. These include Gaussian range filtering, bilateral filtering, adaptive Gaussian filtering, randomly-kernel-subsampled Gaussian range filtering, randomly-kernel-subsampled bilateral filtering, and randomly-kernel-subsampled adaptive Gaussian filtering.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Advanced Image and Video Retrieval Techniques · Remote-Sensing Image Classification · Image Enhancement Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Scientific and Engineering Simulation, Nagoya Institute of Technology, Gokiso-cho, Showa-ku, Nagoya, Aichi 466-8555, Japan
Funding
Japan Society for the Promotion of Science
References (46)
Show source-provided references
1. Cramming more components onto integrated circuits, Reprinted from Electronics, volume 38, number 8, April 19, 1965, pp.114 ff10.1109/N-SSC.2006.4785860 ↗
2. Rotem, E., Ginosar, R., Mendelson, A., and Weiser, U.C. (2013, January 25–27). Power and thermal constraints of modern system-on-a-chip computer. Proceedings of the 19th International Workshop on Thermal Investigations of ICs and Systems (THERMINIC), Berlin, Germany.10.1109/THERMINIC.2013.6675226 ↗
3. Some computer organizations and their effectiveness10.1109/TC.1972.5009071 ↗
4. Single-instruction multiple-data execution
5. Data Transformations for Eliminating Conflict Misses10.1145/277652.277661 ↗
6. Henretty, T., Stock, K., Pouchet, L.N., Franchetti, F., Ramanujam, J., and Sadayappan, P. (April, January 26). Data Layout Transformation for Stencil Computations on Short-vector SIMD Architectures. Proceedings of the International Conference on Compiler Construction: Part of the Joint European Conferences on Theory and Practice of Software (CC’11/ETAPS’11), Saarbrücken, Germany.
7. Saegusa, T., Maruyama, T., and Yamaguchi, Y. (2008, January 8–10). How fast is an FPGA in image processing?. Proceedings of the International Conference on Field Programmable Logic and Applications, Heidelberg, Germany.
8. Asano, S., Maruyama, T., and Yamaguchi, Y. (September, January 31). Performance comparison of FPGA, GPU and CPU in image processing. Proceedings of the International Conference on Field Programmable Logic and Applications, Prague, Czech Republic.
9. A Scalable Massively Parallel Processor for Real-Time Image Processing10.1109/JSSC.2011.2159528 ↗
10. Batcher, K.E. (May, January 30). Sorting networks and their applications. Proceedings of the Spring Joint Computer Conference (SJCC), Atlantic City, NJ, USA.
11. Quicksort10.1093/comjnl/5.1.10 ↗
12. Viola, P., and Jones, M. (2001, January 8–14). Rapid object detection using a boosted cascade of simple features. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Kauai, HI, USA.
13. Gonzalez, R.C., and Woods, R.E. (2008). Digital Image Processing, Prentice Hall.
14. The Design of Multistage Separable Planar Filters10.1109/TGE.1971.271457 ↗
15. Image Perforation: Automatically Accelerating Image Pipelines by Intelligently Skipping Samples10.1145/2904903 ↗
16. A Low-Memory, Straightforward and Fast Bilateral Filter Through Subsampling in Spatial Domain10.1111/j.1467-8659.2011.02078.x ↗
17. Deriche, R. (1992, January 7–11). Recursively Implementating the Gaussian and its Derivatives. Proceedings of the IEEE International Conference on Image Processing (ICIP), Singapore.
18. Recursive implementation of the Gaussian filter10.1016/0165-1684(95)00020-E ↗
19. Van Vliet, L.J., Young, I.T., and Verbeek, P.W. (1998, January 20). Recursive Gaussian derivative filters. Proceedings of the IEEE International Conference on Pattern Recognition, Brisbane, Australia.
20. Wells, W.M. (1986). Efficient synthesis of Gaussian filters by cascaded uniform filters. IEEE Trans. Pattern Anal. Mach. Intell., 234–239.10.1109/TPAMI.1986.4767776 ↗
21. Elboher, E., and Werman, M. (2011, January 11–14). Cosine integral images for fast spatial and range filtering. Proceedings of the IEEE International Conference on Image Processing, Brussels, Belgium.10.1109/ICIP.2011.6116704 ↗
22. Sugimoto, K., and Kamata, S. (2013, January 15–18). Fast Gaussian filter with second-order shift property of DCT-5. Proceedings of the International Conference on Image Processing (ICIP), Melbourne, Australia.10.1109/ICIP.2013.6738106 ↗
23. Efficient Constant-time Gaussian Filtering with Sliding DCT/DST-5 and Dual-domain Error Minimization
24. A survey of Gaussian convolution algorithms10.5201/ipol.2013.87 ↗
25. Fast Bilateral Filtering for the Display of High-Dynamic-Range Images10.1145/566654.566574 ↗
26. Sugimoto, K., Fukushima, N., and Kamata, S. (2016, January 13–16). Fast Bilateral Filter for Multichannel Images via Soft-assignment Coding. Proceedings of the 2016 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC), Jeju, Korea.10.1109/APSIPA.2016.7820813 ↗
27. Compressive Bilateral Filtering10.1109/TIP.2015.2442916 ↗
28. Real-Time Edge-Aware Image Processing with the Bilateral Grid10.1145/1276377.1276506 ↗
29. A Fast Approximation of the Bilateral Filter Using A Signal Processing Approach10.1007/s11263-007-0110-8 ↗
30. Fukushima, N., Fujita, S., and Ishibashi, Y. (2015, January 19–24). Switching Dual Kernels for Separable Edge-Preserving Filtering. Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Brisbane, Australia.10.1109/ICASSP.2015.7178238 ↗
31. Pham, T.Q., and Vliet, L.J.V. (2005, January 6–8). Separable bilateral filtering for fast video preprocessing. Proceedings of the International Conference on Multimedia and Expo (ICME), Amsterdam, The Netherlands.
32. Acceleration of the Shiftable O(1) Algorithm for Bilateral Filtering and Nonlocal Means10.1109/TIP.2012.2222903 ↗
33. Crow, F.C. (1984, January 23–27). Summed-Area Tables for Texture Mapping. Proceedings of the ACM SIGGRAPH, Minneapolis, MN, USA.10.1145/800031.808600 ↗
34. Mitzenmacher, M., and Upfal, E. (2005). Probability and Computing: Randomized Algorithms and Probabilistic Analysis, Cambridge University Press.10.1017/CBO9780511813603 ↗
35. Motwani, R., and Raghavan, P. (1995). Randomized Algorithms, Cambridge University Press.10.1017/CBO9780511814075 ↗
36. Stochastic Sampling in Computer Graphics10.1145/7529.8927 ↗
37. Optimization of Fusion Kernels on Accelerators with Indirect or Strided Memory Access Patterns10.1109/TPDS.2016.2633349 ↗
38. Gradient-based learning applied to document recognition10.1109/5.726791 ↗
39. Chellapilla, K., Puri, S., and Simard, P. (2006, January 23–26). High Performance Convolutional Neural Networks for Document Processing. Proceedings of the International Workshop on Frontiers in Handwriting Recognition, La Baule, France.
40. Chetlur, S., Woolley, C., Vandermersch, P., Cohen, J., Tran, J., Catanzaro, B., and Shelhamer, E. (arXiv, 2014). cuDNN: Efficient Primitives for Deep Learning, arXiv.
41. Vasudevan, A., Anderson, A., and Gregg, D. (2017, January 10–12). Parallel Multi Channel convolution using General Matrix Multiplication. Proceedings of the IEEE International Conference on Application-specific Systems, Architectures and Processors (ASAP), Seattle, WA, USA.10.1109/ASAP.2017.7995254 ↗
42. Distinctive Image Features from Scale-Invariant Keypoints10.1023/B:VISI.0000029664.99615.94 ↗
43. Tomasi, C., and Manduchi, R. (1998, January 7). Bilateral Filtering for Gray and Color Images. Proceedings of the IEEE International Conference on Computer Vision (ICCV), Bombay, India.
44. Deng, G., and Cahill, L. (6, January 31). An adaptive Gaussian filter for noise reduction and edge detection. Proceedings of the IEEE Nuclear Science Symposium and Medical Imaging Conference, San Francisco, CA, USA.
45. Defocus magnification10.1111/j.1467-8659.2007.01080.x ↗
46. Zhang, W., and Cham, W.K. (October, January 27). Single image focus editing. Proceedings of the IEEE International Conference on Computer Vision Workshops (ICCV Workshops), Kyoto, Japan.