journal article·2022-04-23Open access

Efficient Algorithms for Linear System Identification with Particular Symmetric Filters

Ionuţ-Dorinel Fîciu, Jacob Benesty, Laura-Maria Dogariu, Constantin Paleologu, Silviu Ciochină

Applied Sciences· Volume 12· Issue 9

Abstract

In linear system identification problems, it is important to reveal and exploit any specific intrinsic characteristic of the impulse responses, in order to improve the overall performance, especially in terms of the accuracy and complexity of the solution. In this paper, we focus on the nearest Kronecker product decomposition of the impulse responses, together with low-rank approximations. Such an approach is suitable for the identification of a wide range of real-world systems. Most importantly, we reformulate the system identification problem by using a particular symmetric filter within the development, which allows us to efficiently design two (iterative/recursive) algorithms. First, an iterative Wiener filter is proposed, with improved performance as compared to the conventional Wiener filter, especially in challenging conditions (e.g., small amount of available data and/or noisy environments). Second, an even more practical solution is developed, in the form of a recursive least-squares adaptive algorithm, which could represent an appealing choice in real-time applications. Overall, based on the proposed approach, a system identification problem that can be conventionally solved by using a system of L=L1L2 equations (with L unknown parameters) is reformulated as a combination of two systems of PL1 and PL2 equations, respectively, where usually P≪L2 (i.e., a total of PL1+PL2 parameters). This could lead to important advantages, in terms of both performance and complexity. Simulation results are provided in the framework of network and acoustic echo cancellation, supporting the performance gain and the practical features of the proposed algorithms.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced Adaptive Filtering Techniques · Blind Source Separation Techniques · Image and Signal Denoising Methods

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Telecommunications, University Politehnica of Bucharest, 1-3, Iuliu Maniu Blvd., 061071 Bucharest, Romania

INRS-EMT, University of Quebec, Montreal, QC H5A 1K6, Canada

Funding

Unitatea Executiva Pentru Finantarea Invatamantului Superior a Cercetarii Dezvoltarii si Inovarii

References (45)

Show source-provided references
1. Ljung, L. (1999). System Identification: Theory for the User, Prentice-Hall. [2nd ed.].
2. Gay, S.L., and Benesty, J. (2000). Acoustic Signal Processing for Telecommunication, Kluwer Academic Publisher.10.1007/978-1-4419-8644-3 ↗
3. Benesty, J., Gänsler, T., Morgan, D.R., Sondhi, M.M., and Gay, S.L. (2001). Advances in Network and Acoustic Echo Cancellation, Springer.10.1007/978-3-662-04437-7 ↗
4. Rupp, M., and Schwarz, S. (2015, January 19–24). A tensor LMS algorithm. Proceedings of the 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), South Brisbane, QLD, Australia.10.1109/ICASSP.2015.7178591 ↗
5. Rupp, M., and Schwarz, S. (September, January 31). Gradient-based approaches to learn tensor products. Proceedings of the 2015 23rd European Signal Processing Conference (EUSIPCO), Nice, France.10.1109/EUSIPCO.2015.7362832 ↗
6. Gesbert, D., and Duhamel, P. (1996, January 24–26). Robust blind joint data/channel estimation based on bilinear optimization. Proceedings of the 8th Workshop on Statistical Signal and Array Processing, Corfu, Greece.
7. Tensor modelling of MIMO communication systems with performance analysis and Kronecker receivers10.1016/j.sigpro.2017.12.015 ↗
8. Adaptation of a memoryless preprocessor for nonlinear acoustic echo cancelling10.1016/S0165-1684(00)00085-2 ↗
9. Huang, Y., Skoglund, J., and Luebs, A. (2017, January 5–9). Practically efficient nonlinear acoustic echo cancellers using cascaded block RLS and FLMS adaptive filters. Proceedings of the 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), New Orleans, LA, USA.10.1109/ICASSP.2017.7952225 ↗
10. Cichocki, A., Zdunek, R., Pan, A.H., and Amari, S. (2009). Nonnegative Matrix and Tensor Factorizations: Applications to Exploratory Multiway Data Analysis and Blind Source Separation, Wiley.10.1002/9780470747278 ↗
11. A tensor-based method for large-scale blind source separation using segmentation10.1109/TSP.2016.2617858 ↗
12. Benesty, J., Cohen, I., and Chen, J. (2019). Array Processing–Kronecker Product Beamforming, Springer.10.1007/978-3-030-15600-8 ↗
13. Separable linearly constrained minimum variance beamformers10.1016/j.sigpro.2018.12.010 ↗
14. Vasilescu, M.A.O., and Kim, E. (2019). Compositional hierarchical tensor factorization: Representing hierarchical intrinsic and extrinsic causal factors. arXiv.
15. Vasilescu, M.A.O., Kim, E., and Zeng, X.S. (2021, January 10–15). CausalX: Causal eXplanations and block multilinear factor analysis. Proceedings of the 2020 25th International Conference on Pattern Recognition (ICPR), Milan, Italy.10.1109/ICPR48806.2021.9412780 ↗
16. Linear system identification based on a Kronecker product decomposition10.1109/TASLP.2018.2842146 ↗
17. Recursive least-squares algorithms for the identification of low-rank systems10.1109/TASLP.2019.2903276 ↗
18. Bhattacharjee, S.S., and George, N.V. (2020, January 4–8). Nearest Kronecker product decomposition based normalized least mean square algorithm. Proceedings of the ICASSP 2020—2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Barcelona, Spain.10.1109/ICASSP40776.2020.9053421 ↗
19. Nearest Kronecker product decomposition based generalized maximum correntropy and generalized hyperbolic secant robust adaptive filters10.1109/LSP.2020.3017106 ↗
20. Time difference of arrival estimation based on a Kronecker product decomposition10.1109/LSP.2020.3044775 ↗
21. Robust dereverberation with Kronecker product based multichannel linear prediction10.1109/LSP.2020.3044796 ↗
22. On the design of differential Kronecker product beamformers10.1109/TASLP.2021.3069089 ↗
23. A Kronecker product CLMS algorithm for adaptive beamforming10.1016/j.dsp.2021.102968 ↗
24. Fast and efficient acoustic feedback cancellation based on low rank approximation10.1016/j.sigpro.2021.107984 ↗
25. Beamforming with cube microphone arrays via Kronecker product decompositions10.1109/TASLP.2021.3079816 ↗
26. Nearest Kronecker product decomposition based linear-in-the-parameters nonlinear filters10.1109/TASLP.2021.3084755 ↗
27. Kronecker product multichannel linear filtering for adaptive weighted prediction error-based speech dereverberation10.1109/TASLP.2022.3161150 ↗
28. Vadhvana, S., Yadav, S.K., Bhattacharjee, S.S., and George, N.V. (2022). An improved constrained LMS algorithm for fast adaptive beamforming based on a low rank approximation. IEEE Trans. Circuits Syst. II Express Briefs, early access.10.1109/TCSII.2022.3157604 ↗
29. Benesty, J., Paleologu, C., and Ciochină, S. (November, January 31). On the identification of symmetric and antisymmetric impulse responses. Proceedings of the 2021 55th Asilomar Conference on Signals, Systems, and Computers, Pacific Grove, CA, USA.10.1109/IEEECONF53345.2021.9723281 ↗
30. Benesty, J., Paleologu, C., Ciochină, S., Kuhn, E.V., Bakri, K.J., and Seara, R. (2022, January 22–27). LMS and NLMS algorithms for the identification of impulse responses with intrinsic symmetric or antisymmetric properties. Proceedings of the (ICASSP 2022) 2022 IEEE International Conference on Acoustics, Speech and Signal Processing, Singapore. accepted for publication.10.1109/ICASSP43922.2022.9747430 ↗
31. The ubiquitous Kronecker product10.1016/S0377-0427(00)00393-9 ↗
32. Harville, D.A. (1997). Matrix Algebra From a Statistician’s Perspective, Springer.10.1007/b98818 ↗
33. On the identification of bilinear forms with the Wiener filter10.1109/LSP.2017.2685461 ↗
34. Haykin, S. (2002). Adaptive Filter Theory, Prentice-Hall. [4th ed.].
35. Sayed, A.H. (2008). Adaptive Filters, Wiley.10.1002/9780470374122 ↗
36. Diniz, P.S.R. (2013). Adaptive Filtering: Algorithms and Practical Implementation, Springer. [4th ed.].10.1007/978-1-4614-4106-9 ↗
37. A state-space approach to adaptive RLS filtering10.1109/79.295229 ↗
38. Gradient-based variable forgetting factor RLS algorithm in time-varying environments10.1109/TSP.2005.851110 ↗
39. Low-complexity RLS algorithms using dichotomous coordinate descent iterations10.1109/TSP.2008.917874 ↗
40. Apolinário, J.A. (2009). QRD-RLS Adaptive Filtering, Springer.
41. Bertsekas, D.P. (1999). Nonlinear Programming, Athena Scientific. [2nd ed.].
42. (2022, April 01). Digital Network Echo Cancellers; ITU-T Recommendation G.168. Available online: https://www.itu.int/rec/dologin_pub.asp?lang=f&id=T-REC-G.168-200701-S!!PDF-E&type=items.
43. Dogariu, L.-M., Benesty, J., Paleologu, C., and Ciochină, S. (2021). An insightful overview of the Wiener Filter for system identification. Appl. Sci., 11.10.3390/app11177774 ↗
44. Kim, P.S. (2019). Selective finite memory structure filtering using the chi-square test statistic for temporarily uncertain systems. Appl. Sci., 9.10.3390/app9204257 ↗
45. Kwon, B., and Kim, S.-I. (2022). Recursive optimal finite impulse response filter and its application to adaptive estimation. Appl. Sci., 12.10.3390/app12052757 ↗