journal article·2026-05-09Open access

Variable Forgetting Factor RLS Adaptive Algorithms Based on Line Search Methods

Radu-Andrei Otopeleanu, Cristian-Lucian Stanciu, Constantin Paleologu, Jacob Benesty

Applied Sciences· Volume 16· Issue 10

Abstract

Recursive least-squares (RLS) adaptive algorithms are capable of outperforming least-mean-square (LMS) methods for the identification of long-length impulse responses due to their ability to mitigate the high correlation properties of input signals, such as speech. Despite the encouraging results obtained in terms of tracking speed and accuracy, with respect to LMS methods, most RLS algorithms manifest numerical stability issues. Moreover, when an unknown system changes, the identification process needs to adapt to the new impulse response as soon as possible. The algorithm can require a significant amount of time to generate new accurate results in acoustic echo cancellation (AEC) scenarios. Due to the slow propagation speed of sound, acoustic echo paths are usually modeled using thousands of numerical coefficients, and adaptation energy remains relatively limited. A compromise is usually made between tracking capabilities and steady-state accuracy when choosing the forgetting factor (the most important parameter of the RLS algorithm). This paper analyzes a variable forgetting factor (VFF) RLS type of adaptive filter combined with the conjugate gradient (CG) line search method, which is designed to avoid the classical matrix inversion approach. This VFF-RLS-CG adaptive method is not susceptible to numerical stability issues and is designed to adapt its statistical estimates by determining whether a tracking situation occurs or whether the unknown system is not significantly different. Correspondingly, when necessary, the forgetting factor is decreased for faster adaptation to changes in the working environment. When the filter is estimated to work at steady-state, the above-mentioned parameter’s value is increased in order to boost the accuracy of the adaptive filter. The theoretical model is validated using simulations in AEC scenarios with tracking occurrences and relevant steady-state intervals.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced Adaptive Filtering Techniques · Speech and Audio Processing · Direction-of-Arrival Estimation Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Telecommunications, National University of Science and Technology POLITEHNICA Bucharest, Splaiul Independenței 313, 060042 Bucharest, Romania

Academy of Romanian Scientists, Ilfov 3, 050044 Bucharest, Romania

INRS-EMT, University of Quebec, Montreal, QC H5A 1K6, Canada

Funding

Academy of Romanian Scientists

References (32)

Show source-provided references
1. Haykin, S. (2014). Adaptive Filter Theory, Pearson. [5th ed.].
2. Benesty, J., and Huang, Y. (2003). Adaptive Signal Processing—Applications to Real-World Problems, Springer.10.1007/978-3-662-11028-7 ↗
3. Hänsler, E., and Schmidt, G. (2004). Acoustic Echo and Noise Control—A Practical Approach, Wiley.10.1002/0471678406 ↗
4. Sayed, A. (2008). Adaptive Filters, Wiley.10.1002/9780470374122 ↗
5. Diniz, P.S.R. (2013). Adaptive Filtering: Algorithms and Practical Implementation, Springer. [4th ed.].10.1007/978-1-4614-4106-9 ↗
6. Low-Complexity RLS Algorithms Using Dichotomous Coordinate Descent Iterations10.1109/TSP.2008.917874 ↗
7. Architecture and FPGA Design of Dichotomous Coordinate Descent Algorithms10.1109/TCSI.2009.2015725 ↗
8. DCD-RLS Adaptive Filters with Penalties for Sparse Identification10.1109/TSP.2013.2258340 ↗
9. DCD-Based Recursive Adaptive Algorithms Robust Against Impulsive Noise
10. Stereophonic Acoustic Echo Cancellation—An Overview of the Fundamental Problem10.1109/97.404129 ↗
11. MMP-DCD-CV Based Sparse Channel Estimation Algorithm for Underwater Acoustic Transform Domain Communication System10.1016/j.apacoust.2019.04.019 ↗
12. Conjugate Gradient Techniques for Adaptive Filtering10.1109/81.109237 ↗
13. Analysis of Conjugate Gradient Algorithms for Adaptive Filtering10.1109/78.823968 ↗
14. Albu, F. (2012, January 5–7). Improved Variable Forgetting Factor Recursive Least Square Algorithm. Proceedings of the International Conference on Control, Automation, Robotics & Vision, Guangzhou, China.10.1109/ICARCV.2012.6485421 ↗
15. Low-Complexity Variable Forgetting Factor Mechanism for Blind Adaptive Constrained Constant Modulus Algorithms10.1109/TSP.2012.2199317 ↗
16. A Low Complexity Variable Forgetting Factor Constant Modulus RLS Algorithm for Blind Adaptive Beamforming10.1016/j.sigpro.2014.06.003 ↗
17. Improved Variable Forgetting Factor Recursive Algorithm Based on the Logarithmic Cost for Volterra System Identification
18. A New Variable Forgetting Factor-Based Bias-Compensated RLS Algorithm for Identification of FIR Systems With Input Noise and Its Hardware Implementation10.1109/TCSI.2019.2944221 ↗
19. A New Variable Forgetting Factor and Variable Regularized Square Root Extended Instrumental Variable PAST Algorithm with Applications10.1109/TAES.2019.2940304 ↗
20. A Robust PAST-Based ESPRIT Algorithm with Variable Forgetting Factor and Regularization for Frequencies/Harmonics Estimation in Impulsive Noise10.1109/TIM.2022.3173613 ↗
21. Improved Variable Forgetting Factor Proportionate RLS Algorithm with Sparse Penalty and Fast Implementation Using DCD Iterations
22. A Nonparametric Variable Forgetting Factor Recursive Least-Squares Algorithm10.1109/LSP.2025.3632232 ↗
23. A Widely Linear Model for Stereophonic Acoustic Echo Cancellation10.1016/j.sigpro.2012.08.017 ↗
24. Performance of recursive least squares algorithm configurations for online parameter identification of induction machines in an automotive environment10.1109/TTE.2023.3244619 ↗
25. Enhanced sparsity-aware RLS algorithm for efficient estimation of time-varying sparse system
26. An ultrafast variable forgetting factor recursive least square method for determining the state-of-health of Li-Ion batteries10.1109/ACCESS.2023.3340631 ↗
27. An adaptive Hammerstein model for FES-induced torque prediction based on variable forgetting factor recursive least squares algorithm10.1109/TNSRE.2024.3371465 ↗
28. Influence of the forgetting factor in the recursive least squares RLS algorithm on the quality and precision of the identified parameters in a DC corona discharge10.1109/TPS.2024.3524470 ↗
29. Diagnosis of open-switch faults in grid-tied three-level NPC inverters with parameter uncertainty using variable forgetting factor bias-compensation recursive least squares10.1109/TCSI.2025.3563662 ↗
30. Gradient-Based Variable Forgetting Factor RLS Algorithm in Time-Varying Environments10.1109/TSP.2005.851110 ↗
31. (2026, January 26). Open Speech Repository. Available online: https://www.voiptroubleshooter.com/open_speech/index.html.
32. New insights into the RLS algorithm