journal article·2025-08-01Open access

Reinforcement learning algorithm for secondary path identification in active noise control systems

Wenjun Li, Caiyun Wu, Fan Bai

AIP Advances· Volume 15· Issue 8

Abstract

To address the issue of inaccurate secondary path modeling and the challenges of handling nonlinear and time-varying characteristics in traditional active noise control systems, this study proposes a secondary path identification method based on reinforcement learning (RL) and periodic prediction mechanisms. First, the modeling performance of different strategies in complex dynamic systems was analyzed, confirming the advantages of RL methods. Based on this analysis, a policy network with shared self-attention mechanisms and periodic prediction bypass structures was constructed to enhance the model’s ability to capture periodic features and improve the modeling accuracy and training stability. Real-vehicle test results show that this method significantly outperforms traditional algorithms, reducing the average error by 37.2%, increasing the signal-to-noise ratio by 5.1 dB, reducing the relative error by 12.6%, and improving the overall noise reduction by 6.8 dB.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced Adaptive Filtering Techniques · Control Systems and Identification · Speech and Audio Processing

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Equipment Engineering, Shenyang Ligong University , Shenyang 110159,

Funding

Basic Research Projects of Liaoning Provincial Department of Education of China

References (22)

Show source-provided references
1. Secondary path modeling technology for active noise cancelling headphones10.3969/j.issn.1004-1699.2011.02.015 ↗
2. An online secondary path modeling method for adaptive active noise control10.3969/j.issn.1006-1335.2014.05.005 ↗
3. Optimization of secondary path identification based on neural networks in active noise control10.14135/j.cnki.1006-3080.20200928001 ↗
4. A hybrid SFANC-FxNLMS algorithm for active noise control based on deep learning10.1109/lsp.2022.3169428 ↗
5. Online identification and vibration active control of cantilever beams based on neural networks10.13465/j.cnki.jvs.2013.21.001 ↗
6. A vibration active control method based on NARX neural network10.3969/j.issn.1006-1355.2024.02.001 ↗
7. A secondary path-decoupled active noise control algorithm based on deep learning10.1109/lsp.2021.3130023 ↗
8. A study of time-domain FXLMS algorithms with control output constraint10.1121/1.1367247 ↗
9. Deep ANC: A deep learning approach to active noise control10.1016/j.neunet.2021.03.037 ↗
10. Y. Lu , “A vibration active control algorithm with variable step-size LMS for secondary path online identification,” Master’s thesis, Huazhong University of Science and Technology, 2023.
11. Research on vibration isolation control algorithm with variable step-size LMS based on secondary path online identification
12. Secondary path online modeling based on improved Lorentzian function10.26914/c.cnkihy.2023.003091 ↗
13. Active noise control based on offline and online modeling new algorithms10.3969/j.issn.1006-9348.2022.10.070 ↗
14. J. Zhang , “Active noise control over spatial regions,” Ph.D. dissertation, Australian Natl. University, 2019.
15. Recent advances on active noise control: Open issues and innovative applications10.1017/atsip.2012.4 ↗
16. Deep residual learning for image recognition
17. Active noise control10.3397/1.3703006 ↗
18. A reinforcement learning based approach to partition testing10.1007/s11390-024-2900-7 ↗
19. Ultrafast optical and passive acoustic mapping characterization of nanoscale cavitation nuclei based on gas vesicle proteins10.1063/5.0239607 ↗
20. Noise analysis and active noise control strategy of transcranial magnetic stimulation device10.1063/1.5115522 ↗
21. Noise source analysis and control for two axial-flow cooling fans in series10.1007/978-3-662-48868-3_9 ↗
22. Case study: OtologMap: A case study on the construction of an environmental sound map recorded by smart devices at Okayama and Kurashiki10.3397/1/37731 ↗