journal article·2023-11

Deep Reinforcement Learning-Based Optimal and Fast Hybrid Equalizer Design Method for High-Bandwidth Memory (HBM) Module

Seonguk Choi, Keeyoung Son, Hyunwook Park, Seongguk Kim, Boogyo Sim, Jihun Kim, Joonsang Park, Minsu Kim, Haeyeon Kim, Jinwook Song, Youngwoo Kim, Joungho Kim

Publisher page

Abstract

In this article, we propose a deep reinforcement learning (DRL)-based optimal and fast hybrid equalizer (HYEQ) design method for high-bandwidth memory (HBM) module. The HYEQ is a promising key to improving the signal integrity (SI) performance along the broad frequency bands by combining a passive equalizer (PEQ) and an active equalizer (AEQ) for the HBM module. However, the equalizer design process is extremely complex because all of the parameters should be co-optimized by considering the SI characteristics of the target channel. To tackle the design complexity, we utilize the DRL method that trains the policy network to optimize the HYEQ design for maximizing an eye-opening (EO) value. The policy network is configured with a recurrent type of neural network and sequentially determines the optimal values of the HYEQ parameters by considering the relevance between the parameters. Furthermore, the training process for the policy network is implemented in diverse channel dimensions of the silicon interposer. By learning the feature between channel dimensions and equalizer parameters, the policy network directly designs the optimal HYEQ for arbitrary channel dimensions. For verification, the proposed method is compared with the random search (RS) and genetic algorithm (GA) in terms of optimality performance and computational time. The result shows that the proposed method outperforms both RS and GA.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: 3D IC and TSV technologies · Copper Interconnects and Reliability · VLSI and Analog Circuit Testing

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Electrical Engineering, Korea Advanced Institute of Science and Technology, Daejeon, South Korea

Electrical and Computer Engineering, Missouri University of Science and Technology (MST), Rolla, MO, USA

Samsung Electronics, Hwaseong, South Korea

Department of Semiconductor Systems Engineering, Sejong University, Seoul, South Korea

Funding

Samsung Electronics Company, Ltd. · National Research and Development Program through the National Research Foundation of Korea · Ministry of Science and Information and Communication Technology

References (55)

Show source-provided references
1. 10.1109/temc.2010.204875510.1109/temc.2010.2048755 ↗
2. 10.1002/978111816672710.1002/9781118166727 ↗
3. 10.1142/wssaip10.1142/wssaip ↗
4. 10.1007/978-3-319-44586-1_210.1007/978-3-319-44586-1_2 ↗
5. 10.1007/978-981-15-7090-2_210.1007/978-981-15-7090-2_2 ↗
6. 10.1109/tcpmt.2020.304542910.1109/tcpmt.2020.3045429 ↗
7. 2020
8. 10.1109/isscc.2014.675750110.1109/isscc.2014.6757501 ↗
9. 10.1109/panpacific.2016.742842510.1109/panpacific.2016.7428425 ↗
10. 10.1109/tcpmt.2017.277983810.1109/tcpmt.2017.2779838 ↗
11. 10.1109/temc.2016.258782410.1109/temc.2016.2587824 ↗
12. 10.1109/ectc32862.2020.0014410.1109/ectc32862.2020.00144 ↗
13. 10.1109/epeps.2012.645785110.1109/epeps.2012.6457851 ↗
14. 10.1109/TCPMT.2014.236462110.1109/TCPMT.2014.2364621 ↗
15. 10.1109/ectc.2016.13310.1109/ectc.2016.133 ↗
16. 10.1109/TCSI.2017.278376210.1109/TCSI.2017.2783762 ↗
17. 10.1109/epeps.2014.710361410.1109/epeps.2014.7103614 ↗
18. 10.1109/jssc.2015.246646910.1109/jssc.2015.2466469 ↗
19. 10.1109/3dic.2015.733461910.1109/3dic.2015.7334619 ↗
20. 10.1109/tvlsi.2017.277142910.1109/tvlsi.2017.2771429 ↗
21. 10.1109/epeps.2009.533847810.1109/epeps.2009.5338478 ↗
22. 10.1109/edaps50281.2020.931291910.1109/edaps50281.2020.9312919 ↗
23. 10.1109/epeps48591.2020.923147110.1109/epeps48591.2020.9231471 ↗
24. 10.1109/epep.2006.32123910.1109/epep.2006.321239 ↗
25. 10.1109/tcpmt.2013.225792710.1109/tcpmt.2013.2257927 ↗
26. 10.1109/ectc32862.2020.0015510.1109/ectc32862.2020.00155 ↗
27. 10.1109/tsipi.2023.324285510.1109/tsipi.2023.3242855 ↗
28. 10.1109/temc.2010.204538110.1109/temc.2010.2045381 ↗
29. 10.1109/emcsi38923.2020.919156410.1109/emcsi38923.2020.9191564 ↗
30. 10.1109/edaps47854.2019.901165410.1109/edaps47854.2019.9011654 ↗
31. 10.1109/access.2018.288403610.1109/access.2018.2884036 ↗
32. 10.1109/epeps51341.2021.960912410.1109/epeps51341.2021.9609124 ↗
33. 10.1109/epeps.2016.783543810.1109/epeps.2016.7835438 ↗
34. 10.1109/access.2020.298808810.1109/access.2020.2988088 ↗
35. 10.1109/tcpmt.2020.301191010.1109/tcpmt.2020.3011910 ↗
36. 10.1109/isemc.2019.882524910.1109/isemc.2019.8825249 ↗
37. 10.1109/epeps53828.2022.994717310.1109/epeps53828.2022.9947173 ↗
38. 10.1109/temc.2022.322203410.1109/temc.2022.3222034 ↗
39. 10.1109/epeps51341.2021.960919510.1109/epeps51341.2021.9609195 ↗
40. 10.1109/TNN.1998.71219210.1109/TNN.1998.712192 ↗
41. 10.1109/tmtt.2022.320222110.1109/tmtt.2022.3202221 ↗
42. 10.1109/epeps51341.2021.960919410.1109/epeps51341.2021.9609194 ↗
43. 10.1109/epeps51341.2021.960913910.1109/epeps51341.2021.9609139 ↗
44. 10.1109/epeps51341.2021.960919310.1109/epeps51341.2021.9609193 ↗
45. 10.1109/icept.2013.675653110.1109/icept.2013.6756531 ↗
46. 10.3115/v1/D14-117910.3115/v1/D14-1179 ↗
47. Asynchronous methods for deep reinforcement learning
48. 10.1109/jssc.2007.90307610.1109/jssc.2007.903076 ↗
49. 10.1109/vlsic.2002.101504310.1109/vlsic.2002.1015043 ↗
50. 10.1109/tcpmt.2021.311707110.1109/tcpmt.2021.3117071 ↗
51. 10.1109/tcpmt.2022.320167310.1109/tcpmt.2022.3201673 ↗
52. 10.1109/temc.2021.308171310.1109/temc.2021.3081713 ↗
53. 10.1063/1.492146310.1063/1.4921463 ↗
54. Adam: A method for stochastic optimization
55. Deep learning using rectified linear units (ReLU)