Prospects of federated machine learning in fluid dynamics
Source abstract
Abstract
Physics-based models have been mainstream in fluid dynamics for developing predictive models. In recent years, machine learning has offered a renaissance to the fluid community due to the rapid developments in data science, processing units, neural network based technologies, and sensor adaptations. So far in many applications in fluid dynamics, machine learning approaches have been mostly focused on a standard process that requires centralizing the training data on a designated machine or in a data center. In this article, we present a federated machine learning approach that enables localized clients to collaboratively learn an aggregated and shared predictive model while keeping all the training data on each edge device. We demonstrate the feasibility and prospects of such a decentralized learning approach with an effort to forge a deep learning surrogate model for reconstructing spatiotemporal fields. Our results indicate that federated machine learning might be a viable tool for designing highly accurate predictive decentralized digital twins relevant to fluid dynamics.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Neural Networks and Reservoir Computing · Model Reduction and Neural Networks · Meteorological Phenomena and Simulations
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Mechanical and Aerospace Engineering, Oklahoma State University 1 , Stillwater, Oklahoma 74078, USA
Department of Engineering Cybernetics, Norwegian University of Science and Technology 2 , N-7465 Trondheim, Norway
Funding
U.S. Department of Energy
References (38)
Show source-provided references
1. On closures for reduced order models—A spectrum of first-principle to machine-learned avenues10.1063/5.0061577 ↗
2. Digital twin: Values, challenges and enablers from a modeling perspective10.1109/access.2020.2970143 ↗
3. Hybrid analysis and modeling, eclecticism, and multifidelity computing toward digital twin revolution10.1002/gamm.202100007 ↗
4. Report from the NASA machine learning workshop, April 17–19, 2018, Boulder, CO, https://esto.nasa.gov/wp-content/uploads/2020/03/2018MachineLearningWorkshop_Report.pdf.
5. A global comparison between station air temperatures and MODIS land surface temperatures reveals the cooling role of forests10.1029/2010jg001486 ↗
6. Service design for climate-smart agriculture10.1016/j.inpa.2020.07.003 ↗
7. Can the crowdsourcing data paradigm take atmospheric science to a new level? A case study of the urban heat island of London quantified using Netatmo weather stations10.1002/joc.4940 ↗
8. Smart IoT devices in the home: Security and privacy implications10.1109/mts.2018.2826079 ↗
9. Big data storage and analysis for smart farming
10. Kuramoto–Sivashinsky dynamics on the center–unstable manifold10.1137/0149039 ↗
11. 2012
12. Diffusion-induced chaos in reaction systems10.1143/ptps.64.346 ↗
13. Nonlinear analysis of hydrodynamic instability in laminar flames—I. Derivation of basic equations10.1016/0094-5765(77)90096-0 ↗
14. Intermittent chaos driven by nonlinear Alfvén waves10.5194/npg-11-691-2004 ↗
15. Nonlinear saturation of the trapped-ion mode10.1103/physrevlett.34.391 ↗
16. Identification of distributed parameter systems: A neural net based approach10.1016/s0098-1354(98)00191-4 ↗
17. Model-free prediction of large spatiotemporally chaotic systems from data: A reservoir computing approach10.1103/PhysRevLett.120.024102 ↗
18. Data-driven forecasting of high-dimensional chaotic systems with long short-term memory networks10.1098/rspa.2017.0844 ↗
19. Deep learning to discover and predict dynamics on an inertial manifold10.1103/PhysRevE.101.062209 ↗
20. Multiscale simulations of complex systems by learning their effective dynamics10.1038/s42256-022-00464-w ↗
21. Fourth-order time-stepping for stiff PDEs10.1137/s1064827502410633 ↗
22. Communication-efficient learning of deep networks from decentralized data
23. Nonlinear proper orthogonal decomposition for convection-dominated flows10.1063/5.0074310 ↗
24. Federated optimization in heterogeneous networks
25. T. Li, M. Sanjabi, A. Beirami, and V. Smith, “Fair resource allocation in federated learning,” arXiv:1905.10497 (2019).
26. A. Fallah, A. Mokhtari, and A. Ozdaglar, “Personalized federated learning: A meta-learning approach,” arXiv:2002.07948 (2020).
27. Y. Deng, M. M. Kamani, and M. Mahdavi, “Adaptive personalized federated learning,” arXiv:2003.13461 (2020).
28. Towards personalized federated learning10.1109/tnnls.2022.3160699 ↗
29. Memory embedded non-intrusive reduced order modeling of non-ergodic flows10.1063/1.5128374 ↗
30. Model fusion with physics-guided machine learning: Projection-based reduced-order modeling10.1063/5.0053349 ↗
31. Data-driven recovery of hidden physics in reduced order modeling of fluid flows10.1063/5.0002051 ↗
32. Proper orthogonal decomposition closure models for fluid flows: Burgers equation
33. A stabilized proper orthogonal decomposition reduced-order model for large scale quasigeostrophic ocean circulation10.1007/s10444-015-9417-0 ↗
34. On the state space geometry of the Kuramoto–Sivashinsky flow in a periodic domain10.1137/070705623 ↗
35. Inertial manifolds for the Kuramoto-Sivashinsky equation10.1016/0375-9601(94)90775-7 ↗
36. Fast approximated POD for a flat plate benchmark with a time varying angle of attack
37. Principal interval decomposition framework for POD reduced-order modeling of convective Boussinesq flows10.1002/fld.4006 ↗
38. Stabilized principal interval decomposition method for model reduction of nonlinear convective systems with moving shocks10.1007/s40314-018-0718-z ↗