Horizon-constrained Rashomon sets for chaotic forecasting
Source abstract
Abstract
Predictive multiplicity and chaotic dynamics represent two fundamental challenges in machine learning that have evolved independently despite their conceptual connections. We bridge this gap by introducing horizon-constrained Rashomon sets, a theoretical framework that characterizes how model multiplicity evolves with prediction horizon in chaotic systems. Unlike static prediction tasks where the Rashomon set remains fixed, chaos induces exponential divergence among initially similar models, fundamentally transforming the nature of predictive equivalence. We prove that the effective Rashomon set contracts exponentially with lead time at a rate determined by the maximum Lyapunov exponent and introduce Lyapunov-weighted metrics that provide tighter bounds on predictive disagreement. Leveraging these insights, we develop decision-aligned selection algorithms that choose among near-optimal models based on downstream utility rather than forecast accuracy alone. Extensive experiments on synthetic chaotic systems (Lorenz-96 and Kuramoto–Sivashinsky) and real-world applications (wind power, traffic, and weather) demonstrate that our framework improves decision quality by 18%–34% while maintaining competitive predictive performance. This work establishes the first rigorous connection between chaos theory and predictive multiplicity, providing principled guidance for deploying machine learning in safety-critical chaotic domains.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Stochastic Gradient Optimization Techniques · Neural Networks and Reservoir Computing · Adversarial Robustness in Machine Learning
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Electrical Engineering, California State University Long Beach 1 , Long Beach, California 90840,
WorkOnward, Inc. 2 , New York, New York 10003,
Department of Computer Engineering & Computer Science, California State University Long Beach 3 , Long Beach, California 90840,
References (29)
Show source-provided references
1. Deterministic nonperiodic flow10.1175/1520-0469(1963)020<0130:dnf>2.0.co;2 ↗
2. 2018
3. Statistical modeling: The two cultures (with comments and a rejoinder by the author)10.1214/ss/1009213726 ↗
4. Predictive multiplicity in classification
5. On the existence of simpler machine learning models
6. Amazing things come from having many good models
7. The starting dates of COVID-19 multiple waves10.1063/5.0079904 ↗
8. Anticipating synchrony in dynamical systems using information theory10.1063/5.0079255 ↗
9. Early detection of synchrony in coupled oscillator model10.1140/epjp/s13360-022-03122-7 ↗
10. Modeling the machine learning multiverse
11. Discovering governing equations from data by sparse identification of nonlinear dynamical systems10.1073/pnas.1517384113 ↗
12. Model-free prediction of large spatiotemporally chaotic systems from data: A reservoir computing approach10.1103/physrevlett.120.024102 ↗
13. Backpropagation algorithms and reservoir computing in recurrent neural networks for the forecasting of complex spatiotemporal dynamics10.1016/j.neunet.2020.02.016 ↗
14. Ab initio analysis of extreme events in dynamical systems with Rényi entropy production rate10.1016/j.chaos.2026.118041 ↗
15. Underspecification presents challenges for credibility in modern machine learning
16. Model multiplicity: Opportunities, concerns, and solutions
17. Exploring the whole Rashomon set of sparse decision trees
18. SORTeD Rashomon sets of sparse decision trees: Anytime enumeration
19. H. Jaeger , “The ‘echo state’ approach to analysing and training recurrent neural networks,” Technical Report GMD Report 148, German National Research Center for Information Technology, 2001.
20. Harnessing nonlinearity: Predicting chaotic systems and saving energy in wireless communication10.1126/science.1091277 ↗
21. Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations10.1016/j.jcp.2018.10.045 ↗
22. Deep learning for improving numerical weather prediction of heavy rainfall10.1029/2021MS002765 ↗
23. FourCastnet: Accelerating global high-resolution weather forecasting using adaptive Fourier neural operators
24. GraphCast: Learning skillful medium-range global weather forecasting10.1126/science.adi2336 ↗
25. Melding the data-decisions pipeline: Decision-focused learning for combinatorial optimization10.1609/aaai.v33i01.33011658 ↗
26. Smart predict-then-optimize for two-stage linear programs with side information
27. Fairness in forecasting and learning linear dynamical systems10.1609/aaai.v35i12.17328 ↗
28. Decision-focused learning: Foundations, state of the art, benchmark and future opportunities10.1613/jair.1.15320 ↗
29. SDWPF: A dataset for spatial dynamic wind power forecasting challenge at KDD cup 2022