Keeping Chaos in Check: A Simple Trick for Stable AI Models
Chaotic systems like the weather or turbulent fluids change a lot when you tweak the starting point just a bit. This makes guessing what will happen next really hard. Even though we see patterns over long times, the tiny details keep shifting.
Researchers have tried to teach neural nets to copy these patterns. They want the model to keep the same overall statistics forever. But many of these learned models end up producing values that grow without limit. When that happens, the statistics we compute become meaningless.
We built a block that solves this problem. It is a dissipative projection layer that uses simple control ideas. The layer learns two things at once: a dynamics emulator and an energy‑like function. The energy function is turned into an algebraic rule that forces the system to lose energy, keeping trajectories inside a bounded set.
When we test the approach on the Lorenz 96 model and a reduced version of the Kuramoto‑Sivashinsky equation, the forecasts stay bounded for many steps. The long‑run statistics match those of the true chaotic system. Moreover, the level set of the learned energy function gives an outer bound that approximates the strange attractor, which is usually tough to pin down.