AI & ML
Enforcing Symmetries on Pre-trained ML Models for Physics
arXiv stat.ML0 views
arXiv:2611.08992v1 Announce Type: cross Abstract: Post-hoc group averaging (or test-time augmentation) is a simple way to impose symmetry on a trained predictor without changing its architecture or retraining it. For finite and compact groups, averaging over a normalized Haar measure on the group gives the Reynolds operator: a canonical projection onto invariant or equivariant predictors with known non-increasing risk guarantees under certain assumptions. This paper provides numerical experiments on physics emulation models that demonstrate the effectiveness of the approach in this setting. We then extend this framework to non-compact group symmetries. For non-compact groups, the Haar measure cannot be normalized, so group averaging cannot be defined in the same way. We replace it with three alternatives: the Weyl unitary trick (which requires complexifying the space and extending the predictor), a data-dependent orthogonal projection (which involves a non-trivial optimization on the space of invariant or equivariant functions), and a frame averaging approach (which involves mapping each point to a set of orbit representatives). We illustrate the constructions theoretically and empirically on the unit-rescaling group and the Lorentz group. Our results show that in the non-compact case, the Weyl trick and frame averaging do not provide a consistent improvement over the baseline, except where the test data is out-of-distribution (an orders-of-magnitude improvement in this case) and, for the Weyl trick, in low-data regimes. The orthogonal projection can provide improvements in-distribution and out-of-distribution. We also observe that models trained directly on invariant features matched or beat the projection of an unconstrained one. We conclude that post-hoc symmetrization extends to non-compact groups, but it does not consistently outperform training a symmetric model.
Source:https://arxiv.org/abs/2611.08992PreviousOrdered Policy OptimizationNextCalibrating your confidence requires thinking of all the ways you could be wrong
Related posts

Weekly Update 529: Kids Social Media Bans (and Everything Else)
0Troy Hunt

Take-Two reiterates FY 2027 outlook, says Q2 total net bookings fell 18% YoY to $1.6B, vs. $1.65B est., and NBA 2K27 missed sales forecast partly due to GTA VI (Jason Schreier/Bloomberg)
0Techmeme
Learning Abstractions: The Next Frontier for AI
0Hacker News New
Attackers Claim to Have Stolen Data on over 1M Vanderbilt Students, Staff
0Hacker News New
Male donkey is a bull's willing partner in rare interspecies affair
0Hacker News New
ByteAsk: Build-Aware Context and a Checking Harness for C++ Coding Agents
0Hacker News New