AI RESEARCH

Forecast collapse of transformer-based models under squared loss in financial time series

arXiv CS.LG

ArXi:2604.00064v1 Announce Type: cross We study trajectory forecasting under squared loss for time series with weak conditional structure, using highly expressive prediction models. Building on the classical characterization of squared-loss risk minimization, we emphasize regimes in which the conditional expectation of future trajectories is effectively degenerate, leading to trivial Bayes-optimal predictors (flat for prices and zero for returns in standard financial settings). In this regime, increased model expressivity does not improve predictive accuracy but instead.