AI RESEARCH

Convergence of Consensus-Based Particle Methods for Nonconvex Bi-Level Optimization

arXiv CS.LG

ArXi:2605.19667v1 Announce Type: cross In this paper, we study a consensus-based optimization method for nonconvex bi-level optimization, where the objective is to minimize an upper-level function over the set of global minimizers of a lower-level problem. The proposed approach is derivative-free, and constructs its consensus point via smooth quantile selection combined with a Gibbs-type Laplace approximation. We establish convergence guarantees for both the associated \textit{mean-field} dynamics and its \textit{finite-particle} approximation.