BONSAI: Bayesian Optimization with Natural Simplicity and Interpretability

ArXi:2602.07144v2 Announce Type: replace-cross Bayesian optimization (BO) is a popular technique for sample-efficient optimization of black-box functions. In many applications, the parameters being tuned come with a carefully engineered default configuration, and practitioners only want to deviate from this default when necessary. Standard BO, however, does not aim to minimize deviation from the default and, in practice, often pushes weakly relevant parameters to the boundary of the search space.