RegMean++: Enhancing Effectiveness and Generalization of Regression Mean for Model Merging

ArXi:2508.03121v3 Announce Type: replace Regression Mean (RegMean), an approach that formulates model merging as a linear regression problem, aims to find the optimal weights for each linear layer in the merged model by minimizing the discrepancy in predictions between the merged and candidate models. RegMean provides a precise closed-form solution for the merging problem; therefore, it offers explainability and computational efficiency.