AI RESEARCH
Enhancing Pretrained Model-based Continual Representation Learning via Guided Random Projection
arXiv CS.LG
•
ArXi:2603.19145v1 Announce Type: new Recent paradigms in Random Projection Layer (RPL)-based continual representation learning have nstrated superior performance when building upon a pre-trained model (PTM). These methods insert a randomly initialized RPL after a PTM to enhance feature representation in the initial stage. Subsequently, a linear classification head is used for analytic updates in the continual learning stage.