AI RESEARCH
LightTransfer: Your Long-Context LLM is Secretly a Hybrid Model with Effortless Adaptation
arXiv CS.LG
•
ArXi:2410.13846v3 Announce Type: replace-cross Scaling language models to handle longer contexts