AI RESEARCH
DeInfer: Efficient Parallel Inferencing for Decomposed Large Language Models
arXiv CS.CL
•
ArXi:2604.17709v1 Announce Type: new Existing works on large language model (LLM) decomposition mainly focus on improving performance on downstream tasks, but they ignore the poor parallel inference performance when trying to scale up the model size. To mitigate this important performance issue, this paper