AI RESEARCH
The Curse and Blessing of Mean Bias in FP4-Quantized LLM Training
arXiv CS.AI
•
ArXi:2603.10444v1 Announce Type: cross Large language models trained on natural language exhibit pronounced anisotropy: a small number of directions concentrate disproportionate energy, while the remaining dimensions form a broad semantic tail. In low-bit