AI RESEARCH

Colinearity Decay: Training Quantization-Friendly ViTs with Outlier Decay

arXiv CS.CV

ArXi:2605.01330v1 Announce Type: new Low-bit quantization is a practical route for efficiently deploying vision Transformers, yet activation outliers complicate fully quantized deployment. Existing methods either handle quantization post-