They solved AI’s memory problem!

Researchers at the Kimi Team have developed a groundbreaking new AI architecture named Attention Residuals, which is capable of solving the fundamental problem of "AI amnesia" in deep neural networks. While previous large language models have achieved remarkable performance by stacking hundreds of processing layers, they inherently suffer from information degradation, where original context gets buried and lost as data is continually compressed into a single accumulated state.