Nobody Invented Attention. A Frustrated PhD Student Ran Out of Other Options.

Towards AI
Generative AI

Dzmitry Bahdanau was not trying to invent the architecture that would eventually run inside every large language model on earth.