Understanding Transformers Part 18: Completing the Decoding Process

In the previous article, we generated the first output word from the transformer. So far, the translation is correct. However, the decoder does not stop until it produces an token. Feeding the Output Back into the Decoder Now, we take the translated word “vamos” and feed it back into a copy of the decoder’s embedding layer to continue the process.