AI RESEARCH

[D] Is language modeling fundamentally token-level or sequence-level?

r/MachineLearning

Is language modeling fundamentally token-level or sequence-level? There is evidence for both: pre