AI RESEARCH
[P]I built a two-model protocol to probe LLM constraint topology before token collapse — looking for feedback on methodology
r/MachineLearning
•
I've been obsessing over something for a few weeks: what actually happens inside a language model in the split second before it picks a word? Not philosophically. Empirically. I wanted to watch it happen. Here's the thing that bugged me: the model isn't searching and then outputting. It's briefly holding multiple possible answers at once - different tones, different confidence levels, different ways of framing the same thing - and then it collapses into one token. What you read is the aftermath of that collapse. The competition that happened just before it is normally invisible.