Within LLMs, what's the dividing line between data produced from prediction of the next token, and data produced from human-like reasoning?

It would seem that lately, we're seeing a lot of breakthroughs with AI systems, yet there are dissenters who insist the results are still just clever predictive data. I find myself asking, "Is it still just prediction when the videos are getting consistent and increasingly difficult math problems are being solved?" How do we determine that some sort of thought-like process is going on, as opposed to an advanced version of the Chinese Room? Or is it that human reasoning is just really sophisticated prediction and we don't actually possess logic? submitted by /u/thekokoricky [link] [comments.