Why “next-token” is being discussed
The most recent Hacker News stories and comments contributing to this topic's mentions.
They are indeed "just next-token predictors". But rockets to orbit are also "just forward and upward goers". And Steph Curry is "just next three-pointer scorer" and so on. And a…
by arjie · Sep 5, 2026
Right. But that's never what the discussion is about. This is the first time I've seen someone say, "it's not just a next-token predictor because a bunch of the training isn't a…
by wat10000 · Sep 4, 2026
Not the person you’re replying to, but I read the whole article as an admission that it’s still a next-token predictor. More specifically: what does RLVR fundamentally change th…
by angoragoats · Sep 4, 2026
It's a short article; you could read it. One example to get you started is the very first sentence: > Strictly speaking, the statement “LLMs are next-token predictors” isn’t wro…
by Planktonne · Sep 4, 2026
Describing it as a "next-token predictor" in the sense that this would mean it's fundamentally limited to just a fraction of an inferential step is doubly wrong: 1. In order to…
by mofeien · Sep 4, 2026
Interest
Proportion of Hacker News items mentioning "next-token" over time.
Mentions
Total number of Hacker News items mentioning "next-token" over time.