The “next token prediction is a stupid architecture” crowd is fundamentally superstitious. It believes in magic. They look at a car and say “look at these different components, they all work in fundamentally different ways. Each of them must obey a different set of laws of physics.”