It's far from useless. Overblown, for sure.
They made an awesome hammer that can solve many hammer-related tasks, but they're selling it like it can also cook, drive and keep the house clean.
Blame the companies, not the math.
keimevo
joined 3 years ago
It's not like that. Tokens are an inherent computational property of how a model calculates the probabilities and such to generate text.
Having said that, what a token means in terms of computation varies wildly between models and is not directly comparable. So attributing a money value to tokens in general, independently of the model, is weird by nature.
And even within a model, the number of tokens needed to generate a response is very variable too, depending of the model itself and the parameters with which it has been configured (thinking mode, temperature, etc.).
So yeah, companies can pretty much set any price they want and there's not much anyone can do about it.
Claude is trained on stolen data (the whole Internet), so I can't have any sympathy for Anthropic when someone steals from them.
Given that the LLMs could follow the short lists of words well but not the longer lists, and that they were processing images, not text, I think it's more likely that their context just filled up and they forgot the original instructions (or they were assigned a lower weight in the computation).
They never learned the lesson about the Torment Nexus.