Setting the temperature parameter to 0.00 makes an LLM deterministic.
theunknownmuncher
joined 2 years ago
Hmmm you'd think one would not use claude to do writing in the first place if one was bothered by "perversions of writing", and this whole argument is just in bad faith
Because they have a poor user experience with an OS and applications that have chosen not to support it properly, and blame the image format for this
Who could it be???
That's... that's literally the point they are making... did you click the link and read?
Traitors would mean they were ever on your side. Welcome to capitalism, bud. They've always been on the side of maximum profit, like all other corporations.
Maybe the statistical approximate just coincidentally lined up with the actual solution?
Yes, right, and this can happen. I didn't say they are a bad approximation. LLMs may be the most advanced and sophisticated statistical models ever created (if there are other examples of statistical models that are more sophisticated, I would love to learn about them). But given what an LLM actually objectively is, a statistical model of the next token to follow from a sample of language, what other explanation could there be?
We need to keep in mind what the tools that we are working with actually are.
As a code generator, they can produce great results, especially simple stuff like generating a script or some function implementation. Once you get to software engineering tasks like designing system architecture and designing maintainable code, it starts to fall apart really fast. You end up doing all of the work for it in natural language and just using the LLM for a usecase that it is actually great for: translation, from detailed spec to code.
Especially because a statistical model of language has very limited valid usecases. Many tasks that people use LLM for do not make any sense and cannot be accomplished by a statistical model of language. It can only output a statistical approximate of what a solution to the task might look like, not an actual solution.
It's true and a real thing, but its also just a BS excuse to push for removal of body cameras.
view more: next ›
Um... yes. Matrix multiplication is deterministic, there's nothing non-deterministic about an LLM, unless you artificially add randomness to them, like randomly selecting 1 of the top N ranked tokens.