They can’t simply go back to correct their beliefs
Backtracking is a common and integral part of the reasoning learned by what used to be called Large Reasoning Models but today is part of almost any modern model design, much like Mixture-of-Experts
nymnympseudonym
joined 1 year ago
tech bros turning the tech into a large scale game of blackjack
Agreed 100%
As a person who was bookish and deeply computer-focused from back when that meant only that you had no friends outside D&D -- before it also meant, "probably has a challenging career and makes good money".
That "tech" now prefixes the socializing extrovert bros who didn't spend their entire adolescence learning assembly language and soldering alone in their room... is a complete, 180-degree U-turn subversion from the original "techy nerd" meaning
look like human reasoning
You should really listen to the podcast. Not going to summarize it here, but it looks like human reasoning including semantic activation patterns, use of productions, and dozens of other things that cognitive psychologists have known about for decades but for which they have not been able to come up with a mechanism.
replace all the ‘reasoning’ steps from an LLMs output with “please wait” and it will still supply the same final answer.
If you listened to the podcast (or were familiar with the literature) you'd know that's simply Not True.
Sometimes, by listening to bona fide experts, you might learn new things instead of already knowing everything.
Would you believe, the evidence is rather more compelling than that. Similarities in non-obvious failure modes, for example.
model & tooling improvements, giving more weight to higher quality reports and MRs, and more respect for project rules and processes. A mix of soft and hard gates, CLAs, improved early automated bug report & patch reviews and other CI gates
This is exactly what I see happening inside the handful of large software companies into which I have visibility.
We have to deal with the fact that slop or not we all have 100x more security bugs than usual thanks to Mythos and friends, and some of them are real ones that will bit us in the ass if we don't fix like, now
My wife was a member of a Facebook group related to farming (as in growing food)
IIRC a mod shared a post that had been auto-banned: one person complained about weeds; the triggering reply was
"Hoe, do the work"
Exactly.
What is the powerful new tools can be used for great good as well as great evil
Lots of channels have a link to their Patreon or a tip jar; lots do live reads.