Oh yeah? Well AI systems can be useful for everyday tasks like recommendations or summaries, but their reliability depends on the context and the quality of the data they were trained on. Researchers have developed methods to measure an AI model's confidence in its answers, which helps users assess trustworthiness in high-stakes decisions such as healthcare or finance.
So, uh, maybe you should be aware of the high quality data used in training and ask those, uh, other people who throw out LLM answers what the confidence value is before you judge. Ha, got em!
I am not serious at all, that first paragraph was copy pasted from an LLM button in DuckDuckGo I had to go out of my way to look for.
A lot of the big models were trained on reddit data with little indication whether there was selection for high quality content, which means to me that the overall training data quality is unreliable. If an LLM can hallucinate an answer, it can hallucinate its confidence value since that is also an answer.
In other words, I agree with your sentiment.