HK65

joined 2 years ago
[–] HK65@sopuli.xyz 1 points 2 weeks ago

Oh definitely. The whole "reasoning" thing was just sending the answer back as a prompt a few times in different structures, and it was of course all billed

[–] HK65@sopuli.xyz 4 points 2 weeks ago (1 children)

The stance is that chatbota aren't essential to the economy the way smartphones or computers are.

[–] HK65@sopuli.xyz 2 points 2 weeks ago (2 children)

When you send a message to a chatbot, it cuts it up to little pieces made up of a few letters, assigns numbers to them, does math, and gives you back a bunch of other numbers that it translates back to pieces and puts together into a sentence.

You pay for the chatbot by the amount of little pieces in and little pieces out. The little pieces are the tokens.

[–] HK65@sopuli.xyz 0 points 1 month ago

600k is not a lot of money for a software team or for AI though.

[–] HK65@sopuli.xyz 4 points 2 months ago (5 children)

They ship with proprietary code, this would be the point of open source.

In practice in my experience, every company is at least skirting the law regarding privacy, and I never worked for one big enough that could lobby itself out of a fine.

[–] HK65@sopuli.xyz 2 points 2 months ago

There might.be a little of that going around as well, but the datacenters haven't actually been built even close to the scale claimed, and the racks in there are kinda useless at serving SaaS webpage stuff, too many GPUs to make it make sense financially.

[–] HK65@sopuli.xyz 0 points 2 years ago (5 children)

Either somewhere on the far left, and we'll see some actual breakthrough with major impact in the future which actually gets hyped, or on the far right and it already happened, it was just too niche for anyone other than a specific small group to notice.