boonhet

It's meta, there was bound to be faeces

Well hopefully just server grade but still not great

I'm pretty sure you dun wooshd

The vetting for those offshore programmers ain't worth it tbh.

How many will you go through till you get a competent one? I worked at a company with an office in India and... Maybe 20% of the staff there were gifted and hardworking, 80% were a net detriment to the product we were building.

The office was closed. I hope they kept on the people who were actually good as remote employees but I have no idea.

I am absolutely not burning more energy than a frontier model by doing things like putting my laptop to sleep or shutting down unused services when I want to conserve battery power.

I was under the impression you keep loading the model into VRAM and unloading it when finished using it, I meant it's less power efficient than just keeping it in VRAM.

That’s actually not true. In fact it’s much the opposite. Frontier models churn through tokens at a much higher rate, because of their higher complexity and higher number of parameters.

Thing is, the input/reading part of it is cheap and wastefully generating extra tokens as output costs you more in energy (or money if using an external service). Put it this way: Claude has historically had 3 models: Haiku (small), Sonnet (medium), Opus (big). Sonnet 5 came out recently and people using Claude Code have reported that it's so verbose, it's now more expensive to use for the same task than Opus, which has much bigger costs per Mtok. That would mean it probably also uses more energy than the bigger model.

…Almost never? I’m not a fan of letting AI do much of ANY of my coding, because it will inevitably bloat my codebase with garbage regardless of which model I use. So I severely restrict my model usage to simple, clearly-defined, narrow-scoped tasks that can save me a bit of time, and that’s it. With guardrails and discipline like that, I barely ever have the need to re-prompt.

At that point, why bother with a local model, you could use Deepseek V4 flash and probably spend less than a tenner a month on it. It's surprisingly capable (I mean sometimes you can barely tell it's not a frontier model) and costs next to nothing to use.

If you must use a frontier model for something, have it do that work after receiving the output from an agent using a small model to read and summarize your code.

It's sort of what my workflow does when I use OpenCode. Bigger model (GLM-5.2 or GPT-5.5 depending on which one hasn't run into its usage limit) reads my prompt, the .md files describing the repo and the overall file structure of the repo, then fires off parallel DeepSeek V4 Flash scouts on usage credits to read and summarize the files as needed. The big model then does the planning and again DeepSeek V4 Flash is the one to execute it via subagents. The subagents running DeepSeek usually come back with 1-2 cents in cost.

I did try a Qwen-3.6 distillation locally and it was pretty capable in terms of output, but it's more expensive for me than the DeepSeek Flash on API usage costs, since electricity isn't free here and my GPU is 2 generations old. And it's slow as hell, since it has to offload a lot to CPU/RAM over GPU/RAM.

The big models I only use as subscriptions that I'm prepared to end at any moment if they reduce the usage I get. Let the AI companies eat the cost, I'll never pay them API pricing if they want 20 or 30 dollars for a million output tokens.

or they have devalued to zero so they cannot be sold for tax purposes.

Well that's just stupid. In my country, if you sell property that's been depreciated to zero (or lower than its sale price in general), you're just supposed to record it as profit.

Of course when you've depreciated something to zero and it's not something like a car where it's registered with the government, you could just give it away to employees or friends.

If you actually read the article, nobody is asking individuals to reduce usage, the local government is trying to save on its own bill by... Turning off unused lights and computer monitors at work.

The real crime is variable rate power plans and price hikes. Shouldn't exist. It's a utility, why does it need a market price? Should be provided by government, not private companies...

At your local government job? Bold move

You're probably burning more energy turning it off and on again. It doesn't really use any noticeable power sitting idle.

Anyway, a direct comparison would be pretty difficult because your model is probably tens of billions of parameters, not over a trillion. Energy consumption per output token will probably be a bit higher for the frontier models but something that people have found is that higher quality models often need fewer tokens to achieve the same goal. Plus how many times do you re-prompt your local model vs Claude Fable or Opus for example to get the desired result?

Targeted ads.

Google and Facebook in particular aren't selling your data, they're selling the service of showing ads to people who are likely to purchase those things.

The average website that has 800 close friends to share data with is trying to figure out who their target demographic is so they know which demographic to pay Google to advertise to... Or they're also selling ad space.

So it's targeted advertisements either way, just different angles

You also don't need AI for it tbf

Not so much an AI thing as much as an American thing. Americans and Israelis love doing that shit.