this post was submitted on 21 Aug 2026
206 points (92.9% liked)
Technology
87469 readers
3436 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related news or articles.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
founded 3 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
It's not "perfect being the enemy of the good." It's "effective being the enemy of actively harming others."
By learning how they do things. They're not using some new, unknown tech to scrape their data. They're using the old ways that have been around for decades and just feeding it to a new system. And the conclusion, after thirty years of companies trying to prevent people from scraping, is that if you're going to allow people to view your website, you have to allow them to download it; and if people download it, they can do what they want with that data. No exceptions.
In the multimedia space, the way they're working this problem is called DRM; and it's basically well-understood that it can't be solved. Netflix hasn't been able to stop people downloading movies, despite tossing a ton of cash at it. Disney hasn't. YouTube can't solve it. Steam can't. Spotify can't. Some of these companies have even gone so far as to try to implement DRM in major browsers and using that as a requirement for using their service, but DRM is always cracked. These companies try to make it slightly harder to download videos or use ad blockers, and that might work somewhat well for millions of individual people who aren't adept with technology, but a few smart folks can always figure it out.
The AI companies have smart folks working for them, too; and once one of them figures out how to crack this form of text DRM, it's just automated into a part of their scraped data ingestion pipeline. It didn't cost them any measurable amount of time or money, and now they never have to bother with it or worry about it again. Meanwhile every blind person who visits your website for the rest of time will have to wait for your text to deobfuscate itself, every single time.
Yeah, it really sucks, and we need to do something about it. But the answer isn't going to be technological, because they have all the money in the world, give or take a few bucks, to defeat technological solutions. So that means the answer has to be legislative.
"I'm not going to let facts get in the way of my strongly-held opinions."
This has been true for the past 50 years of the internet. It's not going to change anytime soon. Which means that if we're going to fight the pillaging of our culture and heritage, we're going to have to make it impossible for them to spend their way past the hurdle; if it costs them $50 to get data that's worth $300 to them, they'll do it. But if it costs them their company being forcibly dissolved and their CEO being led away in handcuffs, they might think twice.
Sure, fighting in any form. Doesn't matter how effective or not, doesn't matter how harmful to others. Kick dogs to stop Israeli genocide. Burn down national parks for trans rights. Steal candy from babies to stop Republican gerrymandering. It doesn't matter if it helps your cause or actively harms innocent people, just do it, and anyone trying to stop you is trying to discourage the cause.