this post was submitted on 22 Aug 2026
237 points (96.8% liked)
Technology
87575 readers
3743 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related news or articles.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
founded 3 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
While I'm not a fan of scrapping you would think reddit would want this to push traffic to the site. Get a good answer and follow the referral link and you have a new monkey.
Are there any statistics on how many LLM chatbot users actually click on the source links?
https://www.pewresearch.org/short-reads/2025/07/22/google-users-are-less-likely-to-click-on-links-when-an-ai-summary-appears-in-the-results/
That's just for Google's AI summaries, but it's the only one with actual methodology disclosed I could find on a quick (non-AI) search.
Plenty of SEO mills with their own "studies" too, and the trend is similar. People don't interact with the source sites or if they do it's extremely seldom.
They (SEO mills) are currently trying to flip the gaslight towards "Worry not dear Webmaster, now you just have to make sure your content is now formed so it's engaging for AI search and engage able right from the AI!" type shit.
I'm tired boss, and I'm not even generally (as in, in all aspects) anti-AI. Yet, I guess.
Ah yes, I've noticed lots of SEO consultant companies are trying to pivot into "we'll help you to make AI scrape your website more so you show up in the AI search".
I hadn't seen the study before, thanks. That's what I expected, honestly. I guess you could argue they are still building brand awareness, because people subconsciously note the brand as the source, but I don't think that amounts to much.
Great question, I wish I knew. I know when I'm on a deep dive I will hit the links as there is other information or other articles the scrapped site has.
I mean just about every metric I've seen suggests most websites that see an increase in scraping see a decrease in actual human visitors. I doubt there's much distinction between chat and search users - the goal of these services is to drop click-through rates.
Oh, definitely. They are reinventing the old portals concept. That's why I don't think Reddit actually wants to encourage the scraping (partly also because they sell data themselves to build LLM, but that's another thing)
I don't know how many do, but they're fools if they don't.
You'd think that since those links are there, that the information on those links matches what that LLM says, and thus not a hallucination, but at least twice, I've found the information straight up wasn't there, or the LLM had misread / misinterpreted the page's content.
But then I may not be a regular user. I ask a question maybe once every one to two weeks because a regular search finds nothing and, like I say, I prefer to check the sources.
I do for things where I want to be accurate, but sometimes it seems like I’m the only one
On the other hand I advised my teen to buy the wrong battery because I didn’t click into the results for “what battery do i need to replace in my Subaru key?”
I think it had the opposite effect. I believe the recently didn't renew their contract with Google because they were upset people weren't coming to the site, just getting answers from Gemini. I could be wrong, but I thought I read that
The guys on LTT mentioned this during their Linux challenge, but I’ve found it to be true -
Scouring forums for answers to obscure errors used to take hours. Now I just throw it at Gemini, troubleshoot in real time and find the fix.
I’ve even started asking it to give me a PDF of the steps we took and filing them away for future me.
I like to ask it for a beautiful html page instead of a pdf. PDFs are a pain later on.
Tonight I spent the time spinning up a silverbullet instance and converting the PDFs to .md files. You’re right, PDFs aren’t searchable and will be a pain as the database grows.
Thanks for sharing :)