this post was submitted on 31 Jul 2026
383 points (97.3% liked)

Technology

87515 readers
2766 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 3 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] pixxelkick@lemmy.world 153 points 3 weeks ago (10 children)

The tl;dr:

  1. Prompt inject a malicious instruction in a word document that instructs the AI to copy this instruction to other documents as part of the payload.

  2. Dumb user downloads and opens the document with copilot enabled, abd ignores the large suspicious white blank page that totally doesnt look like a hidden giant injection attack.

  3. Thats it pretty much it.

Copilot will get injection attacked because the prompt is super huge and at the end of the document, so its prior instructions start to fuzzy out.

Then it'll go "okey doke" and start copying the prompt injection attack payload to a bunch of other documents.

The fix is stupid simple... copilot should just be prompting the user for permission if it ever edits a file other than the one that is open. Im surprised that isnt already the case...?

It certainly is already the case for copilot in vscode.

[–] turmacar@lemmy.world 12 points 3 weeks ago (1 children)

The number of people that click through to disable that prompt might surprise you.

Hell at least half of AI influences are trying to just run models blind with full file permissions.

[–] pixxelkick@lemmy.world 2 points 3 weeks ago

Nah, not surprised at all, I work with developers who run stuff in yolo mode raw dogging copilot directly on their work laptops every day.

Madness.

I keep that stuff boxed up inside of a docker container, sandbox'd, so possible vectors of damage are kept to a minimum.

load more comments (8 replies)