I think there are physical and economic limits. Neural networks may improve in software, but they still need more and more hardware, at some point that hardware resource curve is going to be to steep to climb at the current rate.
It's true, but think like the crypto miner bugs. I don't know enough on AI's working, but is a distributed computing LLM possible, or is the need for super close super low latency between nodes eliminate the risk of a distributed computing, learn as it travels botnet powered AI worm, that continues evolving even if it's home is shut down.
I think the point is the bugs are being FOUND with AI. Not fixed with AI.
It's basically the same concept as open source in general. IE the average layman hears open source and they think "oh so every moron, malicious person etc... can add his own back doors into the code", of course not, the official version is gated and reviewed. What's happening is AI is basically serving as millions of idiots looking through the code for security flaws, and it's finding them. Which then means the humans fixing it need to go into overdrive to fix them before they become zero days.