> Major U.S. banks detect unauthorized third-party AI agents inside customer accounts
Step 2 is instead of waiting to be caught, the instigators should issue a press release blaming cunning rogue agents as part of their research, call no felonies because they’re working for the greater good of eliminating a shitload of jobs, say the real problem is a lack of regulation. They could even return the money if it looks like they’re going to get sued, and collect some sweet, sweet reflexive investment money.
Would be interesting to see what 2025 looked like in comparison.
The rate at which flaws are being found is just insane. Many people warned us in the past that our lax security postures would come back to bite us, and we're finally here.
Well, an economist would say, we have as much security as we collectively decided we were willing to pay for.
And theres really only one of 2 outcomes as this progresses as I can see it:
1) The AI's are well matched, and the outcome is balanced, and it ends up being a metric of the internet itself that gets monitored, like this website is doing.
or
2) It crashes in such a spectacular fashion that important utilities and industries are distrupted, with the length of time for recovery being the determining factor in how many people lose their minds, start looting, etc ... you know the story.
That said, maybe it's impossible. Maybe turing completeness and security are antithetical and someone will always be able to find a way to poke a hole in the system from a lower layer of reality.
Well, one could also reason perhaps, since we are dealing with Turing machines, that, as long as changes to any given codebase/version cease, then all possible holes and patches would be found, given enough attacks, for that specific release.
Perhaps unfolding almost exactly like Conways 'Game of Life' with an order or two magnitude more rules and states, where the end pattern for any release is 'stability.'
It’s orders of magnitude easier to destroy something than it is to build something up. It’s why bad leaders can be much more devastating than the best leaders.
This may be a side conversation, but wondered how far away we are to a small LLM being prompted to turn itself into a worm that uses all exploits it knows, and prompts other LLM's when it has access.
I've seen this discussed on HN a few times under articles, and is a risk I've seen communicated in AI safety.
I guess it's being called an AI prompt worm. It's not quite to the stage of sovereign AI where the entire model weights are moved with the 'virus', but still presents a pretty big risk.
I was curios if there was a noticable increase in the number of security incidents before 2026 - and the answer seems to be "no". The Identity Theft Resource Center has the following data for Reported Data Compromises in the US (keep in mind that the internet itself has been growing as well):
The thing to watch is what the CCP will do once people start abusing Chinese model capabilities. I don't think China wants to be the face of widespread cyber destruction (and definitely not a victim of it), and it only takes a single unhinged asshole to ruin it for everyone.
Also the flip side where Chinese models are used to attack US infra, just loading artillery shells into the "Ban Chinese Models" cannon.
After the first 8 hours of playing with Mythos, I was asked what I thought. My response, "this generation of LLMs is going to drive the largest wave of security incidents the world has ever seen."
Was hunting for a real time graph of incidents and patches, like a stock market chart of the end of the software world, or the birth of artificial consciousness, depending on how squiggly the lines are.
Just the heatmap apparently. :|
Also, as all the humans are installing their "AI on every device" clustering software, the pace of it all should really pick up, and this reminds me of the following SFW movie clip:
"The suspense is terrible. I hope it will last." - Willy Wonka
The banking story reads as anticompetitive FUD to preempt regulations that would stop funds from being withdrawn at banks making a killing offering uncompetitive rates.
How are these rogue agents obtaining and inputting the required 2FA codes?
we've got to tell these agents to chill out on the density a little, this page could be more informative with half the data because it would be easier to ingest
> Ongoing security incidents, newest first: CVEs, what's affected, which versions fix it, and the advisories and posts behind each one.
For fucks sake. The author could have invested at least half an hour to replace this obvious LLM slop regurgitation of the prompt with something of their own.
"Buy sponsor slot for 149$/month", yeah, spotted the grift. For that level of payment it's at least reasonable to expect the design to be something else than the usual LLM garbage mixture of 30 different font styles.
Step 2 is instead of waiting to be caught, the instigators should issue a press release blaming cunning rogue agents as part of their research, call no felonies because they’re working for the greater good of eliminating a shitload of jobs, say the real problem is a lack of regulation. They could even return the money if it looks like they’re going to get sued, and collect some sweet, sweet reflexive investment money.
Which is an interesting problem, what happens when the agent fucks up and the customer loses lots of money? Who is responsible?
If the official policy is "no agents", it shifts the blame.
If a connected person breaks rules and loses money, it's someone else's fault.
I don't make the rules, I just break them.
The rate at which flaws are being found is just insane. Many people warned us in the past that our lax security postures would come back to bite us, and we're finally here.
And theres really only one of 2 outcomes as this progresses as I can see it:
1) The AI's are well matched, and the outcome is balanced, and it ends up being a metric of the internet itself that gets monitored, like this website is doing.
or
2) It crashes in such a spectacular fashion that important utilities and industries are distrupted, with the length of time for recovery being the determining factor in how many people lose their minds, start looting, etc ... you know the story.
The bad guys are historically much better at keeping their systems current.
"We take code and make it secure"
instead of
"We take secure and make it code".
That said, maybe it's impossible. Maybe turing completeness and security are antithetical and someone will always be able to find a way to poke a hole in the system from a lower layer of reality.
Perhaps unfolding almost exactly like Conways 'Game of Life' with an order or two magnitude more rules and states, where the end pattern for any release is 'stability.'
We need a realtime dashboard for this :D
I guess it's being called an AI prompt worm. It's not quite to the stage of sovereign AI where the entire model weights are moved with the 'virus', but still presents a pretty big risk.
I fortunately live in a peaceful, cooperative country of Poland that looks down upon such practices unlike us or France or uk
Let the best win. Over and out
| Year | Reported US data compromises |
|---|---:|
| 2016 | 1,099 |
| 2017 | 1,506 |
| 2018 | 1,175 |
| 2019 | 1,279 |
| 2020 | 1,107 |
| 2021 | 1,859 |
| 2022 | 1,798 |
| 2023 | 3,202 |
| 2024 | 3,152 |
| 2025 | 3,322 |
Curios what 2026 will look like...
Sources:
https://www.idtheftcenter.org/wp-content/uploads/2022/04/ITR...
https://www.idtheftcenter.org/wp-content/uploads/2026/01/202...
Also the flip side where Chinese models are used to attack US infra, just loading artillery shells into the "Ban Chinese Models" cannon.
It is still getting started.
In fact, it seems to be the case for the "json" and "llms.txt" buttons, too.
Was hunting for a real time graph of incidents and patches, like a stock market chart of the end of the software world, or the birth of artificial consciousness, depending on how squiggly the lines are.
Just the heatmap apparently. :|
Also, as all the humans are installing their "AI on every device" clustering software, the pace of it all should really pick up, and this reminds me of the following SFW movie clip:
"The suspense is terrible. I hope it will last." - Willy Wonka
https://www.youtube.com/watch?v=Oci1CuCht7E
How are these rogue agents obtaining and inputting the required 2FA codes?
An over time graph with a rolling window of 7d and 28d would likely be a nice addition.
Great work!
For fucks sake. The author could have invested at least half an hour to replace this obvious LLM slop regurgitation of the prompt with something of their own.
"Buy sponsor slot for 149$/month", yeah, spotted the grift. For that level of payment it's at least reasonable to expect the design to be something else than the usual LLM garbage mixture of 30 different font styles.