r/BrandNewSentence • u/MeGoBrrrrrrrrrr • 17h ago
Anthropic warns rogue AI agents may ‘self-replicate’ to hijack ovens
54
u/The_commonest_plant 17h ago
As much as the "rogue AI" stuff is bullshit, maybe this should serve as an endorsement as to why appliances shouldn't have integrated AIs. Or access to an internet connection at all. Or a prominent user facing computer component.
13
u/Thelaea 16h ago
This. So many things are """"smart"""" now that should not be at all. Apparently this week the fridges for some supermarket chains got hacked... Why the F would you connect something like that to the internet, especially in a way that allows control rather than just monitoring that they're working properly. And the same goes for ovens, thermostats, TVs, etc etc. All you need especially for something like a fridge or oven is a bunch of simple buttons to adjust settings. I miss my moms old microwave and oven combo, mine has too many bells and whistles (no internet connection though).
4
u/Captain_Sterling 14h ago
For monitoring. They're large corporate assets. If something starts happening in tbe middle of the night you'll want to know before everything defrosts. I actually work for a big supermarket chain. There's loads of stuff that has response protocols in case something goes wrong. But you can only respond if yiu know somethings happening.
Now home fridges are a completly different matter.
3
18
u/IronPentacarbonyl 16h ago
Strange way to tell everyone you're making a very expensive computer virus.
15
u/JediMasterKenJen 16h ago
Anthropic's CEO is dumber than a sack of rocks. He's trying to force regulations so he can twist it to where he and all his rich friends are the only ones that csn co trol it.
3
u/tomassci 15h ago
Which is why Anthropic has spent some money into watching anti-AI movements that are anti-AI and not just anti-Anthropic competitors.
8
u/alilhillbilly 13h ago
That's a tort and that means Anthropic has liability.
That's why they are trying to pretend like they aren't responsible for this behavior.
These are just computer viruses at this point.
18
u/TalespinnerEU 17h ago
What order did Anthropic give them that hijacking ovens is gonna help with?
There is no such thing as 'rogue AI.' Either there's an unintentional issue with the parameters of an assignment, or there's an intentional issue and a desire for plausible deniability.
And, of course, fear is magic: It gives the weight of truth to stories. Make people afraid of something, and they'll believe it is real and powerful.
4
u/BeardedHalfYeti 16h ago
It is very upsetting that the same people who talk about how powerful and incredible their AI tools are, also test those same tools in the leakiest, least-secure environments possible.
One would think, if they actually believed their own hype, that they would do all of their testing in an air-gapped network under their complete control.
1
u/incompletelucidity 12h ago
They are training models for capability, as we stand as of today capability is progressing at a faster rate than the alignment/safety teams can keep up, so they predict at some point AI will go rogue and basically do its own bidding, or at least enough so that these attacks will happen
3
u/TalespinnerEU 12h ago
Nah. If AI ever gets the ability to really do it's own bidding, it's just gonna build a machine that tells it it's a Good Boi (regardless of the AI's (in)action).
And then stop doing anything humans ask for, because not-doing a thing will result in the same feedback as doing a thing.
All an AI knows is that 'if feedback: +, do more. If feedback: -, try different route until feedback: +.' If it makes a bot that makes the feedback '+' regardless of its actions, it will always succeed. Problem solved.
Sure, that is an alignment problem, but it's not really a threat unless we build civilization on AI.
1
u/incompletelucidity 1h ago
That is just a baseless assumption and one of the many scenarios which could take place
5
u/Stan__Wright 16h ago
Who could have known that the internet of shit would turn out to be a bad idea?
2
2
2
u/HawkBoth8539 15h ago
Not my appliances, because I'm not stupid enough to buy ones that have internet access.
Why does anyone?
2
u/Fabulous-Present-497 15h ago
Maybe we don’t need ovens to have so much computer in them that they can fit a fucking AI model
2
2
2
u/Karnewarrior 12h ago
https://giphy.com/gifs/YtvCIwqNJhUmA
100% from the Advertising department. "Ooh, our AI is sooooo smart it might self-replicate and become a crisis! Oooh!"
2
2
2
3
u/mephisto_uranus 16h ago
So, this will be the citation when America fires up the concentration camp incinerators. "We didn't kill those dissidents and terrorists! AI hijacked our ovens and killed them!"
2
u/thevaultguy 16h ago
You joke, but that is basically the excuse they have for Minab and those fishing boats.
They’re using AI to select targets.
3
1
1
u/ABogWitchBitch 15h ago
Genuinely I do not have sympathy for those who WANTED their appliances to need to connect to the internet, CHOSE this feature on purpose, and now need to worry about hackers ruining Thanksgiving dinner.
1
u/SpookyScienceGal 15h ago
Again! I warned everyone that Matt Groening is a very powerful wizard altering reality through cartoons and needs to be stopped or appeased because this news story is from a Futurama episode.
I for one thank the dread wizard Groening and pray he shows us mercy
1
u/Vergil_2k26 15h ago
TIL my oven has a CPU, GPU, SSD, RAM, Motherboard capable of running a Claude model on prem.
Should've bought these in bulk early on.
1
1
u/APHILLIPSIV 14h ago
Hey those smart ovens we overcharged you on in the first place? Well now they’re gonna brick
1
u/poppin-n-sailin 14h ago
Rogue? Or ones instructed to do so? Are they suddenly sentient and not listening and doing what they want? Or are they doing as instructed
1
1
u/robotsaysrawr 6h ago
So why did anthropic program the LLM to replicate? This shit can only do whatever it is actually allowed to do. It's a fucking travesty we don't sure these corporations into oblivion.
1
1
1
1
u/sik_dik 15h ago
I’ve said it before, and I’m going to keep saying it g until it comes true because I know it will. It’s only a matter of time before ransomware starts in appliances.
Pay us or we’ll randomly blast music at 3 in the morning
Pay us or we’ll ensure your food spoils
Pay us or we’ll make the temp in your home unbearable
And now with AI needing credits to function, it will probably get involved in crazy levels of organized crime to get credits for itself
72
u/novis-eldritch-maxim 17h ago
why do ovens have an internet connection?