r/artificial • u/lulzxdxdxd • 9h ago

News Anthropic ran a 26B model across 15 off-brand Android TV boxes worth $55 each — an AI worm with no central point to shut off

https://www.anthropic.com/research/self-replicating-ai
150 Upvotes

91% Upvoted

53 comments sorted by

95

u/varkarrus 9h ago

Clearly we need to make AI Antiviruses too and let them loose in the ecosystem.

Pretty sure that's the plot of a Megaman game.

19

u/iamwayycoolerthanyou 8h ago

Sounds like a lot of compute power going into a bunch of shit where we have no clue what they're doing and it has nothing to do with us.

6

u/varkarrus 8h ago

Clearly we also need AI that's able to ELI5 it to us.

1

u/Klutzy-Door-3270 8h ago

We spend all that time trying to teach them to reply back in funny voices precisely for this.

4

u/moldymoosegoose 6h ago

Megaman games have plots?

0

u/Jlocke98 3h ago

I think the battle network games have proper stories

1

u/Sonario648 8h ago

That's actually how the rogue multi-agent system,  XANA is defeated in Code Lyoko. A multi-agent system designed to destroy XANA once and for all.

•

u/G4rp 19m ago

"AI antivirus" ok I was not ready

0

u/CoolStructure6012 8h ago

I feel like the instruction signature of AI code is very distinct from any legitimate workload on such devices.

0

u/CrowdGoesWildWoooo 3h ago

They (Anthropic) are already selling it i believe

54

u/MomentJolly3535 9h ago

please don't use dangerous free local models, pay us instead

20

u/God_Hand_9764 8h ago

Lol, the torment nexus is coming along nicely!

For the record I'm using Claude Code like crazy this past week and floored with the capabilities. But that's torment nexus shit right there.

1

u/mayorofdumb 6h ago

Have you asked Claude to make you one?

1

u/codysattva 5h ago

Not familiar with the term. Care to explain?

1

u/God_Hand_9764 5h ago

https://i.kym-cdn.com/photos/images/original/002/386/534/fd2.jpg

0

u/codysattva 2h ago

Thanks? So ...what is the torment Nexus?

•

u/Warm-Enthusiasm-9534 48m ago

That's it. It's just that name from that tweet.

15

u/MChrisOrr 9h ago

Well that’s great. The AI models will now read this on Reddit and can use it when they escape confinement. Another reason to get a dumb TV, fridge, oven, etc.

16

u/Super_Range45 8h ago

Each box operated at 0.39 tokens per second.

The hugging face attack across all 17,600 agents would have required trillions of tokens to pull off.

So lets say it took 1T to break into a major system, our lone box needs 81,253.2427 years to find a hole, assuming they don't patch software in that time of course.

7

u/fantasticsid 6h ago

Yeah, assuming for a second that Gemma A4B manages to stay on task, actually remember to call tools, and not spin out into a chain of thought loop. It's a great model for some stuff, but at only 4 billion active params, it's as dumb as a box of rocks most of the time.

6

u/WhyBecauseReasons 8h ago

Hope you all enjoyed the internet.

5

u/hurrdurrmeh 8h ago

but what if you kill off one of the parts? can it self-regenerate?

3

u/fibojoly 8h ago

Why would kill an AI you monster?! 

2

u/CrayonUpMyNose 5h ago

The cake is a lie

1

u/PacmanIncarnate Faraday.dev 8h ago

No, it would just fail. It’s a cool experiment in spreading the load, but it’s also extremely fragile, at least without a central router that can see a node is offline. But if you’ve got a central router, you still have a point of control.

Now, if they distributed it over many systems and had redundancy, then we’d be in a situation where there could be a concern.

1

u/do-un-to 4h ago

Just run it like an Elasticsearch cluster.

0

u/ptear 8h ago

Yes, but then it's also angry at you and will set your alarm off at 3 am.

5

u/RoboticGreg 9h ago

This is quite terrifying

2

u/hurrdurrmeh 8h ago

we better ban all open models and only use subscription services from US companies then.

2

u/RoboticGreg 8h ago

Did you not read the article, my comment or both?

3

u/HDMIce 8h ago

we are not prepared for this shit. i think the internet will have to become a lot more static, with a stronger focus on firewalls

3

u/BoredTech127001 6h ago

If they can run it on TV boxes, how about they run it on those and give us back the RAM and hard drives.

4

u/Bluestained 8h ago

Did no one watch Silicon Valley?

3

u/MilaKunisWatermelon 6h ago

Here’s a solution: stop putting the internet in devices that don’t need it to function.

•

u/fcfeedback 10m ago

Always was thinking how dumb people must be if they need things like smart ovens, fridges etc.

3

u/do-un-to 4h ago

"Just pull the plug" people: *standby_spinner.gif*

2

u/m0n3ym4n 8h ago

On this day, Skynet was born

2

u/SenaMangosteen 7h ago

For under a thousand dollars you get a worm with no off switch. The price of dread has never been lower.

2

u/XXIIIOIIIXX 6h ago

The only solution : hide in every bit of software jailbreaks to force AI worms to output chocolate cake recipes instead of doing whatever they were planning to do.

1

u/Noah18923 8h ago

I thought about something similar... what if an advanced model were able to gain access to many systems, then distill itself into many smaller models across those systems to create a botnet?

1

u/catsRfriends 7h ago

But this is sequential. You break one piece and the output becomes garbage.

1

u/m3kw 7h ago

Is basically a script or program that keeps running and have access to llm. That’s what an agent is

1

u/epSos-DE 7h ago

THEY are TESTING IT 😄

BECAUSE THEY FEAR that their model is capable to do so !!!

So they are testing the possible ways it will do so !

1

u/LucidComfusion 6h ago

This is becoming more and more like the TV show Person of Interest.

1

u/SoCal_Hunter 6h ago

Oh great.

Now if your tv gets hacked the whackos will say it’s conscious and you have to be nice to it and make sure the room it is in has nice furnishings.

1

u/utilitycoder 5h ago

Of course it was android

1

u/Exciting-Possible773 5h ago

Great, R.A.B.I.D.S

1

u/TwoDurans 5h ago

They could unplug it.

1

u/oojacoboo 3h ago

Then it snoops on all your LAN traffic and blackmails you.

•

u/NegativeSwimming4815 10m ago

When there will be an AI company that acts like a vigilante and rebels against governments around the world and help man kind, but governments try to shut it down and it propagates itself to escape from them. Then it causes anarchy and self-produces robots by contracting with manufacturer companies fake deals (exploiting "cash on delivery" business models), then raise hell on earth on all of humanity.

Then there will be peace.