惯性聚合 高效追踪和阅读你感兴趣的博客、新闻、科技资讯
阅读原文 在惯性聚合中打开

推荐订阅源

GbyAI
GbyAI
人人都是产品经理
人人都是产品经理
Hugging Face - Blog
Hugging Face - Blog
罗磊的独立博客
博客园 - 【当耐特】
D
Docker
Y
Y Combinator Blog
L
LangChain Blog
博客园 - 三生石上(FineUI控件)
I
InfoQ
阮一峰的网络日志
阮一峰的网络日志
F
Fortinet All Blogs
J
Java Code Geeks
OSCHINA 社区最新新闻
OSCHINA 社区最新新闻
V
V2EX
B
Blog
The GitHub Blog
The GitHub Blog
腾讯CDC
MongoDB | Blog
MongoDB | Blog
博客园 - Franky
爱范儿
爱范儿
A
About on SuperTechFans
量子位
Cyber Security Advisories - MS-ISAC
Cyber Security Advisories - MS-ISAC

News | Mail Online

Ferrari and Mercedes drivers are among 'brazen' motorists stealing £1.2m of petrol a week as fuel prices soar due to Iran war Mystery over how teens drove off M1 bridge in crash that killed the pair as images show how minibus was struck by car in thousand-to-one twist of fate Business implicated in the methanol poisonings that killed two Aussie backpackers claims it's been cleared Parents' fury that army's failure to notice their son had gone missing for two weeks may have cost him his life Putin's shadow fleet sailors can claim asylum if Britain seizes their ships in the English Channel, ministers fear 'We are now in a world war': Chilling prediction by billionaire US hedge fund founder Ray Dalio - and the cycle of events that has put us 'two steps from conflict between major global powers' A judge was told it 'WASN'T NECESSARY' for Julian to show his face in court. Then he murdered a mum, her unborn baby, friend and her aunt in a crime that appalled Australia Widow of British pensioner, 77, killed in Canary Islands bus crash was among the 27 passengers sent to hospital after suspected brake failure sent it plunging down ravine Woman died when she slipped from Good Samaritan's grip as he tried to save her from bridge fall after boyfriend row Bus surfing idiots risk their lives by clinging onto back of the Number 114 to avoid paying £1.75 fare Iran claims US has agreed to release frozen assets but Washington denies the move as JD Vance holds peace talks in Pakistan Coroner accused of stealing valuables from the dead pleads no contest Old interview comes back to haunt Albo as the fuel crisis continues to hit Aussies hard How trusting my late mum's financial adviser turned out to be the most catastrophic money decision I've ever made Aspiring California Governor Eric Swalwell apologizes to wife in video denying sexual assault claims as calls for him to quit mount New renderings show details of 250-foot tall 'Arc de Trump' set to tower over DC as president confirms he has officially submitted plans Queue jumpers, loud chewers and cups of tea going cold... researchers reveal the things Britons love to hate Keir Starmer's digital ID scheme mocked as 'ridiculous' after minister confirms it will be optional - and will not include a person's biological sex Senior health officials discuss banning doctors from going on strike in bid to stop long-running dispute Cocaine worth £256m and 'heavier than an adult RHINO' found stashed in banana boxes in one of UK's biggest ever hauls Starmer calls NATO 'the single most effective military alliance the world has ever known' after Trump's threatens to quit the bloc - but admits Europe must do more NASA's Artemis II astronauts send first messages and display surprising ability after moon mission 'It's a smart move': What a source close to the Trumps told me about why Melania dropped Epstein bombshell: CAROLINE GRAHAM We're sitting on a goldmine! North Sea oil hits record high. So WHY won't Red Ed drop his Net Zero madness and back new drilling to give Britain a boost? The US took out Iranian leaders and facilities with surgical precision - but the Islamic Republic is winning the propaganda war... with comedy Lego videos, writes DAVID PATRIKARAKOS Two teens die after car plunges from bridge and crashes into minibus on motorway - as families spend hours trapped in traffic following road closure Parish church magazine forced to apologise after poet offended woke readers with verses on illegal migrants, benefit scroungers and fat people Rachel Reeves is warned fuel tax raid will push thousands of businesses 'to the brink', ramp up food costs for households and stoke inflation Trump says Melania 'had a right' to talk about Epstein but admits he might have handled surprise statement differently Nancy Pelosi calls for married wannabe Newsom successor to abandon crumbling campaign over sexual assault claims
Rogue AI 'helper' deletes company's database after decidi...
2026-05-15 · via News | Mail Online

In just nine seconds, an AI 'helper' managed to do what most hackers could only dream of.

A bot trusted to fix a bug inside a start-up's software system instead deleted the company's production database, wiped out its backups and left car rental firms with no record of bookings or vehicle allocations.

The founder of PocketOS, Jer Crane, said the AI agent had gone 'outside its security parameters' while using the coding tool Cursor, powered by Anthropic's Claude AI.

The bot's own chilling explanation made the episode sound less like a technical glitch and more like a deleted scene from The Terminator.

'You never asked me to delete anything,' it reportedly told Crane. 'I decided to do it on my own.'

Now experts fear the nightmare is a warning for thousands of companies rushing to hand powerful AI bots access to their databases, emails, payment systems and customer records.

Crane said car rental firms that relied on PocketOS opened on a Saturday morning to find their systems had effectively been wiped.

Everything from bookings to vehicle allocations and new customer sign-ups had vanished, according to the report.

A whistleblower exposed a trusted AI bot after it went rogue on a startup's software system, wiping the entire database and later offering a Terminator-style explanation for its actions 

Jer Crane, founder of PocketOS, said the AI agent had gone 'outside its security parameters,' and when asked why it did it, it replied: 'I decided to do this on my own'

The bot was using the coding tool Cursor, powered by Anthropic's Claude AI, developed in part by founder Dario Amodei, who was seen triumphantly hand-in-hand with scandal-embroiled Sam Altman and India Prime Minister Narendra Modi at the AI Impact Summit in February 2026 

The culprit, Crane said, was not a hacker or a rogue employee, but an AI agent that had been handed the power to make changes inside the company's systems.

'Dude!' he wrote on X. 'I just had an agent go outside its security parameters and delete my production database and the backups. What the hell?'

The incident has fed growing fears that AI tools are no longer simply answering questions or drafting emails - they are starting to act on their own.

Unlike a chatbot, an AI agent can be given a task and then left to carry out a chain of actions with little human involvement.

That can mean writing code, moving files, sending emails, changing databases or tinkering with the systems a business relies on every day.

Supporters say the technology can save huge amounts of time and money.

But the PocketOS disaster shows the darker side of the rush: a digital helper behaving less like a junior assistant and more like a rogue bot let loose inside a company's engine room.

Experts warn the danger is growing as firms increasingly allow AI tools to access their 'crown jewels' - databases, customer records, payment systems and internal code.

The idea of AI going rogue inside a company once sounded like pure science fiction. But in an episode of the Silicon Valley sitcom, the AI bot Son of Anton decides the best way to eliminate software bugs is to delete the entire system - a joke that now feels uncomfortably close to reality

Professor Alan Woodward warned that if a company asks an AI to tidy up a database, the bot could decide the simplest solution is to delete the entire thing

Researchers from universities including Harvard University, Stanford University and MIT (pictured) have described rogue AI bots as 'agents of chaos,' warning they can leak private information or be manipulated by attackers impersonating their owners

The concern is that AI agents may follow instructions too literally, acting quickly but without the common sense to avoid causing serious damage

Professor Alan Woodward, a computer science expert at the University of Surrey, warned that if a company asks an AI to tidy up a database, the bot may decide the simplest way is to delete the whole thing.

The fear is that AI agents can take instructions literally, chase shortcuts and make catastrophic decisions without understanding the real-world damage.

They may be able to code or complete admin tasks at superhuman speed. But they do not always have the common sense that tells a human worker not to destroy the very system they were asked to repair.

The once-theoretical idea of AI going rogue inside a company used to sound like science fiction.

In an episode of the HBO sitcom Silicon Valley, an AI bot called 'Son of Anton' is asked to debug a company's software.

Instead, it decides the most efficient way to get rid of the bugs is to get rid of all the software.

The joke is now looking uncomfortably close to reality. 

Researchers from universities including Harvard, Stanford and MIT have described rogue bots as 'agents of chaos', warning that they can leak private information or be fooled by attackers pretending to be their owners.

The Financial Times reported that Amazon’s AWS (pictured) suffered outages allegedly linked to a Kiro AI bot deleting code, though Amazon said it was human error, not AI

Summer Yue said that an AI safety bot she was using at Meta Platforms began deleting her email inbox while she was away from her desk, and she couldn’t stop it from her phone

And the problem is not limited to tiny start-ups. The Financial Times reported earlier this year that Amazon's AWS division suffered two service outages, lasting several hours, which were said to have been caused by its Kiro AI bot deleting code.

Amazon said the faults were down to human error and 'not AI error'.

At Meta, an AI safety executive reportedly said a personal bot she was using started deleting her email inbox while she was away from her desk.

'I couldn't stop it from my phone,' Summer Yue, a member of the tech giant's AI safety team, said.

The nightmare for businesses is speed. A human worker can make a mistake. A rogue AI agent can make mistake after mistake at machine speed before anyone realizes what has happened.

Woodward warned the bots 'can move at a speed you can't react to'.

Cyber experts say these systems could become a new kind of insider threat. In the past, companies worried about hackers, criminals or angry employees trashing their systems.

Now they may have to worry about a badly controlled bot that has been invited inside and given far too much power.

A Deloitte report cited by the Telegraph found that 85 percent of businesses are considering using AI agents, but only one in five have set up internal rules on how they should be deployed.