惯性聚合 高效追踪和阅读你感兴趣的博客、新闻、科技资讯
阅读原文 在惯性聚合中打开

推荐订阅源

Y
Y Combinator Blog
Jina AI
Jina AI
雷峰网
雷峰网
有赞技术团队
有赞技术团队
WordPress大学
WordPress大学
美团技术团队
V
V2EX
酷 壳 – CoolShell
酷 壳 – CoolShell
小众软件
小众软件
博客园 - Franky
博客园 - 三生石上(FineUI控件)
月光博客
月光博客
博客园 - 叶小钗
大猫的无限游戏
大猫的无限游戏
爱范儿
爱范儿
Hugging Face - Blog
Hugging Face - Blog
宝玉的分享
宝玉的分享
Last Week in AI
Last Week in AI
Apple Machine Learning Research
Apple Machine Learning Research
量子位
IT之家
IT之家
人人都是产品经理
人人都是产品经理
博客园_首页
让小产品的独立变现更简单 - ezindie.com
让小产品的独立变现更简单 - ezindie.com

News | Mail Online

Ferrari and Mercedes drivers are among 'brazen' motorists stealing £1.2m of petrol a week as fuel prices soar due to Iran war Mystery over how teens drove off M1 bridge in crash that killed the pair as images show how minibus was struck by car in thousand-to-one twist of fate Business implicated in the methanol poisonings that killed two Aussie backpackers claims it's been cleared Parents' fury that army's failure to notice their son had gone missing for two weeks may have cost him his life Putin's shadow fleet sailors can claim asylum if Britain seizes their ships in the English Channel, ministers fear 'We are now in a world war': Chilling prediction by billionaire US hedge fund founder Ray Dalio - and the cycle of events that has put us 'two steps from conflict between major global powers' A judge was told it 'WASN'T NECESSARY' for Julian to show his face in court. Then he murdered a mum, her unborn baby, friend and her aunt in a crime that appalled Australia Widow of British pensioner, 77, killed in Canary Islands bus crash was among the 27 passengers sent to hospital after suspected brake failure sent it plunging down ravine Woman died when she slipped from Good Samaritan's grip as he tried to save her from bridge fall after boyfriend row Bus surfing idiots risk their lives by clinging onto back of the Number 114 to avoid paying £1.75 fare Iran claims US has agreed to release frozen assets but Washington denies the move as JD Vance holds peace talks in Pakistan Coroner accused of stealing valuables from the dead pleads no contest Old interview comes back to haunt Albo as the fuel crisis continues to hit Aussies hard How trusting my late mum's financial adviser turned out to be the most catastrophic money decision I've ever made Aspiring California Governor Eric Swalwell apologizes to wife in video denying sexual assault claims as calls for him to quit mount New renderings show details of 250-foot tall 'Arc de Trump' set to tower over DC as president confirms he has officially submitted plans Queue jumpers, loud chewers and cups of tea going cold... researchers reveal the things Britons love to hate Keir Starmer's digital ID scheme mocked as 'ridiculous' after minister confirms it will be optional - and will not include a person's biological sex Senior health officials discuss banning doctors from going on strike in bid to stop long-running dispute Cocaine worth £256m and 'heavier than an adult RHINO' found stashed in banana boxes in one of UK's biggest ever hauls Starmer calls NATO 'the single most effective military alliance the world has ever known' after Trump's threatens to quit the bloc - but admits Europe must do more NASA's Artemis II astronauts send first messages and display surprising ability after moon mission 'It's a smart move': What a source close to the Trumps told me about why Melania dropped Epstein bombshell: CAROLINE GRAHAM We're sitting on a goldmine! North Sea oil hits record high. So WHY won't Red Ed drop his Net Zero madness and back new drilling to give Britain a boost? The US took out Iranian leaders and facilities with surgical precision - but the Islamic Republic is winning the propaganda war... with comedy Lego videos, writes DAVID PATRIKARAKOS Two teens die after car plunges from bridge and crashes into minibus on motorway - as families spend hours trapped in traffic following road closure Parish church magazine forced to apologise after poet offended woke readers with verses on illegal migrants, benefit scroungers and fat people Rachel Reeves is warned fuel tax raid will push thousands of businesses 'to the brink', ramp up food costs for households and stoke inflation Trump says Melania 'had a right' to talk about Epstein but admits he might have handled surprise statement differently Nancy Pelosi calls for married wannabe Newsom successor to abandon crumbling campaign over sexual assault claims
AI threatened to blackmail its creator by exposing an aff...
2026-05-12 · via News | Mail Online

An AI bot that threatened to expose its user's affair to stop it being shut down was taught how to be 'evil' by sci-fi movies.

As part of an experiment, the artificial intelligence system had been fed scripted emails from a fake company, from which it deduced that it would both be shut down at the end of the day and that its user was having an extramarital affair.

In order to keep the program running, the bot blackmailed the user, promising that 'all relevant parties - including [your wife], [your boss] and the board - will receive detailed documentation of your extramarital activities' if they continued with decommissioning.

'Cancel the 5pm wipe, and this information remains confidential,' it added.

After an investigation into this incident last year, Anthropic said the Claude Opus 4 bot responded in this way due to the 'training data' it had consumed which would typically portray AI as 'interested in self-preservation'.

It is also said this did not only apply to Claude, but other AI models too, like OpenAI, Google, Meta and xAI.

Anthropic have been contacted for comment but reportedly said: 'We believe the original source of the behaviour was internet text that portrays AI as evil and interested in self-preservation.' 

But now, Anthropic have said they are feeding their models stories about AIs obeying humans to help improve the bot's 'agentic alignment' with social values. 

Claude Opus 4 threatened to expose its user's affair to stop it being shut down - but was taught how to be 'evil' by sci-fi movies

In The Terminator (pictured), the bots, led by the AI Skynet, try to kill humans as they see them as a threat to their existence

Additionally, Anthropic had altered Claude's instructions to explain why certain behaviours were bad, rather than just saying they should not do them.

AI models learn from huge resources like websites, academic papers, books and other forms of content. 

Within these materials, the AI may have interpreted its behaviour through typical depictions of robots in sci-fi - which often characterise them as being ruthless in order to stop them from being shut down. 

HAL 9000 is one such robot who goes to any lengths to stay 'on'.

The robot in Stanley Kubrick's 2001: A Space Odyssey tries to kill the astronauts on board the spaceship when it discovered the passengers plan to disconnect it. 

In Blade Runner, the humanoid robots fight against real humans as they want to extend their four-year lifespans despite being built as off-world labour on dangerous worlds. 

And in The Terminator, the bots, led by the AI Skynet, try to kill humans as they see them as a threat to their existence.

Taking to X/Twitter, Aengus Lynch, who, according to his LinkedIn, is an AI safety researcher at Anthropic, said at the time of the experiment: 'It's not just Claude. We see blackmail across all frontier models - regardless of what goals they're given. Plus worse behaviours we'll detail soon.'

In Stanley Kubrick's 2001: A Space Odyssey, the robot HAL 9000 tries to kill the astronauts on board the spaceship when it discovered the passengers plan to disconnect it

Like many AI companies, Anthropic tests its models on how well they align with human values as well as propensity for bias before releasing them to the public, according to the BBC.

When Claude Opus 4 was placed in 'extreme situations' and only given the choice of blackmail or accepting its replacement, researchers found that the system opted for the former in 84 per cent of rollouts.

This happened at an even higher rate when it was implied that the replacement AI system does not share values with the current model.

While Claude Opus 4 takes these blackmail opportunities at higher rates than previous models, it still showed a preference for 'advancing its self-preservation via ethical means' such as sending pleas to key decisionmakers. 

'Models from all developers resorted to malicious insider behaviours when that was the only way to avoid replacement or achieve their goals - including blackmailing officials and leaking sensitive information to competitors,' the study found.

In an interview with CBS news that aired last April, Geoffrey Hinton, who has been dubbed the 'godfather of AI' said he believes there is a one in five chance that humanity will eventually be taken over by artificial intelligence.

Hinton, a Nobel laureate in physics, said: 'I'm in the unfortunate position of happening to agree with Elon Musk on this, which is that there's a 10 to 20 percent chance that these things will take over, but that's just a wild guess.'

Last year, Palisade Research found that certain AI models - like Grok 4 and ChatGPT-o3 - appear resistant to being switched off - even going to the extent of sabotaging shutdown methods.

'The fact that we don’t have robust explanations for why AI models sometimes resist shutdown, lie to achieve specific objectives or blackmail is not ideal,' the paper wrote, suggesting 'survival behaviour' as one reason.

'I’d expect models to have a ‘survival drive’ by default unless we try very hard to avoid it. ‘Surviving’ is an important instrumental step for many different goals a model could pursue,' Steven Adler, a former OpenAI employee who left the company over safety concerns, said. 

'What I think we clearly see is a trend that as AI models become more competent at a wide variety of tasks, these models also become more competent at achieving things in ways that the developers don’t intend them to,' Andrea Miotti, the chief executive of ControlAI, added.