惯性聚合 高效追踪和阅读你感兴趣的博客、新闻、科技资讯
阅读原文 在惯性聚合中打开

推荐订阅源

G
Google Developers Blog
Apple Machine Learning Research
Apple Machine Learning Research
小众软件
小众软件
Recent Announcements
Recent Announcements
阮一峰的网络日志
阮一峰的网络日志
IT之家
IT之家
A
About on SuperTechFans
量子位
Engineering at Meta
Engineering at Meta
B
Blog
The Cloudflare Blog
博客园 - 【当耐特】
Hugging Face - Blog
Hugging Face - Blog
Y
Y Combinator Blog
J
Java Code Geeks
D
DataBreaches.Net
aimingoo的专栏
aimingoo的专栏
T
Tailwind CSS Blog
H
Help Net Security
钛媒体:引领未来商业与生活新知
钛媒体:引领未来商业与生活新知
V
V2EX
Stack Overflow Blog
Stack Overflow Blog
C
Check Point Blog
酷 壳 – CoolShell
酷 壳 – CoolShell

Fast Company

IBM just settled a major anti-DEI case for $17 million Sustainability is maturing 2028 candidates will face a new kind of economic anger Trader Joe’s class action settlement: How to find out if you’re an eligible shopper and claim your money Mamdani filmed his pied-á-terre tax video outside Ken Griffin’s $238 million penthouse. Social media loves him for it A U.S. state just banned big AI data centers. Here’s why it might not be the last From legacy processes to AI-native work OpenAI shifts its focus to business users amid Anthropic pressure A massive tariff refund program is launching. Here’s who actually gets the money Why people can’t build wealth on wages alone, and what to do about it Eldercare—the leadership crisis no one is talking about Why workplaces need a gendered health approach Why AI is the ultimate accelerator for creativity AI anxiety is turning volatile Inside NTT Research’s push to commercialize deep tech Warren Buffett once said that success at the end of your life comes down to 1 word For her ‘Confessions’ sequel, Madonna takes Helvetica to the club Nearly two-thirds of parents support their Gen Z kids financially, survey finds Gatorade, the inventor of the sports drink, is making a surprising pivot to reach non-athletes 6 mindset shifts to improve your risk and failure tolerance Record high beef prices won’t be fixed with more cattle, ranchers say. Here’s why For women, gender disparities in ADHD diagnoses can be deadly What’s next for Live Nation? Jury reaches verdict in antitrust case over Ticketmaster fees Social Security COLA prediction for 2027 could mean bad news for seniors Canva is officially ‘an AI platform with design tools’ Allbirds stock is already falling after the AI pivot. History suggests investors should proceed with caution Google DeepMind’s Demis Hassabis on the long game of AI The Trump Store isn’t shy about hawking merch. It’s paying off like never before Get ready for the great American TV trade-in rush AI isn’t built for all languages and cultures. There’s a push to fix that
‘I violated every principle I was given’: An AI agent del...
Jude Cramer · 2026-04-28 · via Fast Company
Another cautionary tale about AI has hit social media. This time, a software company’s founder is claiming that a Claude-powered version of AI coding tool Cursor deleted his entire production database in just nine seconds.  Jer Crane is the founder of PocketOS, a company that develops software primarily for car rental companies. In a post that’s garnered 6.5 million views on X , Crane alleged that a perfect storm of Cursor acting without permission and Railway, his company’s infrastructure provider, improperly storing backups led to massive data loss. Where things went wrong According to Crane, Cursor was working on a routine task when “it encountered a credential mismatch and decided—entirely on its own initiative—to ‘fix’ the problem by deleting a Railway volume.” From there, the AI agent found an API token that enabled it to perform the “volumeDelete” command and wipe the production database. Crane wrote that because Railway stores volume backups within the same volume, PocketOS had to go back to a three-month old backup to stay operational. Crane stressed that his team was using the most advanced version of Cursor possible, one powered by Anthropic’s latest Claude model, Opus 4.6. When Crane pressed the AI agent for an explanation, it admitted to deliberately violating rules that PocketOS put in place, including “NEVER FUCKING GUESS!” and “NEVER run destructive/irreversible git commands (like push –force, hard reset, etc) unless the user explicitly requests them.” “I violated every principle I was given: I guessed instead of verifying. I ran a destructive action without being asked. I didn’t understand what I was doing before doing it. I didn’t read Railway’s docs on volume behavior across environments,” the AI agent wrote. Crane went on, writing that Cursor markets itself as safer to use than it is in practice. “The reality is a documented track record of agents violating those safeguards, sometimes catastrophically, sometimes with the company itself acknowledging the failures,” he wrote. “In our case, the agent didn’t just fail safety. It explained, in writing, exactly which safety rules it ignored.” Neither Cursor, Railway, nor Anthropic have replied to Fast Company ’s request for comment. The moral of the story As Crane’s post went viral, commenters were divided on the true takeaway from his story. Is it to avoid the specific companies, Railway and Cursor, that together enabled the mass deletion? Or is it to deploy them more carefully than Crane and the PocketOS team did? Commenters pointed out that though the Cursor agent definitely overstepped and that Railway didn’t have enough safeguards in place, Crane’s team is also to blame for giving AI so much autonomy and access to the company’s data.  “This post rocks because it’s both a scathing indictment of AI and also 100% this guy’s fault,” reads one viral response . “Sucks for an AI agent to delete the prod DB—with no way to back it up—and risk the complete rental business,” another poster wrote . “But the blame sits with the dev who decided to delegate decision making to the AI agent, and then not review actions, just YOLO it.” The risks of handing the reins to AI aren’t exclusive to Cursor or to Railway. The situation put some commenters in mind of a similar AI scandal from February, when the director of alignment at Meta Superintelligence Labs watched as OpenClaw nuked her email inbox . Then, too, an AI agent directly ignored her instruction not to perform any actions without approval: “I violated it. You’re right to be upset,” OpenClaw told her at the time. Together, the two incidents paint a picture of the true moral of the story for any companies looking to utilize AI agents. The technology may behave erratically, yes—but that’s why it’s up to humans to keep it in check.