惯性聚合 高效追踪和阅读你感兴趣的博客、新闻、科技资讯
阅读原文 在惯性聚合中打开

推荐订阅源

V
V2EX
J
Java Code Geeks
月光博客
月光博客
博客园_首页
The GitHub Blog
The GitHub Blog
Vercel News
Vercel News
B
Blog RSS Feed
博客园 - 聂微东
宝玉的分享
宝玉的分享
T
Tailwind CSS Blog
Jina AI
Jina AI
S
SegmentFault 最新的问题
B
Blog
钛媒体:引领未来商业与生活新知
钛媒体:引领未来商业与生活新知
有赞技术团队
有赞技术团队
Hugging Face - Blog
Hugging Face - Blog
Google DeepMind News
Google DeepMind News
阮一峰的网络日志
阮一峰的网络日志
The Cloudflare Blog
量子位
Martin Fowler
Martin Fowler
博客园 - Franky
大猫的无限游戏
大猫的无限游戏
博客园 - 叶小钗

Hacker News - Newest: "AI"

AI can't read an investor deck AI as an attorney? Student uses ChatGPT, Gemini to sue UW over alleged racial discrimination Hacking MCP Servers in AI Systems – The Rug Pull: Tool Changes After Approval GitHub - MeepCastana/KubeezCut: Free Web based video editor Can AI judge journalism? A Thiel-backed startup says yes, even if it risks chilling whistleblowers Coming soon: 10 Things That Matter in AI Right Now DARPA built an AI to fact-check enemy weapons claims What explains heterogeneity in AI adoption? When AI Meets Muscle: Context-Aware Electrical Stimulation Promises a New Way to Guide Human Movements - Department of Computer Science AI Changed How We Build. It Did Not Change What Matters. Linux rules on using AI-generated code - Copilot is OK, but humans must take 'full responsibility for the… Meta spins up AI version of Mark Zuckerberg to engage with employees Code Mode: Let Your AI Write Programs, Not Just Call Tools | TanStack Blog GitHub - Delavalom/graft: Go framework for building AI agents. Type-safe tools, multi-provider (OpenAI, Anthropic, Gemini, Bedrock), zero vendor SDKs. India's TCS tops estimates, says new AI models did not dent services demand Gen Z's fading AI hype Strong feeling: we are in a folded AI reality GitHub - machinarii/total-recall-catalog: A reference catalog of latest knowledge retrieval, memory & RAG systems GitHub - mensfeld/code-on-incus: Give each AI agent its own isolated machine with root, Docker, and systemd. Active defense detects and stops threats automatically.. Quantization, LoRA, and the 8% Problem: Benchmarking Local LLMs for Production AI Iran war: We spoke to the man making Lego-style AI videos that experts say are powerful propaganda Powell, Bessent discussed Anthropic's Mythos AI cyber threat with major U.S. banks GitHub - immartian/bellamem: Persistent belief-graph memory for AI agents. Retrieves decisive context by importance — not recency, not RAG, not /compact. recursive-mode: The Repo-Native Operating System for AI Engineering After the attack on Sam Altman's home, will AI CEO's go on the offensive? The biggest advance in AI since the LLM Opus 4.6 vs GPT 5.4 One Prompt Unity World Generation Test “AI polls” are fake polls Client Challenge Can AI be a 'child of God'? Inside Anthropic's meeting with Christian leaders
Too dangerous to release: is Mythos the start of the rest...
sbulaev · 2026-05-27 · via Hacker News - Newest: "AI"

In April, the artificial-intelligence firm Anthropic announced it had made an AI model too dangerous to be released to the public. The company, based in San Francisco, California, said its Claude Mythos model was so powerful that it had found vulnerabilities in every major operating system and web browser currently in use. “The fallout — for economies, public safety, and national security — could be severe,” the company stated in a blogpost about Project Glasswing, its name for the limited release of the model to a group of 50 or so trusted organizations.

The decision marks a turn to secretive, cutting-edge AI research that could become a trend, experts say. What Anthropic has done to throttle Mythos’s release is likely to be adopted by other AI laboratories, reckons Helen Toner, interim executive director at the Center for Security and Emerging Technology at Georgetown University in Washington DC. “I would expect this to more be the first in a series rather than a one-off,” says Toner, who previously sat on the board of Anthropic’s competitor OpenAI, which is also based in San Francisco.

“I expect other providers to adopt a similar strategy,” agrees Vasilios Mavroudis, an AI-safety researcher at the Alan Turing Institute in London. Indeed, OpenAI followed up just a week after Mythos was announced with a limited release of a cybersecurity-specific model, GPT-5.4-Cyber, to vetted researchers and organizations alone.

If this kind of restricted-access AI does take off, it will mark a turning point in the long-standing debate on the merits of ‘closed’ and ‘open’ AI software — with potential knock-on implications for science. For years, researchers have argued that transparency around AI models benefits both AI research and science in general, because researchers can study and build on the algorithms.

Now there’s a prospect that the makers of cutting-edge AI models might not release them widely at all. And if governments decide that powerful AI is a ‘dual-use’ technology — that is, one that could be weaponized by the military as well as used in civilian society — then extra controls, of the kind used for defence-relevant technologies, might also kick in. This could limit who gets to use the most powerful software, says Toner.

Why restrict access?

Firms have tried restricting models before. In February 2019, OpenAI released a cut-down version of its GPT-2 model, citing fears it could be misused, before allowing full access that November. But, viewed by today’s standards, that model had very little capability — it could complete rudimentary sentences.

It’s difficult for researchers who lack access to Mythos to know whether all of Anthropic’s fears are well-founded. But Ciaran Martin, a management researcher at the University of Oxford, UK, who is the former chief executive of the UK National Cyber Security Centre in London, says that Mythos seems to be a “big deal” and “a rapid acceleration of AI capabilities”.

AI labs already implement ‘guard rails’ in their models to prevent misuse, usually in the form of refusals to engage with or answer queries that seem dangerous. However, those are often as simple as a set of hidden instructions given to an AI system on how to respond. They can be unwound (or ‘jailbroken’) if users so choose.

The risk in giving everyone equal access to Mythos is that it could help attackers first, says Mavroudis. “Defenders can use these to find security issues in systems or software projects. Attackers can do the same,” he says. That is why Anthropic is giving defenders a head start. Some unauthorized access to Mythos has reportedly occurred already, however.

The firm has said that its “eventual goal” is to enable users “to safely deploy Mythos-class models at scale”, but didn’t respond to Nature’s query about whether this meant the public would have access. OpenAI has also been unclear, saying that it was “starting” with a limited release of GPT-5.4-Cyber, and a quickly released follow-up model, GPT-5.5-Cyber; it has since launched a cybersecurity-focused product, called Daybreak, which is built on these tools. However, for now, the ‘Cyber’ models are available only to authorized users.

When asked whether its models might become publicly available, an OpenAI spokesperson pointed to language in a blogpost announcing GPT-5.5-Cyber. It states that “expanding access […] responsibly requires stronger confidence in who is using the model, what systems they are targeting, and whether the work is authorized”, but “we expect access to broaden over time”.

Where cyber goes, science follows?

Firms that restrict access to AI models aren’t only concerned about cybersecurity risks. For example, companies launching models specialized for biology research have said that they’re worried about potential misuse related to creating bioweapons.

In April, OpenAI released GPT-Rosalind, aimed at life scientists, which it said it would launch through a ‘trusted-access’ structure so that only approved users could explore it. The company will also monitor how the model is being used, YunYun Wang, OpenAI’s life-sciences product leader, told Nature. And last year, Google launched an ‘AI co-scientist’ system which, again, is available only to researchers who apply for access.

If such restrictions persist, they could mean that only well-connected researchers have access to the most-powerful AI tools. Researchers already worry that price hikes to existing public AI systems are starting to entrench inequality in the field, with some groups not able to afford premium subscriptions.