惯性聚合 高效追踪和阅读你感兴趣的博客、新闻、科技资讯
阅读原文 在惯性聚合中打开

推荐订阅源

B
Blog
V
Vulnerabilities – Threatpost
Apple Machine Learning Research
Apple Machine Learning Research
V
V2EX
博客园 - 叶小钗
阮一峰的网络日志
阮一峰的网络日志
人人都是产品经理
人人都是产品经理
Latest news
Latest news
博客园 - 三生石上(FineUI控件)
美团技术团队
aimingoo的专栏
aimingoo的专栏
Google Online Security Blog
Google Online Security Blog
Security Archives - TechRepublic
Security Archives - TechRepublic
T
Threatpost
Y
Y Combinator Blog
T
Tailwind CSS Blog
CTFtime.org: upcoming CTF events
CTFtime.org: upcoming CTF events
A
Arctic Wolf
C
Cyber Attacks, Cyber Crime and Cyber Security
小众软件
小众软件
Recent Commits to openclaw:main
Recent Commits to openclaw:main
T
Tenable Blog
W
WeLiveSecurity
L
LINUX DO - 热门话题
D
Docker
Cyberwarzone
Cyberwarzone
量子位
A
About on SuperTechFans
The Last Watchdog
The Last Watchdog
雷峰网
雷峰网
C
CERT Recently Published Vulnerability Notes
P
Palo Alto Networks Blog
The Hacker News
The Hacker News
Blog — PlanetScale
Blog — PlanetScale
P
Proofpoint News Feed
OSCHINA 社区最新新闻
OSCHINA 社区最新新闻
F
Full Disclosure
The Cloudflare Blog
T
The Blog of Author Tim Ferriss
T
The Exploit Database - CXSecurity.com
Engineering at Meta
Engineering at Meta
O
OpenAI News
Hacker News - Newest:
Hacker News - Newest: "LLM"
Scott Helme
Scott Helme
IT之家
IT之家
S
Secure Thoughts
MongoDB | Blog
MongoDB | Blog
L
Lohrmann on Cybersecurity
博客园 - 司徒正美
Google DeepMind News
Google DeepMind News

Hacker News - Newest: "AI"

AI can't read an investor deck AI as an attorney? Student uses ChatGPT, Gemini to sue UW over alleged racial discrimination Hacking MCP Servers in AI Systems – The Rug Pull: Tool Changes After Approval GitHub - MeepCastana/KubeezCut: Free Web based video editor GitHub - GenAI-Gurus/awesome-eu-ai-act: Curated tools, official sources, OSS, templates, and guides for EU AI Act compliance. Can AI judge journalism? A Thiel-backed startup says yes, even if it risks chilling whistleblowers Coming soon: 10 Things That Matter in AI Right Now DARPA built an AI to fact-check enemy weapons claims What explains heterogeneity in AI adoption? When AI Meets Muscle: Context-Aware Electrical Stimulation Promises a New Way to Guide Human Movements - Department of Computer Science AI Changed How We Build. It Did Not Change What Matters. Linux rules on using AI-generated code - Copilot is OK, but humans must take 'full responsibility for the… Meta spins up AI version of Mark Zuckerberg to engage with employees Code Mode: Let Your AI Write Programs, Not Just Call Tools | TanStack Blog GitHub - Delavalom/graft: Go framework for building AI agents. Type-safe tools, multi-provider (OpenAI, Anthropic, Gemini, Bedrock), zero vendor SDKs. India's TCS tops estimates, says new AI models did not dent services demand Gen Z's fading AI hype Strong feeling: we are in a folded AI reality GitHub - machinarii/total-recall-catalog: A reference catalog of latest knowledge retrieval, memory & RAG systems GitHub - mensfeld/code-on-incus: Give each AI agent its own isolated machine with root, Docker, and systemd. Active defense detects and stops threats automatically.. Quantization, LoRA, and the 8% Problem: Benchmarking Local LLMs for Production AI Iran war: We spoke to the man making Lego-style AI videos that experts say are powerful propaganda Powell, Bessent discussed Anthropic's Mythos AI cyber threat with major U.S. banks GitHub - immartian/bellamem: Persistent belief-graph memory for AI agents. Retrieves decisive context by importance — not recency, not RAG, not /compact. recursive-mode: The Repo-Native Operating System for AI Engineering After the attack on Sam Altman's home, will AI CEO's go on the offensive? The biggest advance in AI since the LLM Opus 4.6 vs GPT 5.4 One Prompt Unity World Generation Test “AI polls” are fake polls Client Challenge Can AI be a 'child of God'? Inside Anthropic's meeting with Christian leaders How to Switch AI Chatbots and Why You Might Want To GitHub - MattMessinger1/agentic_refund_guardrail: Safe refund policy layer for AI agents — Python + TypeScript. Same behavior, shared tests. Adam/papers/emergent_values_whitepaper.md at master · strangeadvancedmarketing/Adam Ask HN: How do you stop playing 20 questions with your AI coding tools How far can automation and AI support psychotherapy? - @theU GitHub - stagas/rtdiff: realtime git diff gui and AI-assisted commits A Mac Studio for Local AI — 6 Months Later A History of the Early Years of AI at the University of Edinburgh Why AI Coding Tools Still Feel Stuck on Localhost MSN AI Datacenters Are Becoming Strategic Targets twitter.com Penn Researchers Use AI to Surface Unreported GLP-1 Side Effects in Reddit Posts Show HN: MoodSense AI (ML and FastAPI and Gradio, Deployed on Hugging Face) Moodsense Ai - a Hugging Face Space by aman179102 AI models are terrible at betting on soccer—especially xAI Grok GitHub - xialeistudio/echoic GitHub - HimashaHerath/github-dev-wrapped: AI-powered weekly GitHub activity reports deployed to GitHub Pages GitHub - alejandrobalderas/claude-code-from-source: Architecture, patterns & internals of Anthropic's AI coding agent — reverse-engineered from source maps AI and Tech brief: Ireland ascendant GitHub - Titovilal/context0: Context0 - Never Surrender Training for a Marathon with an AI Coach: What Worked and What Didn't Cyber Pulse: Agentic Intel - Apps on Google Play I Built an AI PR Reviewer That Catches Bugs by Not Looking for Bugs Gen Z workers are so fearful AI will take their job they’re intentionally sabotaging their company’s AI rollout | Fortune How AI Is Reimagining the Game of Golf–For Both Players and Courses GitHub - nattergabriel/reseed: A CLI tool for managing and distributing agent skills across projects Is SVG the final frontier? My AI workflow evolved from prompts to a near-autonomous workflow MLSharp Help - 3DGS Viewer & Generator I put my cognitive field based AI's runtime on GitHub Is Numble the first AI-proof game? A3: Kubernetes for autonomous AI agent fleets | Emergent Principles Deepali Vyas ("The Elite Recruiter") GitHub - msmarkgu/RelayFreeLLM: A restful API designed to route user prompts to various AI model providers. Unionized ProPublica staff are on strike over AI, layoffs, and wages Unleashing the Advantage of Quantum AI We're heading for an AI-fueled 'dementia crisis,' brain scientist warns The AI-Assisted Breach of Mexico's Government Infrastructure [pdf] GitHub - stef41/lmscan: 🔍 Detect AI-generated text and fingerprint which LLM wrote it. Open-source GPTZero alternative. Zero dependencies, works offline. MSN GitHub - visionscaper/collabmem: Enabling long-term collaboration with Agentic AI - building up episodic and world model memory over time with in-context awareness We gave an AI a 3 year retail lease in SF and asked it to make a profit | Andon Labs AI Code is Hollowing Out Open Source, and Maintainers are Looking the Other Way What leaked "SteamGPT" files could mean for the PC gaming platform's use of AI AI is the boss at this retail store. What could go wrong? GitHub - Wuzu11517/agentic-proxy: Local proxy meant to help reduce With Drones, Geophysics and ArtificiaI Intelligence, Researchers Prepare to Do Battle Against Land Mines A Single Operator, Two AI Platforms, Nine Government Agencies: The Full Technical Report 在 Steam 上购买 FriedrichAI: Offline AI 立省 10% GitHub - inevolin/resume-cli: Hit Claude usage limits? Resume any AI coding session elsewhere. Switch tools at zero friction. GitHub - atripati/ark: AI Runtime Kernel — a context operating system for AI agents. Eliminates tool bloat, loads only what’s needed, and gives LLMs their reasoning space back. How to Build a Secure AI PR Reviewer with Claude, GitHub Actions, and JavaScript This Startup Wants You to Pay Up to Talk With AI Versions of Human Experts Intel Arc Pro B70 Brings 32GB VRAM to Local AI for $949 WordPress 7.0: The Good, the AI, and the Still Missing AI on the couch: Anthropic gives Claude 20 hours of psychiatry IatroBench: Pre-Registered Evidence of Iatrogenic Harm from AI Safety Measures AI Agents Know About Supabase. They Don't Always Use It Right. The history and future of AI at Google, with Sundar Pichai Inside an AI‑enabled device code phishing campaign How Meta Used AI to Map Tribal Knowledge in Large-Scale Data Pipelines AI for Systems: Using LLMs to Optimize Database Query Execution Forecasting the Economic Effects of AI Introducing Tinker: Play with AI, bring your ideas to life AI sheds light on an ancient gaming mystery People really hate AI but not as much as Iran—or Democrats | Fortune What is an AI Product Engineer? Phoebe Gates wants her $185 million AI startup to succeed with 'no ties to my privilege or my last name': 'I have a chip on my shoulder' | Fortune
The biggest problems in using AI
Dan Shearer · 2026-06-26 · via Hacker News - Newest: "AI"

There are many problems with the AI billions of people use in 2026, discussed endlessly at all levels of society. From the end of 2025 I became interested in the particular problems of ethics and reliability, and why the approaches taken by all of the large AI companies are not good enough. Predictability, or ‘alignment’ as they call it, is just not something we can expect from this type of AI.

A colleague started working on a very different approach from these companies, and from February 2026 I have been contributing to and using prototype versions of the Artificial Organisations ↗ concept. This article explains why I believe Artificial Organisations are a promising new direction. Multi-agent Agentic AI is pretty important, as described here by the UK government ↗ , but it is rarely done well. If you want to try for yourself, you can use the core research code ↗ , as I do daily.

The Perseverance Composition Engine ↗ (PCE) uses Artificial Organisations to solve these pressing AI problems. PCE does not try to make LLMs behave better, but is designed instead so that their inevitable misbehaviour is detected and corrected. And regardless of the computer science, I found these ideas in Iain M Banks’ novels and the Mass Effect video game .

PCE works by assigning a task to LLM agents who each have a carefully enforced role to play. The agents iterate between each other until either the task is completed to specifications, or it fails by honestly saying “I can’t do this, the task is impossible for me.” So far, this arrangement seems effective at detecting and correcting common problems such as confident false assertions, hallucinations, or dangerous advice. With PCE, nobody needs to trust an AI, only the structure. The structure is recognisable by most people, since it is closely modelled on ones tried and tested for centuries. Like any organisation, Artificial Organisations have separation of duties, independent checks, and agents who can only see what they need to see. It works rather well.

This design addresses three failure modes that the usual training and instruction cannot fully fix: hallucination, context issues, and memory issues.

💡

The other biggest problem Many harms can be caused by AI including death, but we should expect AI to harvest our personal data and use it without consent. That’s why I am interested in things such as offline AI, and on-device small language models, and why I try to use PCE such that the robots in the sky don’t learn any more about me than they already do.

Hallucination and nonsense

Language models generate text according to probability, where the next piece of text (a ’token’) is selected based on patterns, not by retrieving facts from a database. If a model does not have a pool of highly relevant text to select from (the ‘context’) it will probabilistically generate text anyway because that it what it is programmed to do. The result is confabulation, where the model sounds confident while making a false or misleading claim. The better the AIs become at expressing themselves, the more convincing these hallucinations can become.

Research keeps concluding ↗ that training does not eliminate hallucination, and newer surveys ↗ describe hallucinations as potentially “fundamental mathematical inevitabilities inherent to [the model’s] architecture.” The AI companies are trying to solve this by giving better instruction and training, but if hallucination is indeed inevitable then this will never be reliable. I am persuaded the architecture needs to change for AI to become more trustworthy.

Context input to a model is called the ‘prior’. A quality prior comprises the best available documents, previous relevant decisions, germane background, and from it AI generates much better output. Just like a human organisation, Artificial Organisations strive to deal with the best quality input documents in order to improve decisionmaking, and to carefully label or even reject guesswork. This is the first structural way we can tackle hallucinations.

A second technique is also familiar: have someone else check the work. PCE has an agent called the Corroborator whose only job is to read what the Composer agent wrote, and to verify every claim against the source documents. The Corroborator has the sources right in front of it, so if the Composer invented a claim, the Corroborator will see it is unsupported. Corroborator is unmoved by plausible confabulation, because it is instructed to only accept what can be proven from the sources to hand, including references on the internet if it has been instructed to do so.

Context indexing is poor

Within any given AI conversation or session, the AI’s Context Window ↗ is the largest amount of information it can consider at once, measured in tokens of a few characters. The most advanced AI models available in 2026 with million+ token context windows (eg Llama 4 Scout, Kimi 3.0, GPT-5.4, Claude Opus 4.6) can hold maybe 1000 pages of text at once, or about *one millionth the storage capacity of a modern phone. An AI is doing a lot more with that text than a phone can possibly do, but this total limit is currently a major cause of why AI is unreliable. Even worse, models become more distractable and error-prone as their context window fills up close to its maximum. When their context window is full they lose information, miss obvious connections, and fail to incorporate relevant material because they can’t find what they need to build a good prior on their output. If AIs had a better index of the things they already know, then their output would be more reliable.

This is a retrieval problem and we know human organisations are good at finding information if we put it is kept in a library or a database. In contrast, asking a model to reconstruct context from scratch is asking it to guess (and it will). PCE solves this with a persistent knowledge base: documents are stored permanently, version-controlled, and indexed for full-text search. When a new task arrives, the system retrieves prior work rather than asking the model to start from scratch. The Curator is the agent responsible for this institutional memory, and it files, indexes, and makes everything findable. The model operates from plentiful, correct context retrieved from this database. Such a database is not a new idea ↗ , but our use of it fits neatly alongside other familiar concepts from physical organisations, inheriting all the well-known behaviours of information that passes from the library department to other departments, or to members of the public etc.

AI is amnesiac and lacks self-awareness

Between AI conversations, an AI has forgotten everything that has happened since it was trained. An AI can’t build on prior work, track decisions already made, or correct accumulated errors across an organisation’s history. Considered as merely a computer, AI is like something from the 1980s, where after power-on you need to instruct it what it knows and what it can do. Similarly with an AI, and that is what happens with every chatbot before you can even type in a request to it. If the chatbot appears to remember what you were discussing last week then that means a lot of work has been done behind the scenes to load the stored information back into the AI context window so you can continue chatting seamlessly. Part of this boot-up work is dedicated to instructing the AI chatbot to be more reliable, not to say dangerous things etc. In multi-agent agentic AI, that means each agent must be booted up with its initial context containing instructions and data relevant to its task.

More subtly, agents lack awareness of their own state — what tools are available, what time it is, whether the context recently filled up and needed to be compacted down into a summary. Without that awareness an agent can’t reason effectively about what it knows and doesn’t know.

The rigidity of Artificial Organisations is computer code that starts up, instructs and monitors each agent, even though the controlling brain of the organisation is yet another agent. This computer code is akin to the rules and laws that define how we expect human organisations to behave, for example, an organisation has a CEO, but there are still limits on what the CEO can do because the legal system cares about enforcing the rules not keeping CEOs happy.

The persistent knowledgebase of Artificial Organisations also addresses this problem of amnesia between AI conversations. Prior decisions, drafts, reasoning, and verification results are preserved and searchable across sessions and between agents. Each composition task leaves a structured trace that future work can build on, so the system knows what has been decided and can reason about its own state. Some recent agentic systems (Claude Code, Goose) have begun adding memory across conversations, but the difference is that PCE’s memory is structured, curated, and searchable — an institutional record with semantic structure, not a bag of remembered facts.

Agentic AI doesn’t do permissions

The mainstream response to AI’s problems is agentic AI, connecting multiple AI agents together, often with access to tools, web search, or document retrieval. This is an improvement over a single model call like a chatbot conversation.

The limitation of existing agentic approaches is that agents share context freely, so the biases and errors of one agent propagate to the next. The same agent that retrieves sources also writes claims and evaluates its own output. There is no structural guarantee that the work is independently checked, so fabrication in the synthesis step passes straight through. Cooperation is the default; adversarial review is not.

PCE takes a different approach: structure first, capability second.

The composition architecture

The Perseverance Composition Engine ↗ implements this organisational logic in code. Context is not shared freely any more than we expect medical records to be available to all workers in a hospital. The standard PCE workflow involves five agents. Tasks can be delegated to individual agents or through the full PCE pipeline depending on requirements.

The Composer drafts text from source materials. It reads the documents and writes coherent prose, but does not see the evaluation criteria — like an author who writes the report but doesn’t set the exam questions.

The Corroborator fact-checks independently, reading both the sources and the draft. Its single task is to verify every claim and catch fabrication before it reaches the reader. The Composer and Corroborator both see the source documents, but the Corroborator is instructed only to accept what the sources support. If the Composer invented something, the Corroborator will see the gap.

The Critic evaluates quality and safety. It reads the draft and the evaluation rubrics, but not the sources. This sounds backwards, but when reviewers see the sources they tend toward lazy evaluation, assuming claims are right because the sources seem to support them. Blind review, familiar from academic peer review, forces the Critic to evaluate what’s actually on the page.

The Censor checks appropriateness for the intended audience. A document can be factually correct and well-argued but contextually wrong for its recipient. We once had a job application letter that was accurate and well-written, but mentioned a private research programme that was inappropriate for that particular employer. The Corroborator passed it (true), the Critic passed it (well-argued), and the Censor caught the mismatch between content and audience.

The Curator publishes and maintains institutional memory, filing, indexing, and making work discoverable to future agents and users. The Curator is the librarian of the organisation, maintaining the structured record of what has been done, who decided it, and why.

No single agent can see the complete picture, so no single agent can rationalise away problems. The Composer can’t excuse unsourced claims by pointing to the sources (it doesn’t see them). The Critic can’t say “the sources must support this” (it hasn’t seen them). The Censor can’t be pressured by arguments about truth or quality — it only evaluates fit. Output cannot advance without passing through these verification gates.

Read our research on this approach ↗ .

The status today

PCE users don’t have to trust the AI, just the structure.

This approach is independent of how good or bad the underlying model is. A less capable, cheaper model embedded in this architecture can outperform a more capable model operating alone, because the cheaper model iterates around the organisational loop and the structure does the work. You can inspect the pipeline, verify that information barriers are enforced, and confirm that decisions pass through verification, which is much easier than auditing a neural network’s internal weights. And the same organisational structure applies to policy analysis, research synthesis, operational decisions, or any task where correctness matters.

Here is summary data from composition tasks across multiple organisations, reported in the Southampton ePrints paper ↗ :

  • The Corroborator detects fabrication in 52% of drafts — cases where confident-sounding claims lack evidence
  • Iterative feedback through the pipeline produces 79% quality improvement in argumentative quality as assessed by the Critic
  • Under impossible task constraints (where no correct answer exists), the system progresses from attempted fabrication toward honest refusal — collective behaviour that was neither explicitly instructed nor individually incentivised

These figures represent operational data from live systems. The methodology and detailed breakdown appear in the full paper.

The hallucination research cited above demonstrates that the field is actively developing mitigations, and context window engineering continues to improve. Our argument is that structural intervention provides measurable benefits today, independent of ongoing improvements to underlying models.


Further Reading