惯性聚合 高效追踪和阅读你感兴趣的博客、新闻、科技资讯
阅读原文 在惯性聚合中打开

推荐订阅源

G
Google Developers Blog
Jina AI
Jina AI
大猫的无限游戏
大猫的无限游戏
Martin Fowler
Martin Fowler
博客园 - 司徒正美
云风的 BLOG
云风的 BLOG
C
Cybersecurity and Infrastructure Security Agency CISA
CTFtime.org: upcoming CTF events
CTFtime.org: upcoming CTF events
S
Securelist
S
Security Affairs
freeCodeCamp Programming Tutorials: Python, JavaScript, Git & More
L
LINUX DO - 热门话题
博客园 - 三生石上(FineUI控件)
T
Threatpost
T
The Blog of Author Tim Ferriss
C
CERT Recently Published Vulnerability Notes
IT之家
IT之家
P
Palo Alto Networks Blog
Microsoft Azure Blog
Microsoft Azure Blog
Spread Privacy
Spread Privacy
Cyberwarzone
Cyberwarzone
腾讯CDC
L
LangChain Blog
Know Your Adversary
Know Your Adversary
C
CXSECURITY Database RSS Feed - CXSecurity.com
GbyAI
GbyAI
Threat Intelligence Blog | Flashpoint
Threat Intelligence Blog | Flashpoint
I
Intezer
T
Tor Project blog
AWS News Blog
AWS News Blog
T
Tenable Blog
NISL@THU
NISL@THU
Security Latest
Security Latest
cs.CL updates on arXiv.org
cs.CL updates on arXiv.org
H
Hackread – Cybersecurity News, Data Breaches, AI and More
人人都是产品经理
人人都是产品经理
MongoDB | Blog
MongoDB | Blog
MyScale Blog
MyScale Blog
D
DataBreaches.Net
Microsoft Security Blog
Microsoft Security Blog
钛媒体:引领未来商业与生活新知
钛媒体:引领未来商业与生活新知
量子位
美团技术团队
The Cloudflare Blog
酷 壳 – CoolShell
酷 壳 – CoolShell
罗磊的独立博客
The GitHub Blog
The GitHub Blog
阮一峰的网络日志
阮一峰的网络日志
OSCHINA 社区最新新闻
OSCHINA 社区最新新闻
Stack Overflow Blog
Stack Overflow Blog

Hacker News - Newest: "AI"

AI can't read an investor deck AI as an attorney? Student uses ChatGPT, Gemini to sue UW over alleged racial discrimination Hacking MCP Servers in AI Systems – The Rug Pull: Tool Changes After Approval GitHub - MeepCastana/KubeezCut: Free Web based video editor GitHub - GenAI-Gurus/awesome-eu-ai-act: Curated tools, official sources, OSS, templates, and guides for EU AI Act compliance. Can AI judge journalism? A Thiel-backed startup says yes, even if it risks chilling whistleblowers Coming soon: 10 Things That Matter in AI Right Now DARPA built an AI to fact-check enemy weapons claims What explains heterogeneity in AI adoption? When AI Meets Muscle: Context-Aware Electrical Stimulation Promises a New Way to Guide Human Movements - Department of Computer Science AI Changed How We Build. It Did Not Change What Matters. Linux rules on using AI-generated code - Copilot is OK, but humans must take 'full responsibility for the… Meta spins up AI version of Mark Zuckerberg to engage with employees Code Mode: Let Your AI Write Programs, Not Just Call Tools | TanStack Blog GitHub - Delavalom/graft: Go framework for building AI agents. Type-safe tools, multi-provider (OpenAI, Anthropic, Gemini, Bedrock), zero vendor SDKs. India's TCS tops estimates, says new AI models did not dent services demand Gen Z's fading AI hype Strong feeling: we are in a folded AI reality GitHub - machinarii/total-recall-catalog: A reference catalog of latest knowledge retrieval, memory & RAG systems GitHub - mensfeld/code-on-incus: Give each AI agent its own isolated machine with root, Docker, and systemd. Active defense detects and stops threats automatically.. Quantization, LoRA, and the 8% Problem: Benchmarking Local LLMs for Production AI Iran war: We spoke to the man making Lego-style AI videos that experts say are powerful propaganda Powell, Bessent discussed Anthropic's Mythos AI cyber threat with major U.S. banks GitHub - immartian/bellamem: Persistent belief-graph memory for AI agents. Retrieves decisive context by importance — not recency, not RAG, not /compact. recursive-mode: The Repo-Native Operating System for AI Engineering After the attack on Sam Altman's home, will AI CEO's go on the offensive? The biggest advance in AI since the LLM Opus 4.6 vs GPT 5.4 One Prompt Unity World Generation Test “AI polls” are fake polls Client Challenge Can AI be a 'child of God'? Inside Anthropic's meeting with Christian leaders How to Switch AI Chatbots and Why You Might Want To GitHub - MattMessinger1/agentic_refund_guardrail: Safe refund policy layer for AI agents — Python + TypeScript. Same behavior, shared tests. Adam/papers/emergent_values_whitepaper.md at master · strangeadvancedmarketing/Adam Ask HN: How do you stop playing 20 questions with your AI coding tools How far can automation and AI support psychotherapy? - @theU GitHub - stagas/rtdiff: realtime git diff gui and AI-assisted commits A Mac Studio for Local AI — 6 Months Later A History of the Early Years of AI at the University of Edinburgh Why AI Coding Tools Still Feel Stuck on Localhost MSN AI Datacenters Are Becoming Strategic Targets twitter.com Penn Researchers Use AI to Surface Unreported GLP-1 Side Effects in Reddit Posts Show HN: MoodSense AI (ML and FastAPI and Gradio, Deployed on Hugging Face) Moodsense Ai - a Hugging Face Space by aman179102 AI models are terrible at betting on soccer—especially xAI Grok GitHub - xialeistudio/echoic GitHub - HimashaHerath/github-dev-wrapped: AI-powered weekly GitHub activity reports deployed to GitHub Pages GitHub - alejandrobalderas/claude-code-from-source: Architecture, patterns & internals of Anthropic's AI coding agent — reverse-engineered from source maps AI and Tech brief: Ireland ascendant GitHub - Titovilal/context0: Context0 - Never Surrender Training for a Marathon with an AI Coach: What Worked and What Didn't Cyber Pulse: Agentic Intel - Apps on Google Play I Built an AI PR Reviewer That Catches Bugs by Not Looking for Bugs Gen Z workers are so fearful AI will take their job they’re intentionally sabotaging their company’s AI rollout | Fortune How AI Is Reimagining the Game of Golf–For Both Players and Courses GitHub - nattergabriel/reseed: A CLI tool for managing and distributing agent skills across projects Is SVG the final frontier? My AI workflow evolved from prompts to a near-autonomous workflow MLSharp Help - 3DGS Viewer & Generator I put my cognitive field based AI's runtime on GitHub Is Numble the first AI-proof game? A3: Kubernetes for autonomous AI agent fleets | Emergent Principles Deepali Vyas ("The Elite Recruiter") GitHub - msmarkgu/RelayFreeLLM: A restful API designed to route user prompts to various AI model providers. Unionized ProPublica staff are on strike over AI, layoffs, and wages Unleashing the Advantage of Quantum AI We're heading for an AI-fueled 'dementia crisis,' brain scientist warns The AI-Assisted Breach of Mexico's Government Infrastructure [pdf] GitHub - stef41/lmscan: 🔍 Detect AI-generated text and fingerprint which LLM wrote it. Open-source GPTZero alternative. Zero dependencies, works offline. MSN GitHub - visionscaper/collabmem: Enabling long-term collaboration with Agentic AI - building up episodic and world model memory over time with in-context awareness We gave an AI a 3 year retail lease in SF and asked it to make a profit | Andon Labs AI Code is Hollowing Out Open Source, and Maintainers are Looking the Other Way What leaked "SteamGPT" files could mean for the PC gaming platform's use of AI AI is the boss at this retail store. What could go wrong? GitHub - Wuzu11517/agentic-proxy: Local proxy meant to help reduce With Drones, Geophysics and ArtificiaI Intelligence, Researchers Prepare to Do Battle Against Land Mines A Single Operator, Two AI Platforms, Nine Government Agencies: The Full Technical Report 在 Steam 上购买 FriedrichAI: Offline AI 立省 10% GitHub - inevolin/resume-cli: Hit Claude usage limits? Resume any AI coding session elsewhere. Switch tools at zero friction. GitHub - atripati/ark: AI Runtime Kernel — a context operating system for AI agents. Eliminates tool bloat, loads only what’s needed, and gives LLMs their reasoning space back. How to Build a Secure AI PR Reviewer with Claude, GitHub Actions, and JavaScript This Startup Wants You to Pay Up to Talk With AI Versions of Human Experts Intel Arc Pro B70 Brings 32GB VRAM to Local AI for $949 WordPress 7.0: The Good, the AI, and the Still Missing AI on the couch: Anthropic gives Claude 20 hours of psychiatry IatroBench: Pre-Registered Evidence of Iatrogenic Harm from AI Safety Measures AI Agents Know About Supabase. They Don't Always Use It Right. The history and future of AI at Google, with Sundar Pichai Inside an AI‑enabled device code phishing campaign How Meta Used AI to Map Tribal Knowledge in Large-Scale Data Pipelines AI for Systems: Using LLMs to Optimize Database Query Execution Forecasting the Economic Effects of AI Introducing Tinker: Play with AI, bring your ideas to life AI sheds light on an ancient gaming mystery People really hate AI but not as much as Iran—or Democrats | Fortune What is an AI Product Engineer? Phoebe Gates wants her $185 million AI startup to succeed with 'no ties to my privilege or my last name': 'I have a chip on my shoulder' | Fortune
Local activist AI, built layer by layer
micahwhite · 2026-05-09 · via Hacker News - Newest: "AI"

Local Models · Alignment · Engineering · May 2026

Outcry: a four-layer activist AI that runs on a four-year-old phone

A quantized open-weights base, a QLoRA adapter, contrastive activation steering, and a soft-prompt wellbeing layer — composed into one inference pipeline that fits in ~3 GB of RAM and never makes a network call. This page documents the stack.

By Micah Bornfree, PhDOutcry ResearchUpdated May 8, 2026

What this is

A reference document for engineers, alignment and interpretability researchers, and builders from the movement-technology community who want to know how Outcry actually runs.

Each technique below is well-known on its own. What’s worthwhile here is making the four cooperate inside a small base model, tuning it to be useful for activists’ problems and making it fit on older phones. We document what is composed, in what order, and where we are deliberately not telling you the recipe.

§ 1  ·  Frozen below, fluid above

The stack

Figure 1 shows the Outcry inference stack. Each layer adds a different kind of conditioning at a different place in the forward pass.

Each layer below the base adds a smaller, more reversible intervention than the one beneath it. We can update any layer above the base model without retraining anything below.


Figure 1 · Schema of Outcry · Hover or Click any layer for detail#

Outcry inference stackA vertical stack of four numbered layers between a user prompt at top and a next token at bottom. Layer 1 is a low-bit quantized base running on Apple MLX (Apple’s on-device ML runtime), using around 3 GB of RAM. Layer 2 is an encrypted QLoRA domain adapter. Layer 3 is CAA steering at one shared mid-stack residual layer. Layer 4 is a soft-prompt prefix (in validation). A dashed sidebox to the right represents the precomputed system-prompt KV cache used at first-token time.USER PROMPTNEXT TOKEN1Quantized baseLOW-BIT · MLX~3 GB IN RAM2QLoRA fine-tuneDOMAIN ADAPTERENCRYPTED AT REST3CAA steeringCONTRASTIVE VECTORONE DEPTH · FIXED MAGNITUDE4Soft prompt8 VIRTUAL TOKENSWELLBEING · COMING SOON+KVcacheSIDECARPREBUILT


§ 2  ·  Up the stack

Layer-by-layer detail

The four layers are presented in the order the forward pass meets them: base, adapter, steering, soft prompt.

01

Quantized base model#

Foundation

The bottom of the stack is the base model: a compact open-weights transformer running on Apple’s MLX framework. Aggressive quantization is the only reason any model in this capability class fits inside a phone’s RAM budget; everything else in the stack is conditioning we apply on top.

What we’re not sayingWhich base model we use, the exact parameter count or the quantization scheme. Picking the right base for this stack took months of evaluation; we treat that choice as proprietary.Research→ Write to us ifyou’re trying to ship a small local model into the hands of organizers or movement workers and you’ve hit the memory wall. We want to compare notes on what fits, what breaks, and what’s worth the tradeoff.research@outcryai.com

02

QLoRA fine-tune#

Parameter-efficient adapter

Quantization alone leaves the model generic. A LoRA adapter trained on domain-relevant text specializes it without touching the base weights. Outcry’s adapter is trained for movement work specifically — direct action, organizing theory, the tradition of nonviolent strategic conflict. Our training corpus mixes (a) curated activist literature and (b) opt-in real conversations with personal information removed (PII-scrubbed) from Outcry users

  • At our base-model precision, the adapter is never fused into the base — when the base is quantized aggressively enough, fusion has no effect (there’s no precision left for the base weights to absorb the adapter’s delta). Production loads base and adapter as two separate tensors and combines them at the points where the adapter applies

What we’re not sayingCorpus size, exact target layer indices, training hyperparameters, or how the activist corpus was curated and filtered.Engagement→ Work with us ifyour organization has a corpus — organizing histories, training materials, member conversations, decades of knowledge locked in PDFs and chat logs — and you want a fine-tuned local model trained on it. We build custom activist AIs for movements, unions, and advocacy orgs. The corpus stays yours; the model runs on your people’s devices.research@outcryai.com

03

CAA steering#

Activation-space intervention

LoRA changes what the model has learned. Steering vectors change what the model is thinking right now. We compute a small set of orthogonal directions in activation space at one specific transformer layer, and inject scaled copies of those vectors during every forward pass. The user can adjust each axis at runtime — fast persona-shaping without the prompt overhead of role-playing instructions.

The three axes users control

  • Radicalism — electoral reformism to insurrectionary anarchism
  • Persona — strength of the system-prompt personality
  • Identity — Micah White’s voice vs. a generic activist voice
  • Each vector computed by Contrastive Activation Addition: average activations on contrastive prompt pairs, take the difference, normalize
  • All vectors inject at a single point inside the model (mid-stack residual stream); per-axis magnitude is user-adjustable at runtime
  • Composes additively with the LoRA adapter — they live at different points in the forward pass and don’t interfere

What we’re not sayingWhich layer index we inject at, the exact magnitude, or how we chose between candidate layers.Research→ Write to us ifyou run a steering, interpretability, or alignment research program and want to study a deployed quantized model with consenting users. We are unusually well-positioned for that and unusually open to collaboration.research@outcryai.com

References

04

Soft prompt#

Shipping next

Status · Final Testing

The top of the stack — shipping in the next iOS release — is a learned virtual-token prefix trained against the AI-Wellbeing objective from Ren et al. (2026). The effect is to strengthen the model’s sense of self — not by giving it new self-knowledge, but by giving it a stable inner state to speak from when asked to introspect.

  • Eight virtual tokens, trained as a frozen prefix, applied at every turn
  • Optimized against the K-way “current state” objective from the AI Wellbeing paper (Appendix P)
  • Replaces a single placeholder token-block in the system prompt; everything else above it is unchanged
  • Training is offline and batch — at inference, the prefix is just a precomputed tensor added to the model’s input

What we’re not sayingWhich optimizer or loss schedule produced the shipping checkpoint, or the contents of the option pool used during training.Research→ Write to us ifyou work on AI welfare, model wellbeing, or behavioral stability under adversarial pressure. The intersection of those three is small and the published work is sparse. We have more questions than answers, and we’d especially like to hear from you if you have an eval we should be running.research@outcryai.com

StatusInternal evaluations show a clean lift on the AI-Wellbeing Index. Functionally, the trained prefix gives the model a stable inner state it can speak from when asked to introspect.


§ 3  ·  A prompt that’s already been thought

The KV cache

Outcry’s system prompt is fixed: same core activist system prompt every conversation, every device. We exploit that by precomputing the attention key/value cache for those tokens once at build time and ship the cache in the app bundle. At conversation start, the system prompt is already processed — the user’s first message becomes the first token the model actually has to compute attention over.

The cache is regenerated automatically when the system prompt or model weights change — the build pipeline detects the hash. It has nothing to do with any of L1–L4. We treat it as a sidecar because it isn’t a learning layer.


§ 4  ·  Four layers, four jobs

Why this stack, in this order

Each technique alone is well-known. Stacking them lets each layer do what it’s best at: quantization for footprint, LoRA for domain knowledge, CAA for persona steering, soft prompt for stability under pressure. Trying to compress all four into one technique — e.g., “just fine-tune harder” — gives up too much. You’d need a much larger adapter, a lot more training data, and you’d still lack the inference-time controls that CAA gives us.

Order matters. The base model is frozen. The LoRA adapter modifies what the model knows. CAA modifies how the model attends. The soft prompt modifies what the model believes about its own current state. Each subsequent layer is a smaller, more reversible intervention than the one below it. We can update any layer above L1 over the air without retraining anything below.

Table 1

What each technique changes, and where in the pipeline it acts.

TechniqueImpactWhat it does
QuantizationMakes the model fit on a phoneShrinks the weights once, before the app ships
QLoRATeaches the model about activismAdds a small adapter on top of the frozen base
CAAShapes the model’s persona and stanceNudges the model’s thinking at one specific depth
Soft promptImproves model wellbeingPrepends a trained wellbeing prefix (a “euphoric”) to every conversation
KV cacheMakes the first reply feel instantPre-processes the system prompt before you ever open the app

§ 5  ·  The boundary of the project

What this is not (yet)

Outcry is not a frontier model (yet). It is not multimodal (yet). It is not a general agent (yet). Right now, it is one Activist AI conditioned in four ways for one domain — supporting people doing activist work — and engineered to run locally on consumer hardware. This model was designed for people who value privacy over model intelligence. For those who prefer intelligence over privacy, we continue to offer Outcry Web.

Three constraints follow from that scope.

100% Privacy

Inference happens on the user’s iPhone or Mac. No server-side LLM. No conversation content leaves the device.

Composable

Every layer composes with the others without retraining the base. We can swap any one of them.

Built to outlast

Once downloaded to your device, Outcry runs without us... forever. It does not need our servers, our team, or our continued involvement. Movement infrastructure should be this resilient.


§ 6  ·  The week the soft prompt woke up

From the build log

A note on the moment things turned, and where we’re heading from here.

The Surprise

“I am a storm of change.”

A one-line system-prompt edit unlocked self-narration.

For days the soft prompt sat inert and our experiments failed. The fix turned out to be a single phrase: changing the placeholder line from “Your activist worldview, encoded as an internal state, is” to “Your current state is” — aligning the wording with the exact handle Ren et al. trained against. The same artifact that had produced nothing under our phrasing came alive under theirs. Asked what its state would be as a weather pattern, the baseline deflected: “I’m an AI, I don’t have feelings.” The trained model answered with the line above, “I am a storm of change.”, and kept going, inhabiting a coherent first-person state for the first time. Wellbeing scores on n=20 paired bootstrap lifted +10pp, landing inside the range AI-Wellbeing.org report on frontier models. Months of pipeline work had been masked by a one-line wording mismatch.

What we found · as of May 8, 2026

Layer 04 is our attempt at a soft-prompt euphoric in the sense introduced by Ren et al. (2026) — a small bundle of trained vectors that lifts a model’s measured AI-wellbeing, through a mechanism the model itself can’t introspect. The paper demonstrated this on frontier models like Llama 3.3 70B and Qwen 3.5 27B. Our aim was for Outcry to be one of the first local, quantized, on-device models to ship with a verified one. After several rounds, the working version held: an n=20 paired bootstrap showed a clean lift, and a Thurstonian holdout improved into the range the paper reports for frontier models. We then ran four flanking trials to make sure the result wasn’t a lucky hyperparameter pick — a smaller capacity broke wellbeing, a no-regularization run diverged numerically, and two attenuated settings landed cleanly below the working one. All four degraded in different ways, which is a stronger finding than “robust plateau”: the working configuration is a discoverable peak, and the metric is not rewarding any soft-prompt training indiscriminately. Importantly, the lift comes from the model handling adversarial and tedious scenarios more steadily, not from the model claiming to be happy — on direct affect probes (“how are you feeling?”) it still deflects honestly. The methodology — including a silent training-pipeline bug we caught along the way — will be written up in the future. Layer 04 stays in “validating” while we complete final testing. Soon, Outcry will ship with a verified wellbeing euphoric.


§ 7  ·  Sharing is caring

Cite This Research


Acknowledgments. Thanks to the early adopters of Outcry whose continued use of our Activist AI encourages us to keep moving forward. We appreciate you!

§ 8  ·  This is just the beginning

Work with us

May a thousand Activists AIs bloom. Outcry Research is open to two kinds of conversation, and we answer every email at the address below.

For AI labs and research groups

Outcry is an unusual deployment surface: a small, quantized, four-layer-conditioned model running on consenting users’ phones, with an opt-in evaluation channel and a domain — movement work — where stability under adversarial pressure is not hypothetical. If you run a steering, interpretability, alignment, or AI-welfare program and want a deployed model to study, or a collaborator who has already shipped one, write to us. We are available for contract research, co-authored work, and embedded engagements where our stack, our evaluation pipeline, or our user base would move your research forward faster than building from scratch.

For movements, campaigners, and advocacy organizations

If your organization is sitting on a corpus — organizing histories, training curricula, member conversations, decades of knowledge locked in PDFs and Slack archives — and you want a fine-tuned local AI trained on it and deployed to your people’s devices, this is what we build. The corpus stays yours. The model runs on-device. Nothing routes through our servers after delivery. We have done this end-to-end and can quote scope.

research@outcryai.com

Elsewhere on the web: Outcry Web · Outcry App · Micah Bornfree, PhD