惯性聚合 高效追踪和阅读你感兴趣的博客、新闻、科技资讯
阅读原文 在惯性聚合中打开

推荐订阅源

阮一峰的网络日志
阮一峰的网络日志
博客园 - 司徒正美
D
DataBreaches.Net
宝玉的分享
宝玉的分享
奇客Solidot–传递最新科技情报
奇客Solidot–传递最新科技情报
博客园 - 【当耐特】
人人都是产品经理
人人都是产品经理
博客园 - Franky
让小产品的独立变现更简单 - ezindie.com
让小产品的独立变现更简单 - ezindie.com
IT之家
IT之家
博客园 - 三生石上(FineUI控件)
J
Java Code Geeks
腾讯CDC
博客园_首页
The Cloudflare Blog
S
SegmentFault 最新的问题
C
Check Point Blog
美团技术团队
爱范儿
爱范儿
大猫的无限游戏
大猫的无限游戏
Hugging Face - Blog
Hugging Face - Blog
T
The Blog of Author Tim Ferriss
A
About on SuperTechFans
Blog — PlanetScale
Blog — PlanetScale

DEV Community

Authentication Security Deep Dive: From Brute Force to Salted Hashing (With Java Examples) Why AI Systems Don’t Fail — They Drift Spilling beans for how i learn for exam😁"Reinforcement Learning Cheat Sheet" I Replaced Chrome with Safari for AI Browser Automation. Here's What Broke (and What Finally Worked) How Python Borrows Other People's Work The $40 Architecture: Processing 1 Billion API Requests with 99.99% Uptime Vibe Coding: A Workflow Guide (From Zero to SaaS) Most webhook security guides protect the wrong side. The scary part is delivery. Headless CMS for TanStack Start: Build a Blog with Cosmic EU Age Verification App "Hacked in 2 Minutes" — What Actually Happened Comfy Cloud’s delete function does not actually remove files Running AI Models on GPU Cloud Servers: A Beginner Guide Event-driven media intelligence with AWS Step Functions and Bedrock I scored 500 AI prompts across 8 quality dimensions — here's what broke How to Call Google Gemini API from Next.js (Free Tier, No Backend Needed) The Portal Protocol: Reclaiming Human Connection in the Age of AI How to Fix Your Team's Scattered Knowledge Problem With a Self-Hosted Forum Intro to tc Cloud Functors: A Graph-First Mental Model for the Modern Cloud Designing Multi-Tenant Backends With Both Ownership and Team Access I Built a Neumorphic CSS Library with 77+ Components — Here's What I Learned PostgreSQL Performance Optimization: Why Connection Pooling Is Critical at Scale Cómo construí un SaaS multi-rubro para gestionar expensas en Argentina con FastAPI + Vue 3 🚀 I Built an Ethical Hacking Scanner Tool – Open Source Project I Replaced /usage and /context in Claude Code With a Single Statusline A Pythonic Way to Handle Emails (IMAP/SMTP) with Auto-Discovery and AI-Ready Design I Collected 8.9 Million Polymarket Price Points — Here's What I Found About How Markets Really Move EcoTrack AI — Carbon Footprint Tracker & Dashboard Everyone's Using AI. No One Agrees How. 5 self-hosted ebook managers worth trying in 2026 Building Your First AI Agent with LangChain: From Chatbot to Autonomous Assistant
Full-Stack On-Device GUI Agent — Mano-P Model + Cider + A...
Mininglamp · 2026-05-06 · via DEV Community

Full-Stack On-Device GUI Agent — Mano-P Model + Cider + AFK, All Open Source

Introduction

GUI automation (Computer Use Agent) is becoming a key capability in the AI agent ecosystem. However, most existing solutions rely on cloud-based inference — every screenshot captured during task execution must be uploaded to a remote server for visual understanding. This creates significant data privacy concerns, especially in enterprise and security-sensitive environments.

Today, we are officially open-sourcing the Mano-P 1.0-4B local model, the Cider inference acceleration SDK, and Mano-AFK (an end-to-end automated app builder) — bringing a complete on-device GUI agent stack to Apple Silicon.

All screenshots and task data stay on your device. No cloud APIs required.

Mano-P Architecture

What is Mano-P

Mano-P is an open-source GUI-VLA (Vision-Language-Action) agent designed for edge devices. "Mano" means "hand" in Spanish, and "P" stands for Private — we believe individuals and organizations should be able to create their own private AI.

Built on the full Mano technical framework (Mano Technical Report), Mano-P uses a three-stage progressive training pipeline (SFT → Offline RL → Online RL) with a think-act-verify reasoning loop to achieve high-precision GUI understanding and operation.

Benchmark results (Mano-P 1.0-72B):

  • OSWorld (Specialized GUI Agent Models): 58.2% success rate, ranked #1
  • WebRetriever Protocol I: 41.7 NavEval score

OSWorld Benchmark

Mano-P 1.0-4B Local Model

The Mano-P 1.0-4B model runs directly on Apple Silicon devices with no internet connection required.

Hardware Requirements:

  • Apple M4 chip or above (Mac mini / MacBook)
  • 32GB+ unified memory
  • Alternatively: Mano-P compute stick via USB 4.0

Performance (Apple M5 Pro, 64GB RAM):

  • W8A16: Prefill 2.839s, Decode ~80 tokens/s
  • W8A8 (with Cider): Prefill 2.519s, Decode ~79.5 tokens/s
  • ~12.7% prefill speedup with Cider W8A8

Privacy: In local mode, all inference runs on-device via MLX. No screenshots or task descriptions are transmitted over the network.

Download:

Cider — INT8 Activation Quantization SDK for MLX

Cider is an open-source inference acceleration SDK for macOS, built on Apple MLX.

Why Cider Exists

MLX's built-in quantization is weight-only: QuantizedLinear dequantizes weights to FP16 and runs FP16 GEMM. MLX does not provide a true W8A8 inference path where both weights and activations are quantized to INT8 for computation.

Cider fills this gap with custom Metal kernels that implement fused quantize-matmul-dequant primitives, exposed as MLX custom primitives with full lazy evaluation support.

Supported Modes

  • W8A8: INT8 symmetric weights + INT8 per-token activation quantization → TensorOps matmul2d
  • W4A8: INT4 packed weights + INT8 per-token activation quantization → Unpack → TensorOps

Performance (Apple M5 Pro)

End-to-end VLM acceleration: Cider W8A8 achieves 1.4x–2.2x prefill speedup vs MLX native W4A16, while maintaining comparable decode speed.

Compatibility

Cider works with any MLX model, not just Mano-P. It also provides non-invasive compatibility patches for mlx_vlm (verified on v0.4.3), fixing several issues with Qwen3-VL multi-image inference.

Conditional Compilation

INT8 TensorOps C++ extensions build only on Apple M5+. On M4 devices, Cider installs as a pure Python package with is_available() returning False. Use CIDER_FORCE_BUILD=1 to override.

Source: github.com/Mininglamp-AI/cider

Mano-AFK — End-to-End App Builder

Mano-AFK is an automated application construction pipeline powered by Mano-P. From a single natural language description, it autonomously handles:

Requirements clarification → Architecture design → Code generation → Deployment → E2E GUI testing → Bug fixing → Delivering a working application

The E2E testing phase uses Mano-P as the local visual model backend, driving real browsers for GUI automation testing. When tests fail, the system automatically locates defects, fixes code, and re-verifies — forming a complete build-test-fix loop entirely on-device.

CUA Benchmark

Test environment: Mano-P 4B on MacBook Pro M5 (16GB unified memory), 100 tasks across 5 auto-built web applications.

  • W8A16: 58.0% accuracy, avg 6.1 steps, ~1,253 tok/s prefill
  • W8A8 (Cider): 54.0% accuracy, avg 6.93 steps, ~1,453 tok/s prefill

Note: On 16GB devices, W8A8 requires storing both original and INT8 weights, nearly doubling weight memory. Memory pressure may offset prefill gains. We recommend 4GB+ free memory beyond model size for full W8A8 benefit.

Source: github.com/Mininglamp-AI/mano-afk

Getting Started

# Install CLI
brew tap Mininglamp-AI/tap
brew install mano-cua

# Set up local mode
mano-cua check
mano-cua install-sdk
mano-cua install-model

# Run locally
mano-cua run "Open Safari and search Python" --local

Enter fullscreen mode Exit fullscreen mode

Open Source Roadmap

Mano-P follows a phased open-source strategy:

  • Phase 1 (Released): Mano-CUA Skills — for Agent enthusiasts using OpenClaw, Claude Code, etc.
  • Phase 2 (This Release): Local model + Cider SDK — for developers with high security requirements
  • Phase 3 (Coming Soon): Training methods, pruning, and quantization techniques — for developers with custom model training needs

Links


We welcome feedback via GitHub Issues and Discussions. If you're interested in on-device AI, we'd love to hear what you build with Mano-P.

If you find this useful, consider giving us a ⭐ on GitHub — it helps us keep building in the open.