Blazing-fast WebGPU runtime · Open Source
The fastest runtime for the web. Run models right in the browser, zero install, and zero dependencies. Build games, agents, vision, and chat. Add a secure cloud gateway when you need it, all from one client.
Open sourceZero installLocal + gateway
SippPink Lemonade Ed.
Serving size: 1 Sipp Client
Amount per pour
% Dev Value
$ npm install @sipphq/sipp
Ingredients
WebGPU · WASM · Rust · C++ · GGUF · TypeScript · 100% real tokens. Contains no frameworks, no concentrate, no added sugar.
Taste test
Manage and query multiple inference endpoints through a single, unified API. Switch or split traffic between local browser execution and cloud gateways without rewriting your code.
Benchmark · WebGPU showdown
Sipp's WebGPU backend runs the same weights up to 5× faster than other browser runtimes. No native install. Pick a model and watch the multipliers stack up.
Measured on Qwen 2.5 0.5B · Q4_K_M. LILO · 1024 in / 512 out · NVIDIA 3080 · Chrome (N=3, 9 runs, 1 warmup). Multipliers show how many times faster Sipp runs vs each browser runtime.
Live demo · Fresh squeeze
A bare-bones chat running 100% in your browser. Pick a model, start the tap, and then chat. No account, no server.
Built with Sipp · 100% in-browser
Real apps running real models with Sipp. No servers, no install, no waiting. Every one runs the model right in your browser.
Mobile support is currently being worked on. Try demos on desktop.
🪄Desktop only
A wizard duel where every spell is generated on the fly by a local LLM. No two casts the same.
Desktop only
🪄Live demo
A wizard duel where every spell is generated on the fly by a local LLM. No two casts the same.
Play in browser ›
🍌Desktop only
A swarm of little agents reason in-browser, each running a local model to pick its next move, all fighting for one banana.
Desktop only
🍌Live demo
A swarm of little agents reason in-browser, each running a local model to pick its next move, all fighting for one banana.
Play in browser ›
🎨Desktop only
Draw something and a local vision model snapshots the canvas, reads it, and gives you live feedback.
Desktop only
🎨Live demo
Draw something and a local vision model snapshots the canvas, reads it, and gives you live feedback.
Play in browser ›
💬Desktop only
Chat with a VRM character whose emotes, actions, and replies are all chosen live by a local model.
Desktop only
💬Live demo
Chat with a VRM character whose emotes, actions, and replies are all chosen live by a local model.
Play in browser ›
Fresh batch ready
Install Sipp, run a model in your browser on WebGPU, then scale to Node, Rust, Python, or your own gateway.
此内容由惯性聚合(RSS阅读器)自动聚合整理，仅供阅读参考。 原文来自 — 版权归原作者所有。
