The Brain That Goes Quiet: Serving a Large Model's Knowledge at 131 Tokens per Second on an 8 GB Laptop by Removing the Large Model from the Runtime Path
[Submitted on 10 Jun 2026]
·
2026-06-11
·
via cs updates on arXiv.org
arXiv:2606.12154v1 Announce Type: new Abstract: In earlier work I showed that a 35B-class Mixture-of-Experts …
此内容由惯性聚合(RSS阅读器)自动聚合整理,仅供阅读参考。 原文来自 — 版权归原作者所有。