慣性聚合 高效追讀感興趣之博客、新聞、科技資訊
閱原文 以慣性聚合開啟

推薦訂閱源

The GitHub Blog
The GitHub Blog
T
ThreatConnect
C
Check Point Blog
T
The Exploit Database - CXSecurity.com
U
Unit 42
云风的 BLOG
云风的 BLOG
freeCodeCamp Programming Tutorials: Python, JavaScript, Git & More
T
Tenable Blog
博客园 - 叶小钗
D
Docker
T
Threatpost
WordPress大学
WordPress大学
腾讯CDC
I
Intezer
T
Tailwind CSS Blog
Engineering at Meta
Engineering at Meta
D
Darknet – Hacking Tools, Hacker News & Cyber Security
Hugging Face - Blog
Hugging Face - Blog
cs.CV updates on arXiv.org
cs.CV updates on arXiv.org
The Register - Security
The Register - Security
Stack Overflow Blog
Stack Overflow Blog
PCI Perspectives
PCI Perspectives
S
Security Archives - TechRepublic
Simon Willison's Weblog
Simon Willison's Weblog
A
Arctic Wolf
MongoDB | Blog
MongoDB | Blog
小众软件
小众软件
Hacker News: Ask HN
Hacker News: Ask HN
O
OpenAI News
博客园 - 【当耐特】
L
LINUX DO - 最新话题
C
Comments on: Blog
S
Securelist
月光博客
月光博客
S
Secure Thoughts
Security Latest
Security Latest
MyScale Blog
MyScale Blog
NISL@THU
NISL@THU
F
Full Disclosure
M
Microsoft Research Blog - Microsoft Research
T
True Tiger Recordings
SecWiki News
SecWiki News
aimingoo的专栏
aimingoo的专栏
Threat Intelligence Blog | Flashpoint
Threat Intelligence Blog | Flashpoint
L
LINUX DO - 热门话题
cs.AI updates on arXiv.org
cs.AI updates on arXiv.org
AWS News Blog
AWS News Blog
Hacker News - Newest:
Hacker News - Newest: "LLM"
L
Lohrmann on Cybersecurity
H
Help Net Security

cs updates on arXiv.org

HydraPrompt: An Adaptive and Asymmetric Framework of Vision-Language Models for Synthetic Image Detection Geometry-Aware Representation Denoising for Robust Multi-view 3D Reconstruction 3D Gaussian Map with Open-Set Semantic Grouping for Vision-Language Navigation On the Push-Based Asynchronous Federated Learning: A Bias-Correction Aggregation Approach OmniInteract: Benchmarking Real-World Streaming Interaction for Real-Time Omnimodal Assistants CNNs, Transformers, Hybrid, and Vision Language Models for Skin Cancer Detection VesselSim: learning 3D blood vessel segmentation without expert annotations Erased but Exploitable: Black-box Embedding-Aware Prompting Against Unlearned Text-to-Image Diffusion Models VisualNeedle: Benchmarking Active Visual Search in Information-Dense Scenes DuoGesture: Neuro-Inspired and Biomechanically Informed Dual-Stream Co-Speech Gesture Generation RadarSim: Simulating Single-Chip Radar via Multimodal Neural Fields RoMo: A Large-Scale, Richly Organized Dataset and Semantic Taxonomy for Human Motion Generation The Rescue Effect: Spatio-Semantic Early Exit Bypasses Quantization Collapse in CLIP When Rule Violations Are Rare: Chimera Training for Logical Anomaly Detection Detail Consistent Stage-Wise Distillation for Efficient 3D MRI Segmentation Sparse-LiDAR Prompting of Monocular Geometry Foundations: An Empirical Study Toward Long-Range Driving Depth AirCast-SR: A Foundation Model for Kilometer-Scale Atmospheric Super-Resolution via Latent Consistency Diffusion Personalized Generative Models for Contextual Debiasing Cross-scale Aligned Supervision for Training GANs Joint Instance Segmentation and Geometric Attribute Regression for Roof Structures in Aerial Imagery Dimensional Distribution Emotion State: Leveraging Valence and Arousal as a Common Embedding Space for Visual Emotion Analysis TSFMAudit: Data Contamination Auditing in Forecasting Time Series Foundation Models Clinically-Grounded Counterfactual Reasoning for Medical Video Diagnosis Triadic Dynamics Aware Diffusion Posterior Sampling for Inverse Problems: Optimizing Guidance and Stochasticity Schedules Comparative Study of Vision-Based Metric Measurement for Large-Scale Planar Scenes LongAV-Compass: Towards Unified Evaluation of Minute-Scale Audio-Visual Generation Across T2AV, I2AV, and V2AV The Constraint Tax: Measuring Validity-Correctness Tradeoffs in Structured Outputs for Small Language Models SilIF: Silhouette-Augmented Isolation Forest for Unsupervised Transaction Fraud Detection Multi-Modal Building Inspection via Perceiver IO Fusion of Satellite and Street-Level Imagery E$^3$C: Video Generation with 3D Environmental Memory and Ego-Exo Human Pose Control Share More, Search Less: Collaborative Parallel Thinking for Efficient Test-Time Scaling Unveiling the Fragility of Vision-Language Models: Multi-Modal Adversarial Synergy via Texture-Constrained Perturbations and Cross-Modal Optimization Sleep-stage efficient classification using a lightweight self-supervised model Underwater360: Reconstructing Underwater Scenes from Panoramic Images with Omnidirectional Gaussian Splatting Rethinking Weakly-supervised Video Temporal Grounding From a Game Perspective Sentinel: Embodied Cooperative Spatial Reasoning and Planning LongCat-Video-Avatar 1.5 Technical Report GEM: Geometric Entropy Mixing for Optimal LLM Data Curation Uncertainty-Aware Gaussian Map for Vision-Language Navigation Frequency-Guided Fusion For RGB-Thermal Semantic Segmentation BioFact-MoE: Biologically Factorized Mixture of Experts for Vision-Language Prognostic Modeling in Hepatocellular Carcinoma A multifractal-based masked auto-encoder: an application to medical images Benchmarking Convolutional, Transformer, Hybrid, and Vision Language Models for Multi Disease Retinal Screening Unified Panoramic Geometry Estimation via Multi-View Foundation Models Not All Modalities Are Equal: Instruction-Aware Gating for Multimodal Videos OmniGF: A Dual-Branch Vision-Language Framework for Unified Gaze Following Zero-Shot Object Re-Identification in Egocentric Kitchen Videos via Multi-Stage SAM3 Feature Fusion Evi-Steer: Learning to Steer Biomedical Vision-Language Models through Efficient and Generalizable Evidential Tuning Planning Neural Dynamics with Lie Group Embedding through Supervised Projective Manifold Learning AnchorDiff: Training-Free Concept Grounding for MM-DiTs via Anchor-Based Graph Propagation
嵌套键值:长上下文键值缓存压缩之嵌套内存路由
Hong Chen, X · 2026-05-27 · via cs updates on arXiv.org

观PDF HTML(实验性)

摘要:长文语境模型受限于键值(KV)缓存之内存足迹。今有无需训练之KV压缩法,多以一重重要性信号——注意力、时新性、层级分配或键之独特性——排序令牌,然当有用语境具全局独特性、局部叙事性或即时相关性时,此法即显脆弱。吾等创制NestedKV,此键值缓存压缩法,受Nested Learning中连续体记忆系统之启发。NestedKV持存全局、区块级与滑动窗口之键锚,以多时尺度余弦异常评分令牌,并结合作成之排序,与无需训练之外层学习器,用头自适应混合与惊奇门控令牌路由相结合。其分值配以自适应每头预算,无需训练或LLM之修改。于RULER(4k--32k)、LooGLE、LongBench、LongBench-E、InfiniteBench及MMLU-Pro诸任务上,NestedKV于保留缓存甚小时最为强效。于Qwen3-4B模型,当$r=0.75$时,其在RULER上较KeyDiff增19.10分,于LongBench增19.29分;当$r=0.95$时,其在LongBench上保留37.32分,而KeyDiff仅得17.55分。
科目: 计算语言学(cs.CL)
引文格式: arXiv:2605.26678 [cs.CL]
  (或 arXiv:2605.26678v1 [cs.CL]为此版本)
  https://doi.org/10.48550/arXiv.2605.26678

arXiv所发DOI,经DataCite(注册待定)

提交历史

自:洪晨 [查看邮件]
[v1] 周二,公历二六六五年五月二十六日辰时八刻十三分(三九三千字节)