惯性聚合 高效追踪和阅读你感兴趣的博客、新闻、科技资讯
阅读原文 在惯性聚合中打开

推荐订阅源

Martin Fowler
Martin Fowler
Y
Y Combinator Blog
M
MIT News - Artificial intelligence
The Cloudflare Blog
WordPress大学
WordPress大学
H
Hackread – Cybersecurity News, Data Breaches, AI and More
博客园 - 司徒正美
小众软件
小众软件
Blog — PlanetScale
Blog — PlanetScale
雷峰网
雷峰网
奇客Solidot–传递最新科技情报
奇客Solidot–传递最新科技情报
J
Java Code Geeks
云风的 BLOG
云风的 BLOG
C
Check Point Blog
D
DataBreaches.Net
T
The Blog of Author Tim Ferriss
V
V2EX
F
Fortinet All Blogs
B
Blog
大猫的无限游戏
大猫的无限游戏
N
Netflix TechBlog - Medium
B
Blog RSS Feed
A
About on SuperTechFans
Cyber Security Advisories - MS-ISAC
Cyber Security Advisories - MS-ISAC

How does Prompt Caching work?

How does Prompt Caching work? How does Prompt Caching work? How does Prompt Caching work? How does Prompt Caching work? How does Prompt Caching work? How does Prompt Caching work? How does Prompt Caching work? How does Prompt Caching work?
How does Prompt Caching work?
lane · 2024-10-26 · via How does Prompt Caching work?

I honestly don’t understand ALL of the linked thread on prompt caching either 😃 but I provided it to Claude with your questions… Scenario 1: Fewer cached tokens than total Caching starts at 1024 tokens and increases in 128-token blocks Maximum cached tokens will be the largest multiple of 128 that fits your total Example: With 5672 total tokens, you’ll see 5432 cached (42 blocks of 128 + 1024) Scenario 2: Large cache drop with small changes KV cache requires exact prefix matches Eve...