惯性聚合 高效追踪和阅读你感兴趣的博客、新闻、科技资讯
阅读原文 在惯性聚合中打开

推荐订阅源

WordPress大学
WordPress大学
A
About on SuperTechFans
小众软件
小众软件
Hugging Face - Blog
Hugging Face - Blog
奇客Solidot–传递最新科技情报
奇客Solidot–传递最新科技情报
博客园 - 叶小钗
博客园 - 聂微东
博客园 - Franky
Apple Machine Learning Research
Apple Machine Learning Research
罗磊的独立博客
量子位
博客园 - 三生石上(FineUI控件)
Recent Announcements
Recent Announcements
The GitHub Blog
The GitHub Blog
B
Blog RSS Feed
T
The Blog of Author Tim Ferriss
GbyAI
GbyAI
云风的 BLOG
云风的 BLOG
Last Week in AI
Last Week in AI
宝玉的分享
宝玉的分享
B
Blog
钛媒体:引领未来商业与生活新知
钛媒体:引领未来商业与生活新知
Stack Overflow Blog
Stack Overflow Blog
Cyber Security Advisories - MS-ISAC
Cyber Security Advisories - MS-ISAC

Recent Commits to openclaw:main

test: merge chat side-result checks · openclaw/openclaw@ddd2c2a test: merge cron history checks · openclaw/openclaw@f7eb746 test: merge responsive navigation shell checks · openclaw/openclaw@c2e4b47 docs(changelog): add codex oauth fixes · openclaw/openclaw@628e6cd test: merge navigation routing cases · openclaw/openclaw@5d8cecb Tests: mock channel registry bundled fallback · openclaw/openclaw@2b08233 Secrets: avoid broad web search discovery for single plugin config · openclaw/openclaw@a464f59 test: merge config view browser checks · openclaw/openclaw@20cf511 fix(status): align oauth health with runtime · openclaw/openclaw@eed7116 feat: add macOS screen snapshots for monitor preview (#67954) thanks … · openclaw/openclaw@f377db1 fix: report shared auth scopes in hello-ok (#67810) thanks @BunsDev · openclaw/openclaw@0b6c39b Auto-reply: avoid eager bundled route fallback · openclaw/openclaw@3ea1bf4 Tests: narrow session binding contract setup · openclaw/openclaw@54e4e16 fix(macOS): enable undo/redo in webchat composer text input (#34962) · openclaw/openclaw@00951dc Tests: speed up channel setup promotion · openclaw/openclaw@82b529a Docs: refresh agent instructions · openclaw/openclaw@5775fe2 fix(auth): serialize OAuth refresh across agents to fix #26322 (#67876) · openclaw/openclaw@8e79080 test: allow ollama public surface boundary test · openclaw/openclaw@7d4f1a6 Docs: add test performance guardrails · openclaw/openclaw@89706d3 Tests: restore context-engine usage proof · openclaw/openclaw@e4c4f95 Tests: slim context engine runtime coverage · openclaw/openclaw@74c198f ci: retry failed custom checkouts · openclaw/openclaw@0ee5baf test: trim duplicate provider auth onboarding cases · openclaw/openclaw@1ffc02e matrix: fix sessions_spawn --thread subagent session spawning (#67643) · openclaw/openclaw@1ce2596 test: reduce auth choice fixture churn · openclaw/openclaw@857b9cd test: mock health status config boundaries · openclaw/openclaw@9d5ab4a test: mock onboard config io boundary · openclaw/openclaw@299694d test: mock legacy state plugin boundaries · openclaw/openclaw@2713089 test: mock channel install boundaries · openclaw/openclaw@b945248 test: mock doctor preview channel boundaries · openclaw/openclaw@b1a3ad4
fix(sessions): estimate local transcript usage · openclaw...
giodl73-repo · 2026-05-16 · via Recent Commits to openclaw:main
AI 总结

该文章是 openclaw/openclaw 仓库中一个 commit 的代码变更摘要,commit 标题为 "fix(sessions): estimate local transcript usage",对应哈希 2c59ea8。变更的核心目的是在会话模块中增加对本地转录使用量的估算功能。

  1. 新增了两个函数:extractTranscriptContentEstimatedCharsextractTranscriptTokenEstimateFromLine。前者用于估算字符串或数组内容的字符数:若为字符串则移除内联指令标签后调用 estimateStringChars;若为数组则遍历每个对象元素,检查 text 属性和 type(需为 "text"、"output_text" 或 "input_text"),对符合条件的文本累加估算字符数。后者从单行转录记录中提取 token 估算:若行过大则返回 null;解析 JSON 后提取 message 字段,要求 role 为 "user" 或 "assistant";获取 provider 信息;增加过滤条件,当角色为 "assistant"、模型提供商为 "openclaw" 且模型名为 "delivery-mirror" 时返回 null;通过 extractTranscriptContentEstimatedChars 估算字符数,若字符数不大于 0 也返回 null;最终返回包含 estimatedCharshasModelIdentity 的对象。

  2. 修改了 extractAggregateUsageFromTranscriptLines 函数:循环中调用新函数,引入变量 estimatedTranscriptCharssawEstimatedTranscriptContentsawEstimateModelIdentity,累加估算字符并标记是否遇到估算内容及模型身份。

  3. 条件性地使用估算结果:生成最终 snapshot 对象时,若 snapshot.totalTokens 不是数字且 saveEstimatedTranscriptContentsawEstimateModelIdentity 都为真,则调用 estimateTokensFromChars 将累积字符数转换为估算 token 数,填入 snapshot.totalTokens 并标记为新鲜估算。

整体来看,本次提交为会话模块引入了基于本地文本内容的字符和 token 估算能力,通过分析 transcript 行中的消息类型和文本部分,实现更准确的使用量统计,并包含对特定模型 (delivery-mirror) 的过滤逻辑。

@@ -5,6 +5,7 @@ import { jsonUtf8Bytes } from "../infra/json-utf8-bytes.js";

55

import { hasInterSessionUserProvenance } from "../sessions/input-provenance.js";

66

import { extractAssistantVisibleText } from "../shared/chat-message-content.js";

77

import { normalizeLowercaseStringOrEmpty } from "../shared/string-coerce.js";

8+

import { estimateStringChars, estimateTokensFromChars } from "../utils/cjk-chars.js";

89

import { stripInlineDirectiveTagsForDisplay } from "../utils/directive-tags.js";

910

import { extractToolCallNames, hasToolCall } from "../utils/transcript-tools.js";

1011

import { stripEnvelope } from "./chat-sanitize.js";

@@ -1159,6 +1160,85 @@ function resolvePositiveUsageNumber(value: unknown): number | undefined {

11591160

return typeof value === "number" && Number.isFinite(value) && value > 0 ? value : undefined;

11601161

}

116111621163+

function extractTranscriptContentEstimatedChars(content: unknown): number {

1164+

if (typeof content === "string") {

1165+

const normalized = stripInlineDirectiveTagsForDisplay(content).text.trim();

1166+

return normalized ? estimateStringChars(normalized) : 0;

1167+

}

1168+

if (!Array.isArray(content)) {

1169+

return 0;

1170+

}

1171+

let chars = 0;

1172+

for (const part of content) {

1173+

if (!part || typeof part !== "object" || Array.isArray(part)) {

1174+

continue;

1175+

}

1176+

const record = part as Record<string, unknown>;

1177+

if (typeof record.text !== "string") {

1178+

continue;

1179+

}

1180+

const type = typeof record.type === "string" ? record.type : "text";

1181+

if (type !== "text" && type !== "output_text" && type !== "input_text") {

1182+

continue;

1183+

}

1184+

const normalized = stripInlineDirectiveTagsForDisplay(record.text).text.trim();

1185+

if (normalized) {

1186+

chars += estimateStringChars(normalized);

1187+

}

1188+

}

1189+

return chars;

1190+

}

1191+1192+

function extractTranscriptTokenEstimateFromLine(line: string): {

1193+

estimatedChars: number;

1194+

hasModelIdentity: boolean;

1195+

} | null {

1196+

if (isOversizedTranscriptLine(line)) {

1197+

return null;

1198+

}

1199+

try {

1200+

const parsed = JSON.parse(line) as Record<string, unknown>;

1201+

const message =

1202+

parsed.message && typeof parsed.message === "object" && !Array.isArray(parsed.message)

1203+

? (parsed.message as Record<string, unknown>)

1204+

: undefined;

1205+

if (!message) {

1206+

return null;

1207+

}

1208+

const role = typeof message.role === "string" ? message.role : undefined;

1209+

if (role !== "user" && role !== "assistant") {

1210+

return null;

1211+

}

1212+

const modelProvider =

1213+

typeof message.provider === "string"

1214+

? message.provider.trim()

1215+

: typeof parsed.provider === "string"

1216+

? parsed.provider.trim()

1217+

: undefined;

1218+

const model =

1219+

typeof message.model === "string"

1220+

? message.model.trim()

1221+

: typeof parsed.model === "string"

1222+

? parsed.model.trim()

1223+

: undefined;

1224+

const isDeliveryMirror =

1225+

role === "assistant" && modelProvider === "openclaw" && model === "delivery-mirror";

1226+

if (isDeliveryMirror) {

1227+

return null;

1228+

}

1229+

const contentChars = extractTranscriptContentEstimatedChars(message.content);

1230+

if (contentChars <= 0) {

1231+

return null;

1232+

}

1233+

return {

1234+

estimatedChars: contentChars,

1235+

hasModelIdentity: role === "assistant" && Boolean(modelProvider || model),

1236+

};

1237+

} catch {

1238+

return null;

1239+

}

1240+

}

1241+11621242

function extractUsageSnapshotFromTranscriptLine(

11631243

line: string,

11641244

): SessionTranscriptUsageSnapshot | null {

@@ -1261,8 +1341,17 @@ function extractAggregateUsageFromTranscriptLines(

12611341

let sawCacheWrite = false;

12621342

let costUsdTotal = 0;

12631343

let sawCost = false;

1344+

let estimatedTranscriptChars = 0;

1345+

let sawEstimatedTranscriptContent = false;

1346+

let sawEstimateModelIdentity = false;

1264134712651348

for (const line of lines) {

1349+

const estimate = extractTranscriptTokenEstimateFromLine(line);

1350+

if (estimate) {

1351+

estimatedTranscriptChars += estimate.estimatedChars;

1352+

sawEstimatedTranscriptContent = true;

1353+

sawEstimateModelIdentity ||= estimate.hasModelIdentity;

1354+

}

12661355

const current = extractUsageSnapshotFromTranscriptLine(line);

12671356

if (!current) {

12681357

continue;

@@ -1318,6 +1407,17 @@ function extractAggregateUsageFromTranscriptLines(

13181407

if (sawCost) {

13191408

snapshot.costUsd = costUsdTotal;

13201409

}

1410+

if (

1411+

typeof snapshot.totalTokens !== "number" &&

1412+

sawEstimatedTranscriptContent &&

1413+

sawEstimateModelIdentity

1414+

) {

1415+

const estimatedTotalTokens = estimateTokensFromChars(estimatedTranscriptChars);

1416+

if (estimatedTotalTokens > 0) {

1417+

snapshot.totalTokens = estimatedTotalTokens;

1418+

snapshot.totalTokensFresh = true;

1419+

}

1420+

}

13211421

return snapshot;

13221422

}

13231423