惯性聚合 高效追踪和阅读你感兴趣的博客、新闻、科技资讯
阅读原文 在惯性聚合中打开

推荐订阅源

Recent Announcements
Recent Announcements
人人都是产品经理
人人都是产品经理
月光博客
月光博客
博客园 - 三生石上(FineUI控件)
GbyAI
GbyAI
博客园 - 司徒正美
美团技术团队
Vercel News
Vercel News
IT之家
IT之家
U
Unit 42
Y
Y Combinator Blog
罗磊的独立博客
Microsoft Security Blog
Microsoft Security Blog
MongoDB | Blog
MongoDB | Blog
Jina AI
Jina AI
V
Visual Studio Blog
B
Blog
钛媒体:引领未来商业与生活新知
钛媒体:引领未来商业与生活新知
MyScale Blog
MyScale Blog
博客园 - 叶小钗
A
About on SuperTechFans
WordPress大学
WordPress大学
Hugging Face - Blog
Hugging Face - Blog
B
Blog RSS Feed

Recent Commits to openclaw:main

test: merge chat side-result checks · openclaw/openclaw@ddd2c2a test: merge cron history checks · openclaw/openclaw@f7eb746 test: merge responsive navigation shell checks · openclaw/openclaw@c2e4b47 docs(changelog): add codex oauth fixes · openclaw/openclaw@628e6cd test: merge navigation routing cases · openclaw/openclaw@5d8cecb Tests: mock channel registry bundled fallback · openclaw/openclaw@2b08233 Secrets: avoid broad web search discovery for single plugin config · openclaw/openclaw@a464f59 test: merge config view browser checks · openclaw/openclaw@20cf511 fix(status): align oauth health with runtime · openclaw/openclaw@eed7116 feat: add macOS screen snapshots for monitor preview (#67954) thanks … · openclaw/openclaw@f377db1 fix: report shared auth scopes in hello-ok (#67810) thanks @BunsDev · openclaw/openclaw@0b6c39b Auto-reply: avoid eager bundled route fallback · openclaw/openclaw@3ea1bf4 Tests: narrow session binding contract setup · openclaw/openclaw@54e4e16 fix(macOS): enable undo/redo in webchat composer text input (#34962) · openclaw/openclaw@00951dc Tests: speed up channel setup promotion · openclaw/openclaw@82b529a Docs: refresh agent instructions · openclaw/openclaw@5775fe2 fix(auth): serialize OAuth refresh across agents to fix #26322 (#67876) · openclaw/openclaw@8e79080 test: allow ollama public surface boundary test · openclaw/openclaw@7d4f1a6 Docs: add test performance guardrails · openclaw/openclaw@89706d3 Tests: restore context-engine usage proof · openclaw/openclaw@e4c4f95 Tests: slim context engine runtime coverage · openclaw/openclaw@74c198f ci: retry failed custom checkouts · openclaw/openclaw@0ee5baf test: trim duplicate provider auth onboarding cases · openclaw/openclaw@1ffc02e matrix: fix sessions_spawn --thread subagent session spawning (#67643) · openclaw/openclaw@1ce2596 test: reduce auth choice fixture churn · openclaw/openclaw@857b9cd test: mock health status config boundaries · openclaw/openclaw@9d5ab4a test: mock onboard config io boundary · openclaw/openclaw@299694d test: mock legacy state plugin boundaries · openclaw/openclaw@2713089 test: mock channel install boundaries · openclaw/openclaw@b945248 test: mock doctor preview channel boundaries · openclaw/openclaw@b1a3ad4
test(qa-lab): add bus tool trace scenario · openclaw/open...
vincentkoc · 2026-05-22 · via Recent Commits to openclaw:main
Original file line numberDiff line numberDiff line change

@@ -19,6 +19,7 @@ Docs: https://docs.openclaw.ai

1919

- Dependencies: refresh provider, plugin, UI, and tooling packages, update `protobufjs` to 8.4.0 to clear the current npm advisory, and carry the Claude ACP completion patch forward to `@agentclientprotocol/claude-agent-acp` 0.36.1.

2020

- Agents/tools: remove the old sender-owner tool gating path so configured tools stay visible for trusted sessions while command and channel-action auth still carry real sender identity.

2121

- QA-Lab: add curated mock JSONL replay fixtures and first-drift reporting for runtime-parity audits. (#80323, refs #80176) Thanks @100yenadmin.

22+

- QA-Lab: add a QA bus tool-trace visibility scenario for sanitized tool-call assertions.

2223

- QA-Lab: replace generic evidence framing in seeded scenario prompts with concrete observed QA behavior.

2324

- QA-Lab: list live transport lane membership in the coverage report so real transport checks stay separate from seeded qa-channel scenarios.

2425

- QA-Lab: include the optional 100-turn runtime parity soak in release-soak artifacts so long-run Codex/Pi transcript drift stays visible outside the default gate. (#80395) Thanks @100yenadmin.

Original file line numberDiff line numberDiff line change

@@ -202,6 +202,27 @@ describe("qa scenario catalog", () => {

202202

expect(readQaScenarioById("long-context-progress-watchdog").gatewayConfigPatch).toBeUndefined();

203203

});

204204
205+

it("loads the QA bus tool trace visibility harness scenario", () => {

206+

const scenario = readQaScenarioById("qa-bus-tool-trace-visibility");

207+

const config = readQaScenarioExecutionConfig(scenario.id) as

208+

| {

209+

expectedToolName?: string;

210+

expectedRedaction?: string;

211+

searchQuery?: string;

212+

}

213+

| undefined;

214+
215+

expect(scenario.sourcePath).toBe("qa/scenarios/runtime/qa-bus-tool-trace-visibility.md");

216+

expect(scenario.coverage?.primary).toContain("harness.tool-trace-visibility");

217+

expect(scenario.coverage?.secondary).toContain("runtime.qa-bus");

218+

expect(config?.expectedToolName).toBe("exec");

219+

expect(config?.expectedRedaction).toBe("[redacted]");

220+

expect(config?.searchQuery).toBe("exec");

221+

expect(scenario.execution.flow?.steps.map((step) => step.name)).toEqual([

222+

"preserves searchable sanitized tool-call traces",

223+

]);

224+

});

225+
205226

it("loads the opt-in update.run package self-upgrade sentinel", () => {

206227

const scenario = readQaScenarioById("update-run-package-self-upgrade");

207228

const config = readQaScenarioExecutionConfig(scenario.id) as

Original file line numberDiff line numberDiff line change

@@ -0,0 +1,69 @@

1+

# QA bus tool trace visibility

2+
3+

```yaml qa-scenario

4+

id: qa-bus-tool-trace-visibility

5+

title: QA bus tool trace visibility

6+

surface: harness

7+

coverage:

8+

primary:

9+

- harness.tool-trace-visibility

10+

secondary:

11+

- runtime.qa-bus

12+

- tools.trace

13+

objective: Verify QA-Lab can assert sanitized tool-call traces directly on bus messages.

14+

successCriteria:

15+

- QA bus messages can carry a toolCalls array.

16+

- Readback preserves the tool name while redacting sensitive argument values.

17+

- QA bus search can locate the message by tool name.

18+

docsRefs:

19+

- docs/help/testing.md

20+

- qa/scenarios/index.md

21+

codeRefs:

22+

- extensions/qa-lab/src/bus-state.ts

23+

- extensions/qa-lab/src/bus-queries.ts

24+

- extensions/qa-lab/src/runtime-api.ts

25+

execution:

26+

kind: flow

27+

summary: Add a synthetic tool-backed bus message and verify sanitized trace assertions.

28+

config:

29+

expectedToolName: exec

30+

expectedRedaction: "[redacted]"

31+

searchQuery: exec

32+

```

33+
34+

```yaml qa-flow

35+

steps:

36+

- name: preserves searchable sanitized tool-call traces

37+

actions:

38+

- call: reset

39+

- call: state.addOutboundMessage

40+

saveAs: outbound

41+

args:

42+

- to: dm:qa-operator

43+

text: qa bus tool trace check

44+

toolCalls:

45+

- name:

46+

expr: config.expectedToolName

47+

arguments:

48+

command: pwd

49+

apiToken: qa-secret-token

50+

- set: readback

51+

value:

52+

expr: "state.readMessage({ messageId: outbound.id })"

53+

- assert:

54+

expr: "readback.toolCalls?.[0]?.name === config.expectedToolName"

55+

message:

56+

expr: "`expected tool name ${config.expectedToolName}, got ${String(readback.toolCalls?.[0]?.name ?? '')}`"

57+

- assert:

58+

expr: "readback.toolCalls?.[0]?.arguments?.command === config.expectedRedaction && readback.toolCalls?.[0]?.arguments?.apiToken === config.expectedRedaction"

59+

message:

60+

expr: "`expected redacted tool arguments, got ${JSON.stringify(readback.toolCalls?.[0]?.arguments ?? null)}`"

61+

- set: searchMatches

62+

value:

63+

expr: "state.searchMessages({ query: config.searchQuery })"

64+

- assert:

65+

expr: "searchMatches.some((message) => message.id === outbound.id)"

66+

message:

67+

expr: "`expected search query ${config.searchQuery} to find ${outbound.id}, got ${JSON.stringify(searchMatches.map((message) => message.id))}`"

68+

detailsExpr: "`${readback.toolCalls?.[0]?.name}:${String(readback.toolCalls?.[0]?.arguments?.command ?? '')}`"

69+

```