惯性聚合 高效追踪和阅读你感兴趣的博客、新闻、科技资讯
阅读原文 在惯性聚合中打开

推荐订阅源

Martin Fowler
Martin Fowler
Threat Intelligence Blog | Flashpoint
Threat Intelligence Blog | Flashpoint
博客园 - 聂微东
IT之家
IT之家
GbyAI
GbyAI
奇客Solidot–传递最新科技情报
奇客Solidot–传递最新科技情报
Y
Y Combinator Blog
博客园 - 【当耐特】
The Cloudflare Blog
宝玉的分享
宝玉的分享
罗磊的独立博客
钛媒体:引领未来商业与生活新知
钛媒体:引领未来商业与生活新知
让小产品的独立变现更简单 - ezindie.com
让小产品的独立变现更简单 - ezindie.com
V
Visual Studio Blog
小众软件
小众软件
博客园_首页
Last Week in AI
Last Week in AI
J
Java Code Geeks
V
V2EX
雷峰网
雷峰网
Apple Machine Learning Research
Apple Machine Learning Research
阮一峰的网络日志
阮一峰的网络日志
腾讯CDC
博客园 - 司徒正美
Engineering at Meta
Engineering at Meta
The GitHub Blog
The GitHub Blog
H
Hackread – Cybersecurity News, Data Breaches, AI and More
D
DataBreaches.Net
博客园 - 三生石上(FineUI控件)
MyScale Blog
MyScale Blog
云风的 BLOG
云风的 BLOG
The Register - Security
The Register - Security
M
MIT News - Artificial intelligence
Microsoft Azure Blog
Microsoft Azure Blog
T
The Blog of Author Tim Ferriss
N
Netflix TechBlog - Medium
F
Full Disclosure
B
Blog
H
Help Net Security
C
Check Point Blog
WordPress大学
WordPress大学
人人都是产品经理
人人都是产品经理
Cyber Security Advisories - MS-ISAC
Cyber Security Advisories - MS-ISAC
Jina AI
Jina AI
酷 壳 – CoolShell
酷 壳 – CoolShell
Blog — PlanetScale
Blog — PlanetScale
L
LangChain Blog
P
Proofpoint News Feed
D
Docker
Microsoft Security Blog
Microsoft Security Blog

Recent Commits to openclaw:main

test: merge chat side-result checks · openclaw/openclaw@ddd2c2a test: merge cron history checks · openclaw/openclaw@f7eb746 test: merge responsive navigation shell checks · openclaw/openclaw@c2e4b47 docs(changelog): add codex oauth fixes · openclaw/openclaw@628e6cd test: merge navigation routing cases · openclaw/openclaw@5d8cecb Tests: mock channel registry bundled fallback · openclaw/openclaw@2b08233 Secrets: avoid broad web search discovery for single plugin config · openclaw/openclaw@a464f59 test: merge config view browser checks · openclaw/openclaw@20cf511 fix(status): align oauth health with runtime · openclaw/openclaw@eed7116 feat: add macOS screen snapshots for monitor preview (#67954) thanks … · openclaw/openclaw@f377db1 fix: report shared auth scopes in hello-ok (#67810) thanks @BunsDev · openclaw/openclaw@0b6c39b Auto-reply: avoid eager bundled route fallback · openclaw/openclaw@3ea1bf4 Tests: narrow session binding contract setup · openclaw/openclaw@54e4e16 fix(macOS): enable undo/redo in webchat composer text input (#34962) · openclaw/openclaw@00951dc Tests: speed up channel setup promotion · openclaw/openclaw@82b529a Docs: refresh agent instructions · openclaw/openclaw@5775fe2 fix(auth): serialize OAuth refresh across agents to fix #26322 (#67876) · openclaw/openclaw@8e79080 test: allow ollama public surface boundary test · openclaw/openclaw@7d4f1a6 Docs: add test performance guardrails · openclaw/openclaw@89706d3 Tests: restore context-engine usage proof · openclaw/openclaw@e4c4f95 Tests: slim context engine runtime coverage · openclaw/openclaw@74c198f ci: retry failed custom checkouts · openclaw/openclaw@0ee5baf test: trim duplicate provider auth onboarding cases · openclaw/openclaw@1ffc02e matrix: fix sessions_spawn --thread subagent session spawning (#67643) · openclaw/openclaw@1ce2596 test: reduce auth choice fixture churn · openclaw/openclaw@857b9cd test: mock health status config boundaries · openclaw/openclaw@9d5ab4a test: mock onboard config io boundary · openclaw/openclaw@299694d test: mock legacy state plugin boundaries · openclaw/openclaw@2713089 test: mock channel install boundaries · openclaw/openclaw@b945248 test: mock doctor preview channel boundaries · openclaw/openclaw@b1a3ad4 test: trim doctor command hotspots · openclaw/openclaw@c66f16a test: isolate agent auth and spawn hotspots · openclaw/openclaw@9285935 test: stabilize MCP startup disposal race · openclaw/openclaw@dd9d2eb test: merge browser contract server suites · openclaw/openclaw@5817a76 test: narrow ollama provider discovery setup · openclaw/openclaw@a0d9598 build: declare qa-lab aimock runtime dependency · openclaw/openclaw@24431e5 test: speed up safe-bins exec harness · openclaw/openclaw@ee856ab test: preserve tool helpers in embedded runner mocks · openclaw/openclaw@acd86a0 refactor: move memory embeddings into provider plugins · openclaw/openclaw@77e6e4c test: reuse system-run temp fixtures · openclaw/openclaw@7e9ff0f test: trim hotspot wait overhead · openclaw/openclaw@12a59b0 Check: avoid duplicate boundary prep · openclaw/openclaw@baf11b8 test: reduce hotspot fixture overhead · openclaw/openclaw@3a59edd feat(ui): overhaul settings and slash command UX (#67819) thanks @Bun… · openclaw/openclaw@2cfb660 QA Matrix: exit cleanly on failure · openclaw/openclaw@42805d2 QA Matrix: isolate scenario coverage · openclaw/openclaw@7e659e1 Matrix: refresh crypto bootstrap state · openclaw/openclaw@94081d8 QA Lab: add provider registry · openclaw/openclaw@bb7e982 Matrix: add plugin changelog · openclaw/openclaw@4acab55 test: trim more hotspot overhead · openclaw/openclaw@f485311 test: trim remaining hotspot tests · openclaw/openclaw@6ba8626 test: narrow hotspot mocks · openclaw/openclaw@dbc8179 test: isolate gemini embedding request helpers · openclaw/openclaw@cd330f5 test: trim memory and mcp hotspots · openclaw/openclaw@fd48dfa test: slim provider registry mocks · openclaw/openclaw@2e08c77 test: harden Parallels update smoke · openclaw/openclaw@1a98090 feat: default Anthropic to Opus 4.7 · openclaw/openclaw@628b454 fix: harden node-host shell payload mutability checks · openclaw/openclaw@75c551e fix: land node-host approval binding for native binaries (#66731) (th… · openclaw/openclaw@29919bb CI: add daily schedule to CodeQL workflow (#67645) · openclaw/openclaw@69d25f5 fix(gateway): capture config hash after plugin auto-enable to prevent… · openclaw/openclaw@8c11210 fix: repair sanitized replay tool results before send (#67620) (thank… · openclaw/openclaw@c3c7a99 fix: restrict HTML timeout short-circuit to transient statuses · openclaw/openclaw@de129a6 fix: keep TUI watchdog bound to active run (#67401) (thanks @xantorres) · openclaw/openclaw@3525273 Gateway/skills: dedupe skills prefix-match + drop dead fallback on log · openclaw/openclaw@d7f489f Extensions/lmstudio: back off inference preload after consecutive fai… · openclaw/openclaw@b555214 TUI/streaming: add watchdog that resets the activity indicator after … · openclaw/openclaw@f44ab20 Agents/tool-loop: enable unknown-tool stream guard by default · openclaw/openclaw@36ed367 Gateway/skills: invalidate session skills snapshot on config write · openclaw/openclaw@b23d59a fix: classify HTML provider error pages correctly (#67642) (thanks @s… · openclaw/openclaw@e588e90 fix(skills): remove unused model-usage import (#67641) · openclaw/openclaw@55f05df docs(changelog): credit codex fix superseded PRs · openclaw/openclaw@e485f24 fix(openai-codex): normalize stale transport metadata in resolution a… · openclaw/openclaw@90801ba CI: pin Docker-related GitHub Actions (#67632) · openclaw/openclaw@f697b01 Android: modernize WebView and discovery API usage (#67627) · openclaw/openclaw@44a6e50 fix(deps): bump hono to 4.12.14 and @hono/node-server to 1.19.14 (GHS… · openclaw/openclaw@fbccc18 fix(deps): bump dompurify to 3.4.0 (#67614) · openclaw/openclaw@2c2dc00 CI: add explicit permissions to all workflow jobs (fixes code-scannin… · openclaw/openclaw@01b7516 fix: register bundled TTS providers and route overrides correctly (#6… · openclaw/openclaw@6ea3cdd fix: align host tilde paths with OS home (#62804) (thanks @stainlu) · openclaw/openclaw@ecfaf64 fix: flush creds queue before reconnect socket open (#67464) (thanks … · openclaw/openclaw@405c63f fix: strip standalone <function> tool call tags from visible text (#6… · openclaw/openclaw@78df859 fix(agents): preserve cli session metadata before transcript persist … · openclaw/openclaw@898fd04 docs(changelog): move cli transcript entry · openclaw/openclaw@c1817c6 fix(agents): normalize cli transcript api field · openclaw/openclaw@3a3fae0 docs(changelog): note cli transcript persistence · openclaw/openclaw@6c343f1 fix(agents): persist cli transcript turns · openclaw/openclaw@b8ef507 fix(msteams): harden security-sensitive flows (#65841) · openclaw/openclaw@c56b56e [Dashboard] Fix exec approval modal overflow for long command content… · openclaw/openclaw@053c5b0 Docs: remove QA changelog entry · openclaw/openclaw@7fd5771 QA: fix private runtime source loading (#67428) · openclaw/openclaw@d5933af docs(gateway): correct protocol.md schema path, hello-ok example, aut… · openclaw/openclaw@489404d CI: pin Node 22 runners to 22.18.0 · openclaw/openclaw@4ffa621 models.authStatus: normalize provider ids + tighten env-backed escape… · openclaw/openclaw@f2fdb9d Update CHANGELOG.md · openclaw/openclaw@7694a92 test(parallels): clean up npm update guard jobs · openclaw/openclaw@045ea7b Plugins: prefer scanDir override paths · openclaw/openclaw@b2974da fix(dreaming): default storage.mode to "separate" so phase blocks sto… · openclaw/openclaw@8c392f0 fix(memory-core): skip dreaming transcript ingestion via session stor… · openclaw/openclaw@a1b01f0 fix: dedupe replayed exec.finished node events (#67281) · openclaw/openclaw@5dcf526
test: harden plugin update validation · openclaw/openclaw@bcd6499
steipete · 2026-05-02 · via Recent Commits to openclaw:main

@@ -0,0 +1,228 @@

1+

---

2+

summary: "How OpenClaw validates update paths, package migrations, and plugin install/update behavior"

3+

read_when:

4+

- Changing OpenClaw update, doctor, package acceptance, or plugin install behavior

5+

- Preparing or approving a release candidate

6+

- Debugging package update, plugin dependency cleanup, or plugin install regressions

7+

title: "Testing: updates and plugins"

8+

sidebarTitle: "Update and plugin tests"

9+

---

10+11+

This is the dedicated checklist for update and plugin validation. The goal is

12+

simple: prove the installable package can update real user state, repair stale

13+

legacy state through `doctor`, and still install, load, update, and uninstall

14+

plugins from the supported sources.

15+16+

For the broader test runner map, see [Testing](/help/testing). For live provider

17+

keys and network-touching suites, see [Testing live](/help/testing-live).

18+19+

## What we protect

20+21+

Update and plugin tests protect these contracts:

22+23+

- A package tarball is complete, has a valid `dist/postinstall-inventory.json`,

24+

and does not depend on unpacked repo files.

25+

- A user can move from an older published package to the candidate package

26+

without losing config, agents, sessions, workspaces, plugin allowlists, or

27+

channel config.

28+

- `openclaw doctor --fix --non-interactive` owns legacy cleanup and repair

29+

paths. Startup should not grow hidden compatibility migrations for stale

30+

plugin state.

31+

- Plugin installs work from local directories, git repos, npm packages, and the

32+

ClawHub registry path.

33+

- Plugin npm dependencies are installed in the managed npm root, scanned before

34+

trust, and removed through npm during uninstall so hoisted dependencies do not

35+

linger.

36+

- Plugin update is stable when nothing changed: install records, resolved source,

37+

and enabled state stay intact.

38+39+

## Local proof during development

40+41+

Start narrow:

42+43+

```bash

44+

pnpm changed:lanes --json

45+

pnpm check:changed

46+

pnpm test:changed

47+

```

48+49+

For plugin install, uninstall, dependency, or package-inventory changes, also

50+

run the focused tests that cover the edited seam:

51+52+

```bash

53+

pnpm test src/plugins/uninstall.test.ts src/infra/package-dist-inventory.test.ts test/scripts/package-acceptance-workflow.test.ts

54+

```

55+56+

Before any package Docker lane consumes a tarball, prove the package artifact:

57+58+

```bash

59+

pnpm release:check

60+

```

61+62+

`release:check` runs config/docs/API drift checks, writes the package dist

63+

inventory, runs `npm pack --dry-run`, rejects forbidden packed files, installs

64+

the tarball into a temp prefix, runs postinstall, and smokes bundled channel

65+

entrypoints.

66+67+

## Docker lanes

68+69+

The Docker lanes are the product-level proof. They install or update a real

70+

package inside Linux containers and assert behavior through CLI commands,

71+

Gateway startup, HTTP probes, RPC status, and filesystem state.

72+73+

Use focused lanes while iterating:

74+75+

```bash

76+

pnpm test:docker:plugins

77+

pnpm test:docker:plugin-update

78+

pnpm test:docker:upgrade-survivor

79+

pnpm test:docker:published-upgrade-survivor

80+

```

81+82+

Important lanes:

83+84+

- `test:docker:plugins` validates plugin install smoke, local folder installs,

85+

local folders with preinstalled dependencies, git installs with package

86+

dependencies, npm package dependency installs, local ClawHub fixture installs,

87+

marketplace update behavior, and Claude-bundle enable/inspect. Set

88+

`OPENCLAW_PLUGINS_E2E_CLAWHUB=0` to keep the ClawHub block hermetic/offline.

89+

- `test:docker:plugin-update` validates that an unchanged installed plugin does

90+

not reinstall or lose install metadata during `openclaw plugins update`.

91+

- `test:docker:upgrade-survivor` installs the candidate tarball over a dirty

92+

old-user fixture, runs package update plus non-interactive doctor, then starts

93+

a loopback Gateway and checks state preservation.

94+

- `test:docker:published-upgrade-survivor` first installs a published baseline,

95+

configures it through a baked `openclaw config set` recipe, updates it to the

96+

candidate tarball, runs doctor, checks legacy cleanup, starts the Gateway, and

97+

probes `/healthz`, `/readyz`, and RPC status.

98+99+

Useful published-upgrade survivor variants:

100+101+

```bash

102+

OPENCLAW_UPGRADE_SURVIVOR_BASELINE_SPEC=openclaw@2026.4.23 \

103+

OPENCLAW_UPGRADE_SURVIVOR_SCENARIO=versioned-runtime-deps \

104+

pnpm test:docker:published-upgrade-survivor

105+106+

OPENCLAW_UPGRADE_SURVIVOR_BASELINE_SPEC=openclaw@latest \

107+

OPENCLAW_UPGRADE_SURVIVOR_SCENARIO=bootstrap-persona \

108+

pnpm test:docker:published-upgrade-survivor

109+

```

110+111+

Available scenarios are `base`, `feishu-channel`, `bootstrap-persona`,

112+

`tilde-log-path`, and `versioned-runtime-deps`. In aggregate runs,

113+

`OPENCLAW_UPGRADE_SURVIVOR_SCENARIOS=reported-issues` expands to all reported

114+

issue-shaped scenarios.

115+116+

## Package Acceptance

117+118+

Package Acceptance is the GitHub-native package gate. It resolves one candidate

119+

package into a `package-under-test` tarball, records version and SHA-256, then

120+

runs reusable Docker E2E lanes against that exact tarball. The workflow harness

121+

ref is separate from the package source ref, so current test logic can validate

122+

older trusted releases.

123+124+

Candidate sources:

125+126+

- `source=npm`: validate `openclaw@beta`, `openclaw@latest`, or an exact

127+

published version.

128+

- `source=ref`: pack a trusted branch, tag, or commit with the selected current

129+

harness.

130+

- `source=url`: validate an HTTPS tarball with required `package_sha256`.

131+

- `source=artifact`: reuse a tarball uploaded by another Actions run.

132+133+

Release checks call Package Acceptance with the package/update/plugin set:

134+135+

```text

136+

doctor-switch update-channel-switch upgrade-survivor published-upgrade-survivor plugins-offline plugin-update

137+

```

138+139+

They also pass:

140+141+

```text

142+

published_upgrade_survivor_baselines=release-history

143+

published_upgrade_survivor_scenarios=reported-issues

144+

telegram_mode=mock-openai

145+

```

146+147+

This keeps package migration, update channel switching, stale plugin dependency

148+

cleanup, offline plugin coverage, plugin update behavior, and Telegram package

149+

QA on the same resolved artifact.

150+151+

Run a package profile manually when validating a candidate before release:

152+153+

```bash

154+

gh workflow run package-acceptance.yml \

155+

--ref main \

156+

-f workflow_ref=main \

157+

-f source=npm \

158+

-f package_spec=openclaw@beta \

159+

-f suite_profile=package \

160+

-f published_upgrade_survivor_baselines=release-history \

161+

-f published_upgrade_survivor_scenarios=reported-issues \

162+

-f telegram_mode=mock-openai

163+

```

164+165+

Use `suite_profile=product` when the release question includes MCP channels,

166+

cron/subagent cleanup, OpenAI web search, or OpenWebUI. Use `suite_profile=full`

167+

only when you need full Docker release-path coverage.

168+169+

## Release default

170+171+

For release candidates, the default proof stack is:

172+173+

1. `pnpm check:changed` and `pnpm test:changed` for source-level regressions.

174+

2. `pnpm release:check` for package artifact integrity.

175+

3. Package Acceptance `package` profile or the release-check custom package

176+

lanes for install/update/plugin contracts.

177+

4. Cross-OS release checks for OS-specific installer, onboarding, and platform

178+

behavior.

179+

5. Live suites only when the changed surface touches provider or hosted-service

180+

behavior.

181+182+

On maintainer machines, broad gates and Docker/package product proof should run

183+

in Testbox unless explicitly doing local proof.

184+185+

## Legacy compatibility

186+187+

Compatibility leniency is narrow and time boxed:

188+189+

- Packages through `2026.4.25`, including `2026.4.25-beta.*`, may tolerate

190+

already-shipped package metadata gaps in Package Acceptance.

191+

- The published `2026.4.26` package may warn for local build metadata stamp

192+

files already shipped.

193+

- Later packages must satisfy modern contracts. The same gaps fail instead of

194+

warning or skipping.

195+196+

Do not add new startup migrations for these old shapes. Add or extend a doctor

197+

repair, then prove it with `upgrade-survivor` or `published-upgrade-survivor`.

198+199+

## Adding coverage

200+201+

When changing update or plugin behavior, add coverage at the lowest layer that

202+

can fail for the right reason:

203+204+

- Pure path or metadata logic: unit test beside the source.

205+

- Package inventory or packed-file behavior: `package-dist-inventory` or tarball

206+

checker test.

207+

- CLI install/update behavior: Docker lane assertion or fixture.

208+

- Published-release migration behavior: `published-upgrade-survivor` scenario.

209+

- Registry/package source behavior: `test:docker:plugins` fixture or ClawHub

210+

fixture server.

211+212+

Keep new Docker fixtures hermetic by default. Use local fixture registries and

213+

fake packages unless the point of the test is live registry behavior.

214+215+

## Failure triage

216+217+

Start with the artifact identity:

218+219+

- Package Acceptance `resolve_package` summary: source, version, SHA-256, and

220+

artifact name.

221+

- Docker artifacts: `.artifacts/docker-tests/**/summary.json`,

222+

`failures.json`, lane logs, and rerun commands.

223+

- Upgrade survivor summary: `.artifacts/upgrade-survivor/summary.json`,

224+

including baseline version, candidate version, scenario, phase timings, and

225+

recipe steps.

226+227+

Prefer rerunning the failed exact lane with the same package artifact over

228+

rerunning the whole release umbrella.