惯性聚合 高效追踪和阅读你感兴趣的博客、新闻、科技资讯
阅读原文 在惯性聚合中打开

推荐订阅源

A
About on SuperTechFans
Y
Y Combinator Blog
钛媒体:引领未来商业与生活新知
钛媒体:引领未来商业与生活新知
Microsoft Security Blog
Microsoft Security Blog
aimingoo的专栏
aimingoo的专栏
I
InfoQ
C
Check Point Blog
IT之家
IT之家
MyScale Blog
MyScale Blog
Apple Machine Learning Research
Apple Machine Learning Research
Vercel News
Vercel News
Last Week in AI
Last Week in AI
GbyAI
GbyAI
P
Proofpoint News Feed
量子位
Stack Overflow Blog
Stack Overflow Blog
Microsoft Azure Blog
Microsoft Azure Blog
月光博客
月光博客
阮一峰的网络日志
阮一峰的网络日志
人人都是产品经理
人人都是产品经理
B
Blog
T
The Blog of Author Tim Ferriss
H
Help Net Security
云风的 BLOG
云风的 BLOG

Recent Commits to openclaw:main

test: merge chat side-result checks · openclaw/openclaw@ddd2c2a test: merge cron history checks · openclaw/openclaw@f7eb746 test: merge responsive navigation shell checks · openclaw/openclaw@c2e4b47 docs(changelog): add codex oauth fixes · openclaw/openclaw@628e6cd test: merge navigation routing cases · openclaw/openclaw@5d8cecb Tests: mock channel registry bundled fallback · openclaw/openclaw@2b08233 Secrets: avoid broad web search discovery for single plugin config · openclaw/openclaw@a464f59 test: merge config view browser checks · openclaw/openclaw@20cf511 fix(status): align oauth health with runtime · openclaw/openclaw@eed7116 feat: add macOS screen snapshots for monitor preview (#67954) thanks … · openclaw/openclaw@f377db1 fix: report shared auth scopes in hello-ok (#67810) thanks @BunsDev · openclaw/openclaw@0b6c39b Auto-reply: avoid eager bundled route fallback · openclaw/openclaw@3ea1bf4 Tests: narrow session binding contract setup · openclaw/openclaw@54e4e16 fix(macOS): enable undo/redo in webchat composer text input (#34962) · openclaw/openclaw@00951dc Tests: speed up channel setup promotion · openclaw/openclaw@82b529a Docs: refresh agent instructions · openclaw/openclaw@5775fe2 fix(auth): serialize OAuth refresh across agents to fix #26322 (#67876) · openclaw/openclaw@8e79080 test: allow ollama public surface boundary test · openclaw/openclaw@7d4f1a6 Docs: add test performance guardrails · openclaw/openclaw@89706d3 Tests: restore context-engine usage proof · openclaw/openclaw@e4c4f95 Tests: slim context engine runtime coverage · openclaw/openclaw@74c198f ci: retry failed custom checkouts · openclaw/openclaw@0ee5baf test: trim duplicate provider auth onboarding cases · openclaw/openclaw@1ffc02e matrix: fix sessions_spawn --thread subagent session spawning (#67643) · openclaw/openclaw@1ce2596 test: reduce auth choice fixture churn · openclaw/openclaw@857b9cd test: mock health status config boundaries · openclaw/openclaw@9d5ab4a test: mock onboard config io boundary · openclaw/openclaw@299694d test: mock legacy state plugin boundaries · openclaw/openclaw@2713089 test: mock channel install boundaries · openclaw/openclaw@b945248 test: mock doctor preview channel boundaries · openclaw/openclaw@b1a3ad4
refactor: route browser screenshot vision through shared ...
scotthuang · 2026-05-31 · via Recent Commits to openclaw:main
11

---

2-

summary: "Rich output shortcode protocol for embeds, media, audio hints, and replies"

2+

summary: "Rich output protocol for structured media, embeds, audio hints, and replies"

33

read_when:

44

- Changing assistant output rendering in the Control UI

5-

- Debugging `[embed ...]`, `MEDIA:`, reply, or audio presentation directives

5+

- Debugging `[embed ...]`, structured media, reply, or audio presentation directives

66

title: "Rich output protocol"

77

---

8899

Assistant output can carry a small set of delivery/render directives:

101011-

- `MEDIA:` for attachment delivery

11+

- structured `mediaUrl` / `mediaUrls` fields for attachment delivery

1212

- `[[audio_as_voice]]` for audio presentation hints

1313

- `[[reply_to_current]]` / `[[reply_to:<id>]]` for reply metadata

1414

- `[embed ...]` for Control UI rich rendering

151516-

Remote `MEDIA:` attachments must be public `https:` URLs. Plain `http:`,

16+

Remote media attachments must be public `https:` URLs. Plain `http:`,

1717

loopback, link-local, private, and internal hostnames are ignored as attachment

1818

directives; server-side media fetchers still enforce their own network guards.

191920-

Local `MEDIA:` attachments can use absolute paths, workspace-relative paths, or

20+

Local media attachments can use absolute paths, workspace-relative paths, or

2121

home-relative `~/` paths. They still pass through the agent file-read policy and

2222

media type checks before delivery.

23232424

<Warning>

25-

`MEDIA:` is parsed only as plain text. Wrapping the directive in Markdown

26-

formatting (bold, inline code, fenced code) prevents the parser from

27-

recognizing it, and the attachment is silently dropped from delivery.

25+

Do not emit text commands for attachments from tools, plugins, streaming blocks,

26+

browser output, or message actions. Use structured media fields instead.

282729-

Valid:

28+

Valid message-tool payload:

302931-

```text

32-

MEDIA:/workspace/image.png

33-

```

34-35-

Invalid (parsed as prose, no attachment delivered):

36-37-

```text

38-

**MEDIA:/workspace/image.png**

39-

`MEDIA:/workspace/image.png`

40-

Here is your image: MEDIA:/workspace/image.png

30+

```json

31+

{ "message": "Here is your image.", "mediaUrl": "/workspace/image.png" }

4132

```

423343-

Keep `MEDIA:` on its own line, in plain text, with no surrounding formatting.

34+

Legacy final assistant reply text may still be normalized for compatibility, but

35+

it is not a general plugin/tool protocol.

4436

</Warning>

45374638

Plain Markdown image syntax stays text by default. Channels that intentionally

4739

map Markdown image replies to media attachments opt in at their outbound

4840

adapter; Telegram does this so `![alt](url)` can still become a media reply.

494150-

These directives are separate. `MEDIA:` and reply/voice tags remain delivery metadata; `[embed ...]` is the web-only rich render path.

51-

Trusted tool-result media uses the same `MEDIA:` / `[[audio_as_voice]]` parser before delivery, so text tool outputs can still mark an audio attachment as a voice note.

42+

These directives are separate. Structured media fields and reply/voice tags are

43+

delivery metadata; `[embed ...]` is the web-only rich render path.

524453-

When block streaming is enabled, `MEDIA:` remains single-delivery metadata for a

54-

turn. If the same media URL is sent in a streamed block and repeated in the final

55-

assistant payload, OpenClaw delivers the attachment once and strips the duplicate

56-

from the final payload.

45+

When block streaming is enabled, media must be carried on structured payload

46+

fields. If the same media URL is sent in a streamed block and repeated in the

47+

final assistant payload, OpenClaw delivers the attachment once and strips the

48+

duplicate from the final payload.

57495850

## `[embed ...]`

5951

@@ -72,7 +64,7 @@ Rules:

7264

- Only URL-backed embeds are rendered. Use `ref="..."` or `url="..."`.

7365

- Block-form inline HTML embed shortcodes are not rendered.

7466

- The web UI strips the shortcode from visible text and renders the embed inline.

75-

- `MEDIA:` is not an embed alias and should not be used for rich embed rendering.

67+

- Structured media is not an embed alias and should not be used for rich embed rendering.

76687769

## Stored rendering shape

7870