惯性聚合 高效追踪和阅读你感兴趣的博客、新闻、科技资讯
阅读原文 在惯性聚合中打开

推荐订阅源

Last Week in AI
Last Week in AI
D
DataBreaches.Net
腾讯CDC
Recent Announcements
Recent Announcements
有赞技术团队
有赞技术团队
A
About on SuperTechFans
Cyber Security Advisories - MS-ISAC
Cyber Security Advisories - MS-ISAC
Google DeepMind News
Google DeepMind News
Microsoft Security Blog
Microsoft Security Blog
云风的 BLOG
云风的 BLOG
罗磊的独立博客
月光博客
月光博客
MyScale Blog
MyScale Blog
U
Unit 42
Martin Fowler
Martin Fowler
Stack Overflow Blog
Stack Overflow Blog
T
Tailwind CSS Blog
Engineering at Meta
Engineering at Meta
N
Netflix TechBlog - Medium
G
Google Developers Blog
博客园 - 【当耐特】
D
Docker
I
InfoQ
雷峰网
雷峰网

Recent Commits to openclaw:main

test: merge chat side-result checks · openclaw/openclaw@ddd2c2a test: merge cron history checks · openclaw/openclaw@f7eb746 test: merge responsive navigation shell checks · openclaw/openclaw@c2e4b47 docs(changelog): add codex oauth fixes · openclaw/openclaw@628e6cd test: merge navigation routing cases · openclaw/openclaw@5d8cecb Tests: mock channel registry bundled fallback · openclaw/openclaw@2b08233 Secrets: avoid broad web search discovery for single plugin config · openclaw/openclaw@a464f59 test: merge config view browser checks · openclaw/openclaw@20cf511 fix(status): align oauth health with runtime · openclaw/openclaw@eed7116 feat: add macOS screen snapshots for monitor preview (#67954) thanks … · openclaw/openclaw@f377db1 fix: report shared auth scopes in hello-ok (#67810) thanks @BunsDev · openclaw/openclaw@0b6c39b Auto-reply: avoid eager bundled route fallback · openclaw/openclaw@3ea1bf4 Tests: narrow session binding contract setup · openclaw/openclaw@54e4e16 fix(macOS): enable undo/redo in webchat composer text input (#34962) · openclaw/openclaw@00951dc Tests: speed up channel setup promotion · openclaw/openclaw@82b529a Docs: refresh agent instructions · openclaw/openclaw@5775fe2 fix(auth): serialize OAuth refresh across agents to fix #26322 (#67876) · openclaw/openclaw@8e79080 test: allow ollama public surface boundary test · openclaw/openclaw@7d4f1a6 Docs: add test performance guardrails · openclaw/openclaw@89706d3 Tests: restore context-engine usage proof · openclaw/openclaw@e4c4f95 Tests: slim context engine runtime coverage · openclaw/openclaw@74c198f ci: retry failed custom checkouts · openclaw/openclaw@0ee5baf test: trim duplicate provider auth onboarding cases · openclaw/openclaw@1ffc02e matrix: fix sessions_spawn --thread subagent session spawning (#67643) · openclaw/openclaw@1ce2596 test: reduce auth choice fixture churn · openclaw/openclaw@857b9cd test: mock health status config boundaries · openclaw/openclaw@9d5ab4a test: mock onboard config io boundary · openclaw/openclaw@299694d test: mock legacy state plugin boundaries · openclaw/openclaw@2713089 test: mock channel install boundaries · openclaw/openclaw@b945248 test: mock doctor preview channel boundaries · openclaw/openclaw@b1a3ad4
refactor: route browser screenshot vision through shared ...
scotthuang · 2026-05-31 · via Recent Commits to openclaw:main
11

---

2-

summary: "Rich output shortcode protocol for embeds, media, audio hints, and replies"

2+

summary: "Rich output protocol for structured media, embeds, audio hints, and replies"

33

read_when:

44

- Changing assistant output rendering in the Control UI

5-

- Debugging `[embed ...]`, `MEDIA:`, reply, or audio presentation directives

5+

- Debugging `[embed ...]`, structured media, reply, or audio presentation directives

66

title: "Rich output protocol"

77

---

8899

Assistant output can carry a small set of delivery/render directives:

101011-

- `MEDIA:` for attachment delivery

11+

- structured `mediaUrl` / `mediaUrls` fields for attachment delivery

1212

- `[[audio_as_voice]]` for audio presentation hints

1313

- `[[reply_to_current]]` / `[[reply_to:<id>]]` for reply metadata

1414

- `[embed ...]` for Control UI rich rendering

151516-

Remote `MEDIA:` attachments must be public `https:` URLs. Plain `http:`,

16+

Remote media attachments must be public `https:` URLs. Plain `http:`,

1717

loopback, link-local, private, and internal hostnames are ignored as attachment

1818

directives; server-side media fetchers still enforce their own network guards.

191920-

Local `MEDIA:` attachments can use absolute paths, workspace-relative paths, or

20+

Local media attachments can use absolute paths, workspace-relative paths, or

2121

home-relative `~/` paths. They still pass through the agent file-read policy and

2222

media type checks before delivery.

23232424

<Warning>

25-

`MEDIA:` is parsed only as plain text. Wrapping the directive in Markdown

26-

formatting (bold, inline code, fenced code) prevents the parser from

27-

recognizing it, and the attachment is silently dropped from delivery.

25+

Do not emit text commands for attachments from tools, plugins, streaming blocks,

26+

browser output, or message actions. Use structured media fields instead.

282729-

Valid:

28+

Valid message-tool payload:

302931-

```text

32-

MEDIA:/workspace/image.png

33-

```

34-35-

Invalid (parsed as prose, no attachment delivered):

36-37-

```text

38-

**MEDIA:/workspace/image.png**

39-

`MEDIA:/workspace/image.png`

40-

Here is your image: MEDIA:/workspace/image.png

30+

```json

31+

{ "message": "Here is your image.", "mediaUrl": "/workspace/image.png" }

4132

```

423343-

Keep `MEDIA:` on its own line, in plain text, with no surrounding formatting.

34+

Legacy final assistant reply text may still be normalized for compatibility, but

35+

it is not a general plugin/tool protocol.

4436

</Warning>

45374638

Plain Markdown image syntax stays text by default. Channels that intentionally

4739

map Markdown image replies to media attachments opt in at their outbound

4840

adapter; Telegram does this so `![alt](url)` can still become a media reply.

494150-

These directives are separate. `MEDIA:` and reply/voice tags remain delivery metadata; `[embed ...]` is the web-only rich render path.

51-

Trusted tool-result media uses the same `MEDIA:` / `[[audio_as_voice]]` parser before delivery, so text tool outputs can still mark an audio attachment as a voice note.

42+

These directives are separate. Structured media fields and reply/voice tags are

43+

delivery metadata; `[embed ...]` is the web-only rich render path.

524453-

When block streaming is enabled, `MEDIA:` remains single-delivery metadata for a

54-

turn. If the same media URL is sent in a streamed block and repeated in the final

55-

assistant payload, OpenClaw delivers the attachment once and strips the duplicate

56-

from the final payload.

45+

When block streaming is enabled, media must be carried on structured payload

46+

fields. If the same media URL is sent in a streamed block and repeated in the

47+

final assistant payload, OpenClaw delivers the attachment once and strips the

48+

duplicate from the final payload.

57495850

## `[embed ...]`

5951

@@ -72,7 +64,7 @@ Rules:

7264

- Only URL-backed embeds are rendered. Use `ref="..."` or `url="..."`.

7365

- Block-form inline HTML embed shortcodes are not rendered.

7466

- The web UI strips the shortcode from visible text and renders the embed inline.

75-

- `MEDIA:` is not an embed alias and should not be used for rich embed rendering.

67+

- Structured media is not an embed alias and should not be used for rich embed rendering.

76687769

## Stored rendering shape

7870