惯性聚合 高效追踪和阅读你感兴趣的博客、新闻、科技资讯
阅读原文 在惯性聚合中打开

推荐订阅源

博客园 - 叶小钗
Cyber Security Advisories - MS-ISAC
Cyber Security Advisories - MS-ISAC
Microsoft Security Blog
Microsoft Security Blog
罗磊的独立博客
大猫的无限游戏
大猫的无限游戏
美团技术团队
让小产品的独立变现更简单 - ezindie.com
让小产品的独立变现更简单 - ezindie.com
钛媒体:引领未来商业与生活新知
钛媒体:引领未来商业与生活新知
aimingoo的专栏
aimingoo的专栏
腾讯CDC
WordPress大学
WordPress大学
Apple Machine Learning Research
Apple Machine Learning Research
F
Fortinet All Blogs
G
Google Developers Blog
MongoDB | Blog
MongoDB | Blog
Microsoft Azure Blog
Microsoft Azure Blog
小众软件
小众软件
Engineering at Meta
Engineering at Meta
博客园_首页
B
Blog RSS Feed
D
Docker
M
MIT News - Artificial intelligence
爱范儿
爱范儿
I
InfoQ

Recent Commits to openclaw:main

test: merge chat side-result checks · openclaw/openclaw@ddd2c2a test: merge cron history checks · openclaw/openclaw@f7eb746 test: merge responsive navigation shell checks · openclaw/openclaw@c2e4b47 docs(changelog): add codex oauth fixes · openclaw/openclaw@628e6cd test: merge navigation routing cases · openclaw/openclaw@5d8cecb Tests: mock channel registry bundled fallback · openclaw/openclaw@2b08233 Secrets: avoid broad web search discovery for single plugin config · openclaw/openclaw@a464f59 test: merge config view browser checks · openclaw/openclaw@20cf511 fix(status): align oauth health with runtime · openclaw/openclaw@eed7116 feat: add macOS screen snapshots for monitor preview (#67954) thanks … · openclaw/openclaw@f377db1 fix: report shared auth scopes in hello-ok (#67810) thanks @BunsDev · openclaw/openclaw@0b6c39b Auto-reply: avoid eager bundled route fallback · openclaw/openclaw@3ea1bf4 Tests: narrow session binding contract setup · openclaw/openclaw@54e4e16 fix(macOS): enable undo/redo in webchat composer text input (#34962) · openclaw/openclaw@00951dc Tests: speed up channel setup promotion · openclaw/openclaw@82b529a Docs: refresh agent instructions · openclaw/openclaw@5775fe2 fix(auth): serialize OAuth refresh across agents to fix #26322 (#67876) · openclaw/openclaw@8e79080 test: allow ollama public surface boundary test · openclaw/openclaw@7d4f1a6 Docs: add test performance guardrails · openclaw/openclaw@89706d3 Tests: restore context-engine usage proof · openclaw/openclaw@e4c4f95 Tests: slim context engine runtime coverage · openclaw/openclaw@74c198f ci: retry failed custom checkouts · openclaw/openclaw@0ee5baf test: trim duplicate provider auth onboarding cases · openclaw/openclaw@1ffc02e matrix: fix sessions_spawn --thread subagent session spawning (#67643) · openclaw/openclaw@1ce2596 test: reduce auth choice fixture churn · openclaw/openclaw@857b9cd test: mock health status config boundaries · openclaw/openclaw@9d5ab4a test: mock onboard config io boundary · openclaw/openclaw@299694d test: mock legacy state plugin boundaries · openclaw/openclaw@2713089 test: mock channel install boundaries · openclaw/openclaw@b945248 test: mock doctor preview channel boundaries · openclaw/openclaw@b1a3ad4
fix(voice): reuse preflight transcripts across channels ·...
steipete · 2026-04-26 · via Recent Commits to openclaw:main
Original file line numberDiff line numberDiff line change

@@ -96,6 +96,14 @@ Docs: https://docs.openclaw.ai

9696

before agent dispatch and keep raw Feishu `file_key` payloads out of message

9797

text. Fixes #67120 and #61876.

9898

- Tasks: terminalize async Gateway agent task records from the Gateway run result while preserving aborted, failed, and cancelled outcomes instead of leaving completed runs stuck as active or lost. (#71905) Thanks @likewen-tech.

99+

- WhatsApp: let authorized group voice-note transcripts satisfy mention gating

100+

before reply dispatch, while keeping unmentioned transcripts in pending group

101+

history. Fixes #44908.

102+

- Media understanding: carry channel voice-note preflight state into attachment

103+

selection so WhatsApp, Feishu, Telegram, and Discord do not transcribe the

104+

same inbound audio twice. Fixes #70580.

105+

- TTS/BlueBubbles: deliver compatible auto-TTS audio as iMessage voice memo

106+

bubbles instead of plain MP3/CAF file attachments. Fixes #16848.

99107

- ACP: send subagent and async-task completion wakes to external ACP harnesses as

100108

plain prompts instead of OpenClaw internal runtime-context envelopes, while

101109

keeping those envelopes out of ACP transcripts.

Original file line numberDiff line numberDiff line change

@@ -21,6 +21,8 @@ need a separate `openclaw plugins install` step.

2121

- OpenClaw talks to it through its REST API (`GET /api/v1/ping`, `POST /message/text`, `POST /chat/:id/*`).

2222

- Incoming messages arrive via webhooks; outgoing replies, typing indicators, read receipts, and tapbacks are REST calls.

2323

- Attachments and stickers are ingested as inbound media (and surfaced to the agent when possible).

24+

- Auto-TTS replies that synthesize MP3 or CAF audio are delivered as iMessage

25+

voice memo bubbles instead of plain file attachments.

2426

- Pairing/allowlist works the same way as other channels (`/channels/pairing` etc) with `channels.bluebubbles.allowFrom` + pairing codes.

2527

- Reactions are surfaced as system events just like Slack/Telegram so agents can "mention" them before replying.

2628

- Advanced features: edit, unsend, reply threading, message effects, group management.

Original file line numberDiff line numberDiff line change

@@ -244,6 +244,7 @@ content and identifiers.

244244
245245

- explicit WhatsApp mentions of the bot identity

246246

- configured mention regex patterns (`agents.list[].groupChat.mentionPatterns`, fallback `messages.groupChat.mentionPatterns`)

247+

- inbound voice-note transcripts for authorized group messages

247248

- implicit reply-to-bot detection (reply sender matches bot identity)

248249
249250

Security note:

@@ -296,6 +297,11 @@ When the linked self number is also present in `allowFrom`, WhatsApp self-chat s

296297

- `<media:document>`

297298

- `<media:sticker>`

298299
300+

Authorized group voice notes are transcribed before mention gating when the

301+

body is only `<media:audio>`, so saying the bot mention in the voice note can

302+

trigger the reply. If the transcript still does not mention the bot, the

303+

transcript is kept in pending group history instead of the raw placeholder.

304+
299305

Location bodies use terse coordinate text. Location labels/comments and contact/vCard details are rendered as fenced untrusted metadata, not inline prompt text.

300306
301307

</Accordion>

Original file line numberDiff line numberDiff line change

@@ -58,6 +58,10 @@ Video and music generation run as background tasks because provider processing t

5858
5959

Deepgram, ElevenLabs, Mistral, OpenAI, SenseAudio, and xAI can all transcribe

6060

inbound audio through the batch `tools.media.audio` path when configured.

61+

Channel plugins that preflight a voice note for mention gating or command

62+

parsing mark the transcribed attachment on the inbound context, so the shared

63+

media-understanding pass reuses that transcript instead of making a second STT

64+

call for the same audio.

6165

Deepgram, ElevenLabs, Mistral, OpenAI, and xAI also register Voice Call

6266

streaming STT providers, so live phone audio can be forwarded to the selected

6367

vendor without waiting for a completed recording.

Original file line numberDiff line numberDiff line change

@@ -330,7 +330,7 @@ export const bluebubblesPlugin: ChannelPlugin<ResolvedBlueBubblesAccount, BlueBu

330330

},

331331

sendMedia: async (ctx) => {

332332

const runtime = await loadBlueBubblesChannelRuntime();

333-

const { cfg, to, text, mediaUrl, accountId, replyToId } = ctx;

333+

const { cfg, to, text, mediaUrl, accountId, replyToId, audioAsVoice } = ctx;

334334

const { mediaPath, mediaBuffer, contentType, filename, caption } = ctx as {

335335

mediaPath?: string;

336336

mediaBuffer?: Uint8Array;

@@ -349,6 +349,7 @@ export const bluebubblesPlugin: ChannelPlugin<ResolvedBlueBubblesAccount, BlueBu

349349

caption: caption ?? text ?? undefined,

350350

replyToId: replyToId ?? null,

351351

accountId: accountId ?? undefined,

352+

asVoice: audioAsVoice === true,

352353

});

353354

},

354355

},

Original file line numberDiff line numberDiff line change

@@ -323,4 +323,27 @@ describe("sendBlueBubblesMedia local-path hardening", () => {

323323

);

324324

expect(sendBlueBubblesAttachmentMock).toHaveBeenCalledTimes(1);

325325

});

326+
327+

it("passes asVoice through to attachment delivery", async () => {

328+

runtimeMocks.fetchRemoteMedia.mockResolvedValueOnce({

329+

buffer: new Uint8Array([1, 2, 3]),

330+

contentType: "audio/mpeg",

331+

fileName: "voice.mp3",

332+

});

333+
334+

await sendBlueBubblesMedia({

335+

cfg: createConfig(),

336+

to: "chat:123",

337+

mediaUrl: "https://example.com/voice.mp3",

338+

asVoice: true,

339+

});

340+
341+

expect(sendBlueBubblesAttachmentMock).toHaveBeenCalledWith(

342+

expect.objectContaining({

343+

asVoice: true,

344+

contentType: "audio/mpeg",

345+

filename: "voice.mp3",

346+

}),

347+

);

348+

});

326349

});

Original file line numberDiff line numberDiff line change

@@ -1686,6 +1686,7 @@ async function processMessageAfterDedupe(

16861686

caption: caption ?? undefined,

16871687

replyToId: replyToMessageGuid || null,

16881688

accountId: account.accountId,

1689+

asVoice: payload.audioAsVoice === true,

16891690

});

16901691

} catch (err) {

16911692

forgetPendingOutboundMessageId(pendingId);

Original file line numberDiff line numberDiff line change

@@ -405,6 +405,7 @@ describe("preflightDiscordMessage", () => {

405405

);

406406

expect(result).not.toBeNull();

407407

expect(result?.isDirectMessage).toBe(true);

408+

expect(result?.preflightAudioTranscript).toBe("hello openclaw from dm audio");

408409

});

409410
410411

it("falls back to the default discord account for omitted-account dm authorization", async () => {

@@ -1096,6 +1097,7 @@ describe("preflightDiscordMessage", () => {

10961097

);

10971098

expect(result).not.toBeNull();

10981099

expect(result?.wasMentioned).toBe(true);

1100+

expect(result?.preflightAudioTranscript).toBe("hey openclaw");

10991101

});

11001102
11011103

it("does not transcribe guild audio from unauthorized members", async () => {

Original file line numberDiff line numberDiff line change

@@ -1112,6 +1112,7 @@ export async function preflightDiscordMessage(

11121112

commandAuthorized,

11131113

baseText,

11141114

messageText,

1115+

...(preflightTranscript !== undefined ? { preflightAudioTranscript: preflightTranscript } : {}),

11151116

wasMentioned,

11161117

route: effectiveRoute,

11171118

threadBinding,

Original file line numberDiff line numberDiff line change

@@ -56,6 +56,7 @@ export type DiscordMessagePreflightContext = DiscordMessagePreflightSharedFields

5656

commandAuthorized: boolean;

5757

baseText: string;

5858

messageText: string;

59+

preflightAudioTranscript?: string;

5960

wasMentioned: boolean;

6061
6162

route: ReturnType<typeof resolveAgentRoute>;