惯性聚合 高效追踪和阅读你感兴趣的博客、新闻、科技资讯
阅读原文 在惯性聚合中打开

推荐订阅源

Spread Privacy
Spread Privacy
P
Palo Alto Networks Blog
P
Proofpoint News Feed
AI
AI
Help Net Security
Help Net Security
S
Securelist
T
Troy Hunt's Blog
K
KPMG report finds enterprise disconnect between AI and its ROI | CIO
C
Cisco Blogs
Scott Helme
Scott Helme
Hacker News - Newest:
Hacker News - Newest: "LLM"
Vercel News
Vercel News
Exploit-DB.com RSS Feed
Exploit-DB.com RSS Feed
CTFtime.org: upcoming CTF events
CTFtime.org: upcoming CTF events
B
Blog
GbyAI
GbyAI
Recent Commits to openclaw:main
Recent Commits to openclaw:main
D
Darknet – Hacking Tools, Hacker News & Cyber Security
P
Proofpoint News Feed
S
Security Affairs
Cisco Talos Blog
Cisco Talos Blog
AWS News Blog
AWS News Blog
T
Tenable Blog
H
Help Net Security
NISL@THU
NISL@THU
F
Fortinet All Blogs
博客园_首页
G
GRAHAM CLULEY
L
LINUX DO - 最新话题
P
Privacy International News Feed
G
Google Developers Blog
博客园 - Franky
Cyber Security Advisories - MS-ISAC
Cyber Security Advisories - MS-ISAC
cs.CL updates on arXiv.org
cs.CL updates on arXiv.org
Security Archives - TechRepublic
Security Archives - TechRepublic
The Register - Security
The Register - Security
L
LangChain Blog
aimingoo的专栏
aimingoo的专栏
T
Tor Project blog
P
Privacy & Cybersecurity Law Blog
量子位
C
Cyber Attacks, Cyber Crime and Cyber Security
Forbes - Security
Forbes - Security
S
Secure Thoughts
Simon Willison's Weblog
Simon Willison's Weblog
D
Docker
Recorded Future
Recorded Future
博客园 - 三生石上(FineUI控件)
L
Lohrmann on Cybersecurity
T
Tailwind CSS Blog

Recent Commits to openclaw:main

test: merge chat side-result checks · openclaw/openclaw@ddd2c2a test: merge cron history checks · openclaw/openclaw@f7eb746 test: merge responsive navigation shell checks · openclaw/openclaw@c2e4b47 docs(changelog): add codex oauth fixes · openclaw/openclaw@628e6cd test: merge navigation routing cases · openclaw/openclaw@5d8cecb Tests: mock channel registry bundled fallback · openclaw/openclaw@2b08233 Secrets: avoid broad web search discovery for single plugin config · openclaw/openclaw@a464f59 test: merge config view browser checks · openclaw/openclaw@20cf511 fix(status): align oauth health with runtime · openclaw/openclaw@eed7116 feat: add macOS screen snapshots for monitor preview (#67954) thanks … · openclaw/openclaw@f377db1 fix: report shared auth scopes in hello-ok (#67810) thanks @BunsDev · openclaw/openclaw@0b6c39b Auto-reply: avoid eager bundled route fallback · openclaw/openclaw@3ea1bf4 Tests: narrow session binding contract setup · openclaw/openclaw@54e4e16 fix(macOS): enable undo/redo in webchat composer text input (#34962) · openclaw/openclaw@00951dc Tests: speed up channel setup promotion · openclaw/openclaw@82b529a Docs: refresh agent instructions · openclaw/openclaw@5775fe2 fix(auth): serialize OAuth refresh across agents to fix #26322 (#67876) · openclaw/openclaw@8e79080 test: allow ollama public surface boundary test · openclaw/openclaw@7d4f1a6 Docs: add test performance guardrails · openclaw/openclaw@89706d3 Tests: restore context-engine usage proof · openclaw/openclaw@e4c4f95 Tests: slim context engine runtime coverage · openclaw/openclaw@74c198f ci: retry failed custom checkouts · openclaw/openclaw@0ee5baf test: trim duplicate provider auth onboarding cases · openclaw/openclaw@1ffc02e matrix: fix sessions_spawn --thread subagent session spawning (#67643) · openclaw/openclaw@1ce2596 test: reduce auth choice fixture churn · openclaw/openclaw@857b9cd test: mock health status config boundaries · openclaw/openclaw@9d5ab4a test: mock onboard config io boundary · openclaw/openclaw@299694d test: mock legacy state plugin boundaries · openclaw/openclaw@2713089 test: mock channel install boundaries · openclaw/openclaw@b945248 test: mock doctor preview channel boundaries · openclaw/openclaw@b1a3ad4 test: trim doctor command hotspots · openclaw/openclaw@c66f16a test: isolate agent auth and spawn hotspots · openclaw/openclaw@9285935 test: stabilize MCP startup disposal race · openclaw/openclaw@dd9d2eb test: merge browser contract server suites · openclaw/openclaw@5817a76 test: narrow ollama provider discovery setup · openclaw/openclaw@a0d9598 build: declare qa-lab aimock runtime dependency · openclaw/openclaw@24431e5 test: speed up safe-bins exec harness · openclaw/openclaw@ee856ab test: preserve tool helpers in embedded runner mocks · openclaw/openclaw@acd86a0 refactor: move memory embeddings into provider plugins · openclaw/openclaw@77e6e4c test: reuse system-run temp fixtures · openclaw/openclaw@7e9ff0f test: trim hotspot wait overhead · openclaw/openclaw@12a59b0 Check: avoid duplicate boundary prep · openclaw/openclaw@baf11b8 test: reduce hotspot fixture overhead · openclaw/openclaw@3a59edd feat(ui): overhaul settings and slash command UX (#67819) thanks @Bun… · openclaw/openclaw@2cfb660 QA Matrix: exit cleanly on failure · openclaw/openclaw@42805d2 QA Matrix: isolate scenario coverage · openclaw/openclaw@7e659e1 Matrix: refresh crypto bootstrap state · openclaw/openclaw@94081d8 QA Lab: add provider registry · openclaw/openclaw@bb7e982 Matrix: add plugin changelog · openclaw/openclaw@4acab55 test: trim more hotspot overhead · openclaw/openclaw@f485311 test: trim remaining hotspot tests · openclaw/openclaw@6ba8626 test: narrow hotspot mocks · openclaw/openclaw@dbc8179 test: isolate gemini embedding request helpers · openclaw/openclaw@cd330f5 test: trim memory and mcp hotspots · openclaw/openclaw@fd48dfa test: slim provider registry mocks · openclaw/openclaw@2e08c77 test: harden Parallels update smoke · openclaw/openclaw@1a98090 feat: default Anthropic to Opus 4.7 · openclaw/openclaw@628b454 fix: harden node-host shell payload mutability checks · openclaw/openclaw@75c551e fix: land node-host approval binding for native binaries (#66731) (th… · openclaw/openclaw@29919bb CI: add daily schedule to CodeQL workflow (#67645) · openclaw/openclaw@69d25f5 fix(gateway): capture config hash after plugin auto-enable to prevent… · openclaw/openclaw@8c11210 fix: repair sanitized replay tool results before send (#67620) (thank… · openclaw/openclaw@c3c7a99 fix: restrict HTML timeout short-circuit to transient statuses · openclaw/openclaw@de129a6 fix: keep TUI watchdog bound to active run (#67401) (thanks @xantorres) · openclaw/openclaw@3525273 Gateway/skills: dedupe skills prefix-match + drop dead fallback on log · openclaw/openclaw@d7f489f Extensions/lmstudio: back off inference preload after consecutive fai… · openclaw/openclaw@b555214 TUI/streaming: add watchdog that resets the activity indicator after … · openclaw/openclaw@f44ab20 Agents/tool-loop: enable unknown-tool stream guard by default · openclaw/openclaw@36ed367 Gateway/skills: invalidate session skills snapshot on config write · openclaw/openclaw@b23d59a fix: classify HTML provider error pages correctly (#67642) (thanks @s… · openclaw/openclaw@e588e90 fix(skills): remove unused model-usage import (#67641) · openclaw/openclaw@55f05df docs(changelog): credit codex fix superseded PRs · openclaw/openclaw@e485f24 fix(openai-codex): normalize stale transport metadata in resolution a… · openclaw/openclaw@90801ba CI: pin Docker-related GitHub Actions (#67632) · openclaw/openclaw@f697b01 Android: modernize WebView and discovery API usage (#67627) · openclaw/openclaw@44a6e50 fix(deps): bump hono to 4.12.14 and @hono/node-server to 1.19.14 (GHS… · openclaw/openclaw@fbccc18 fix(deps): bump dompurify to 3.4.0 (#67614) · openclaw/openclaw@2c2dc00 CI: add explicit permissions to all workflow jobs (fixes code-scannin… · openclaw/openclaw@01b7516 fix: register bundled TTS providers and route overrides correctly (#6… · openclaw/openclaw@6ea3cdd fix: align host tilde paths with OS home (#62804) (thanks @stainlu) · openclaw/openclaw@ecfaf64 fix: flush creds queue before reconnect socket open (#67464) (thanks … · openclaw/openclaw@405c63f fix: strip standalone <function> tool call tags from visible text (#6… · openclaw/openclaw@78df859 fix(agents): preserve cli session metadata before transcript persist … · openclaw/openclaw@898fd04 docs(changelog): move cli transcript entry · openclaw/openclaw@c1817c6 fix(agents): normalize cli transcript api field · openclaw/openclaw@3a3fae0 docs(changelog): note cli transcript persistence · openclaw/openclaw@6c343f1 fix(agents): persist cli transcript turns · openclaw/openclaw@b8ef507 fix(msteams): harden security-sensitive flows (#65841) · openclaw/openclaw@c56b56e [Dashboard] Fix exec approval modal overflow for long command content… · openclaw/openclaw@053c5b0 Docs: remove QA changelog entry · openclaw/openclaw@7fd5771 QA: fix private runtime source loading (#67428) · openclaw/openclaw@d5933af docs(gateway): correct protocol.md schema path, hello-ok example, aut… · openclaw/openclaw@489404d CI: pin Node 22 runners to 22.18.0 · openclaw/openclaw@4ffa621 models.authStatus: normalize provider ids + tighten env-backed escape… · openclaw/openclaw@f2fdb9d Update CHANGELOG.md · openclaw/openclaw@7694a92 test(parallels): clean up npm update guard jobs · openclaw/openclaw@045ea7b Plugins: prefer scanDir override paths · openclaw/openclaw@b2974da fix(dreaming): default storage.mode to "separate" so phase blocks sto… · openclaw/openclaw@8c392f0 fix(memory-core): skip dreaming transcript ingestion via session stor… · openclaw/openclaw@a1b01f0 fix: dedupe replayed exec.finished node events (#67281) · openclaw/openclaw@5dcf526
feat(openrouter): add inbound audio STT support · openclaw/openclaw@5c87b69
remdev · 2026-05-12 · via Recent Commits to openclaw:main

@@ -0,0 +1,180 @@

1+

import { afterEach, describe, expect, it, vi } from "vitest";

2+

import {

3+

openrouterMediaUnderstandingProvider,

4+

transcribeOpenRouterAudio,

5+

} from "./media-understanding-provider.js";

6+7+

const { assertOkOrThrowHttpErrorMock, postJsonRequestMock, resolveProviderHttpRequestConfigMock } =

8+

vi.hoisted(() => ({

9+

assertOkOrThrowHttpErrorMock: vi.fn(async () => {}),

10+

postJsonRequestMock: vi.fn(),

11+

resolveProviderHttpRequestConfigMock: vi.fn((params: Record<string, unknown>) => ({

12+

baseUrl: params.baseUrl ?? params.defaultBaseUrl ?? "https://openrouter.ai/api/v1",

13+

allowPrivateNetwork: false,

14+

headers: new Headers(params.defaultHeaders as HeadersInit | undefined),

15+

dispatcherPolicy: undefined,

16+

})),

17+

}));

18+19+

vi.mock("openclaw/plugin-sdk/provider-http", () => ({

20+

assertOkOrThrowHttpError: assertOkOrThrowHttpErrorMock,

21+

postJsonRequest: postJsonRequestMock,

22+

requireTranscriptionText: (value: string | undefined, message: string) => {

23+

const text = value?.trim();

24+

if (!text) {

25+

throw new Error(message);

26+

}

27+

return text;

28+

},

29+

resolveProviderHttpRequestConfig: resolveProviderHttpRequestConfigMock,

30+

}));

31+32+

describe("openrouter media understanding provider", () => {

33+

afterEach(() => {

34+

assertOkOrThrowHttpErrorMock.mockClear();

35+

postJsonRequestMock.mockReset();

36+

resolveProviderHttpRequestConfigMock.mockClear();

37+

});

38+39+

it("declares image and audio capabilities with defaults", () => {

40+

expect(openrouterMediaUnderstandingProvider).toMatchObject({

41+

id: "openrouter",

42+

capabilities: ["image", "audio"],

43+

defaultModels: {

44+

image: "auto",

45+

audio: "openai/whisper-large-v3-turbo",

46+

},

47+

autoPriority: { audio: 35 },

48+

});

49+

expect(openrouterMediaUnderstandingProvider.transcribeAudio).toBeTypeOf("function");

50+

});

51+52+

it("sends JSON STT payload to OpenRouter transcriptions endpoint", async () => {

53+

const release = vi.fn(async () => {});

54+

postJsonRequestMock.mockResolvedValue({

55+

response: new Response(JSON.stringify({ text: "hello world" }), { status: 200 }),

56+

release,

57+

});

58+59+

const result = await transcribeOpenRouterAudio({

60+

buffer: Buffer.from("audio-bytes"),

61+

fileName: "voice.oga",

62+

mime: "audio/ogg",

63+

apiKey: "sk-openrouter",

64+

timeoutMs: 12_000,

65+

language: " en ",

66+

fetchFn: fetch,

67+

});

68+69+

expect(result).toEqual({

70+

text: "hello world",

71+

model: "openai/whisper-large-v3-turbo",

72+

});

73+

expect(resolveProviderHttpRequestConfigMock).toHaveBeenCalledWith(

74+

expect.objectContaining({

75+

provider: "openrouter",

76+

capability: "audio",

77+

}),

78+

);

79+

expect(postJsonRequestMock).toHaveBeenCalledWith(

80+

expect.objectContaining({

81+

url: "https://openrouter.ai/api/v1/audio/transcriptions",

82+

timeoutMs: 12_000,

83+

body: {

84+

model: "openai/whisper-large-v3-turbo",

85+

input_audio: {

86+

data: Buffer.from("audio-bytes").toString("base64"),

87+

format: "ogg",

88+

},

89+

language: "en",

90+

},

91+

}),

92+

);

93+

const headers = postJsonRequestMock.mock.calls[0]?.[0]?.headers as Headers;

94+

expect(headers.get("authorization")).toBe("Bearer sk-openrouter");

95+

expect(headers.get("http-referer")).toBe("https://openclaw.ai");

96+

expect(headers.get("x-openrouter-title")).toBe("OpenClaw");

97+

expect(release).toHaveBeenCalledOnce();

98+

});

99+100+

it("accepts temperature via provider query options", async () => {

101+

const release = vi.fn(async () => {});

102+

postJsonRequestMock.mockResolvedValue({

103+

response: new Response(JSON.stringify({ text: "ok" }), { status: 200 }),

104+

release,

105+

});

106+107+

await transcribeOpenRouterAudio({

108+

buffer: Buffer.from("audio"),

109+

fileName: "voice.webm",

110+

apiKey: "sk-openrouter",

111+

timeoutMs: 5_000,

112+

query: { temperature: 0.2 },

113+

fetchFn: fetch,

114+

});

115+116+

expect(postJsonRequestMock).toHaveBeenCalledWith(

117+

expect.objectContaining({

118+

body: expect.objectContaining({

119+

temperature: 0.2,

120+

}),

121+

}),

122+

);

123+

});

124+125+

it("falls back to filename extension when mime is missing", async () => {

126+

const release = vi.fn(async () => {});

127+

postJsonRequestMock.mockResolvedValue({

128+

response: new Response(JSON.stringify({ text: "ok" }), { status: 200 }),

129+

release,

130+

});

131+132+

await transcribeOpenRouterAudio({

133+

buffer: Buffer.from("audio"),

134+

fileName: "voice.opus",

135+

apiKey: "sk-openrouter",

136+

timeoutMs: 5_000,

137+

fetchFn: fetch,

138+

});

139+140+

expect(postJsonRequestMock).toHaveBeenCalledWith(

141+

expect.objectContaining({

142+

body: expect.objectContaining({

143+

input_audio: expect.objectContaining({ format: "ogg" }),

144+

}),

145+

}),

146+

);

147+

});

148+149+

it("throws when format cannot be resolved", async () => {

150+

await expect(

151+

transcribeOpenRouterAudio({

152+

buffer: Buffer.from("audio"),

153+

fileName: "voice.bin",

154+

mime: "application/octet-stream",

155+

apiKey: "sk-openrouter",

156+

timeoutMs: 5_000,

157+

fetchFn: fetch,

158+

}),

159+

).rejects.toThrow("OpenRouter STT could not resolve audio format");

160+

expect(postJsonRequestMock).not.toHaveBeenCalled();

161+

});

162+163+

it("throws when provider response omits text", async () => {

164+

const release = vi.fn(async () => {});

165+

postJsonRequestMock.mockResolvedValue({

166+

response: new Response(JSON.stringify({}), { status: 200 }),

167+

release,

168+

});

169+170+

await expect(

171+

transcribeOpenRouterAudio({

172+

buffer: Buffer.from("audio"),

173+

fileName: "voice.mp3",

174+

apiKey: "sk-openrouter",

175+

timeoutMs: 5_000,

176+

fetchFn: fetch,

177+

}),

178+

).rejects.toThrow("OpenRouter transcription response missing text");

179+

});

180+

});