惯性聚合 高效追踪和阅读你感兴趣的博客、新闻、科技资讯
阅读原文 在惯性聚合中打开

推荐订阅源

阮一峰的网络日志
阮一峰的网络日志
Blog — PlanetScale
Blog — PlanetScale
B
Blog RSS Feed
L
LangChain Blog
Jina AI
Jina AI
爱范儿
爱范儿
C
Check Point Blog
云风的 BLOG
云风的 BLOG
Last Week in AI
Last Week in AI
月光博客
月光博客
GbyAI
GbyAI
freeCodeCamp Programming Tutorials: Python, JavaScript, Git & More
Stack Overflow Blog
Stack Overflow Blog
V
V2EX
A
About on SuperTechFans
有赞技术团队
有赞技术团队
Microsoft Azure Blog
Microsoft Azure Blog
The GitHub Blog
The GitHub Blog
博客园 - Franky
Apple Machine Learning Research
Apple Machine Learning Research
奇客Solidot–传递最新科技情报
奇客Solidot–传递最新科技情报
Google DeepMind News
Google DeepMind News
博客园 - 三生石上(FineUI控件)
S
SegmentFault 最新的问题

Recent Commits to openclaw:main

test: merge chat side-result checks · openclaw/openclaw@ddd2c2a test: merge cron history checks · openclaw/openclaw@f7eb746 test: merge responsive navigation shell checks · openclaw/openclaw@c2e4b47 docs(changelog): add codex oauth fixes · openclaw/openclaw@628e6cd test: merge navigation routing cases · openclaw/openclaw@5d8cecb Tests: mock channel registry bundled fallback · openclaw/openclaw@2b08233 Secrets: avoid broad web search discovery for single plugin config · openclaw/openclaw@a464f59 test: merge config view browser checks · openclaw/openclaw@20cf511 fix(status): align oauth health with runtime · openclaw/openclaw@eed7116 feat: add macOS screen snapshots for monitor preview (#67954) thanks … · openclaw/openclaw@f377db1 fix: report shared auth scopes in hello-ok (#67810) thanks @BunsDev · openclaw/openclaw@0b6c39b Auto-reply: avoid eager bundled route fallback · openclaw/openclaw@3ea1bf4 Tests: narrow session binding contract setup · openclaw/openclaw@54e4e16 fix(macOS): enable undo/redo in webchat composer text input (#34962) · openclaw/openclaw@00951dc Tests: speed up channel setup promotion · openclaw/openclaw@82b529a Docs: refresh agent instructions · openclaw/openclaw@5775fe2 fix(auth): serialize OAuth refresh across agents to fix #26322 (#67876) · openclaw/openclaw@8e79080 test: allow ollama public surface boundary test · openclaw/openclaw@7d4f1a6 Docs: add test performance guardrails · openclaw/openclaw@89706d3 Tests: restore context-engine usage proof · openclaw/openclaw@e4c4f95 Tests: slim context engine runtime coverage · openclaw/openclaw@74c198f ci: retry failed custom checkouts · openclaw/openclaw@0ee5baf test: trim duplicate provider auth onboarding cases · openclaw/openclaw@1ffc02e matrix: fix sessions_spawn --thread subagent session spawning (#67643) · openclaw/openclaw@1ce2596 test: reduce auth choice fixture churn · openclaw/openclaw@857b9cd test: mock health status config boundaries · openclaw/openclaw@9d5ab4a test: mock onboard config io boundary · openclaw/openclaw@299694d test: mock legacy state plugin boundaries · openclaw/openclaw@2713089 test: mock channel install boundaries · openclaw/openclaw@b945248 test: mock doctor preview channel boundaries · openclaw/openclaw@b1a3ad4
fix(xai): support video reference images · openclaw/openc...
steipete · 2026-04-26 · via Recent Commits to openclaw:main

@@ -81,6 +81,136 @@ describe("xai video generation provider", () => {

8181

);

8282

});

838384+

it("sends a single unroled image as xAI first-frame image-to-video", async () => {

85+

postJsonRequestMock.mockResolvedValue({

86+

response: {

87+

json: async () => ({

88+

request_id: "req_image",

89+

}),

90+

},

91+

release: vi.fn(async () => {}),

92+

});

93+

fetchWithTimeoutMock

94+

.mockResolvedValueOnce({

95+

json: async () => ({

96+

request_id: "req_image",

97+

status: "done",

98+

video: { url: "https://cdn.x.ai/image-video.mp4" },

99+

}),

100+

})

101+

.mockResolvedValueOnce({

102+

headers: new Headers({ "content-type": "video/mp4" }),

103+

arrayBuffer: async () => Buffer.from("image-video-bytes"),

104+

});

105+106+

const provider = buildXaiVideoGenerationProvider();

107+

const result = await provider.generateVideo({

108+

provider: "xai",

109+

model: "grok-imagine-video",

110+

prompt: "Animate this logo into a clean bumper",

111+

cfg: {},

112+

inputImages: [{ buffer: Buffer.from("png-bytes"), mimeType: "image/png" }],

113+

});

114+115+

const body = postJsonRequestMock.mock.calls[0]?.[0]?.body as Record<string, unknown>;

116+

expect(postJsonRequestMock).toHaveBeenCalledWith(

117+

expect.objectContaining({

118+

url: "https://api.x.ai/v1/videos/generations",

119+

body: expect.objectContaining({

120+

image: {

121+

url: expect.stringMatching(/^data:image\/png;base64,/),

122+

},

123+

}),

124+

}),

125+

);

126+

expect(body).not.toHaveProperty("reference_images");

127+

expect(result.metadata).toEqual(

128+

expect.objectContaining({

129+

mode: "generate",

130+

}),

131+

);

132+

});

133+134+

it("sends reference_image roles through xAI reference_images mode", async () => {

135+

postJsonRequestMock.mockResolvedValue({

136+

response: {

137+

json: async () => ({

138+

request_id: "req_refs",

139+

}),

140+

},

141+

release: vi.fn(async () => {}),

142+

});

143+

fetchWithTimeoutMock

144+

.mockResolvedValueOnce({

145+

json: async () => ({

146+

request_id: "req_refs",

147+

status: "done",

148+

video: { url: "https://cdn.x.ai/reference-video.mp4" },

149+

}),

150+

})

151+

.mockResolvedValueOnce({

152+

headers: new Headers({ "content-type": "video/mp4" }),

153+

arrayBuffer: async () => Buffer.from("reference-video-bytes"),

154+

});

155+156+

const provider = buildXaiVideoGenerationProvider();

157+

const result = await provider.generateVideo({

158+

provider: "xai",

159+

model: "grok-imagine-video",

160+

prompt: "Make a cinematic brand vignette using these references",

161+

cfg: {},

162+

durationSeconds: 12,

163+

aspectRatio: "9:16",

164+

resolution: "720P",

165+

inputImages: [

166+

{ url: "https://example.com/subject.png", role: "reference_image" },

167+

{ url: "https://example.com/style.png", role: "reference_image" },

168+

],

169+

});

170+171+

const body = postJsonRequestMock.mock.calls[0]?.[0]?.body as Record<string, unknown>;

172+

expect(postJsonRequestMock).toHaveBeenCalledWith(

173+

expect.objectContaining({

174+

url: "https://api.x.ai/v1/videos/generations",

175+

body: expect.objectContaining({

176+

reference_images: [

177+

{ url: "https://example.com/subject.png" },

178+

{ url: "https://example.com/style.png" },

179+

],

180+

duration: 10,

181+

aspect_ratio: "9:16",

182+

resolution: "720p",

183+

}),

184+

}),

185+

);

186+

expect(body).not.toHaveProperty("image");

187+

expect(result.metadata).toEqual(

188+

expect.objectContaining({

189+

mode: "referenceToVideo",

190+

}),

191+

);

192+

});

193+194+

it("rejects mixed xAI first-frame and reference-image roles", async () => {

195+

const provider = buildXaiVideoGenerationProvider();

196+197+

await expect(

198+

provider.generateVideo({

199+

provider: "xai",

200+

model: "grok-imagine-video",

201+

prompt: "Use both images",

202+

cfg: {},

203+

inputImages: [

204+

{ url: "https://example.com/subject.png", role: "reference_image" },

205+

{ url: "https://example.com/first-frame.png", role: "first_frame" },

206+

],

207+

}),

208+

).rejects.toThrow(

209+

"xAI reference-image video generation requires every image role to be reference_image.",

210+

);

211+

expect(postJsonRequestMock).not.toHaveBeenCalled();

212+

});

213+84214

it("routes video inputs to the extension endpoint when duration is set", async () => {

85215

postJsonRequestMock.mockResolvedValue({

86216

response: {