惯性聚合 高效追踪和阅读你感兴趣的博客、新闻、科技资讯
阅读原文 在惯性聚合中打开

推荐订阅源

V
Visual Studio Blog
Y
Y Combinator Blog
奇客Solidot–传递最新科技情报
奇客Solidot–传递最新科技情报
Hugging Face - Blog
Hugging Face - Blog
钛媒体:引领未来商业与生活新知
钛媒体:引领未来商业与生活新知
OSCHINA 社区最新新闻
OSCHINA 社区最新新闻
The Cloudflare Blog
L
LangChain Blog
美团技术团队
N
Netflix TechBlog - Medium
量子位
酷 壳 – CoolShell
酷 壳 – CoolShell
B
Blog
博客园 - 司徒正美
爱范儿
爱范儿
D
DataBreaches.Net
月光博客
月光博客
U
Unit 42
B
Blog RSS Feed
Engineering at Meta
Engineering at Meta
Apple Machine Learning Research
Apple Machine Learning Research
Jina AI
Jina AI
MongoDB | Blog
MongoDB | Blog
腾讯CDC

Recent Commits to openclaw:main

test: merge chat side-result checks · openclaw/openclaw@ddd2c2a test: merge cron history checks · openclaw/openclaw@f7eb746 test: merge responsive navigation shell checks · openclaw/openclaw@c2e4b47 docs(changelog): add codex oauth fixes · openclaw/openclaw@628e6cd test: merge navigation routing cases · openclaw/openclaw@5d8cecb Tests: mock channel registry bundled fallback · openclaw/openclaw@2b08233 Secrets: avoid broad web search discovery for single plugin config · openclaw/openclaw@a464f59 test: merge config view browser checks · openclaw/openclaw@20cf511 fix(status): align oauth health with runtime · openclaw/openclaw@eed7116 feat: add macOS screen snapshots for monitor preview (#67954) thanks … · openclaw/openclaw@f377db1 fix: report shared auth scopes in hello-ok (#67810) thanks @BunsDev · openclaw/openclaw@0b6c39b Auto-reply: avoid eager bundled route fallback · openclaw/openclaw@3ea1bf4 Tests: narrow session binding contract setup · openclaw/openclaw@54e4e16 fix(macOS): enable undo/redo in webchat composer text input (#34962) · openclaw/openclaw@00951dc Tests: speed up channel setup promotion · openclaw/openclaw@82b529a Docs: refresh agent instructions · openclaw/openclaw@5775fe2 fix(auth): serialize OAuth refresh across agents to fix #26322 (#67876) · openclaw/openclaw@8e79080 test: allow ollama public surface boundary test · openclaw/openclaw@7d4f1a6 Docs: add test performance guardrails · openclaw/openclaw@89706d3 Tests: restore context-engine usage proof · openclaw/openclaw@e4c4f95 Tests: slim context engine runtime coverage · openclaw/openclaw@74c198f ci: retry failed custom checkouts · openclaw/openclaw@0ee5baf test: trim duplicate provider auth onboarding cases · openclaw/openclaw@1ffc02e matrix: fix sessions_spawn --thread subagent session spawning (#67643) · openclaw/openclaw@1ce2596 test: reduce auth choice fixture churn · openclaw/openclaw@857b9cd test: mock health status config boundaries · openclaw/openclaw@9d5ab4a test: mock onboard config io boundary · openclaw/openclaw@299694d test: mock legacy state plugin boundaries · openclaw/openclaw@2713089 test: mock channel install boundaries · openclaw/openclaw@b945248 test: mock doctor preview channel boundaries · openclaw/openclaw@b1a3ad4
feat(openai): add codex oauth image generation · openclaw...
steipete · 2026-04-24 · via Recent Commits to openclaw:main

@@ -1,5 +1,8 @@

11

import { afterEach, describe, expect, it, vi } from "vitest";

2-

import { buildOpenAIImageGenerationProvider } from "./image-generation-provider.js";

2+

import {

3+

buildOpenAICodexImageGenerationProvider,

4+

buildOpenAIImageGenerationProvider,

5+

} from "./image-generation-provider.js";

3647

const {

58

resolveApiKeyForProviderMock,

@@ -47,6 +50,32 @@ function mockGeneratedPngResponse() {

4750

});

4851

}

495253+

function mockCodexImageStream(params: { imageData?: string; revisedPrompt?: string } = {}) {

54+

const image = Buffer.from(params.imageData ?? "codex-png-bytes").toString("base64");

55+

const events = [

56+

{

57+

type: "response.output_item.done",

58+

item: {

59+

type: "image_generation_call",

60+

result: image,

61+

...(params.revisedPrompt ? { revised_prompt: params.revisedPrompt } : {}),

62+

},

63+

},

64+

{

65+

type: "response.completed",

66+

response: {

67+

usage: { input_tokens: 10, output_tokens: 20, total_tokens: 30 },

68+

tool_usage: { image_gen: { total_tokens: 30 } },

69+

},

70+

},

71+

];

72+

const body = events.map((event) => `data: ${JSON.stringify(event)}\n\n`).join("");

73+

postJsonRequestMock.mockImplementation(async () => ({

74+

response: new Response(body),

75+

release: vi.fn(async () => {}),

76+

}));

77+

}

78+5079

describe("openai image generation provider", () => {

5180

afterEach(() => {

5281

resolveApiKeyForProviderMock.mockClear();

@@ -252,6 +281,132 @@ describe("openai image generation provider", () => {

252281

expect(result.images).toHaveLength(1);

253282

});

254283284+

it("registers Codex OAuth image generation through Responses streaming", async () => {

285+

mockCodexImageStream({ imageData: "codex-image", revisedPrompt: "revised codex prompt" });

286+287+

const provider = buildOpenAICodexImageGenerationProvider();

288+

const authStore = { version: 1, profiles: {} };

289+

const result = await provider.generateImage({

290+

provider: "openai-codex",

291+

model: "gpt-image-2",

292+

prompt: "Draw a Codex lighthouse",

293+

cfg: {},

294+

authStore,

295+

count: 1,

296+

size: "1024x1536",

297+

});

298+299+

expect(resolveApiKeyForProviderMock).toHaveBeenCalledWith(

300+

expect.objectContaining({

301+

provider: "openai-codex",

302+

store: authStore,

303+

}),

304+

);

305+

expect(resolveProviderHttpRequestConfigMock).toHaveBeenCalledWith(

306+

expect.objectContaining({

307+

defaultBaseUrl: "https://chatgpt.com/backend-api/codex",

308+

defaultHeaders: expect.objectContaining({

309+

Authorization: "Bearer openai-key",

310+

Accept: "text/event-stream",

311+

}),

312+

provider: "openai-codex",

313+

api: "openai-codex-responses",

314+

capability: "image",

315+

}),

316+

);

317+

expect(postJsonRequestMock).toHaveBeenCalledWith(

318+

expect.objectContaining({

319+

url: "https://chatgpt.com/backend-api/codex/responses",

320+

body: expect.objectContaining({

321+

model: "gpt-5.4",

322+

instructions: "You are an image generation assistant.",

323+

stream: true,

324+

store: false,

325+

tools: [

326+

{

327+

type: "image_generation",

328+

model: "gpt-image-2",

329+

size: "1024x1536",

330+

},

331+

],

332+

tool_choice: { type: "image_generation" },

333+

}),

334+

}),

335+

);

336+

expect(postMultipartRequestMock).not.toHaveBeenCalled();

337+

expect(result.images).toEqual([

338+

{

339+

buffer: Buffer.from("codex-image"),

340+

mimeType: "image/png",

341+

fileName: "image-1.png",

342+

revisedPrompt: "revised codex prompt",

343+

},

344+

]);

345+

expect(result.metadata).toEqual({

346+

responses: [

347+

{

348+

usage: { input_tokens: 10, output_tokens: 20, total_tokens: 30 },

349+

toolUsage: { image_gen: { total_tokens: 30 } },

350+

},

351+

],

352+

});

353+

});

354+355+

it("sends Codex reference images as Responses input images", async () => {

356+

mockCodexImageStream();

357+358+

const provider = buildOpenAICodexImageGenerationProvider();

359+

await provider.generateImage({

360+

provider: "openai-codex",

361+

model: "gpt-image-2",

362+

prompt: "Use the reference image",

363+

cfg: {},

364+

inputImages: [

365+

{ buffer: Buffer.from("png-bytes"), mimeType: "image/png", fileName: "ref.png" },

366+

],

367+

});

368+369+

const body = postJsonRequestMock.mock.calls[0]?.[0].body as {

370+

input: Array<{ content: Array<Record<string, string>> }>;

371+

};

372+

expect(body.input[0]?.content).toEqual([

373+

{ type: "input_text", text: "Use the reference image" },

374+

{

375+

type: "input_image",

376+

image_url: `data:image/png;base64,${Buffer.from("png-bytes").toString("base64")}`,

377+

detail: "auto",

378+

},

379+

]);

380+

expect(postJsonRequestMock).not.toHaveBeenCalledWith(

381+

expect.objectContaining({ url: expect.stringContaining("/images/edits") }),

382+

);

383+

expect(postMultipartRequestMock).not.toHaveBeenCalled();

384+

});

385+386+

it("satisfies Codex count by issuing one Responses request per image", async () => {

387+

mockCodexImageStream({ imageData: "codex-image" });

388+389+

const provider = buildOpenAICodexImageGenerationProvider();

390+

const result = await provider.generateImage({

391+

provider: "openai-codex",

392+

model: "gpt-image-2",

393+

prompt: "Draw two Codex icons",

394+

cfg: {},

395+

count: 2,

396+

});

397+398+

expect(postJsonRequestMock).toHaveBeenCalledTimes(2);

399+

const firstBody = postJsonRequestMock.mock.calls[0]?.[0].body as {

400+

tools: Array<Record<string, unknown>>;

401+

};

402+

expect(firstBody.tools[0]).toEqual({

403+

type: "image_generation",

404+

model: "gpt-image-2",

405+

size: "1024x1024",

406+

});

407+

expect(result.images.map((image) => image.fileName)).toEqual(["image-1.png", "image-2.png"]);

408+

});

409+255410

it("forwards SSRF guard fields to multipart edit requests", async () => {

256411

mockGeneratedPngResponse();

257412