- Discord: allow configuring a bounded `agentComponents.ttlMs` callback registry lifetime for long-running component workflows, with per-account overrides and a 24-hour cap. (#84189) Thanks @100menotu001.

- Plugin SDK: add row-level session workflow helpers and deprecate `loadSessionStore` so plugins can read and patch sessions without depending on the legacy whole-store shape. (#84693) Thanks @efpiva.

- Gateway/plugins: reuse a compatible Gateway startup plugin registry during dispatch so safe plugin dispatches avoid redundant registry loading. (#84324) Thanks @ai-hpc.

- Plugins/SDK: add a general `embeddingProviders` capability contract and registration API so embeddings can become a reusable provider surface outside memory-specific adapters.

- Dependencies: refresh provider, plugin, UI, and tooling packages, update `protobufjs` to 8.4.0 to clear the current npm advisory, and carry the Claude ACP completion patch forward to `@agentclientprotocol/claude-agent-acp` 0.36.1.

- Agents/tools: remove the old sender-owner tool gating path so configured tools stay visible for trusted sessions while command and channel-action auth still carry real sender identity.

- QA-Lab: add curated mock JSONL replay fixtures and first-drift reporting for runtime-parity audits. (#80323, refs #80176) Thanks @100yenadmin.

load pipeline, runtime helpers), see [Plugin internals](/plugins/architecture).

</Info>

Use this when OpenClaw needs a new shared domain such as image generation, video generation, or some future vendor-backed feature area.

Use this when OpenClaw needs a new shared domain such as embeddings, image

generation, video generation, or some future vendor-backed feature area.

The rule:

Keep those separate so fallback and policy remain explicit.

## Embedding providers

Use `embeddingProviders` for reusable vector embedding providers. This contract

is intentionally broader than memory: tools, search, retrieval, importers, or

future feature plugins can consume embeddings without depending on the memory

engine.

For memory-engine-specific adapters, keep using `memoryEmbeddingProviders`.

Those adapters own memory indexing details such as query/document split,

runtime metadata, and local memory engine setup. Do not make a generic

embedding provider depend on memory-owned modules unless the provider is only

usable by memory.

## Review checklist

Before shipping a new capability, verify:

| ---------------------- | ------------------------------------------------ | ------------------------------------ |

| Text inference | `api.registerProvider(...)` | `openai`, `anthropic` |

| CLI inference backend | `api.registerCliBackend(...)` | `openai`, `anthropic` |

| Embeddings | `api.registerEmbeddingProvider(...)` | Provider-owned vector plugins |

| Speech | `api.registerSpeechProvider(...)` | `elevenlabs`, `microsoft` |

| Realtime transcription | `api.registerRealtimeTranscriptionProvider(...)` | `openai` |

| Realtime voice | `api.registerRealtimeVoiceProvider(...)` | `openai` |

| `api.registerAgentHarness(...)` | Experimental low-level agent executor |

| `api.registerCliBackend(...)` | Local CLI inference backend |

| `api.registerChannel(...)` | Messaging channel |

| `api.registerEmbeddingProvider(...)` | Reusable vector embedding provider |

| `api.registerSpeechProvider(...)` | Text-to-speech / STT synthesis |

| `api.registerRealtimeTranscriptionProvider(...)` | Streaming realtime transcription |

| `api.registerRealtimeVoiceProvider(...)` | Duplex realtime voice sessions |

| `api.registerWebFetchProvider(...)` | Web fetch / scrape provider |

| `api.registerWebSearchProvider(...)` | Web search |

Embedding providers registered with `api.registerEmbeddingProvider(...)` must

also be listed in `contracts.embeddingProviders` in the plugin manifest. This

is the generic embedding surface for reusable vector generation. Memory-only

adapters still use `api.registerMemoryEmbeddingProvider(...)` and

`contracts.memoryEmbeddingProviders`.

### Tools and commands

Use [`defineToolPlugin`](/plugins/tool-plugins) for simple tool-only plugins

<Step title="Add extra capabilities (optional)">

### Step 5: Add extra capabilities

A provider plugin can register speech, realtime transcription, realtime

voice, media understanding, image generation, video generation, web fetch,

and web search alongside text inference. OpenClaw classifies this as a

A provider plugin can register embeddings, speech, realtime transcription,

realtime voice, media understanding, image generation, video generation,

web fetch, and web search alongside text inference. OpenClaw classifies this as a

**hybrid-capability** plugin - the recommended pattern for company plugins

(one plugin per vendor). See

[Internals: Capability Ownership](/plugins/architecture#capability-ownership-model).

});

```

</Tab>

<Tab title="Embeddings">

```typescript

api.registerEmbeddingProvider({

id: "acme-ai",

defaultModel: "acme-embed",

transport: "remote",

authProviderId: "acme-ai",

create: async ({ model }) => ({

provider: {

id: "acme-ai",

model,

dimensions: 1536,

embed: async (input) => {

const text = typeof input === "string" ? input : input.text;

return fetchAcmeEmbedding(text);

},

embedBatch: async (inputs) =>

Promise.all(

inputs.map((input) =>

fetchAcmeEmbedding(typeof input === "string" ? input : input.text),

),

),

},

}),

});

```

Declare the same id in `contracts.embeddingProviders`. This is the

general embedding contract for reusable vector generation. Use

`registerMemoryEmbeddingProvider(...)` only for memory-engine-specific

adapters.

</Tab>

<Tab title="Image and video generation">

Video capabilities use a **mode-aware** shape: `generate`,

`imageToVideo`, and `videoToVideo`. Flat aggregate fields like

| `plugin-sdk/provider-web-search-config-contract` | Narrow web-search config/credential helpers for providers that do not need plugin-enable wiring |

| `plugin-sdk/provider-web-search-contract` | Narrow web-search config/credential contract helpers such as `createWebSearchProviderContractFields`, `enablePluginInConfig`, `resolveProviderWebSearchPluginConfig`, and scoped credential setters/getters |

| `plugin-sdk/provider-web-search` | Web-search provider registration/cache/runtime helpers |

| `plugin-sdk/embedding-providers` | General embedding provider types and read helpers, including `EmbeddingProviderAdapter`, `getEmbeddingProvider(...)`, and `listEmbeddingProviders(...)`; plugins register providers through `api.registerEmbeddingProvider(...)` so manifest ownership is enforced |

| `plugin-sdk/provider-tools` | `ProviderToolCompatFamily`, `buildProviderToolCompatFamilyHooks`, and DeepSeek/Gemini/OpenAI schema cleanup + diagnostics |

| `plugin-sdk/provider-usage` | `fetchClaudeUsage` and similar |

| `plugin-sdk/provider-stream` | `ProviderStreamFamily`, `buildProviderStreamFamilyHooks`, `composeProviderStreamWrappers`, stream wrapper types, and shared Anthropic/Bedrock/DeepSeek V4/Google/Kilocode/Moonshot/OpenAI/OpenRouter/Z.A.I/MiniMax/Copilot wrapper helpers |

"types": "./dist/plugin-sdk/media-mime.d.ts",

"default": "./dist/plugin-sdk/media-mime.js"

},

"./plugin-sdk/embedding-providers": {

"types": "./dist/plugin-sdk/embedding-providers.d.ts",

"default": "./dist/plugin-sdk/embedding-providers.js"

},

"./plugin-sdk/media-generation-runtime": {

"types": "./dist/plugin-sdk/media-generation-runtime.d.ts",

"default": "./dist/plugin-sdk/media-generation-runtime.js"

"media-runtime",

"media-store",

"media-mime",

"embedding-providers",

"media-generation-runtime",

"conversation-binding-runtime",

"conversation-runtime",

channelIds: [],

cliBackendIds: [],

providerIds: [],

embeddingProviderIds: [],

speechProviderIds: [],

realtimeTranscriptionProviderIds: [],

realtimeVoiceProviderIds: [],