```bash

pnpm openclaw qa character-eval \

--model openai/gpt-5.4,thinking=medium,fast \

--model openai/gpt-5.5,thinking=medium,fast \

--model openai/gpt-5.2,thinking=xhigh \

--model openai/gpt-5,thinking=xhigh \

--model anthropic/claude-opus-4-6,thinking=high \

--model anthropic/claude-sonnet-4-6,thinking=high \

--model zai/glm-5.1,thinking=high \

--model moonshot/kimi-k2.5,thinking=high \

--model google/gemini-3.1-pro-preview,thinking=high \

--judge-model openai/gpt-5.4,thinking=xhigh,fast \

--judge-model openai/gpt-5.5,thinking=xhigh,fast \

--judge-model anthropic/claude-opus-4-6,thinking=high \

--blind-judge-models \

--concurrency 16 \

every transcript and run status, but candidate refs are replaced with neutral

labels such as `candidate-01`; the report maps rankings back to real refs after

parsing.

Candidate runs default to `high` thinking, with `medium` for GPT-5.4 and `xhigh`

Candidate runs default to `high` thinking, with `medium` for GPT-5.5 and `xhigh`

for older OpenAI eval refs that support it. Override a specific candidate inline with

`--model provider/model,thinking=<level>`. `--thinking <level>` still sets a

global fallback, and the older `--model-thinking <provider/model=level>` form is

`--concurrency` or `--judge-concurrency` when provider limits or local gateway

pressure make a run too noisy.

When no candidate `--model` is passed, the character eval defaults to

`openai/gpt-5.4`, `openai/gpt-5.2`, `openai/gpt-5`, `anthropic/claude-opus-4-6`,

`openai/gpt-5.5`, `openai/gpt-5.2`, `openai/gpt-5`, `anthropic/claude-opus-4-6`,

`anthropic/claude-sonnet-4-6`, `zai/glm-5.1`,

`moonshot/kimi-k2.5`, and

`google/gemini-3.1-pro-preview` when no `--model` is passed.

When no `--judge-model` is passed, the judges default to

`openai/gpt-5.4,thinking=xhigh,fast` and

`openai/gpt-5.5,thinking=xhigh,fast` and

`anthropic/claude-opus-4-6,thinking=high`.

## Related docs