An open, community-maintained catalog of LLM model parameters. Browse the UI below, query the API, or install the npm package.
Parameters
temperature
top_p
max_tokens
thinking.type
response_format.type
max_completion_tokens
top_k
frequency_penalty
presence_penalty
reasoning_effort
thinking.budget_tokens
stop
seed
do_sample
thinking.display
random_seed
safe_prompt
output_config.effort
reasoning.effort
generationConfig.maxOutputTokens
generationConfig.responseMimeType
generationConfig.seed
generationConfig.temperature
generationConfig.thinkingConfig.includeThoughts
generationConfig.topK
generationConfig.topP
reasoning.summary
text.verbosity
tool_choice
extra_body.top_k
k
logprobs
p
reasoning_split
safety_mode
stop_sequences
generationConfig.thinkingConfig.thinkingBudget
extra_body.chat_template_kwargs.enable_thinking
generationConfig.thinkingConfig.thinkingLevel
repetition_penalty
return_images
return_related_questions
search_after_date_filter
search_before_date_filter
search_domain_filter
search_mode
search_recency_filter
web_search_options.search_context_size
disable_search
n
prompt_mode
reasoning_budget
chunk_length
expert_type
flat_ner
max_output_tokens
overlap
text.format.type
thinking.token_budget
threshold
191 of 191 models
Sort models
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | 4096 | Maximum number of output tokens the model may generate. | — |
Sampling 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…2 step 0.1) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. | — |
|
Top P top_p
|
number (0…1 step 0.01) | 1 | Controls nucleus sampling by limiting generation to tokens whose cumulative probability reaches this value. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | 4096 | Maximum number of output tokens the model may generate. | — |
Sampling 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…2 step 0.1) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. | — |
|
Top P top_p
|
number (0…1 step 0.01) | 1 | Controls nucleus sampling by limiting generation to tokens whose cumulative probability reaches this value. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | 4096 | Maximum number of output tokens the model may generate. | — |
Sampling 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…2 step 0.1) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. | — |
|
Top P top_p
|
number (0…1 step 0.01) | 1 | Controls nucleus sampling by limiting generation to tokens whose cumulative probability reaches this value. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | 4096 | Maximum number of output tokens the model may generate. | — |
Sampling 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…2 step 0.1) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. | — |
|
Top P top_p
|
number (0…1 step 0.01) | 1 | Controls nucleus sampling by limiting generation to tokens whose cumulative probability reaches this value. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | 4096 | Maximum number of output tokens the model may generate. | — |
Sampling 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…2 step 0.1) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. | — |
|
Top P top_p
|
number (0…1 step 0.01) | 1 | Controls nucleus sampling by limiting generation to tokens whose cumulative probability reaches this value. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | 4096 | Maximum number of output tokens the model may generate. | — |
Sampling 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…2 step 0.1) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. | — |
|
Top P top_p
|
number (0…1 step 0.01) | 1 | Controls nucleus sampling by limiting generation to tokens whose cumulative probability reaches this value. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | 4096 | Maximum number of output tokens the model may generate. | — |
Sampling 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…2 step 0.1) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. | — |
|
Top P top_p
|
number (0…1 step 0.01) | 1 | Controls nucleus sampling by limiting generation to tokens whose cumulative probability reaches this value. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | 4096 | Maximum number of output tokens the model may generate. | — |
Sampling 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…2 step 0.1) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. | — |
|
Top P top_p
|
number (0…1 step 0.01) | 1 | Controls nucleus sampling by limiting generation to tokens whose cumulative probability reaches this value. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | 4096 | Maximum number of output tokens the model may generate. | — |
Sampling 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…2 step 0.1) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. | — |
|
Top P top_p
|
number (0…1 step 0.01) | 1 | Controls nucleus sampling by limiting generation to tokens whose cumulative probability reaches this value. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | 4096 | Maximum number of output tokens the model may generate. | — |
Sampling 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…2 step 0.1) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. | — |
|
Top P top_p
|
number (0…1 step 0.01) | 1 | Controls nucleus sampling by limiting generation to tokens whose cumulative probability reaches this value. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max completion tokens max_completion_tokens
|
integer (16…+∞) | 4096 | Maximum number of output tokens the model may generate. | — |
Reasoning 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Reasoning effort reasoning_effort
|
enum (minimal | low | medium | high) | "medium" | Controls how much reasoning the model should perform before producing an answer. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max completion tokens max_completion_tokens
|
integer (16…+∞) | 4096 | Maximum number of output tokens the model may generate. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max completion tokens max_completion_tokens
|
integer (16…+∞) | 4096 | Maximum number of output tokens the model may generate. | — |
Reasoning 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Reasoning effort reasoning_effort
|
enum (minimal | low | medium | high) | "medium" | Controls how much reasoning the model should perform before producing an answer. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max completion tokens max_completion_tokens
|
integer (16…+∞) | 4096 | Maximum number of output tokens the model may generate. | — |
Reasoning 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Reasoning effort reasoning_effort
|
enum (minimal | low | medium | high) | "medium" | Controls how much reasoning the model should perform before producing an answer. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max completion tokens max_completion_tokens
|
integer (16…+∞) | 4096 | Maximum number of output tokens the model may generate. | — |
Reasoning 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Reasoning effort reasoning_effort
|
enum (none | low | medium | high) | "none" | Controls how much reasoning the model should perform before producing an answer. | — |
Reasoning 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Reasoning effort reasoning.effort
|
enum (minimal | low | medium | high | xhigh) | "medium" | Controls how much reasoning the model should perform before producing an answer. | — |
|
Reasoning summary reasoning.summary
|
enum (auto | concise | detailed | none) | "auto" | Controls the level of reasoning summary returned with the response. | — |
Output 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Verbosity text.verbosity
|
enum (low | medium | high) | "medium" | Controls how concise or detailed the model's final text response should be. | — |
Reasoning 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Reasoning effort reasoning.effort
|
enum (minimal | low | medium | high) | "medium" | Controls how much reasoning the model should perform before producing an answer. | — |
|
Reasoning summary reasoning.summary
|
enum (auto | concise | detailed | none) | "auto" | Controls the level of reasoning summary returned with the response. | — |
Output 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Verbosity text.verbosity
|
enum (low | medium | high) | "medium" | Controls how concise or detailed the model's final text response should be. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max completion tokens max_completion_tokens
|
integer (16…+∞) | 4096 | Maximum number of output tokens the model may generate. | — |
Reasoning 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Reasoning effort reasoning_effort
|
enum (none | low | medium | high | xhigh) | "medium" | Controls how much reasoning the model should perform before producing an answer. | — |
Reasoning 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Reasoning effort reasoning.effort
|
enum (minimal | low | medium | high | xhigh) | "medium" | Controls how much reasoning the model should perform before producing an answer. | — |
|
Reasoning summary reasoning.summary
|
enum (auto | concise | detailed | none) | "auto" | Controls the level of reasoning summary returned with the response. | — |
Output 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Verbosity text.verbosity
|
enum (low | medium | high) | "medium" | Controls how concise or detailed the model's final text response should be. | — |
Reasoning 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Reasoning effort reasoning.effort
|
enum (minimal | low | medium | high | xhigh) | "medium" | Controls how much reasoning the model should perform before producing an answer. | — |
|
Reasoning summary reasoning.summary
|
enum (auto | concise | detailed | none) | "auto" | Controls the level of reasoning summary returned with the response. | — |
Output 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Verbosity text.verbosity
|
enum (low | medium | high) | "medium" | Controls how concise or detailed the model's final text response should be. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max completion tokens max_completion_tokens
|
integer (16…+∞) | 4096 | Maximum number of output tokens the model may generate. | — |
Reasoning 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Reasoning effort reasoning_effort
|
enum (low | medium | high | xhigh) | "medium" | Controls how much reasoning the model should perform before producing an answer. | — |
Reasoning 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Reasoning effort reasoning.effort
|
enum (minimal | low | medium | high | xhigh) | "medium" | Controls how much reasoning the model should perform before producing an answer. | — |
|
Reasoning summary reasoning.summary
|
enum (auto | concise | detailed | none) | "auto" | Controls the level of reasoning summary returned with the response. | — |
Output 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Verbosity text.verbosity
|
enum (low | medium | high) | "medium" | Controls how concise or detailed the model's final text response should be. | — |
Reasoning 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Reasoning effort reasoning.effort
|
enum (minimal | low | medium | high | xhigh) | "medium" | Controls how much reasoning the model should perform before producing an answer. | — |
|
Reasoning summary reasoning.summary
|
enum (auto | concise | detailed | none) | "auto" | Controls the level of reasoning summary returned with the response. | — |
Output 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Verbosity text.verbosity
|
enum (low | medium | high) | "medium" | Controls how concise or detailed the model's final text response should be. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max completion tokens max_completion_tokens
|
integer (16…+∞) | 4096 | Maximum number of output tokens the model may generate. | — |
Reasoning 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Reasoning effort reasoning_effort
|
enum (none | low | medium | high | xhigh) | "medium" | Controls how much reasoning the model should perform before producing an answer. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max completion tokens max_completion_tokens
|
integer (16…+∞) | 4096 | Maximum number of output tokens the model may generate. | — |
Reasoning 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Reasoning effort reasoning_effort
|
enum (none | low | medium | high | xhigh) | "medium" | Controls how much reasoning the model should perform before producing an answer. | — |
Reasoning 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Reasoning effort reasoning.effort
|
enum (minimal | low | medium | high | xhigh) | "medium" | Controls how much reasoning the model should perform before producing an answer. | — |
|
Reasoning summary reasoning.summary
|
enum (auto | concise | detailed | none) | "auto" | Controls the level of reasoning summary returned with the response. | — |
Output 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Verbosity text.verbosity
|
enum (low | medium | high) | "medium" | Controls how concise or detailed the model's final text response should be. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max completion tokens max_completion_tokens
|
integer (16…+∞) | 4096 | Maximum number of output tokens the model may generate. | — |
Reasoning 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Reasoning effort reasoning_effort
|
enum (none | low | medium | high | xhigh) | "medium" | Controls how much reasoning the model should perform before producing an answer. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max completion tokens max_completion_tokens
|
integer (16…+∞) | 4096 | Maximum number of output tokens the model may generate. | — |
Reasoning 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Reasoning effort reasoning_effort
|
enum (medium | high | xhigh) | "medium" | Controls how much reasoning the model should perform before producing an answer. | — |
Reasoning 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Reasoning effort reasoning.effort
|
enum (medium | high | xhigh) | "medium" | Controls how much reasoning the model should perform before producing an answer. | — |
|
Reasoning summary reasoning.summary
|
enum (auto | concise | detailed | none) | "auto" | Controls the level of reasoning summary returned with the response. | — |
Output 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Verbosity text.verbosity
|
enum (low | medium | high) | "medium" | Controls how concise or detailed the model's final text response should be. | — |
Reasoning 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Reasoning effort reasoning.effort
|
enum (minimal | low | medium | high | xhigh) | "medium" | Controls how much reasoning the model should perform before producing an answer. | — |
|
Reasoning summary reasoning.summary
|
enum (auto | concise | detailed | none) | "auto" | Controls the level of reasoning summary returned with the response. | — |
Output 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Verbosity text.verbosity
|
enum (low | medium | high) | "medium" | Controls how concise or detailed the model's final text response should be. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max completion tokens max_completion_tokens
|
integer (16…+∞) | 4096 | Maximum number of output tokens the model may generate. | — |
Reasoning 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Reasoning effort reasoning_effort
|
enum (none | low | medium | high | xhigh) | "medium" | Controls how much reasoning the model should perform before producing an answer. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max completion tokens max_completion_tokens
|
integer (16…+∞) | 4096 | Maximum number of output tokens the model may generate. | — |
Reasoning 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Reasoning effort reasoning_effort
|
enum (medium | high | xhigh) | "medium" | Controls how much reasoning the model should perform before producing an answer. | — |
Reasoning 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Reasoning effort reasoning.effort
|
enum (medium | high | xhigh) | "medium" | Controls how much reasoning the model should perform before producing an answer. | — |
|
Reasoning summary reasoning.summary
|
enum (auto | concise | detailed | none) | "auto" | Controls the level of reasoning summary returned with the response. | — |
Output 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Verbosity text.verbosity
|
enum (low | medium | high) | "medium" | Controls how concise or detailed the model's final text response should be. | — |
Reasoning 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Reasoning effort reasoning.effort
|
enum (minimal | low | medium | high | xhigh) | "medium" | Controls how much reasoning the model should perform before producing an answer. | — |
|
Reasoning summary reasoning.summary
|
enum (auto | concise | detailed | none) | "auto" | Controls the level of reasoning summary returned with the response. | — |
Output 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Verbosity text.verbosity
|
enum (low | medium | high) | "medium" | Controls how concise or detailed the model's final text response should be. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max completion tokens max_completion_tokens
|
integer (16…+∞) | 4096 | Maximum number of output tokens the model may generate. | — |
Reasoning 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Reasoning effort reasoning_effort
|
enum (low | medium | high | xhigh) | "medium" | Controls how much reasoning the model should perform before producing an answer. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | 4096 | Maximum number of output tokens the model may generate. | — |
Reasoning 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Reasoning effort reasoning_effort
|
enum (minimal | low | medium | high) | "medium" | Controls how much reasoning the model should perform before producing an answer. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | 4096 | Maximum number of output tokens the model may generate. | — |
Reasoning 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Reasoning effort reasoning_effort
|
enum (minimal | low | medium | high) | "medium" | Controls how much reasoning the model should perform before producing an answer. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max completion tokens max_completion_tokens
|
integer (16…+∞) | 4096 | Maximum number of output tokens the model may generate. | — |
Reasoning 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Reasoning effort reasoning_effort
|
enum (low | medium | high | xhigh) | "medium" | Controls how much reasoning the model should perform before producing an answer. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max completion tokens max_completion_tokens
|
integer (16…+∞) | 4096 | Maximum number of output tokens the model may generate. | — |
Reasoning 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Reasoning effort reasoning_effort
|
enum (low | medium | high | xhigh) | "medium" | Controls how much reasoning the model should perform before producing an answer. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max completion tokens max_completion_tokens
|
integer (16…+∞) | 4096 | Maximum number of output tokens the model may generate. | — |
Reasoning 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Reasoning effort reasoning_effort
|
enum (low | medium | high | xhigh) | "medium" | Controls how much reasoning the model should perform before producing an answer. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max completion tokens max_completion_tokens
|
integer (16…+∞) | 4096 | Maximum number of output tokens the model may generate. | — |
Reasoning 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Reasoning effort reasoning_effort
|
enum (low | medium | high | xhigh) | "medium" | Controls how much reasoning the model should perform before producing an answer. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | 4096 | Maximum number of output tokens the model may generate. | — |
Sampling 3 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…1 step 0.1) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. |
Not when thinking.type ∈ {"adaptive", "enabled"} |
|
Top P top_p
|
number (0…1 step 0.01) | 1 | Controls nucleus sampling by limiting generation to tokens whose cumulative probability reaches this value. |
Not when thinking.type ∈ {"adaptive", "enabled"} or temperature ≠ 1 |
|
Top K top_k
|
integer (0…+∞) | 0 | Limits token sampling to the top K most likely next tokens. |
Not when thinking.type ∈ {"adaptive", "enabled"} |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | 4096 | Maximum number of output tokens the model may generate. | — |
Sampling 3 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…1 step 0.1) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. |
Not when thinking.type ∈ {"adaptive", "enabled"} |
|
Top P top_p
|
number (0…1 step 0.01) | 1 | Controls nucleus sampling by limiting generation to tokens whose cumulative probability reaches this value. |
Not when thinking.type ∈ {"adaptive", "enabled"} or temperature ≠ 1 |
|
Top K top_k
|
integer (0…+∞) | 0 | Limits token sampling to the top K most likely next tokens. |
Not when thinking.type ∈ {"adaptive", "enabled"} |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | 4096 | Maximum number of output tokens the model may generate. | — |
Sampling 3 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…1 step 0.1) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. |
Not when thinking.type ∈ {"adaptive", "enabled"} |
|
Top P top_p
|
number (0…1 step 0.01) | 1 | Controls nucleus sampling by limiting generation to tokens whose cumulative probability reaches this value. |
Not when thinking.type ∈ {"adaptive", "enabled"} or temperature ≠ 1 |
|
Top K top_k
|
integer (0…+∞) | 0 | Limits token sampling to the top K most likely next tokens. |
Not when thinking.type ∈ {"adaptive", "enabled"} |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | 4096 | Maximum number of output tokens the model may generate. | — |
Sampling 3 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…1 step 0.1) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. |
Not when thinking.type ∈ {"adaptive", "enabled"} |
|
Top P top_p
|
number (0…1 step 0.01) | 1 | Controls nucleus sampling by limiting generation to tokens whose cumulative probability reaches this value. |
Not when thinking.type ∈ {"adaptive", "enabled"} or temperature ≠ 1 |
|
Top K top_k
|
integer (0…+∞) | 0 | Limits token sampling to the top K most likely next tokens. |
Not when thinking.type ∈ {"adaptive", "enabled"} |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | 4096 | Maximum number of output tokens the model may generate. | — |
Sampling 3 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…1 step 0.1) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. |
Not when thinking.type ∈ {"adaptive", "enabled"} |
|
Top P top_p
|
number (0…1 step 0.01) | 1 | Controls nucleus sampling by limiting generation to tokens whose cumulative probability reaches this value. |
Not when thinking.type ∈ {"adaptive", "enabled"} or temperature ≠ 1 |
|
Top K top_k
|
integer (0…+∞) | 0 | Limits token sampling to the top K most likely next tokens. |
Not when thinking.type ∈ {"adaptive", "enabled"} |
Reasoning 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Thinking mode thinking.type
|
enum (disabled | enabled) | "disabled" | Controls the Anthropic thinking mode values supported by this model. | — |
|
Budget tokens thinking.budget_tokens
|
integer (1024…+∞) | 4096 | Maximum token budget Anthropic may use for extended thinking before producing the final answer. |
Only when thinking.type = "enabled" |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | 4096 | Maximum number of output tokens the model may generate. | — |
Sampling 3 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…1 step 0.1) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. |
Not when thinking.type ∈ {"adaptive", "enabled"} |
|
Top P top_p
|
number (0…1 step 0.01) | 1 | Controls nucleus sampling by limiting generation to tokens whose cumulative probability reaches this value. |
Not when thinking.type ∈ {"adaptive", "enabled"} or temperature ≠ 1 |
|
Top K top_k
|
integer (0…+∞) | 0 | Limits token sampling to the top K most likely next tokens. |
Not when thinking.type ∈ {"adaptive", "enabled"} |
Reasoning 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Thinking mode thinking.type
|
enum (disabled | enabled) | "disabled" | Controls the Anthropic thinking mode values supported by this model. | — |
|
Budget tokens thinking.budget_tokens
|
integer (1024…+∞) | 4096 | Maximum token budget Anthropic may use for extended thinking before producing the final answer. |
Only when thinking.type = "enabled" |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | 4096 | Maximum number of output tokens the model may generate. | — |
Sampling 3 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…1 step 0.1) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. |
Not when thinking.type ∈ {"adaptive", "enabled"} |
|
Top P top_p
|
number (0…1 step 0.01) | 1 | Controls nucleus sampling by limiting generation to tokens whose cumulative probability reaches this value. |
Not when thinking.type ∈ {"adaptive", "enabled"} or temperature ≠ 1 |
|
Top K top_k
|
integer (0…+∞) | 0 | Limits token sampling to the top K most likely next tokens. |
Not when thinking.type ∈ {"adaptive", "enabled"} |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | 4096 | Maximum number of output tokens the model may generate. | — |
Sampling 3 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…1 step 0.1) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. |
Not when thinking.type ∈ {"adaptive", "enabled"} |
|
Top P top_p
|
number (0…1 step 0.01) | 1 | Controls nucleus sampling by limiting generation to tokens whose cumulative probability reaches this value. |
Not when thinking.type ∈ {"adaptive", "enabled"} or temperature ≠ 1 |
|
Top K top_k
|
integer (0…+∞) | 0 | Limits token sampling to the top K most likely next tokens. |
Not when thinking.type ∈ {"adaptive", "enabled"} |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | 4096 | Maximum number of output tokens the model may generate. | — |
Reasoning 3 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Thinking mode thinking.type
|
enum (adaptive) | — | Only adaptive thinking is supported; omit the parameter entirely to run without thinking (an explicit disabled value is rejected). | — |
|
Thinking display thinking.display
|
enum (summarized | omitted) | "omitted" | Controls whether Anthropic returns summarized or omitted thinking content. |
Only when thinking.type = "adaptive" |
|
Effort output_config.effort
|
enum (low | medium | high | xhigh | max) | "high" | Controls Anthropic response thoroughness and token spend. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | 4096 | Maximum number of output tokens the model may generate. | — |
Reasoning 3 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Thinking mode thinking.type
|
enum (adaptive) | — | Only adaptive thinking is supported; omit the parameter entirely to run without thinking (an explicit disabled value is rejected). | — |
|
Thinking display thinking.display
|
enum (summarized | omitted) | "omitted" | Controls whether Anthropic returns summarized or omitted thinking content. |
Only when thinking.type = "adaptive" |
|
Effort output_config.effort
|
enum (low | medium | high | xhigh | max) | "high" | Controls Anthropic response thoroughness and token spend. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | 4096 | Maximum number of output tokens the model may generate. | — |
Sampling 3 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…1 step 0.1) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. |
Not when thinking.type ∈ {"adaptive", "enabled"} |
|
Top P top_p
|
number (0…1 step 0.01) | 1 | Controls nucleus sampling by limiting generation to tokens whose cumulative probability reaches this value. |
Not when thinking.type ∈ {"adaptive", "enabled"} or temperature ≠ 1 |
|
Top K top_k
|
integer (0…+∞) | 0 | Limits token sampling to the top K most likely next tokens. |
Not when thinking.type ∈ {"adaptive", "enabled"} |
Reasoning 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Thinking mode thinking.type
|
enum (disabled | enabled) | "disabled" | Controls the Anthropic thinking mode values supported by this model. | — |
|
Budget tokens thinking.budget_tokens
|
integer (1024…+∞) | 4096 | Maximum token budget Anthropic may use for extended thinking before producing the final answer. |
Only when thinking.type = "enabled" |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | 4096 | Maximum number of output tokens the model may generate. | — |
Sampling 3 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…1 step 0.1) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. |
Not when thinking.type ∈ {"adaptive", "enabled"} |
|
Top P top_p
|
number (0…1 step 0.01) | 1 | Controls nucleus sampling by limiting generation to tokens whose cumulative probability reaches this value. |
Not when thinking.type ∈ {"adaptive", "enabled"} or temperature ≠ 1 |
|
Top K top_k
|
integer (0…+∞) | 0 | Limits token sampling to the top K most likely next tokens. |
Not when thinking.type ∈ {"adaptive", "enabled"} |
Reasoning 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Thinking mode thinking.type
|
enum (disabled | enabled) | "disabled" | Controls the Anthropic thinking mode values supported by this model. | — |
|
Budget tokens thinking.budget_tokens
|
integer (1024…+∞) | 4096 | Maximum token budget Anthropic may use for extended thinking before producing the final answer. |
Only when thinking.type = "enabled" |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | 4096 | Maximum number of output tokens the model may generate. | — |
Sampling 3 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…1 step 0.1) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. |
Not when thinking.type = "enabled" or top_p ≠ null |
|
Top P top_p
|
number (0…1 step 0.01) | 1 | Controls nucleus sampling by limiting generation to tokens whose cumulative probability reaches this value. |
Not when thinking.type = "enabled" or temperature ≠ null |
|
Top K top_k
|
integer (0…+∞) | 0 | Limits token sampling to the top K most likely next tokens. |
Not when thinking.type = "enabled" |
Reasoning 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Thinking mode thinking.type
|
enum (disabled | enabled) | "disabled" | Controls the Anthropic thinking mode values supported by this model. | — |
|
Budget tokens thinking.budget_tokens
|
integer (1024…+∞) | 4096 | Maximum token budget Anthropic may use for extended thinking before producing the final answer. |
Only when thinking.type = "enabled" |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | 4096 | Maximum number of output tokens the model may generate. | — |
Sampling 3 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…1 step 0.1) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. |
Not when thinking.type = "enabled" or top_p ≠ null |
|
Top P top_p
|
number (0…1 step 0.01) | 1 | Controls nucleus sampling by limiting generation to tokens whose cumulative probability reaches this value. |
Not when thinking.type = "enabled" or temperature ≠ null |
|
Top K top_k
|
integer (0…+∞) | 0 | Limits token sampling to the top K most likely next tokens. |
Not when thinking.type = "enabled" |
Reasoning 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Thinking mode thinking.type
|
enum (disabled | enabled) | "disabled" | Controls the Anthropic thinking mode values supported by this model. | — |
|
Budget tokens thinking.budget_tokens
|
integer (1024…+∞) | 4096 | Maximum token budget Anthropic may use for extended thinking before producing the final answer. |
Only when thinking.type = "enabled" |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | 4096 | Maximum number of output tokens the model may generate. | — |
Sampling 3 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…1 step 0.1) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. |
Not when thinking.type ∈ {"adaptive", "enabled"} |
|
Top P top_p
|
number (0…1 step 0.01) | 1 | Controls nucleus sampling by limiting generation to tokens whose cumulative probability reaches this value. |
Not when thinking.type ∈ {"adaptive", "enabled"} or temperature ≠ 1 |
|
Top K top_k
|
integer (0…+∞) | 0 | Limits token sampling to the top K most likely next tokens. |
Not when thinking.type ∈ {"adaptive", "enabled"} |
Reasoning 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Thinking mode thinking.type
|
enum (disabled | enabled) | "disabled" | Controls the Anthropic thinking mode values supported by this model. | — |
|
Budget tokens thinking.budget_tokens
|
integer (1024…+∞) | 4096 | Maximum token budget Anthropic may use for extended thinking before producing the final answer. |
Only when thinking.type = "enabled" |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | 4096 | Maximum number of output tokens the model may generate. | — |
Sampling 3 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…1 step 0.1) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. |
Not when thinking.type ∈ {"adaptive", "enabled"} |
|
Top P top_p
|
number (0…1 step 0.01) | 1 | Controls nucleus sampling by limiting generation to tokens whose cumulative probability reaches this value. |
Not when thinking.type ∈ {"adaptive", "enabled"} or temperature ≠ 1 |
|
Top K top_k
|
integer (0…+∞) | 0 | Limits token sampling to the top K most likely next tokens. |
Not when thinking.type ∈ {"adaptive", "enabled"} |
Reasoning 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Thinking mode thinking.type
|
enum (disabled | enabled) | "disabled" | Controls the Anthropic thinking mode values supported by this model. | — |
|
Budget tokens thinking.budget_tokens
|
integer (1024…+∞) | 4096 | Maximum token budget Anthropic may use for extended thinking before producing the final answer. |
Only when thinking.type = "enabled" |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | 4096 | Maximum number of output tokens the model may generate. | — |
Sampling 3 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…1 step 0.1) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. |
Not when thinking.type = "enabled" or top_p ≠ null |
|
Top P top_p
|
number (0…1 step 0.01) | 1 | Controls nucleus sampling by limiting generation to tokens whose cumulative probability reaches this value. |
Not when thinking.type = "enabled" or temperature ≠ null |
|
Top K top_k
|
integer (0…+∞) | 0 | Limits token sampling to the top K most likely next tokens. |
Not when thinking.type = "enabled" |
Reasoning 3 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Thinking mode thinking.type
|
enum (disabled | enabled) | "disabled" | Controls the Anthropic thinking mode values supported by this model. | — |
|
Budget tokens thinking.budget_tokens
|
integer (1024…+∞) | 4096 | Maximum token budget Anthropic may use for extended thinking before producing the final answer. |
Only when thinking.type = "enabled" |
|
Thinking display thinking.display
|
enum (summarized | omitted) | "summarized" | Controls whether Anthropic returns summarized or omitted thinking content. |
Only when thinking.type = "enabled" |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | 4096 | Maximum number of output tokens the model may generate. | — |
Sampling 3 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…1 step 0.1) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. |
Not when thinking.type = "enabled" or top_p ≠ null |
|
Top P top_p
|
number (0…1 step 0.01) | 1 | Controls nucleus sampling by limiting generation to tokens whose cumulative probability reaches this value. |
Not when thinking.type = "enabled" or temperature ≠ null |
|
Top K top_k
|
integer (0…+∞) | 0 | Limits token sampling to the top K most likely next tokens. |
Not when thinking.type = "enabled" |
Reasoning 3 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Thinking mode thinking.type
|
enum (disabled | enabled) | "disabled" | Controls the Anthropic thinking mode values supported by this model. | — |
|
Budget tokens thinking.budget_tokens
|
integer (1024…+∞) | 4096 | Maximum token budget Anthropic may use for extended thinking before producing the final answer. |
Only when thinking.type = "enabled" |
|
Thinking display thinking.display
|
enum (summarized | omitted) | "summarized" | Controls whether Anthropic returns summarized or omitted thinking content. |
Only when thinking.type = "enabled" |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | 4096 | Maximum number of output tokens the model may generate. | — |
Sampling 3 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…1 step 0.1) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. |
Not when thinking.type = "enabled" |
|
Top P top_p
|
number (0…1 step 0.01) | 1 | Controls nucleus sampling by limiting generation to tokens whose cumulative probability reaches this value. |
Not when thinking.type = "enabled" |
|
Top K top_k
|
integer (0…+∞) | 0 | Limits token sampling to the top K most likely next tokens. |
Not when thinking.type = "enabled" |
Reasoning 3 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Thinking mode thinking.type
|
enum (disabled | enabled) | "disabled" | Controls the Anthropic thinking mode values supported by this model. | — |
|
Budget tokens thinking.budget_tokens
|
integer (1024…+∞) | 4096 | Maximum token budget Anthropic may use for extended thinking before producing the final answer. |
Only when thinking.type = "enabled" |
|
Thinking display thinking.display
|
enum (summarized | omitted) | "summarized" | Controls whether Anthropic returns summarized or omitted thinking content. |
Only when thinking.type = "enabled" |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | 4096 | Maximum number of output tokens the model may generate. | — |
Sampling 3 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…1 step 0.1) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. |
Not when thinking.type = "enabled" |
|
Top P top_p
|
number (0…1 step 0.01) | 1 | Controls nucleus sampling by limiting generation to tokens whose cumulative probability reaches this value. |
Not when thinking.type = "enabled" |
|
Top K top_k
|
integer (0…+∞) | 0 | Limits token sampling to the top K most likely next tokens. |
Not when thinking.type = "enabled" |
Reasoning 3 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Thinking mode thinking.type
|
enum (disabled | enabled) | "disabled" | Controls the Anthropic thinking mode values supported by this model. | — |
|
Budget tokens thinking.budget_tokens
|
integer (1024…+∞) | 4096 | Maximum token budget Anthropic may use for extended thinking before producing the final answer. |
Only when thinking.type = "enabled" |
|
Thinking display thinking.display
|
enum (summarized | omitted) | "summarized" | Controls whether Anthropic returns summarized or omitted thinking content. |
Only when thinking.type = "enabled" |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | 4096 | Maximum number of output tokens the model may generate. | — |
Sampling 3 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…1 step 0.1) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. |
Not when thinking.type = "enabled" or top_p ≠ null |
|
Top P top_p
|
number (0…1 step 0.01) | 1 | Controls nucleus sampling by limiting generation to tokens whose cumulative probability reaches this value. |
Not when thinking.type = "enabled" or temperature ≠ null |
|
Top K top_k
|
integer (0…+∞) | 0 | Limits token sampling to the top K most likely next tokens. |
Not when thinking.type = "enabled" |
Reasoning 4 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Thinking mode thinking.type
|
enum (disabled | enabled) | "disabled" | Controls the Anthropic thinking mode values supported by this model. | — |
|
Budget tokens thinking.budget_tokens
|
integer (1024…+∞) | 4096 | Maximum token budget Anthropic may use for extended thinking before producing the final answer. |
Only when thinking.type = "enabled" |
|
Thinking display thinking.display
|
enum (summarized | omitted) | "summarized" | Controls whether Anthropic returns summarized or omitted thinking content. |
Only when thinking.type = "enabled" |
|
Effort output_config.effort
|
enum (low | medium | high) | "high" | Controls Anthropic response thoroughness and token spend. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | 4096 | Maximum number of output tokens the model may generate. | — |
Sampling 3 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…1 step 0.1) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. |
Not when thinking.type = "enabled" or top_p ≠ null |
|
Top P top_p
|
number (0…1 step 0.01) | 1 | Controls nucleus sampling by limiting generation to tokens whose cumulative probability reaches this value. |
Not when thinking.type = "enabled" or temperature ≠ null |
|
Top K top_k
|
integer (0…+∞) | 0 | Limits token sampling to the top K most likely next tokens. |
Not when thinking.type = "enabled" |
Reasoning 4 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Thinking mode thinking.type
|
enum (disabled | enabled) | "disabled" | Controls the Anthropic thinking mode values supported by this model. | — |
|
Budget tokens thinking.budget_tokens
|
integer (1024…+∞) | 4096 | Maximum token budget Anthropic may use for extended thinking before producing the final answer. |
Only when thinking.type = "enabled" |
|
Thinking display thinking.display
|
enum (summarized | omitted) | "summarized" | Controls whether Anthropic returns summarized or omitted thinking content. |
Only when thinking.type = "enabled" |
|
Effort output_config.effort
|
enum (low | medium | high) | "high" | Controls Anthropic response thoroughness and token spend. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | 4096 | Maximum number of output tokens the model may generate. | — |
Sampling 3 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…1 step 0.1) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. |
Not when thinking.type ∈ {"enabled", "adaptive"} or top_p ≠ null |
|
Top P top_p
|
number (0…1 step 0.01) | 1 | Controls nucleus sampling by limiting generation to tokens whose cumulative probability reaches this value. |
Not when thinking.type ∈ {"enabled", "adaptive"} or temperature ≠ null |
|
Top K top_k
|
integer (0…+∞) | 0 | Limits token sampling to the top K most likely next tokens. |
Not when thinking.type ∈ {"enabled", "adaptive"} |
Reasoning 4 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Thinking mode thinking.type
|
enum (disabled | adaptive | enabled) | "disabled" | Controls the Anthropic thinking mode values supported by this model. | — |
|
Budget tokens thinking.budget_tokens
|
integer (1024…+∞) | 4096 | Maximum token budget Anthropic may use for extended thinking before producing the final answer. |
Only when thinking.type = "enabled" |
|
Thinking display thinking.display
|
enum (summarized | omitted) | "summarized" | Controls whether Anthropic returns summarized or omitted thinking content. |
Only when thinking.type ∈ {"adaptive", "enabled"} |
|
Effort output_config.effort
|
enum (low | medium | high | max) | "high" | Controls Anthropic response thoroughness and token spend. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | 4096 | Maximum number of output tokens the model may generate. | — |
Sampling 3 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…1 step 0.1) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. |
Not when thinking.type ∈ {"enabled", "adaptive"} or top_p ≠ null |
|
Top P top_p
|
number (0…1 step 0.01) | 1 | Controls nucleus sampling by limiting generation to tokens whose cumulative probability reaches this value. |
Not when thinking.type ∈ {"enabled", "adaptive"} or temperature ≠ null |
|
Top K top_k
|
integer (0…+∞) | 0 | Limits token sampling to the top K most likely next tokens. |
Not when thinking.type ∈ {"enabled", "adaptive"} |
Reasoning 4 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Thinking mode thinking.type
|
enum (disabled | adaptive | enabled) | "disabled" | Controls the Anthropic thinking mode values supported by this model. | — |
|
Budget tokens thinking.budget_tokens
|
integer (1024…+∞) | 4096 | Maximum token budget Anthropic may use for extended thinking before producing the final answer. |
Only when thinking.type = "enabled" |
|
Thinking display thinking.display
|
enum (summarized | omitted) | "summarized" | Controls whether Anthropic returns summarized or omitted thinking content. |
Only when thinking.type ∈ {"adaptive", "enabled"} |
|
Effort output_config.effort
|
enum (low | medium | high | max) | "high" | Controls Anthropic response thoroughness and token spend. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | 4096 | Maximum number of output tokens the model may generate. | — |
Reasoning 3 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Thinking mode thinking.type
|
enum (disabled | adaptive) | "disabled" | Controls the Anthropic thinking mode values supported by this model. | — |
|
Thinking display thinking.display
|
enum (summarized | omitted) | "omitted" | Controls whether Anthropic returns summarized or omitted thinking content. |
Only when thinking.type = "adaptive" |
|
Effort output_config.effort
|
enum (low | medium | high | xhigh | max) | "high" | Controls Anthropic response thoroughness and token spend. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | 4096 | Maximum number of output tokens the model may generate. | — |
Reasoning 3 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Thinking mode thinking.type
|
enum (disabled | adaptive) | "disabled" | Controls the Anthropic thinking mode values supported by this model. | — |
|
Thinking display thinking.display
|
enum (summarized | omitted) | "omitted" | Controls whether Anthropic returns summarized or omitted thinking content. |
Only when thinking.type = "adaptive" |
|
Effort output_config.effort
|
enum (low | medium | high | xhigh | max) | "high" | Controls Anthropic response thoroughness and token spend. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | 4096 | Maximum number of output tokens the model may generate. | — |
Reasoning 3 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Thinking mode thinking.type
|
enum (disabled | adaptive) | "disabled" | Controls the Anthropic thinking mode values supported by this model. | — |
|
Thinking display thinking.display
|
enum (summarized | omitted) | "omitted" | Controls whether Anthropic returns summarized or omitted thinking content. |
Only when thinking.type = "adaptive" |
|
Effort output_config.effort
|
enum (low | medium | high | xhigh | max) | "high" | Controls Anthropic response thoroughness and token spend. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | 4096 | Maximum number of output tokens the model may generate. | — |
Reasoning 3 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Thinking mode thinking.type
|
enum (disabled | adaptive) | "disabled" | Controls the Anthropic thinking mode values supported by this model. | — |
|
Thinking display thinking.display
|
enum (summarized | omitted) | "omitted" | Controls whether Anthropic returns summarized or omitted thinking content. |
Only when thinking.type = "adaptive" |
|
Effort output_config.effort
|
enum (low | medium | high | xhigh | max) | "high" | Controls Anthropic response thoroughness and token spend. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | 4096 | Maximum number of output tokens the model may generate. | — |
Sampling 3 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…1 step 0.1) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. |
Not when thinking.type ∈ {"adaptive", "enabled"} |
|
Top P top_p
|
number (0…1 step 0.01) | 1 | Controls nucleus sampling by limiting generation to tokens whose cumulative probability reaches this value. |
Not when thinking.type ∈ {"adaptive", "enabled"} or temperature ≠ 1 |
|
Top K top_k
|
integer (0…+∞) | 0 | Limits token sampling to the top K most likely next tokens. |
Not when thinking.type ∈ {"adaptive", "enabled"} |
Reasoning 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Thinking mode thinking.type
|
enum (disabled | adaptive | enabled) | "disabled" | Controls the Anthropic thinking mode values supported by this model. | — |
|
Budget tokens thinking.budget_tokens
|
integer (1024…+∞) | 4096 | Maximum token budget Anthropic may use for extended thinking before producing the final answer. |
Only when thinking.type = "enabled" |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | 4096 | Maximum number of output tokens the model may generate. | — |
Sampling 3 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…1 step 0.1) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. |
Not when thinking.type = "enabled" |
|
Top P top_p
|
number (0…1 step 0.01) | 1 | Controls nucleus sampling by limiting generation to tokens whose cumulative probability reaches this value. |
Not when thinking.type = "enabled" |
|
Top K top_k
|
integer (0…+∞) | 0 | Limits token sampling to the top K most likely next tokens. |
Not when thinking.type = "enabled" |
Reasoning 3 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Thinking mode thinking.type
|
enum (disabled | enabled) | "disabled" | Controls the Anthropic thinking mode values supported by this model. | — |
|
Budget tokens thinking.budget_tokens
|
integer (1024…+∞) | 4096 | Maximum token budget Anthropic may use for extended thinking before producing the final answer. |
Only when thinking.type = "enabled" |
|
Thinking display thinking.display
|
enum (summarized | omitted) | "summarized" | Controls whether Anthropic returns summarized or omitted thinking content. |
Only when thinking.type = "enabled" |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | 4096 | Maximum number of output tokens the model may generate. | — |
Sampling 3 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…1 step 0.1) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. |
Not when thinking.type = "enabled" |
|
Top P top_p
|
number (0…1 step 0.01) | 1 | Controls nucleus sampling by limiting generation to tokens whose cumulative probability reaches this value. |
Not when thinking.type = "enabled" |
|
Top K top_k
|
integer (0…+∞) | 0 | Limits token sampling to the top K most likely next tokens. |
Not when thinking.type = "enabled" |
Reasoning 3 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Thinking mode thinking.type
|
enum (disabled | enabled) | "disabled" | Controls the Anthropic thinking mode values supported by this model. | — |
|
Budget tokens thinking.budget_tokens
|
integer (1024…+∞) | 4096 | Maximum token budget Anthropic may use for extended thinking before producing the final answer. |
Only when thinking.type = "enabled" |
|
Thinking display thinking.display
|
enum (summarized | omitted) | "summarized" | Controls whether Anthropic returns summarized or omitted thinking content. |
Only when thinking.type = "enabled" |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | 4096 | Maximum number of output tokens the model may generate. | — |
Sampling 3 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…1 step 0.1) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. |
Not when thinking.type ∈ {"adaptive", "enabled"} |
|
Top P top_p
|
number (0…1 step 0.01) | 1 | Controls nucleus sampling by limiting generation to tokens whose cumulative probability reaches this value. |
Not when thinking.type ∈ {"adaptive", "enabled"} or temperature ≠ 1 |
|
Top K top_k
|
integer (0…+∞) | 0 | Limits token sampling to the top K most likely next tokens. |
Not when thinking.type ∈ {"adaptive", "enabled"} |
Reasoning 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Thinking mode thinking.type
|
enum (disabled | adaptive | enabled) | "disabled" | Controls the Anthropic thinking mode values supported by this model. | — |
|
Budget tokens thinking.budget_tokens
|
integer (1024…+∞) | 4096 | Maximum token budget Anthropic may use for extended thinking before producing the final answer. |
Only when thinking.type = "enabled" |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | 4096 | Maximum number of output tokens the model may generate. | — |
Sampling 3 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…1 step 0.1) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. |
Not when thinking.type = "enabled" or top_p ≠ null |
|
Top P top_p
|
number (0…1 step 0.01) | 1 | Controls nucleus sampling by limiting generation to tokens whose cumulative probability reaches this value. |
Not when thinking.type = "enabled" or temperature ≠ null |
|
Top K top_k
|
integer (0…+∞) | 0 | Limits token sampling to the top K most likely next tokens. |
Not when thinking.type = "enabled" |
Reasoning 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Thinking mode thinking.type
|
enum (disabled | enabled) | "disabled" | Controls the Anthropic thinking mode values supported by this model. | — |
|
Budget tokens thinking.budget_tokens
|
integer (1024…+∞) | 4096 | Maximum token budget Anthropic may use for extended thinking before producing the final answer. |
Only when thinking.type = "enabled" |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | 4096 | Maximum number of output tokens the model may generate. | — |
Sampling 3 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…1 step 0.1) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. |
Not when thinking.type = "enabled" or top_p ≠ null |
|
Top P top_p
|
number (0…1 step 0.01) | 1 | Controls nucleus sampling by limiting generation to tokens whose cumulative probability reaches this value. |
Not when thinking.type = "enabled" or temperature ≠ null |
|
Top K top_k
|
integer (0…+∞) | 0 | Limits token sampling to the top K most likely next tokens. |
Not when thinking.type = "enabled" |
Reasoning 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Thinking mode thinking.type
|
enum (disabled | enabled) | "disabled" | Controls the Anthropic thinking mode values supported by this model. | — |
|
Budget tokens thinking.budget_tokens
|
integer (1024…+∞) | 4096 | Maximum token budget Anthropic may use for extended thinking before producing the final answer. |
Only when thinking.type = "enabled" |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | 4096 | Maximum number of output tokens the model may generate. | — |
Sampling 3 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…1 step 0.1) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. |
Not when thinking.type ∈ {"adaptive", "enabled"} |
|
Top P top_p
|
number (0…1 step 0.01) | 1 | Controls nucleus sampling by limiting generation to tokens whose cumulative probability reaches this value. |
Not when thinking.type ∈ {"adaptive", "enabled"} or temperature ≠ 1 |
|
Top K top_k
|
integer (0…+∞) | 0 | Limits token sampling to the top K most likely next tokens. |
Not when thinking.type ∈ {"adaptive", "enabled"} |
Reasoning 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Thinking mode thinking.type
|
enum (disabled | adaptive | enabled) | "disabled" | Controls the Anthropic thinking mode values supported by this model. | — |
|
Budget tokens thinking.budget_tokens
|
integer (1024…+∞) | 4096 | Maximum token budget Anthropic may use for extended thinking before producing the final answer. |
Only when thinking.type = "enabled" |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | 4096 | Maximum number of output tokens the model may generate. | — |
Sampling 3 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…1 step 0.1) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. |
Not when thinking.type ∈ {"enabled", "adaptive"} or top_p ≠ null |
|
Top P top_p
|
number (0…1 step 0.01) | 1 | Controls nucleus sampling by limiting generation to tokens whose cumulative probability reaches this value. |
Not when thinking.type ∈ {"enabled", "adaptive"} or temperature ≠ null |
|
Top K top_k
|
integer (0…+∞) | 0 | Limits token sampling to the top K most likely next tokens. |
Not when thinking.type ∈ {"enabled", "adaptive"} |
Reasoning 4 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Thinking mode thinking.type
|
enum (disabled | adaptive | enabled) | "disabled" | Controls the Anthropic thinking mode values supported by this model. | — |
|
Budget tokens thinking.budget_tokens
|
integer (1024…+∞) | 4096 | Maximum token budget Anthropic may use for extended thinking before producing the final answer. |
Only when thinking.type = "enabled" |
|
Thinking display thinking.display
|
enum (summarized | omitted) | "summarized" | Controls whether Anthropic returns summarized or omitted thinking content. |
Only when thinking.type ∈ {"adaptive", "enabled"} |
|
Effort output_config.effort
|
enum (low | medium | high | max) | "high" | Controls Anthropic response thoroughness and token spend. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | 4096 | Maximum number of output tokens the model may generate. | — |
Sampling 3 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…1 step 0.1) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. |
Not when thinking.type ∈ {"enabled", "adaptive"} or top_p ≠ null |
|
Top P top_p
|
number (0…1 step 0.01) | 1 | Controls nucleus sampling by limiting generation to tokens whose cumulative probability reaches this value. |
Not when thinking.type ∈ {"enabled", "adaptive"} or temperature ≠ null |
|
Top K top_k
|
integer (0…+∞) | 0 | Limits token sampling to the top K most likely next tokens. |
Not when thinking.type ∈ {"enabled", "adaptive"} |
Reasoning 4 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Thinking mode thinking.type
|
enum (disabled | adaptive | enabled) | "disabled" | Controls the Anthropic thinking mode values supported by this model. | — |
|
Budget tokens thinking.budget_tokens
|
integer (1024…+∞) | 4096 | Maximum token budget Anthropic may use for extended thinking before producing the final answer. |
Only when thinking.type = "enabled" |
|
Thinking display thinking.display
|
enum (summarized | omitted) | "summarized" | Controls whether Anthropic returns summarized or omitted thinking content. |
Only when thinking.type ∈ {"adaptive", "enabled"} |
|
Effort output_config.effort
|
enum (low | medium | high | max) | "high" | Controls Anthropic response thoroughness and token spend. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | 4096 | Maximum number of output tokens the model may generate. | — |
Sampling 3 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…1 step 0.1) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. |
Not when thinking.type ∈ {"adaptive", "enabled"} |
|
Top P top_p
|
number (0…1 step 0.01) | 1 | Controls nucleus sampling by limiting generation to tokens whose cumulative probability reaches this value. |
Not when thinking.type ∈ {"adaptive", "enabled"} or temperature ≠ 1 |
|
Top K top_k
|
integer (0…+∞) | 0 | Limits token sampling to the top K most likely next tokens. |
Not when thinking.type ∈ {"adaptive", "enabled"} |
Reasoning 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Thinking mode thinking.type
|
enum (disabled | adaptive | enabled) | "disabled" | Controls the Anthropic thinking mode values supported by this model. | — |
|
Budget tokens thinking.budget_tokens
|
integer (1024…+∞) | 4096 | Maximum token budget Anthropic may use for extended thinking before producing the final answer. |
Only when thinking.type = "enabled" |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | — | Maximum number of tokens to generate in the response. | — |
Sampling 3 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…1 step 0.1) | 0.6 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. |
Not when do_sample = false |
|
Top P top_p
|
number (0.01…1 step 0.01) | 0.95 | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. |
Not when do_sample = false |
|
Do sample do_sample
|
boolean | true | When false, the model uses greedy decoding and ignores temperature and top_p. | — |
Reasoning 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Thinking mode thinking.type
|
enum (enabled | disabled) | "enabled" | Toggles the model's extended reasoning before it produces the final answer. | — |
Output 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Response format response_format.type
|
enum (text | json_object) | "text" | Forces the response into plain text or a JSON object. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | — | Maximum number of tokens to generate in the response. | — |
Sampling 3 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…1 step 0.1) | 0.6 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. |
Not when do_sample = false |
|
Top P top_p
|
number (0.01…1 step 0.01) | 0.95 | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. |
Not when do_sample = false |
|
Do sample do_sample
|
boolean | true | When false, the model uses greedy decoding and ignores temperature and top_p. | — |
Reasoning 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Thinking mode thinking.type
|
enum (enabled | disabled) | "enabled" | Toggles the model's extended reasoning before it produces the final answer. | — |
Output 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Response format response_format.type
|
enum (text | json_object) | "text" | Forces the response into plain text or a JSON object. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | — | Maximum number of tokens to generate in the response. | — |
Sampling 3 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…1 step 0.1) | 0.6 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. |
Not when do_sample = false |
|
Top P top_p
|
number (0.01…1 step 0.01) | 0.95 | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. |
Not when do_sample = false |
|
Do sample do_sample
|
boolean | true | When false, the model uses greedy decoding and ignores temperature and top_p. | — |
Reasoning 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Thinking mode thinking.type
|
enum (enabled | disabled) | "enabled" | Toggles the model's extended reasoning before it produces the final answer. | — |
Output 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Response format response_format.type
|
enum (text | json_object) | "text" | Forces the response into plain text or a JSON object. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | — | Maximum number of tokens to generate in the response. | — |
Sampling 3 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…1 step 0.1) | 0.6 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. |
Not when do_sample = false |
|
Top P top_p
|
number (0.01…1 step 0.01) | 0.95 | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. |
Not when do_sample = false |
|
Do sample do_sample
|
boolean | true | When false, the model uses greedy decoding and ignores temperature and top_p. | — |
Reasoning 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Thinking mode thinking.type
|
enum (enabled | disabled) | "enabled" | Toggles the model's extended reasoning before it produces the final answer. | — |
Output 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Response format response_format.type
|
enum (text | json_object) | "text" | Forces the response into plain text or a JSON object. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | — | Maximum number of tokens to generate in the response. | — |
Sampling 3 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…1 step 0.1) | 0.6 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. |
Not when do_sample = false |
|
Top P top_p
|
number (0.01…1 step 0.01) | 0.95 | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. |
Not when do_sample = false |
|
Do sample do_sample
|
boolean | true | When false, the model uses greedy decoding and ignores temperature and top_p. | — |
Reasoning 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Thinking mode thinking.type
|
enum (enabled | disabled) | "enabled" | Toggles the model's extended reasoning before it produces the final answer. | — |
Output 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Response format response_format.type
|
enum (text | json_object) | "text" | Forces the response into plain text or a JSON object. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | — | Maximum number of tokens to generate in the response. | — |
Sampling 3 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…1 step 0.1) | 0.6 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. |
Not when do_sample = false |
|
Top P top_p
|
number (0.01…1 step 0.01) | 0.95 | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. |
Not when do_sample = false |
|
Do sample do_sample
|
boolean | true | When false, the model uses greedy decoding and ignores temperature and top_p. | — |
Reasoning 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Thinking mode thinking.type
|
enum (enabled | disabled) | "enabled" | Toggles the model's extended reasoning before it produces the final answer. | — |
Output 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Response format response_format.type
|
enum (text | json_object) | "text" | Forces the response into plain text or a JSON object. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | — | Maximum number of tokens to generate in the response. | — |
Sampling 3 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…1 step 0.1) | 0.6 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. |
Not when do_sample = false |
|
Top P top_p
|
number (0.01…1 step 0.01) | 0.95 | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. |
Not when do_sample = false |
|
Do sample do_sample
|
boolean | true | When false, the model uses greedy decoding and ignores temperature and top_p. | — |
Reasoning 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Thinking mode thinking.type
|
enum (enabled | disabled) | "enabled" | Toggles the model's extended reasoning before it produces the final answer. | — |
Output 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Response format response_format.type
|
enum (text | json_object) | "text" | Forces the response into plain text or a JSON object. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | — | Maximum number of tokens to generate in the response. | — |
Sampling 3 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…1 step 0.1) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. |
Not when do_sample = false |
|
Top P top_p
|
number (0.01…1 step 0.01) | 0.95 | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. |
Not when do_sample = false |
|
Do sample do_sample
|
boolean | true | When false, the model uses greedy decoding and ignores temperature and top_p. | — |
Reasoning 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Thinking mode thinking.type
|
enum (enabled | disabled) | "enabled" | Toggles the model's extended reasoning before it produces the final answer. | — |
Output 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Response format response_format.type
|
enum (text | json_object) | "text" | Forces the response into plain text or a JSON object. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | — | Maximum number of tokens to generate in the response. | — |
Sampling 3 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…1 step 0.1) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. |
Not when do_sample = false |
|
Top P top_p
|
number (0.01…1 step 0.01) | 0.95 | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. |
Not when do_sample = false |
|
Do sample do_sample
|
boolean | true | When false, the model uses greedy decoding and ignores temperature and top_p. | — |
Reasoning 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Thinking mode thinking.type
|
enum (enabled | disabled) | "enabled" | Toggles the model's extended reasoning before it produces the final answer. | — |
Output 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Response format response_format.type
|
enum (text | json_object) | "text" | Forces the response into plain text or a JSON object. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | — | Maximum number of tokens to generate in the response. | — |
Sampling 3 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…1 step 0.1) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. |
Not when do_sample = false |
|
Top P top_p
|
number (0.01…1 step 0.01) | 0.95 | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. |
Not when do_sample = false |
|
Do sample do_sample
|
boolean | true | When false, the model uses greedy decoding and ignores temperature and top_p. | — |
Reasoning 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Thinking mode thinking.type
|
enum (enabled | disabled) | "enabled" | Toggles the model's extended reasoning before it produces the final answer. | — |
Output 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Response format response_format.type
|
enum (text | json_object) | "text" | Forces the response into plain text or a JSON object. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | — | Maximum number of tokens to generate in the response. | — |
Sampling 3 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…1 step 0.1) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. |
Not when do_sample = false |
|
Top P top_p
|
number (0.01…1 step 0.01) | 0.95 | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. |
Not when do_sample = false |
|
Do sample do_sample
|
boolean | true | When false, the model uses greedy decoding and ignores temperature and top_p. | — |
Reasoning 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Thinking mode thinking.type
|
enum (enabled | disabled) | "enabled" | Toggles the model's extended reasoning before it produces the final answer. | — |
Output 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Response format response_format.type
|
enum (text | json_object) | "text" | Forces the response into plain text or a JSON object. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | — | Maximum number of tokens to generate in the response. | — |
Sampling 3 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…1 step 0.1) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. |
Not when do_sample = false |
|
Top P top_p
|
number (0.01…1 step 0.01) | 0.95 | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. |
Not when do_sample = false |
|
Do sample do_sample
|
boolean | true | When false, the model uses greedy decoding and ignores temperature and top_p. | — |
Reasoning 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Thinking mode thinking.type
|
enum (enabled | disabled) | "enabled" | Toggles the model's extended reasoning before it produces the final answer. | — |
Output 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Response format response_format.type
|
enum (text | json_object) | "text" | Forces the response into plain text or a JSON object. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | — | Maximum number of tokens to generate in the response. | — |
Sampling 3 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…1 step 0.1) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. |
Not when do_sample = false |
|
Top P top_p
|
number (0.01…1 step 0.01) | 0.95 | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. |
Not when do_sample = false |
|
Do sample do_sample
|
boolean | true | When false, the model uses greedy decoding and ignores temperature and top_p. | — |
Reasoning 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Thinking mode thinking.type
|
enum (enabled | disabled) | "enabled" | Toggles the model's extended reasoning before it produces the final answer. | — |
Output 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Response format response_format.type
|
enum (text | json_object) | "text" | Forces the response into plain text or a JSON object. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | — | Maximum number of tokens to generate in the response. | — |
Sampling 3 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…1 step 0.1) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. |
Not when do_sample = false |
|
Top P top_p
|
number (0.01…1 step 0.01) | 0.95 | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. |
Not when do_sample = false |
|
Do sample do_sample
|
boolean | true | When false, the model uses greedy decoding and ignores temperature and top_p. | — |
Reasoning 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Thinking mode thinking.type
|
enum (enabled | disabled) | "enabled" | Toggles the model's extended reasoning before it produces the final answer. | — |
Output 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Response format response_format.type
|
enum (text | json_object) | "text" | Forces the response into plain text or a JSON object. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | — | Maximum number of tokens to generate in the response. | — |
Sampling 3 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…1 step 0.1) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. |
Not when do_sample = false |
|
Top P top_p
|
number (0.01…1 step 0.01) | 0.95 | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. |
Not when do_sample = false |
|
Do sample do_sample
|
boolean | true | When false, the model uses greedy decoding and ignores temperature and top_p. | — |
Reasoning 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Thinking mode thinking.type
|
enum (enabled | disabled) | "enabled" | Toggles the model's extended reasoning before it produces the final answer. | — |
Output 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Response format response_format.type
|
enum (text | json_object) | "text" | Forces the response into plain text or a JSON object. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | — | Maximum number of tokens to generate in the response. | — |
Sampling 3 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…1 step 0.1) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. |
Not when do_sample = false |
|
Top P top_p
|
number (0.01…1 step 0.01) | 0.95 | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. |
Not when do_sample = false |
|
Do sample do_sample
|
boolean | true | When false, the model uses greedy decoding and ignores temperature and top_p. | — |
Reasoning 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Thinking mode thinking.type
|
enum (enabled | disabled) | "enabled" | Toggles the model's extended reasoning before it produces the final answer. | — |
Output 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Response format response_format.type
|
enum (text | json_object) | "text" | Forces the response into plain text or a JSON object. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | — | Maximum number of tokens to generate in the response. | — |
Sampling 3 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…1 step 0.1) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. |
Not when do_sample = false |
|
Top P top_p
|
number (0.01…1 step 0.01) | 0.95 | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. |
Not when do_sample = false |
|
Do sample do_sample
|
boolean | true | When false, the model uses greedy decoding and ignores temperature and top_p. | — |
Reasoning 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Thinking mode thinking.type
|
enum (enabled | disabled) | "enabled" | Toggles the model's extended reasoning before it produces the final answer. | — |
Output 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Response format response_format.type
|
enum (text | json_object) | "text" | Forces the response into plain text or a JSON object. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | — | Maximum number of tokens to generate in the response. | — |
Sampling 3 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…1 step 0.1) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. |
Not when do_sample = false |
|
Top P top_p
|
number (0.01…1 step 0.01) | 0.95 | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. |
Not when do_sample = false |
|
Do sample do_sample
|
boolean | true | When false, the model uses greedy decoding and ignores temperature and top_p. | — |
Reasoning 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Thinking mode thinking.type
|
enum (enabled | disabled) | "enabled" | Toggles the model's extended reasoning before it produces the final answer. | — |
Output 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Response format response_format.type
|
enum (text | json_object) | "text" | Forces the response into plain text or a JSON object. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | — | Maximum number of tokens to generate in the response. | — |
Sampling 3 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…1 step 0.1) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. |
Not when do_sample = false |
|
Top P top_p
|
number (0.01…1 step 0.01) | 0.95 | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. |
Not when do_sample = false |
|
Do sample do_sample
|
boolean | true | When false, the model uses greedy decoding and ignores temperature and top_p. | — |
Reasoning 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Thinking mode thinking.type
|
enum (enabled | disabled) | "enabled" | Toggles the model's extended reasoning before it produces the final answer. | — |
Output 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Response format response_format.type
|
enum (text | json_object) | "text" | Forces the response into plain text or a JSON object. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max completion tokens max_completion_tokens
|
integer (1…+∞) | — | Maximum number of tokens to generate in the completion. | — |
Sampling 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0.01…1 step 0.01) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. Values must be greater than 0 and at most 1. | — |
|
Top P top_p
|
number (0.01…1 step 0.01) | 0.95 | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. | — |
Reasoning 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Split reasoning reasoning_split
|
boolean | false | Returns the model's reasoning in a separate reasoning_details field instead of inline with the response. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | — | Maximum number of tokens to generate in the response. | — |
Sampling 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0.01…1 step 0.01) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. Values must be greater than 0 and at most 1. | — |
|
Top P top_p
|
number (0.01…1 step 0.01) | 0.95 | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max completion tokens max_completion_tokens
|
integer (1…+∞) | — | Maximum number of tokens to generate in the completion. | — |
Sampling 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0.01…1 step 0.01) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. Values must be greater than 0 and at most 1. | — |
|
Top P top_p
|
number (0.01…1 step 0.01) | 0.95 | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. | — |
Reasoning 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Split reasoning reasoning_split
|
boolean | false | Returns the model's reasoning in a separate reasoning_details field instead of inline with the response. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max completion tokens max_completion_tokens
|
integer (1…+∞) | — | Maximum number of tokens to generate in the completion. | — |
Sampling 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0.01…1 step 0.01) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. Values must be greater than 0 and at most 1. | — |
|
Top P top_p
|
number (0.01…1 step 0.01) | 0.95 | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. | — |
Reasoning 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Split reasoning reasoning_split
|
boolean | false | Returns the model's reasoning in a separate reasoning_details field instead of inline with the response. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | — | Maximum number of tokens to generate in the response. | — |
Sampling 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0.01…1 step 0.01) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. Values must be greater than 0 and at most 1. | — |
|
Top P top_p
|
number (0.01…1 step 0.01) | 0.95 | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | — | Maximum number of tokens to generate in the response. | — |
Sampling 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0.01…1 step 0.01) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. Values must be greater than 0 and at most 1. | — |
|
Top P top_p
|
number (0.01…1 step 0.01) | 0.95 | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max completion tokens max_completion_tokens
|
integer (1…+∞) | — | Maximum number of tokens to generate in the completion. | — |
Sampling 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0.01…1 step 0.01) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. Values must be greater than 0 and at most 1. | — |
|
Top P top_p
|
number (0.01…1 step 0.01) | 0.95 | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. | — |
Reasoning 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Split reasoning reasoning_split
|
boolean | false | Returns the model's reasoning in a separate reasoning_details field instead of inline with the response. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max completion tokens max_completion_tokens
|
integer (1…+∞) | — | Maximum number of tokens to generate in the completion. | — |
Sampling 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0.01…1 step 0.01) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. Values must be greater than 0 and at most 1. | — |
|
Top P top_p
|
number (0.01…1 step 0.01) | 0.95 | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. | — |
Reasoning 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Split reasoning reasoning_split
|
boolean | false | Returns the model's reasoning in a separate reasoning_details field instead of inline with the response. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | — | Maximum number of tokens to generate in the response. | — |
Sampling 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0.01…1 step 0.01) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. Values must be greater than 0 and at most 1. | — |
|
Top P top_p
|
number (0.01…1 step 0.01) | 0.95 | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | — | Maximum number of tokens to generate in the response. | — |
Sampling 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0.01…1 step 0.01) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. Values must be greater than 0 and at most 1. | — |
|
Top P top_p
|
number (0.01…1 step 0.01) | 0.95 | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max completion tokens max_completion_tokens
|
integer (1…+∞) | — | Maximum number of tokens to generate in the completion. | — |
Sampling 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0.01…1 step 0.01) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. Values must be greater than 0 and at most 1. | — |
|
Top P top_p
|
number (0.01…1 step 0.01) | 0.95 | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. | — |
Reasoning 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Split reasoning reasoning_split
|
boolean | false | Returns the model's reasoning in a separate reasoning_details field instead of inline with the response. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max completion tokens max_completion_tokens
|
integer (1…+∞) | — | Maximum number of tokens to generate in the completion. | — |
Sampling 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0.01…1 step 0.01) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. Values must be greater than 0 and at most 1. | — |
|
Top P top_p
|
number (0.01…1 step 0.01) | 0.95 | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. | — |
Reasoning 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Split reasoning reasoning_split
|
boolean | false | Returns the model's reasoning in a separate reasoning_details field instead of inline with the response. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | — | Maximum number of tokens to generate in the response. | — |
Sampling 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0.01…1 step 0.01) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. Values must be greater than 0 and at most 1. | — |
|
Top P top_p
|
number (0.01…1 step 0.01) | 0.95 | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | — | Maximum number of tokens to generate in the response. | — |
Sampling 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0.01…1 step 0.01) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. Values must be greater than 0 and at most 1. | — |
|
Top P top_p
|
number (0.01…1 step 0.01) | 0.95 | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max completion tokens max_completion_tokens
|
integer (1…+∞) | — | Maximum number of tokens to generate in the completion. | — |
Sampling 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0.01…1 step 0.01) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. Values must be greater than 0 and at most 1. | — |
|
Top P top_p
|
number (0.01…1 step 0.01) | 0.95 | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. | — |
Reasoning 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Split reasoning reasoning_split
|
boolean | false | Returns the model's reasoning in a separate reasoning_details field instead of inline with the response. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | — | Maximum number of tokens to generate in the response. | — |
Sampling 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0.01…1 step 0.01) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. Values must be greater than 0 and at most 1. | — |
|
Top P top_p
|
number (0.01…1 step 0.01) | 0.95 | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. | — |
Sampling 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Threshold threshold
|
number (0…1) | 0.5 | Confidence threshold for entity detection. Lower values detect more entities but may include false positives. | — |
Metadata 3 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Chunk length chunk_length
|
integer (1…2048) | 384 | Context window size for processing. Longer texts are automatically split into chunks with overlap for complete coverage. Must be greater than overlap. | — |
|
Overlap overlap
|
integer (0…512) | 128 | Token overlap between chunks to prevent entity clipping. Must be less than chunk_length. | — |
|
Flat NER flat_ner
|
boolean | false | When true, prevents overlapping entity spans. When false, may return nested entities such as both a full name and its constituent first name. | — |
Length 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | 1024 | Maximum number of tokens to generate. Generation stops when this limit is reached. | — |
|
Stop stop
|
string | — | A string or list of strings where the API will stop generating further tokens. The returned text will not contain the stop sequence. | — |
Sampling 4 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…2) | 0.5 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. Not recommended to modify both temperature and top_p in the same call. | — |
|
Top P top_p
|
number (-∞…1) | 1 | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. Not recommended to modify both temperature and top_p in the same call. | — |
|
Frequency penalty frequency_penalty
|
number (-2…2) | 0 | Penalizes new tokens based on their existing frequency in the text so far, decreasing the model's likelihood to repeat the same line verbatim. | — |
|
Presence penalty presence_penalty
|
number (-2…2) | 0 | Positive values penalize new tokens based on whether they appear in the text so far, increasing the model's likelihood to talk about new topics. | — |
Length 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…16384) | 4096 | Maximum number of tokens to generate. Generation stops when this limit is reached. | — |
|
Stop stop
|
string | — | A string or list of strings where the API will stop generating further tokens. The returned text will not contain the stop sequence. | — |
Sampling 5 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…1) | 0.6 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. Not recommended to modify both temperature and top_p in the same call. | — |
|
Top P top_p
|
number (-∞…1) | 0.95 | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. Not recommended to modify both temperature and top_p in the same call. | — |
|
Frequency penalty frequency_penalty
|
number (-2…2) | 0 | Penalizes new tokens based on their existing frequency in the text so far, decreasing the model's likelihood to repeat the same line verbatim. | — |
|
Presence penalty presence_penalty
|
number (-2…2) | 0 | Positive values penalize new tokens based on whether they appear in the text so far, increasing the model's likelihood to talk about new topics. | — |
|
Seed seed
|
integer (0…18446744073709552000) | 0 | Best-effort deterministic sampling seed. Changing the seed produces a different response with similar characteristics. Fix the seed to reproduce results. | — |
Sampling 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…1) | 0 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. | — |
Length 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…16384) | 4096 | Maximum number of tokens to generate. Generation stops when this limit is reached. | — |
|
Stop stop
|
string | — | A string or list of strings where the API will stop generating further tokens. The returned text will not contain the stop sequence. | — |
Sampling 5 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…1) | 0.6 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. Not recommended to modify both temperature and top_p in the same call. | — |
|
Top P top_p
|
number (-∞…1) | 0.95 | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. Not recommended to modify both temperature and top_p in the same call. | — |
|
Frequency penalty frequency_penalty
|
number (-2…2) | 0 | Penalizes new tokens based on their existing frequency in the text so far, decreasing the model's likelihood to repeat the same line verbatim. | — |
|
Presence penalty presence_penalty
|
number (-2…2) | 0 | Positive values penalize new tokens based on whether they appear in the text so far, increasing the model's likelihood to talk about new topics. | — |
|
Seed seed
|
integer (0…18446744073709552000) | 0 | Best-effort deterministic sampling seed. Changing the seed produces a different response with similar characteristics. Fix the seed to reproduce results. | — |
Length 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…16384) | 4096 | Maximum number of tokens to generate. Generation stops when this limit is reached. | — |
|
Stop stop
|
string | — | A string or list of strings where the API will stop generating further tokens. The returned text will not contain the stop sequence. | — |
Sampling 5 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…1) | 0.6 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. Not recommended to modify both temperature and top_p in the same call. | — |
|
Top P top_p
|
number (-∞…1) | 0.95 | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. Not recommended to modify both temperature and top_p in the same call. | — |
|
Frequency penalty frequency_penalty
|
number (-2…2) | 0 | Penalizes new tokens based on their existing frequency in the text so far, decreasing the model's likelihood to repeat the same line verbatim. | — |
|
Presence penalty presence_penalty
|
number (-2…2) | 0 | Positive values penalize new tokens based on whether they appear in the text so far, increasing the model's likelihood to talk about new topics. | — |
|
Seed seed
|
integer (0…18446744073709552000) | 0 | Best-effort deterministic sampling seed. Changing the seed produces a different response with similar characteristics. Fix the seed to reproduce results. | — |
Length 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…65536) | 65536 | Maximum number of tokens to generate. Generation stops when this limit is reached. | — |
|
Stop stop
|
string | — | A string or list of strings where the API will stop generating further tokens. The returned text will not contain the stop sequence. | — |
Sampling 5 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…1) | 0.6 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. Not recommended to modify both temperature and top_p in the same call. | — |
|
Top P top_p
|
number (-∞…1) | 0.95 | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. Not recommended to modify both temperature and top_p in the same call. | — |
|
Frequency penalty frequency_penalty
|
number (-2…2) | 0 | Penalizes new tokens based on their existing frequency in the text so far, decreasing the model's likelihood to repeat the same line verbatim. | — |
|
Presence penalty presence_penalty
|
number (-2…2) | 0 | Positive values penalize new tokens based on whether they appear in the text so far, increasing the model's likelihood to talk about new topics. | — |
|
Seed seed
|
integer (0…18446744073709552000) | 0 | Best-effort deterministic sampling seed. Changing the seed produces a different response with similar characteristics. Fix the seed to reproduce results. | — |
No parameters documented yet.
Length 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…32768) | 16384 | Maximum number of tokens to generate. Generation stops when this limit is reached. | — |
|
Stop stop
|
string | — | A string or list of strings where the API will stop generating further tokens. The returned text will not contain the stop sequence. | — |
Sampling 3 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (-∞…1) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. Not recommended to modify both temperature and top_p in the same call. | — |
|
Top P top_p
|
number (-∞…1) | 1 | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. Not recommended to modify both temperature and top_p in the same call. | — |
|
Seed seed
|
integer (0…18446744073709552000) | — | Best-effort deterministic sampling seed. Repeated requests with the same seed and parameters should return the same result. | — |
Length 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…32768) | 16384 | Maximum number of tokens to generate. Generation stops when this limit is reached. | — |
|
Stop stop
|
string | — | A string or list of strings where the API will stop generating further tokens. The returned text will not contain the stop sequence. | — |
Sampling 3 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (-∞…1) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. Not recommended to modify both temperature and top_p in the same call. | — |
|
Top P top_p
|
number (-∞…1) | 0.95 | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. Not recommended to modify both temperature and top_p in the same call. | — |
|
Seed seed
|
integer (0…18446744073709552000) | — | Best-effort deterministic sampling seed. Repeated requests with the same seed and parameters should return the same result. | — |
Reasoning 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Reasoning effort reasoning_effort
|
enum (none | low | high) | "high" | Controls the reasoning mode. 'none' disables reasoning tokens, 'low' enables low-effort reasoning, and 'high' enables full reasoning. | — |
|
Reasoning budget reasoning_budget
|
integer (-1…32768) | 16384 | Maximum number of tokens the model may use for internal reasoning before being forced to end the reasoning trace. Use -1 to disable budget enforcement. | — |
Length 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…32768) | 16384 | Maximum number of tokens to generate. Generation stops when this limit is reached. | — |
|
Stop stop
|
string | — | A string or list of strings where the API will stop generating further tokens. The returned text will not contain the stop sequence. | — |
Sampling 3 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (-∞…1) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. Not recommended to modify both temperature and top_p in the same call. | — |
|
Top P top_p
|
number (-∞…1) | 0.95 | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. Not recommended to modify both temperature and top_p in the same call. | — |
|
Seed seed
|
integer (0…18446744073709552000) | — | Best-effort deterministic sampling seed. Repeated requests with the same seed and parameters should return the same result. | — |
Reasoning 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Reasoning effort reasoning_effort
|
enum (none | medium | high) | "high" | Controls the reasoning mode. 'none' disables reasoning tokens, 'medium' enables efficient reasoning, and 'high' enables full reasoning. | — |
|
Reasoning budget reasoning_budget
|
integer (-1…32768) | 16384 | Maximum number of tokens the model may use for internal reasoning before being forced to end the reasoning trace. Use -1 to disable budget enforcement. | — |
Length 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…32768) | 16384 | Maximum number of tokens to generate. Generation stops when this limit is reached. | — |
|
Stop stop
|
string | — | A string or list of strings where the API will stop generating further tokens. The returned text will not contain the stop sequence. | — |
Sampling 3 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (-∞…1) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. Not recommended to modify both temperature and top_p in the same call. | — |
|
Top P top_p
|
number (-∞…1) | 1 | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. Not recommended to modify both temperature and top_p in the same call. | — |
|
Seed seed
|
integer (0…18446744073709552000) | — | Best-effort deterministic sampling seed. Repeated requests with the same seed and parameters should return the same result. | — |
Length 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…4096) | 1024 | Maximum number of tokens to generate. Generation stops when this limit is reached. | — |
|
Stop stop
|
string | — | A string or list of strings where the API will stop generating further tokens. The returned text will not contain the stop sequence. | — |
Sampling 4 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…1) | 0.2 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. Not recommended to modify both temperature and top_p in the same call. | — |
|
Top P top_p
|
number (-∞…1) | 0.7 | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. Not recommended to modify both temperature and top_p in the same call. | — |
|
Frequency penalty frequency_penalty
|
number (-2…2) | 0 | Penalizes new tokens based on their existing frequency in the text so far, decreasing the model's likelihood to repeat the same line verbatim. | — |
|
Presence penalty presence_penalty
|
number (-2…2) | 0 | Positive values penalize new tokens based on whether they appear in the text so far, increasing the model's likelihood to talk about new topics. | — |
Length 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…4096) | 512 | Maximum number of tokens to generate. Generation stops when this limit is reached. | — |
|
Stop stop
|
string | — | A string or list of strings where the API will stop generating further tokens. The returned text will not contain the stop sequence. | — |
Sampling 4 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…1) | 0 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. Not recommended to modify both temperature and top_p in the same call. | — |
|
Top P top_p
|
number (-∞…1) | 0.9 | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. Not recommended to modify both temperature and top_p in the same call. | — |
|
Frequency penalty frequency_penalty
|
number (-2…2) | 0 | Penalizes new tokens based on their existing frequency in the text so far, decreasing the model's likelihood to repeat the same line verbatim. | — |
|
Presence penalty presence_penalty
|
number (-2…2) | 0 | Positive values penalize new tokens based on whether they appear in the text so far, increasing the model's likelihood to talk about new topics. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…2048) | 1024 | Maximum number of tokens to generate. Generation stops when this limit is reached. | — |
Sampling 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…1) | 0.1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. Not recommended to modify both temperature and top_p in the same call. | — |
|
Top P top_p
|
number (-∞…1) | 1 | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. Not recommended to modify both temperature and top_p in the same call. | — |
Metadata 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Expert type expert_type
|
enum (auto | code | knowledge | helperfunction) | "auto" | The type of expert to use. 'knowledge' answers with USD knowledge, 'code' responds with vanilla OpenUSD code, 'helperfunction' uses high-level helper functions, and 'auto' lets the LLM determine which expert to use. | — |
Length 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | — | Maximum number of tokens to generate in the completion. | — |
|
Stop sequence stop
|
string | — | Stops generation when this string is detected. | — |
Sampling 5 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…1.5 step 0.1) | — | Controls randomness. Lower values make outputs more focused; higher values make them more varied. | — |
|
Top P top_p
|
number (0…1 step 0.01) | 1 | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. | — |
|
Random seed random_seed
|
integer (0…+∞) | — | Seed used for deterministic sampling when reproducible outputs are desired. | — |
|
Presence penalty presence_penalty
|
number (-2…2 step 0.1) | 0 | Penalizes repeated words or phrases to encourage a wider variety of generated content. | — |
|
Frequency penalty frequency_penalty
|
number (-2…2 step 0.1) | 0 | Penalizes words based on how often they already appear in the generated text. | — |
Output 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Response format response_format.type
|
enum (text | json_object) | "text" | Controls whether the model returns normal text or JSON mode output. | — |
Metadata 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Safe prompt safe_prompt
|
boolean | false | Controls whether Mistral injects its safety prompt before the conversation. | — |
Length 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | — | Maximum number of tokens to generate in the completion. | — |
|
Stop sequence stop
|
string | — | Stops generation when this string is detected. | — |
Sampling 5 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…1.5 step 0.1) | — | Controls randomness. Lower values make outputs more focused; higher values make them more varied. | — |
|
Top P top_p
|
number (0…1 step 0.01) | 1 | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. | — |
|
Random seed random_seed
|
integer (0…+∞) | — | Seed used for deterministic sampling when reproducible outputs are desired. | — |
|
Presence penalty presence_penalty
|
number (-2…2 step 0.1) | 0 | Penalizes repeated words or phrases to encourage a wider variety of generated content. | — |
|
Frequency penalty frequency_penalty
|
number (-2…2 step 0.1) | 0 | Penalizes words based on how often they already appear in the generated text. | — |
Output 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Response format response_format.type
|
enum (text | json_object) | "text" | Controls whether the model returns normal text or JSON mode output. | — |
Metadata 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Safe prompt safe_prompt
|
boolean | false | Controls whether Mistral injects its safety prompt before the conversation. | — |
Length 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | — | Maximum number of tokens to generate in the completion. | — |
|
Stop sequence stop
|
string | — | Stops generation when this string is detected. | — |
Sampling 5 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…1.5 step 0.1) | — | Controls randomness. Lower values make outputs more focused; higher values make them more varied. | — |
|
Top P top_p
|
number (0…1 step 0.01) | 1 | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. | — |
|
Random seed random_seed
|
integer (0…+∞) | — | Seed used for deterministic sampling when reproducible outputs are desired. | — |
|
Presence penalty presence_penalty
|
number (-2…2 step 0.1) | 0 | Penalizes repeated words or phrases to encourage a wider variety of generated content. | — |
|
Frequency penalty frequency_penalty
|
number (-2…2 step 0.1) | 0 | Penalizes words based on how often they already appear in the generated text. | — |
Output 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Response format response_format.type
|
enum (text | json_object) | "text" | Controls whether the model returns normal text or JSON mode output. | — |
Metadata 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Safe prompt safe_prompt
|
boolean | false | Controls whether Mistral injects its safety prompt before the conversation. | — |
Length 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | — | Maximum number of tokens to generate in the completion. | — |
|
Stop sequence stop
|
string | — | Stops generation when this string is detected. | — |
Sampling 5 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…1.5 step 0.1) | — | Controls randomness. Lower values make outputs more focused; higher values make them more varied. | — |
|
Top P top_p
|
number (0…1 step 0.01) | 1 | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. | — |
|
Random seed random_seed
|
integer (0…+∞) | — | Seed used for deterministic sampling when reproducible outputs are desired. | — |
|
Presence penalty presence_penalty
|
number (-2…2 step 0.1) | 0 | Penalizes repeated words or phrases to encourage a wider variety of generated content. | — |
|
Frequency penalty frequency_penalty
|
number (-2…2 step 0.1) | 0 | Penalizes words based on how often they already appear in the generated text. | — |
Reasoning 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Prompt mode prompt_mode
|
enum (reasoning) | — | Enables Mistral's reasoning system prompt; leave unset to disable the default reasoning behavior. | — |
Output 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Response format response_format.type
|
enum (text | json_object) | "text" | Controls whether the model returns normal text or JSON mode output. | — |
Metadata 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Safe prompt safe_prompt
|
boolean | false | Controls whether Mistral injects its safety prompt before the conversation. | — |
Length 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | — | Maximum number of tokens to generate in the completion. | — |
|
Stop sequence stop
|
string | — | Stops generation when this string is detected. | — |
Sampling 5 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…1.5 step 0.1) | — | Controls randomness. Lower values make outputs more focused; higher values make them more varied. | — |
|
Top P top_p
|
number (0…1 step 0.01) | 1 | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. | — |
|
Random seed random_seed
|
integer (0…+∞) | — | Seed used for deterministic sampling when reproducible outputs are desired. | — |
|
Presence penalty presence_penalty
|
number (-2…2 step 0.1) | 0 | Penalizes repeated words or phrases to encourage a wider variety of generated content. | — |
|
Frequency penalty frequency_penalty
|
number (-2…2 step 0.1) | 0 | Penalizes words based on how often they already appear in the generated text. | — |
Reasoning 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Prompt mode prompt_mode
|
enum (reasoning) | — | Enables Mistral's reasoning system prompt; leave unset to disable the default reasoning behavior. | — |
Output 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Response format response_format.type
|
enum (text | json_object) | "text" | Controls whether the model returns normal text or JSON mode output. | — |
Metadata 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Safe prompt safe_prompt
|
boolean | false | Controls whether Mistral injects its safety prompt before the conversation. | — |
Length 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | — | Maximum number of tokens to generate in the completion. | — |
|
Stop sequence stop
|
string | — | Stops generation when this string is detected. | — |
Sampling 5 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…1.5 step 0.1) | — | Controls randomness. Lower values make outputs more focused; higher values make them more varied. | — |
|
Top P top_p
|
number (0…1 step 0.01) | 1 | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. | — |
|
Random seed random_seed
|
integer (0…+∞) | — | Seed used for deterministic sampling when reproducible outputs are desired. | — |
|
Presence penalty presence_penalty
|
number (-2…2 step 0.1) | 0 | Penalizes repeated words or phrases to encourage a wider variety of generated content. | — |
|
Frequency penalty frequency_penalty
|
number (-2…2 step 0.1) | 0 | Penalizes words based on how often they already appear in the generated text. | — |
Output 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Response format response_format.type
|
enum (text | json_object) | "text" | Controls whether the model returns normal text or JSON mode output. | — |
Metadata 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Safe prompt safe_prompt
|
boolean | false | Controls whether Mistral injects its safety prompt before the conversation. | — |
Length 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | — | Maximum number of tokens to generate in the completion. | — |
|
Stop sequence stop
|
string | — | Stops generation when this string is detected. | — |
Sampling 5 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…1.5 step 0.1) | — | Controls randomness. Lower values make outputs more focused; higher values make them more varied. | — |
|
Top P top_p
|
number (0…1 step 0.01) | 1 | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. | — |
|
Random seed random_seed
|
integer (0…+∞) | — | Seed used for deterministic sampling when reproducible outputs are desired. | — |
|
Presence penalty presence_penalty
|
number (-2…2 step 0.1) | 0 | Penalizes repeated words or phrases to encourage a wider variety of generated content. | — |
|
Frequency penalty frequency_penalty
|
number (-2…2 step 0.1) | 0 | Penalizes words based on how often they already appear in the generated text. | — |
Output 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Response format response_format.type
|
enum (text | json_object) | "text" | Controls whether the model returns normal text or JSON mode output. | — |
Metadata 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Safe prompt safe_prompt
|
boolean | false | Controls whether Mistral injects its safety prompt before the conversation. | — |
Length 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | — | Maximum number of tokens to generate in the completion. | — |
|
Stop sequence stop
|
string | — | Stops generation when this string is detected. | — |
Sampling 5 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…1.5 step 0.1) | — | Controls randomness. Lower values make outputs more focused; higher values make them more varied. | — |
|
Top P top_p
|
number (0…1 step 0.01) | 1 | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. | — |
|
Random seed random_seed
|
integer (0…+∞) | — | Seed used for deterministic sampling when reproducible outputs are desired. | — |
|
Presence penalty presence_penalty
|
number (-2…2 step 0.1) | 0 | Penalizes repeated words or phrases to encourage a wider variety of generated content. | — |
|
Frequency penalty frequency_penalty
|
number (-2…2 step 0.1) | 0 | Penalizes words based on how often they already appear in the generated text. | — |
Output 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Response format response_format.type
|
enum (text | json_object) | "text" | Controls whether the model returns normal text or JSON mode output. | — |
Metadata 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Safe prompt safe_prompt
|
boolean | false | Controls whether Mistral injects its safety prompt before the conversation. | — |
Length 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | — | Maximum number of tokens to generate in the completion. | — |
|
Stop sequence stop
|
string | — | Stops generation when this string is detected. | — |
Sampling 5 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…1.5 step 0.1) | — | Controls randomness. Lower values make outputs more focused; higher values make them more varied. | — |
|
Top P top_p
|
number (0…1 step 0.01) | 1 | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. | — |
|
Random seed random_seed
|
integer (0…+∞) | — | Seed used for deterministic sampling when reproducible outputs are desired. | — |
|
Presence penalty presence_penalty
|
number (-2…2 step 0.1) | 0 | Penalizes repeated words or phrases to encourage a wider variety of generated content. | — |
|
Frequency penalty frequency_penalty
|
number (-2…2 step 0.1) | 0 | Penalizes words based on how often they already appear in the generated text. | — |
Output 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Response format response_format.type
|
enum (text | json_object) | "text" | Controls whether the model returns normal text or JSON mode output. | — |
Metadata 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Safe prompt safe_prompt
|
boolean | false | Controls whether Mistral injects its safety prompt before the conversation. | — |
Length 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | — | Maximum number of tokens to generate in the completion. | — |
|
Stop sequence stop
|
string | — | Stops generation when this string is detected. | — |
Sampling 5 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…1.5 step 0.1) | — | Controls randomness. Lower values make outputs more focused; higher values make them more varied. | — |
|
Top P top_p
|
number (0…1 step 0.01) | 1 | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. | — |
|
Random seed random_seed
|
integer (0…+∞) | — | Seed used for deterministic sampling when reproducible outputs are desired. | — |
|
Presence penalty presence_penalty
|
number (-2…2 step 0.1) | 0 | Penalizes repeated words or phrases to encourage a wider variety of generated content. | — |
|
Frequency penalty frequency_penalty
|
number (-2…2 step 0.1) | 0 | Penalizes words based on how often they already appear in the generated text. | — |
Output 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Response format response_format.type
|
enum (text | json_object) | "text" | Controls whether the model returns normal text or JSON mode output. | — |
Metadata 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Safe prompt safe_prompt
|
boolean | false | Controls whether Mistral injects its safety prompt before the conversation. | — |
Length 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | — | Maximum number of tokens to generate in the completion. | — |
|
Stop sequence stop
|
string | — | Stops generation when this string is detected. | — |
Sampling 5 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…1.5 step 0.1) | — | Controls randomness. Lower values make outputs more focused; higher values make them more varied. | — |
|
Top P top_p
|
number (0…1 step 0.01) | 1 | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. | — |
|
Random seed random_seed
|
integer (0…+∞) | — | Seed used for deterministic sampling when reproducible outputs are desired. | — |
|
Presence penalty presence_penalty
|
number (-2…2 step 0.1) | 0 | Penalizes repeated words or phrases to encourage a wider variety of generated content. | — |
|
Frequency penalty frequency_penalty
|
number (-2…2 step 0.1) | 0 | Penalizes words based on how often they already appear in the generated text. | — |
Output 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Response format response_format.type
|
enum (text | json_object) | "text" | Controls whether the model returns normal text or JSON mode output. | — |
Metadata 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Safe prompt safe_prompt
|
boolean | false | Controls whether Mistral injects its safety prompt before the conversation. | — |
Length 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | — | Maximum number of tokens to generate in the completion. | — |
|
Stop sequence stop
|
string | — | Stops generation when this string is detected. | — |
Sampling 5 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…1.5 step 0.1) | — | Controls randomness. Lower values make outputs more focused; higher values make them more varied. | — |
|
Top P top_p
|
number (0…1 step 0.01) | 1 | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. | — |
|
Random seed random_seed
|
integer (0…+∞) | — | Seed used for deterministic sampling when reproducible outputs are desired. | — |
|
Presence penalty presence_penalty
|
number (-2…2 step 0.1) | 0 | Penalizes repeated words or phrases to encourage a wider variety of generated content. | — |
|
Frequency penalty frequency_penalty
|
number (-2…2 step 0.1) | 0 | Penalizes words based on how often they already appear in the generated text. | — |
Output 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Response format response_format.type
|
enum (text | json_object) | "text" | Controls whether the model returns normal text or JSON mode output. | — |
Metadata 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Safe prompt safe_prompt
|
boolean | false | Controls whether Mistral injects its safety prompt before the conversation. | — |
Length 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | — | Maximum number of tokens to generate in the completion. | — |
|
Stop sequence stop
|
string | — | Stops generation when this string is detected. | — |
Sampling 5 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…1.5 step 0.1) | — | Controls randomness. Lower values make outputs more focused; higher values make them more varied. | — |
|
Top P top_p
|
number (0…1 step 0.01) | 1 | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. | — |
|
Random seed random_seed
|
integer (0…+∞) | — | Seed used for deterministic sampling when reproducible outputs are desired. | — |
|
Presence penalty presence_penalty
|
number (-2…2 step 0.1) | 0 | Penalizes repeated words or phrases to encourage a wider variety of generated content. | — |
|
Frequency penalty frequency_penalty
|
number (-2…2 step 0.1) | 0 | Penalizes words based on how often they already appear in the generated text. | — |
Output 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Response format response_format.type
|
enum (text | json_object) | "text" | Controls whether the model returns normal text or JSON mode output. | — |
Metadata 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Safe prompt safe_prompt
|
boolean | false | Controls whether Mistral injects its safety prompt before the conversation. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max output tokens generationConfig.maxOutputTokens
|
integer (1…65536) | — | Maximum number of tokens to include in a response candidate. | — |
Sampling 4 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature generationConfig.temperature
|
number (0…2 step 0.1) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. | — |
|
Top P generationConfig.topP
|
number (0…1 step 0.01) | 0.95 | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. | — |
|
Top K generationConfig.topK
|
integer (0…+∞) | 64 | Limits token sampling to the top K most likely next tokens. | — |
|
Seed generationConfig.seed
|
integer | — | Optional seed used for decoding when reproducible sampling is desired. | — |
Reasoning 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Thinking budget generationConfig.thinkingConfig.thinkingBudget
|
integer (-1…24576) | -1 | Number of thinking tokens Gemini should use; 0 disables thinking and -1 uses dynamic thinking. | — |
|
Include thoughts generationConfig.thinkingConfig.includeThoughts
|
boolean | false | Controls whether Gemini returns available thought summaries in the response parts. | — |
Output 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Response MIME type generationConfig.responseMimeType
|
enum (text/plain | application/json) | "text/plain" | MIME type for generated text candidates. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max output tokens generationConfig.maxOutputTokens
|
integer (1…65536) | — | Maximum number of tokens to include in a response candidate. | — |
Sampling 4 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature generationConfig.temperature
|
number (0…2 step 0.1) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. | — |
|
Top P generationConfig.topP
|
number (0…1 step 0.01) | 0.95 | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. | — |
|
Top K generationConfig.topK
|
integer (0…+∞) | 64 | Limits token sampling to the top K most likely next tokens. | — |
|
Seed generationConfig.seed
|
integer | — | Optional seed used for decoding when reproducible sampling is desired. | — |
Reasoning 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Thinking budget generationConfig.thinkingConfig.thinkingBudget
|
integer | 0 | Number of thinking tokens Gemini should use; -1 uses dynamic thinking, 0 disables thinking, and fixed budgets start at 512 tokens. | — |
|
Include thoughts generationConfig.thinkingConfig.includeThoughts
|
boolean | false | Controls whether Gemini returns available thought summaries in the response parts. | — |
Output 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Response MIME type generationConfig.responseMimeType
|
enum (text/plain | application/json) | "text/plain" | MIME type for generated text candidates. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max output tokens generationConfig.maxOutputTokens
|
integer (1…65536) | — | Maximum number of tokens to include in a response candidate. | — |
Sampling 4 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature generationConfig.temperature
|
number (0…2 step 0.1) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. | — |
|
Top P generationConfig.topP
|
number (0…1 step 0.01) | 0.95 | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. | — |
|
Top K generationConfig.topK
|
integer (0…+∞) | 64 | Limits token sampling to the top K most likely next tokens. | — |
|
Seed generationConfig.seed
|
integer | — | Optional seed used for decoding when reproducible sampling is desired. | — |
Reasoning 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Thinking budget generationConfig.thinkingConfig.thinkingBudget
|
integer | 0 | Number of thinking tokens Gemini should use; -1 uses dynamic thinking, 0 disables thinking, and fixed budgets start at 512 tokens. | — |
|
Include thoughts generationConfig.thinkingConfig.includeThoughts
|
boolean | false | Controls whether Gemini returns available thought summaries in the response parts. | — |
Output 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Response MIME type generationConfig.responseMimeType
|
enum (text/plain | application/json) | "text/plain" | MIME type for generated text candidates. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max output tokens generationConfig.maxOutputTokens
|
integer (1…65536) | — | Maximum number of tokens to include in a response candidate. | — |
Sampling 4 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature generationConfig.temperature
|
number (0…2 step 0.1) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. | — |
|
Top P generationConfig.topP
|
number (0…1 step 0.01) | 0.95 | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. | — |
|
Top K generationConfig.topK
|
integer (0…+∞) | 64 | Limits token sampling to the top K most likely next tokens. | — |
|
Seed generationConfig.seed
|
integer | — | Optional seed used for decoding when reproducible sampling is desired. | — |
Reasoning 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Thinking budget generationConfig.thinkingConfig.thinkingBudget
|
integer (-1…24576) | -1 | Number of thinking tokens Gemini should use; 0 disables thinking and -1 uses dynamic thinking. | — |
|
Include thoughts generationConfig.thinkingConfig.includeThoughts
|
boolean | false | Controls whether Gemini returns available thought summaries in the response parts. | — |
Output 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Response MIME type generationConfig.responseMimeType
|
enum (text/plain | application/json) | "text/plain" | MIME type for generated text candidates. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max output tokens generationConfig.maxOutputTokens
|
integer (1…65536) | — | Maximum number of tokens to include in a response candidate. | — |
Sampling 4 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature generationConfig.temperature
|
number (0…2 step 0.1) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. | — |
|
Top P generationConfig.topP
|
number (0…1 step 0.01) | 0.95 | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. | — |
|
Top K generationConfig.topK
|
integer (0…+∞) | 64 | Limits token sampling to the top K most likely next tokens. | — |
|
Seed generationConfig.seed
|
integer | — | Optional seed used for decoding when reproducible sampling is desired. | — |
Reasoning 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Thinking budget generationConfig.thinkingConfig.thinkingBudget
|
integer (128…32768) | — | Maximum number of thinking tokens Gemini should use before producing the final answer. | — |
|
Include thoughts generationConfig.thinkingConfig.includeThoughts
|
boolean | false | Controls whether Gemini returns available thought summaries in the response parts. | — |
Output 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Response MIME type generationConfig.responseMimeType
|
enum (text/plain | application/json) | "text/plain" | MIME type for generated text candidates. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max output tokens generationConfig.maxOutputTokens
|
integer (1…65536) | — | Maximum number of tokens to include in a response candidate. | — |
Sampling 4 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature generationConfig.temperature
|
number (0…2 step 0.1) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. | — |
|
Top P generationConfig.topP
|
number (0…1 step 0.01) | 0.95 | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. | — |
|
Top K generationConfig.topK
|
integer (0…+∞) | 64 | Limits token sampling to the top K most likely next tokens. | — |
|
Seed generationConfig.seed
|
integer | — | Optional seed used for decoding when reproducible sampling is desired. | — |
Reasoning 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Thinking budget generationConfig.thinkingConfig.thinkingBudget
|
integer (128…32768) | — | Maximum number of thinking tokens Gemini should use before producing the final answer. | — |
|
Include thoughts generationConfig.thinkingConfig.includeThoughts
|
boolean | false | Controls whether Gemini returns available thought summaries in the response parts. | — |
Output 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Response MIME type generationConfig.responseMimeType
|
enum (text/plain | application/json) | "text/plain" | MIME type for generated text candidates. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max output tokens generationConfig.maxOutputTokens
|
integer (1…65536) | — | Maximum number of tokens to include in a response candidate. | — |
Sampling 4 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature generationConfig.temperature
|
number (0…2 step 0.1) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. | — |
|
Top P generationConfig.topP
|
number (0…1 step 0.01) | 0.95 | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. | — |
|
Top K generationConfig.topK
|
integer (0…+∞) | 64 | Limits token sampling to the top K most likely next tokens. | — |
|
Seed generationConfig.seed
|
integer | — | Optional seed used for decoding when reproducible sampling is desired. | — |
Reasoning 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Thinking level generationConfig.thinkingConfig.thinkingLevel
|
enum (minimal | low | medium | high) | "high" | Controls Gemini 3 Flash reasoning effort. | — |
|
Include thoughts generationConfig.thinkingConfig.includeThoughts
|
boolean | false | Controls whether Gemini returns available thought summaries in the response parts. | — |
Output 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Response MIME type generationConfig.responseMimeType
|
enum (text/plain | application/json) | "text/plain" | MIME type for generated text candidates. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max output tokens generationConfig.maxOutputTokens
|
integer (1…65536) | — | Maximum number of tokens to include in a response candidate. | — |
Sampling 4 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature generationConfig.temperature
|
number (0…2 step 0.1) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. | — |
|
Top P generationConfig.topP
|
number (0…1 step 0.01) | 0.95 | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. | — |
|
Top K generationConfig.topK
|
integer (0…+∞) | 64 | Limits token sampling to the top K most likely next tokens. | — |
|
Seed generationConfig.seed
|
integer | — | Optional seed used for decoding when reproducible sampling is desired. | — |
Reasoning 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Thinking level generationConfig.thinkingConfig.thinkingLevel
|
enum (minimal | low | medium | high) | "high" | Controls Gemini 3.1 Flash-Lite reasoning effort. | — |
|
Include thoughts generationConfig.thinkingConfig.includeThoughts
|
boolean | false | Controls whether Gemini returns available thought summaries in the response parts. | — |
Output 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Response MIME type generationConfig.responseMimeType
|
enum (text/plain | application/json) | "text/plain" | MIME type for generated text candidates. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max output tokens generationConfig.maxOutputTokens
|
integer (1…65536) | — | Maximum number of tokens to include in a response candidate. | — |
Sampling 4 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature generationConfig.temperature
|
number (0…2 step 0.1) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. | — |
|
Top P generationConfig.topP
|
number (0…1 step 0.01) | 0.95 | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. | — |
|
Top K generationConfig.topK
|
integer (0…+∞) | 64 | Limits token sampling to the top K most likely next tokens. | — |
|
Seed generationConfig.seed
|
integer | — | Optional seed used for decoding when reproducible sampling is desired. | — |
Reasoning 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Thinking level generationConfig.thinkingConfig.thinkingLevel
|
enum (minimal | low | medium | high) | "high" | Controls Gemini 3.1 Flash-Lite reasoning effort. | — |
|
Include thoughts generationConfig.thinkingConfig.includeThoughts
|
boolean | false | Controls whether Gemini returns available thought summaries in the response parts. | — |
Output 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Response MIME type generationConfig.responseMimeType
|
enum (text/plain | application/json) | "text/plain" | MIME type for generated text candidates. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max output tokens generationConfig.maxOutputTokens
|
integer (1…65536) | — | Maximum number of tokens to include in a response candidate. | — |
Sampling 4 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature generationConfig.temperature
|
number (0…2 step 0.1) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. | — |
|
Top P generationConfig.topP
|
number (0…1 step 0.01) | 0.95 | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. | — |
|
Top K generationConfig.topK
|
integer (0…+∞) | 64 | Limits token sampling to the top K most likely next tokens. | — |
|
Seed generationConfig.seed
|
integer | — | Optional seed used for decoding when reproducible sampling is desired. | — |
Reasoning 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Thinking level generationConfig.thinkingConfig.thinkingLevel
|
enum (low | high) | "high" | Controls Gemini 3 Pro reasoning effort. | — |
|
Include thoughts generationConfig.thinkingConfig.includeThoughts
|
boolean | false | Controls whether Gemini returns available thought summaries in the response parts. | — |
Output 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Response MIME type generationConfig.responseMimeType
|
enum (text/plain | application/json) | "text/plain" | MIME type for generated text candidates. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max output tokens generationConfig.maxOutputTokens
|
integer (1…65536) | — | Maximum number of tokens to include in a response candidate. | — |
Sampling 4 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature generationConfig.temperature
|
number (0…2 step 0.1) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. | — |
|
Top P generationConfig.topP
|
number (0…1 step 0.01) | 0.95 | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. | — |
|
Top K generationConfig.topK
|
integer (0…+∞) | 64 | Limits token sampling to the top K most likely next tokens. | — |
|
Seed generationConfig.seed
|
integer | — | Optional seed used for decoding when reproducible sampling is desired. | — |
Reasoning 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Thinking level generationConfig.thinkingConfig.thinkingLevel
|
enum (minimal | low | medium | high) | "medium" | Controls Gemini 3.5 Flash reasoning effort. | — |
|
Include thoughts generationConfig.thinkingConfig.includeThoughts
|
boolean | false | Controls whether Gemini returns available thought summaries in the response parts. | — |
Output 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Response MIME type generationConfig.responseMimeType
|
enum (text/plain | application/json) | "text/plain" | MIME type for generated text candidates. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | — | Maximum number of output tokens the model may generate. | — |
Sampling 3 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…2 step 0.1) | — | Controls randomness. Lower values make outputs more focused; higher values make them more varied. | — |
|
Top P top_p
|
number (0…1 step 0.01) | — | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. | — |
|
Top K extra_body.top_k
|
integer (1…+∞) | 20 | Limits generation to the selected number of highest-probability tokens. | — |
Reasoning 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Enable thinking extra_body.chat_template_kwargs.enable_thinking
|
boolean | true | Controls Qwen3 thinking mode when using OpenAI-compatible clients that pass provider-specific extra body fields. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | — | Maximum number of output tokens the model may generate. | — |
Sampling 3 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…2 step 0.1) | — | Controls randomness. Lower values make outputs more focused; higher values make them more varied. | — |
|
Top P top_p
|
number (0…1 step 0.01) | — | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. | — |
|
Top K extra_body.top_k
|
integer (1…+∞) | 20 | Limits generation to the selected number of highest-probability tokens. | — |
Reasoning 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Enable thinking extra_body.chat_template_kwargs.enable_thinking
|
boolean | true | Controls Qwen3 thinking mode when using OpenAI-compatible clients that pass provider-specific extra body fields. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | — | Maximum number of output tokens the model may generate. | — |
Sampling 3 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…2 step 0.1) | — | Controls randomness. Lower values make outputs more focused; higher values make them more varied. | — |
|
Top P top_p
|
number (0…1 step 0.01) | — | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. | — |
|
Top K extra_body.top_k
|
integer (1…+∞) | 20 | Limits generation to the selected number of highest-probability tokens. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | — | Maximum number of output tokens the model may generate. | — |
Sampling 3 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…2 step 0.1) | — | Controls randomness. Lower values make outputs more focused; higher values make them more varied. | — |
|
Top P top_p
|
number (0…1 step 0.01) | — | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. | — |
|
Top K extra_body.top_k
|
integer (1…+∞) | 20 | Limits generation to the selected number of highest-probability tokens. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | — | Maximum number of output tokens the model may generate. | — |
Sampling 3 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…2 step 0.1) | — | Controls randomness. Lower values make outputs more focused; higher values make them more varied. | — |
|
Top P top_p
|
number (0…1 step 0.01) | — | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. | — |
|
Top K extra_body.top_k
|
integer (1…+∞) | 20 | Limits generation to the selected number of highest-probability tokens. | — |
Reasoning 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Enable thinking extra_body.chat_template_kwargs.enable_thinking
|
boolean | false | Controls Qwen3 thinking mode when using OpenAI-compatible clients that pass provider-specific extra body fields. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | — | Maximum number of output tokens the model may generate. | — |
Sampling 3 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…2 step 0.1) | — | Controls randomness. Lower values make outputs more focused; higher values make them more varied. | — |
|
Top P top_p
|
number (0…1 step 0.01) | — | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. | — |
|
Top K extra_body.top_k
|
integer (1…+∞) | 20 | Limits generation to the selected number of highest-probability tokens. | — |
Reasoning 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Enable thinking extra_body.chat_template_kwargs.enable_thinking
|
boolean | true | Controls Qwen3 thinking mode when using OpenAI-compatible clients that pass provider-specific extra body fields. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | — | Maximum number of output tokens the model may generate. | — |
Sampling 3 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…2 step 0.1) | — | Controls randomness. Lower values make outputs more focused; higher values make them more varied. | — |
|
Top P top_p
|
number (0…1 step 0.01) | — | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. | — |
|
Top K extra_body.top_k
|
integer (1…+∞) | 20 | Limits generation to the selected number of highest-probability tokens. | — |
Reasoning 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Enable thinking extra_body.chat_template_kwargs.enable_thinking
|
boolean | true | Controls Qwen3 thinking mode when using OpenAI-compatible clients that pass provider-specific extra body fields. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | — | Maximum number of output tokens the model may generate. | — |
Sampling 3 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…2 step 0.1) | — | Controls randomness. Lower values make outputs more focused; higher values make them more varied. | — |
|
Top P top_p
|
number (0…1 step 0.01) | — | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. | — |
|
Top K extra_body.top_k
|
integer (1…+∞) | 20 | Limits generation to the selected number of highest-probability tokens. | — |
Length 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | — | Maximum number of output tokens the model may generate. | — |
|
Stop sequences stop_sequences
|
string | — | Stops generation when one of these sequences is detected; up to five are allowed. | — |
Sampling 6 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…+∞ step 0.1) | 0.3 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. | — |
|
Top P p
|
number (0.01…0.99 step 0.01) | 0.75 | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. | — |
|
Top K k
|
integer (0…500) | 0 | Limits sampling to the K most likely tokens; 0 disables top-k sampling. | — |
|
Frequency penalty frequency_penalty
|
number (0…1 step 0.1) | 0 | Penalizes tokens proportional to how often they have already appeared to reduce repetition. | — |
|
Presence penalty presence_penalty
|
number (0…1 step 0.1) | 0 | Penalizes tokens that have already appeared to encourage a wider variety of content. | — |
|
Seed seed
|
integer | — | Seed used for best-effort deterministic sampling when reproducible outputs are desired. | — |
Tools 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Tool choice tool_choice
|
enum (REQUIRED | NONE) | — | Forces the model to either call a tool or skip tool calls for this request. | — |
Output 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Response format response_format.type
|
enum (text | json_object) | "text" | Controls whether the model returns normal text or JSON object output. | — |
Observability 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Log probabilities logprobs
|
boolean | false | Controls whether the response includes log probabilities for the generated tokens. | — |
Metadata 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Safety mode safety_mode
|
enum (CONTEXTUAL | STRICT) | "CONTEXTUAL" | Controls Cohere's built-in safety instructions applied to the generation. | — |
Length 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | — | Maximum number of output tokens the model may generate. | — |
|
Stop sequences stop_sequences
|
string | — | Stops generation when one of these sequences is detected; up to five are allowed. | — |
Sampling 6 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…+∞ step 0.1) | 0.3 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. | — |
|
Top P p
|
number (0.01…0.99 step 0.01) | 0.75 | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. | — |
|
Top K k
|
integer (0…500) | 0 | Limits sampling to the K most likely tokens; 0 disables top-k sampling. | — |
|
Frequency penalty frequency_penalty
|
number (0…1 step 0.1) | 0 | Penalizes tokens proportional to how often they have already appeared to reduce repetition. | — |
|
Presence penalty presence_penalty
|
number (0…1 step 0.1) | 0 | Penalizes tokens that have already appeared to encourage a wider variety of content. | — |
|
Seed seed
|
integer | — | Seed used for best-effort deterministic sampling when reproducible outputs are desired. | — |
Tools 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Tool choice tool_choice
|
enum (REQUIRED | NONE) | — | Forces the model to either call a tool or skip tool calls for this request. | — |
Output 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Response format response_format.type
|
enum (text | json_object) | "text" | Controls whether the model returns normal text or JSON object output. | — |
Observability 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Log probabilities logprobs
|
boolean | false | Controls whether the response includes log probabilities for the generated tokens. | — |
Metadata 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Safety mode safety_mode
|
enum (CONTEXTUAL | STRICT) | "CONTEXTUAL" | Controls Cohere's built-in safety instructions applied to the generation. | — |
Length 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | — | Maximum number of output tokens the model may generate. | — |
|
Stop sequences stop_sequences
|
string | — | Stops generation when one of these sequences is detected; up to five are allowed. | — |
Sampling 6 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…+∞ step 0.1) | 0.3 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. | — |
|
Top P p
|
number (0.01…0.99 step 0.01) | 0.75 | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. | — |
|
Top K k
|
integer (0…500) | 0 | Limits sampling to the K most likely tokens; 0 disables top-k sampling. | — |
|
Frequency penalty frequency_penalty
|
number (0…1 step 0.1) | 0 | Penalizes tokens proportional to how often they have already appeared to reduce repetition. | — |
|
Presence penalty presence_penalty
|
number (0…1 step 0.1) | 0 | Penalizes tokens that have already appeared to encourage a wider variety of content. | — |
|
Seed seed
|
integer | — | Seed used for best-effort deterministic sampling when reproducible outputs are desired. | — |
Reasoning 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Thinking mode thinking.type
|
enum (enabled | disabled) | "disabled" | Controls whether the model reasons step by step before producing its final answer. | — |
|
Thinking token budget thinking.token_budget
|
integer (1…+∞) | — | Maximum number of tokens the model may spend on reasoning before answering. |
Only when thinking.type = "enabled" |
Tools 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Tool choice tool_choice
|
enum (REQUIRED | NONE) | — | Forces the model to either call a tool or skip tool calls for this request. | — |
Output 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Response format response_format.type
|
enum (text | json_object) | "text" | Controls whether the model returns normal text or JSON object output. | — |
Observability 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Log probabilities logprobs
|
boolean | false | Controls whether the response includes log probabilities for the generated tokens. | — |
Metadata 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Safety mode safety_mode
|
enum (CONTEXTUAL | STRICT) | "CONTEXTUAL" | Controls Cohere's built-in safety instructions applied to the generation. | — |
Length 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | — | Maximum number of output tokens the model may generate. | — |
|
Stop sequences stop_sequences
|
string | — | Stops generation when one of these sequences is detected; up to five are allowed. | — |
Sampling 6 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…+∞ step 0.1) | 0.3 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. | — |
|
Top P p
|
number (0.01…0.99 step 0.01) | 0.75 | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. | — |
|
Top K k
|
integer (0…500) | 0 | Limits sampling to the K most likely tokens; 0 disables top-k sampling. | — |
|
Frequency penalty frequency_penalty
|
number (0…1 step 0.1) | 0 | Penalizes tokens proportional to how often they have already appeared to reduce repetition. | — |
|
Presence penalty presence_penalty
|
number (0…1 step 0.1) | 0 | Penalizes tokens that have already appeared to encourage a wider variety of content. | — |
|
Seed seed
|
integer | — | Seed used for best-effort deterministic sampling when reproducible outputs are desired. | — |
Tools 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Tool choice tool_choice
|
enum (REQUIRED | NONE) | — | Forces the model to either call a tool or skip tool calls for this request. | — |
Output 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Response format response_format.type
|
enum (text | json_object) | "text" | Controls whether the model returns normal text or JSON object output. | — |
Observability 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Log probabilities logprobs
|
boolean | false | Controls whether the response includes log probabilities for the generated tokens. | — |
Metadata 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Safety mode safety_mode
|
enum (CONTEXTUAL | STRICT) | "CONTEXTUAL" | Controls Cohere's built-in safety instructions applied to the generation. | — |
Length 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | — | Maximum number of output tokens the model may generate. | — |
|
Stop sequences stop_sequences
|
string | — | Stops generation when one of these sequences is detected; up to five are allowed. | — |
Sampling 6 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…+∞ step 0.1) | 0.3 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. | — |
|
Top P p
|
number (0.01…0.99 step 0.01) | 0.75 | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. | — |
|
Top K k
|
integer (0…500) | 0 | Limits sampling to the K most likely tokens; 0 disables top-k sampling. | — |
|
Frequency penalty frequency_penalty
|
number (0…1 step 0.1) | 0 | Penalizes tokens proportional to how often they have already appeared to reduce repetition. | — |
|
Presence penalty presence_penalty
|
number (0…1 step 0.1) | 0 | Penalizes tokens that have already appeared to encourage a wider variety of content. | — |
|
Seed seed
|
integer | — | Seed used for best-effort deterministic sampling when reproducible outputs are desired. | — |
Tools 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Tool choice tool_choice
|
enum (REQUIRED | NONE) | — | Forces the model to either call a tool or skip tool calls for this request. | — |
Output 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Response format response_format.type
|
enum (text | json_object) | "text" | Controls whether the model returns normal text or JSON object output. | — |
Observability 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Log probabilities logprobs
|
boolean | false | Controls whether the response includes log probabilities for the generated tokens. | — |
Metadata 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Safety mode safety_mode
|
enum (CONTEXTUAL | STRICT) | "CONTEXTUAL" | Controls Cohere's built-in safety instructions applied to the generation. | — |
Length 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | — | Maximum number of output tokens the model may generate. | — |
|
Stop sequences stop_sequences
|
string | — | Stops generation when one of these sequences is detected; up to five are allowed. | — |
Sampling 6 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…+∞ step 0.1) | 0.3 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. | — |
|
Top P p
|
number (0.01…0.99 step 0.01) | 0.75 | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. | — |
|
Top K k
|
integer (0…500) | 0 | Limits sampling to the K most likely tokens; 0 disables top-k sampling. | — |
|
Frequency penalty frequency_penalty
|
number (0…1 step 0.1) | 0 | Penalizes tokens proportional to how often they have already appeared to reduce repetition. | — |
|
Presence penalty presence_penalty
|
number (0…1 step 0.1) | 0 | Penalizes tokens that have already appeared to encourage a wider variety of content. | — |
|
Seed seed
|
integer | — | Seed used for best-effort deterministic sampling when reproducible outputs are desired. | — |
Output 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Response format response_format.type
|
enum (text | json_object) | "text" | Controls whether the model returns normal text or JSON object output. | — |
Observability 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Log probabilities logprobs
|
boolean | false | Controls whether the response includes log probabilities for the generated tokens. | — |
Metadata 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Safety mode safety_mode
|
enum (CONTEXTUAL | STRICT | OFF) | "CONTEXTUAL" | Controls Cohere's built-in safety instructions applied to the generation. | — |
Length 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | — | Maximum number of output tokens the model may generate. | — |
|
Stop sequences stop_sequences
|
string | — | Stops generation when one of these sequences is detected; up to five are allowed. | — |
Sampling 6 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…+∞ step 0.1) | 0.3 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. | — |
|
Top P p
|
number (0.01…0.99 step 0.01) | 0.75 | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. | — |
|
Top K k
|
integer (0…500) | 0 | Limits sampling to the K most likely tokens; 0 disables top-k sampling. | — |
|
Frequency penalty frequency_penalty
|
number (0…1 step 0.1) | 0 | Penalizes tokens proportional to how often they have already appeared to reduce repetition. | — |
|
Presence penalty presence_penalty
|
number (0…1 step 0.1) | 0 | Penalizes tokens that have already appeared to encourage a wider variety of content. | — |
|
Seed seed
|
integer | — | Seed used for best-effort deterministic sampling when reproducible outputs are desired. | — |
Output 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Response format response_format.type
|
enum (text | json_object) | "text" | Controls whether the model returns normal text or JSON object output. | — |
Observability 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Log probabilities logprobs
|
boolean | false | Controls whether the response includes log probabilities for the generated tokens. | — |
Metadata 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Safety mode safety_mode
|
enum (CONTEXTUAL | STRICT | OFF) | "CONTEXTUAL" | Controls Cohere's built-in safety instructions applied to the generation. | — |
Length 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | — | Maximum number of output tokens the model may generate. | — |
|
Stop sequences stop_sequences
|
string | — | Stops generation when one of these sequences is detected; up to five are allowed. | — |
Sampling 6 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…+∞ step 0.1) | 0.3 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. | — |
|
Top P p
|
number (0.01…0.99 step 0.01) | 0.75 | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. | — |
|
Top K k
|
integer (0…500) | 0 | Limits sampling to the K most likely tokens; 0 disables top-k sampling. | — |
|
Frequency penalty frequency_penalty
|
number (0…1 step 0.1) | 0 | Penalizes tokens proportional to how often they have already appeared to reduce repetition. | — |
|
Presence penalty presence_penalty
|
number (0…1 step 0.1) | 0 | Penalizes tokens that have already appeared to encourage a wider variety of content. | — |
|
Seed seed
|
integer | — | Seed used for best-effort deterministic sampling when reproducible outputs are desired. | — |
Tools 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Tool choice tool_choice
|
enum (REQUIRED | NONE) | — | Forces the model to either call a tool or skip tool calls for this request. | — |
Output 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Response format response_format.type
|
enum (text | json_object) | "text" | Controls whether the model returns normal text or JSON object output. | — |
Observability 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Log probabilities logprobs
|
boolean | false | Controls whether the response includes log probabilities for the generated tokens. | — |
Metadata 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Safety mode safety_mode
|
enum (CONTEXTUAL | STRICT) | "CONTEXTUAL" | Controls Cohere's built-in safety instructions applied to the generation. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max completion tokens max_completion_tokens
|
integer (1…+∞) | — | Maximum number of tokens to generate in the chat completion. | — |
Reasoning 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Thinking mode thinking.type
|
enum (enabled | disabled) | — | Controls whether Kimi reasons step by step before answering, or responds directly when set to disabled. | — |
Output 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Response format response_format.type
|
enum (text | json_object) | "text" | Forces the response into plain text or a JSON object. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max completion tokens max_completion_tokens
|
integer (1…+∞) | — | Maximum number of tokens to generate in the chat completion. | — |
Reasoning 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Thinking mode thinking.type
|
enum (enabled | disabled) | "enabled" | Controls whether Kimi reasons step by step before answering. Thinking is enabled by default; set disabled to respond directly. | — |
Output 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Response format response_format.type
|
enum (text | json_object) | "text" | Forces the response into plain text or a JSON object. | — |
Length 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max completion tokens max_completion_tokens
|
integer (1…+∞) | — | Maximum number of tokens to generate in the chat completion. | — |
|
Number of completions n
|
integer (1…5) | 1 | How many chat completion choices to generate for the request. | — |
Sampling 4 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…1 step 0.1) | 0.3 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. | — |
|
Top P top_p
|
number (0…1 step 0.01) | 1 | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. | — |
|
Presence penalty presence_penalty
|
number (-2…2 step 0.1) | 0 | Penalizes tokens that have already appeared, encouraging the model to talk about new topics. | — |
|
Frequency penalty frequency_penalty
|
number (-2…2 step 0.1) | 0 | Penalizes tokens by how often they have appeared, reducing verbatim repetition. | — |
Output 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Response format response_format.type
|
enum (text | json_object) | "text" | Forces the response into plain text or a JSON object. | — |
Length 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max completion tokens max_completion_tokens
|
integer (1…+∞) | — | Maximum number of tokens to generate in the chat completion. | — |
|
Number of completions n
|
integer (1…5) | 1 | How many chat completion choices to generate for the request. | — |
Sampling 4 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…1 step 0.1) | 0.3 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. | — |
|
Top P top_p
|
number (0…1 step 0.01) | 1 | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. | — |
|
Presence penalty presence_penalty
|
number (-2…2 step 0.1) | 0 | Penalizes tokens that have already appeared, encouraging the model to talk about new topics. | — |
|
Frequency penalty frequency_penalty
|
number (-2…2 step 0.1) | 0 | Penalizes tokens by how often they have appeared, reducing verbatim repetition. | — |
Output 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Response format response_format.type
|
enum (text | json_object) | "text" | Forces the response into plain text or a JSON object. | — |
Length 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max completion tokens max_completion_tokens
|
integer (1…+∞) | — | Maximum number of tokens to generate in the chat completion. | — |
|
Number of completions n
|
integer (1…5) | 1 | How many chat completion choices to generate for the request. | — |
Sampling 4 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…1 step 0.1) | 0.3 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. | — |
|
Top P top_p
|
number (0…1 step 0.01) | 1 | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. | — |
|
Presence penalty presence_penalty
|
number (-2…2 step 0.1) | 0 | Penalizes tokens that have already appeared, encouraging the model to talk about new topics. | — |
|
Frequency penalty frequency_penalty
|
number (-2…2 step 0.1) | 0 | Penalizes tokens by how often they have appeared, reducing verbatim repetition. | — |
Output 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Response format response_format.type
|
enum (text | json_object) | "text" | Forces the response into plain text or a JSON object. | — |
Length 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max completion tokens max_completion_tokens
|
integer (1…+∞) | — | Upper bound for visible output tokens generated in the chat completion. | — |
|
Stop sequence stop
|
string | — | Stops generation when this sequence is produced. xAI accepts up to four stop sequences. | — |
Sampling 3 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…2 step 0.1) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. | — |
|
Top P top_p
|
number (0…1 step 0.01) | 1 | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. | — |
|
Seed seed
|
integer | — | Optional seed used for decoding when reproducible sampling is desired. | — |
Output 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Response format response_format.type
|
enum (text | json_object | json_schema) | "text" | Controls whether the model returns text, JSON mode output, or structured JSON schema output. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max completion tokens max_completion_tokens
|
integer (1…+∞) | — | Upper bound for visible output tokens generated in the chat completion. | — |
Sampling 3 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…2 step 0.1) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. | — |
|
Top P top_p
|
number (0…1 step 0.01) | 1 | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. | — |
|
Seed seed
|
integer | — | Optional seed used for decoding when reproducible sampling is desired. | — |
Output 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Response format response_format.type
|
enum (text | json_object | json_schema) | "text" | Controls whether the model returns text, JSON mode output, or structured JSON schema output. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max output tokens max_output_tokens
|
integer (1…+∞) | — | Upper bound for output tokens generated in the Responses API response. | — |
Sampling 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…2 step 0.1) | 0.7 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. | — |
|
Top P top_p
|
number (0…1 step 0.01) | 0.95 | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. | — |
Reasoning 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Reasoning effort reasoning.effort
|
enum (low | medium | high | xhigh) | — | Controls whether the Responses API request uses the 4-agent or 16-agent multi-agent setup. | — |
Output 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Text format text.format.type
|
enum (text | json_object | json_schema) | "text" | Controls whether the Responses API returns free-form text, JSON mode output, or structured JSON schema output. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max completion tokens max_completion_tokens
|
integer (1…+∞) | — | Upper bound for visible output tokens generated in the chat completion. | — |
Sampling 3 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…2 step 0.1) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. | — |
|
Top P top_p
|
number (0…1 step 0.01) | 1 | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. | — |
|
Seed seed
|
integer | — | Optional seed used for decoding when reproducible sampling is desired. | — |
Reasoning 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Reasoning effort reasoning_effort
|
enum (none | low | medium | high) | "low" | Controls how much reasoning Grok performs before responding. Set to none for non-reasoning requests. | — |
Output 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Response format response_format.type
|
enum (text | json_object | json_schema) | "text" | Controls whether the model returns text, JSON mode output, or structured JSON schema output. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max completion tokens max_completion_tokens
|
integer (1…+∞) | — | Upper bound for visible output tokens generated in the chat completion. | — |
Sampling 3 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…2 step 0.1) | 1 | Controls randomness. Lower values make outputs more focused; higher values make them more varied. | — |
|
Top P top_p
|
number (0…1 step 0.01) | 1 | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. | — |
|
Seed seed
|
integer | — | Optional seed used for decoding when reproducible sampling is desired. | — |
Output 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Response format response_format.type
|
enum (text | json_object | json_schema) | "text" | Controls whether the model returns text, JSON mode output, or structured JSON schema output. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | 4096 | Maximum number of output tokens the model may generate. | — |
Sampling 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…2 step 0.1) | 1 | Controls randomness. In DeepSeek thinking mode this parameter is accepted for compatibility but has no effect. |
Not when thinking.type = "enabled" |
|
Top P top_p
|
number (0…1 step 0.01) | 1 | Controls nucleus sampling. In DeepSeek thinking mode this parameter is accepted for compatibility but has no effect. |
Not when thinking.type = "enabled" |
Reasoning 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Thinking mode thinking.type
|
enum (disabled | enabled) | "disabled" | Controls whether DeepSeek uses thinking mode before producing the final answer. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | 4096 | Maximum number of output tokens the model may generate. | — |
Sampling 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…2 step 0.1) | 1 | Controls randomness. In DeepSeek thinking mode this parameter is accepted for compatibility but has no effect. |
Not when thinking.type = "enabled" |
|
Top P top_p
|
number (0…1 step 0.01) | 1 | Controls nucleus sampling. In DeepSeek thinking mode this parameter is accepted for compatibility but has no effect. |
Not when thinking.type = "enabled" |
Reasoning 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Thinking mode thinking.type
|
enum (enabled | disabled) | "enabled" | Controls whether DeepSeek uses thinking mode before producing the final answer. | — |
|
Reasoning effort reasoning_effort
|
enum (high | max) | "high" | Controls DeepSeek thinking effort when thinking mode is enabled. |
Only when thinking.type = "enabled" |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | 4096 | Maximum number of output tokens the model may generate. | — |
Sampling 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…2 step 0.1) | 1 | Controls randomness. In DeepSeek thinking mode this parameter is accepted for compatibility but has no effect. |
Not when thinking.type = "enabled" |
|
Top P top_p
|
number (0…1 step 0.01) | 1 | Controls nucleus sampling. In DeepSeek thinking mode this parameter is accepted for compatibility but has no effect. |
Not when thinking.type = "enabled" |
Reasoning 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Thinking mode thinking.type
|
enum (enabled | disabled) | "enabled" | Controls whether DeepSeek uses thinking mode before producing the final answer. | — |
|
Reasoning effort reasoning_effort
|
enum (high | max) | "high" | Controls DeepSeek thinking effort when thinking mode is enabled. |
Only when thinking.type = "enabled" |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…+∞) | 4096 | Maximum number of output tokens the model may generate. | — |
Sampling 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…2 step 0.1) | 1 | Controls randomness. In DeepSeek thinking mode this parameter is accepted for compatibility but has no effect. |
Not when thinking.type = "enabled" |
|
Top P top_p
|
number (0…1 step 0.01) | 1 | Controls nucleus sampling. In DeepSeek thinking mode this parameter is accepted for compatibility but has no effect. |
Not when thinking.type = "enabled" |
Reasoning 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Thinking mode thinking.type
|
enum (enabled | disabled) | "enabled" | Controls whether DeepSeek uses thinking mode before producing the final answer. | — |
|
Reasoning effort reasoning_effort
|
enum (high | max) | "high" | Controls DeepSeek thinking effort when thinking mode is enabled. |
Only when thinking.type = "enabled" |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max completion tokens max_completion_tokens
|
integer (1…+∞) | — | Maximum number of output tokens the model may generate. | — |
Sampling 4 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number | — | Controls randomness. Lower values make outputs more focused; higher values make them more varied. | — |
|
Top P top_p
|
number | — | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. | — |
|
Top K top_k
|
integer | — | Limits generation to the selected number of highest-probability tokens. | — |
|
Repetition penalty repetition_penalty
|
number | — | Penalizes tokens that have already appeared to reduce repetition in the output. | — |
Tools 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Tool choice tool_choice
|
enum (auto | none | required) | — | Controls whether the model may call tools, must call one, or skips tool calls. | — |
Output 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Response format response_format.type
|
enum (text | json_schema) | "text" | Controls whether the model returns normal text or a schema-constrained JSON object. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max completion tokens max_completion_tokens
|
integer (1…+∞) | — | Maximum number of output tokens the model may generate. | — |
Sampling 4 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number | — | Controls randomness. Lower values make outputs more focused; higher values make them more varied. | — |
|
Top P top_p
|
number | — | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. | — |
|
Top K top_k
|
integer | — | Limits generation to the selected number of highest-probability tokens. | — |
|
Repetition penalty repetition_penalty
|
number | — | Penalizes tokens that have already appeared to reduce repetition in the output. | — |
Tools 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Tool choice tool_choice
|
enum (auto | none | required) | — | Controls whether the model may call tools, must call one, or skips tool calls. | — |
Output 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Response format response_format.type
|
enum (text | json_schema) | "text" | Controls whether the model returns normal text or a schema-constrained JSON object. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max completion tokens max_completion_tokens
|
integer (1…+∞) | — | Maximum number of output tokens the model may generate. | — |
Sampling 4 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number | — | Controls randomness. Lower values make outputs more focused; higher values make them more varied. | — |
|
Top P top_p
|
number | — | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. | — |
|
Top K top_k
|
integer | — | Limits generation to the selected number of highest-probability tokens. | — |
|
Repetition penalty repetition_penalty
|
number | — | Penalizes tokens that have already appeared to reduce repetition in the output. | — |
Tools 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Tool choice tool_choice
|
enum (auto | none | required) | — | Controls whether the model may call tools, must call one, or skips tool calls. | — |
Output 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Response format response_format.type
|
enum (text | json_schema) | "text" | Controls whether the model returns normal text or a schema-constrained JSON object. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max completion tokens max_completion_tokens
|
integer (1…+∞) | — | Maximum number of output tokens the model may generate. | — |
Sampling 4 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number | — | Controls randomness. Lower values make outputs more focused; higher values make them more varied. | — |
|
Top P top_p
|
number | — | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. | — |
|
Top K top_k
|
integer | — | Limits generation to the selected number of highest-probability tokens. | — |
|
Repetition penalty repetition_penalty
|
number | — | Penalizes tokens that have already appeared to reduce repetition in the output. | — |
Tools 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Tool choice tool_choice
|
enum (auto | none | required) | — | Controls whether the model may call tools, must call one, or skips tool calls. | — |
Output 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Response format response_format.type
|
enum (text | json_schema) | "text" | Controls whether the model returns normal text or a schema-constrained JSON object. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…128000) | — | Maximum number of output tokens the model may generate. | — |
Sampling 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…2 step 0.1) | — | Controls randomness. Lower values make outputs more focused; higher values make them more varied. | — |
|
Top P top_p
|
number (0…1 step 0.01) | — | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. | — |
Metadata 9 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Search mode search_mode
|
enum (web | academic | sec) | — | Selects the corpus the model searches when grounding its answer. | — |
|
Search recency filter search_recency_filter
|
enum (hour | day | week | month | year) | — | Restricts web search results to a recent time window. | — |
|
Search domain filter search_domain_filter
|
string | — | Limits search to, or excludes, specific domains. | — |
|
Search after date search_after_date_filter
|
string | — | Restricts search results to content published after this date (MM/DD/YYYY). | — |
|
Search before date search_before_date_filter
|
string | — | Restricts search results to content published before this date (MM/DD/YYYY). | — |
|
Search context size web_search_options.search_context_size
|
enum (low | medium | high) | "low" | Controls how much web search context is retrieved before generating the answer. | — |
|
Return images return_images
|
boolean | false | Controls whether the response may include related images from the search. | — |
|
Return related questions return_related_questions
|
boolean | false | Controls whether the response includes suggested follow-up questions. | — |
|
Disable search disable_search
|
boolean | false | Turns off web search so the model answers from its own knowledge only. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…128000) | — | Maximum number of output tokens the model may generate. | — |
Sampling 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…2 step 0.1) | — | Controls randomness. Lower values make outputs more focused; higher values make them more varied. | — |
|
Top P top_p
|
number (0…1 step 0.01) | — | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. | — |
Reasoning 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Reasoning effort reasoning_effort
|
enum (minimal | low | medium | high) | — | Controls how much reasoning and searching the model performs before producing the report. | — |
Metadata 8 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Search mode search_mode
|
enum (web | academic | sec) | — | Selects the corpus the model searches when grounding its answer. | — |
|
Search recency filter search_recency_filter
|
enum (hour | day | week | month | year) | — | Restricts web search results to a recent time window. | — |
|
Search domain filter search_domain_filter
|
string | — | Limits search to, or excludes, specific domains. | — |
|
Search after date search_after_date_filter
|
string | — | Restricts search results to content published after this date (MM/DD/YYYY). | — |
|
Search before date search_before_date_filter
|
string | — | Restricts search results to content published before this date (MM/DD/YYYY). | — |
|
Search context size web_search_options.search_context_size
|
enum (low | medium | high) | "low" | Controls how much web search context is retrieved before generating the answer. | — |
|
Return images return_images
|
boolean | false | Controls whether the response may include related images from the search. | — |
|
Return related questions return_related_questions
|
boolean | false | Controls whether the response includes suggested follow-up questions. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…128000) | — | Maximum number of output tokens the model may generate. | — |
Sampling 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…2 step 0.1) | — | Controls randomness. Lower values make outputs more focused; higher values make them more varied. | — |
|
Top P top_p
|
number (0…1 step 0.01) | — | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. | — |
Metadata 9 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Search mode search_mode
|
enum (web | academic | sec) | — | Selects the corpus the model searches when grounding its answer. | — |
|
Search recency filter search_recency_filter
|
enum (hour | day | week | month | year) | — | Restricts web search results to a recent time window. | — |
|
Search domain filter search_domain_filter
|
string | — | Limits search to, or excludes, specific domains. | — |
|
Search after date search_after_date_filter
|
string | — | Restricts search results to content published after this date (MM/DD/YYYY). | — |
|
Search before date search_before_date_filter
|
string | — | Restricts search results to content published before this date (MM/DD/YYYY). | — |
|
Search context size web_search_options.search_context_size
|
enum (low | medium | high) | "low" | Controls how much web search context is retrieved before generating the answer. | — |
|
Return images return_images
|
boolean | false | Controls whether the response may include related images from the search. | — |
|
Return related questions return_related_questions
|
boolean | false | Controls whether the response includes suggested follow-up questions. | — |
|
Disable search disable_search
|
boolean | false | Turns off web search so the model answers from its own knowledge only. | — |
Length 1 param
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Max tokens max_tokens
|
integer (1…128000) | — | Maximum number of output tokens the model may generate. | — |
Sampling 2 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Temperature temperature
|
number (0…2 step 0.1) | — | Controls randomness. Lower values make outputs more focused; higher values make them more varied. | — |
|
Top P top_p
|
number (0…1 step 0.01) | — | Controls nucleus sampling by limiting generation to tokens within the selected cumulative probability. | — |
Metadata 9 params
| Parameter | Type | Default | Description | Condition |
|---|---|---|---|---|
|
Search mode search_mode
|
enum (web | academic | sec) | — | Selects the corpus the model searches when grounding its answer. | — |
|
Search recency filter search_recency_filter
|
enum (hour | day | week | month | year) | — | Restricts web search results to a recent time window. | — |
|
Search domain filter search_domain_filter
|
string | — | Limits search to, or excludes, specific domains. | — |
|
Search after date search_after_date_filter
|
string | — | Restricts search results to content published after this date (MM/DD/YYYY). | — |
|
Search before date search_before_date_filter
|
string | — | Restricts search results to content published before this date (MM/DD/YYYY). | — |
|
Search context size web_search_options.search_context_size
|
enum (low | medium | high) | "low" | Controls how much web search context is retrieved before generating the answer. | — |
|
Return images return_images
|
boolean | false | Controls whether the response may include related images from the search. | — |
|
Return related questions return_related_questions
|
boolean | false | Controls whether the response includes suggested follow-up questions. | — |
|
Disable search disable_search
|
boolean | false | Turns off web search so the model answers from its own knowledge only. | — |
No models match your filters.
Building with an AI agent? Hit Copy to grab this whole guide as Markdown and paste it in — or point your agent straight at /llms.txt.
modelparams.dev is an open, community-maintained catalog of LLM model parameters. Each entry shows the knobs you can turn — type, default, range, and the conditions that gate it.
The same model accessed via an API key and via a subscription usually exposes a different set of parameters. We list both as separate entries so the data stays honest.
The full catalog is static JSON, CORS-enabled, served from the edge.
curl https://modelparams.dev/api/v1/models.json
Each entry is keyed by provider/model for API-key variants; subscription variants append -subscription.
If you only need the params for one model contract, use the providerless endpoint. Subscription contracts are model slugs with -subscription.
curl https://modelparams.dev/api/v1/params/gpt-5.5.json
curl https://modelparams.dev/api/v1/params/gpt-5.5-subscription.jsoncurl https://modelparams.dev/api/v1/models/anthropic/claude-opus-4-7.json
curl https://modelparams.dev/api/v1/models/anthropic/claude-opus-4-7-subscription.jsonEvery entry validates against a JSON Schema you can use in your editor or pipeline.
curl https://modelparams.dev/api/v1/schema.jsonAdd this header to any YAML you author for autocomplete in VS Code:
# yaml-language-server: $schema=https://modelparams.dev/api/v1/schema.json
Provider logos are available at /assets/logos/{provider}.svg
where {provider} is the provider slug. They use currentColor so they inherit your text color.
curl https://modelparams.dev/assets/logos/anthropic.svgLogos are sourced from the models.dev repo (MIT) and used under nominative fair use.
The data lives in YAML under models/{provider}/{model}-{auth}.yaml
in the GitHub repo.
Open a PR; CI validates against the schema and rebuilds.
此内容由惯性聚合(RSS阅读器)自动聚合整理，仅供阅读参考。 原文来自 — 版权归原作者所有。