Changes

• Redesigned chat composer: Taller input area with the paperclip and message-action buttons pinned to the bottom, similar to Gemini and DeepSeek.
• Smooth scroll animation when sending a new message: Inspired by Gemini's chat UI.
• Electron improvements:
  • Persist window bounds and maximize state across launches.
  • Add a --no-electron flag to skip the desktop window and use the web UI in the browser instead.
  • Disable spellcheck in the chat input.
• API: Add support for list-format content in tool and assistant messages.
• Add more space below the last chat/chat-instruct message so its action buttons have breathing room.

Bug fixes

• Electron:
  • Fix --listen mode in the launcher.
  • Fix missing log colors on Windows.
  • Fix big character picture failing to load (#7540).
• Fix speculative decoding broken by upstream llama.cpp arg renames (#7541).
• Fix truncation length reverting after model load on UI reload (#7540).
• Don't clear the chat input when sending a message with no model loaded (#7542).

Dependency updates

• Update llama.cpp to ggml-org/llama.cpp@68380ae
• Update ik_llama.cpp to ikawrakow/ik_llama.cpp@9a26522

Portable builds

TextGen is now a desktop app for local LLMs. Download, unzip, double-click.

Windows

Linux

macOS

macOS note: You need to run xattr -cr /path/to/your/textgen-folder on the extracted folder before launching. See #7558.

Updating a portable install:

1. Download and extract the latest version.
2. Replace the user_data folder with the one in your existing install. All your settings and models will be moved.

Starting with 4.0, you can also move user_data one folder up, next to the install folder. It will be detected automatically, making updates easier:

textgen-4.6/
textgen-4.7/
user_data/    <-- shared by both installs