Changes

• Native desktop app: Portable builds now bundle Electron and open as a native window. Run textgen / textgen.bat instead of the previous start scripts. Pass --listen or --nowebui to skip the window and run the server directly.
• Major UI overhaul:
  • Replace Noto Sans with Inter as the default font.
  • Replace emoji refresh/save/delete buttons with Lucide SVG icons.
  • Turn the chat mode selector (chat / chat-instruct / instruct) into a 3-button segmented control.
  • Redesign the chat input as a single rounded card with a circular accent-colored send button.
  • Use a flat underline for the active tab indicator.
  • Replace the sidebar toggle buttons with 3px hairline handles on desktop.
• Tensor parallelism for llama.cpp: New --split-mode flag (replacing --row-split) with a tensor option that can make multi-GPU inference 60%+ faster. On the ik_llama.cpp backend, tensor and row fall back to graph.
• Replace DuckDuckGo HTML scraping in the web search tool with the ddgs library, which is more robust against DuckDuckGo's bot blocking.
• Add support for standalone .jinja/.jinja2 instruction template files in the UI, in addition to the existing .yaml format (#7517).

Bug fixes

• Fix Stop button being ignored during tool call approval, and not interrupting between tool turns in multi-turn tool loops.
• Fix race condition in the ExLlamaV3 backend that could affect concurrent API requests.
• Fix extension settings not saving for extensions inside user_data/extensions (#7525).

Dependency updates

• Update llama.cpp to ggml-org/llama.cpp@0929436
• Update ik_llama.cpp to ikawrakow/ik_llama.cpp@9f1deef
• Update transformers to 5.6

Portable builds

TextGen is now a desktop app for local LLMs. Download, unzip, double-click.

Windows

Linux

macOS

Updating a portable install:

1. Download and extract the latest version.
2. Replace the user_data folder with the one in your existing install. All your settings and models will be moved.

Starting with 4.0, you can also move user_data one folder up, next to the install folder. It will be detected automatically, making updates easier:

textgen-4.6/
textgen-4.7/
user_data/    <-- shared by both installs