Skip to Main Content

Features

The core feature of text-generation-webui is text generation, which includes the following capabilities:

  • Interactive communication with the model through chat, interactive notes, and conversation
  • Integration with multiple model runtime environments, supporting various model formats and runtime environments such as peft, llama.cpp, and GPTQ-for-LLaMa
  • GUI support for fine-tuning model training, including training for peft LoRA
  • Extensibility, allowing other community developers to integrate with text-generation-webui through development of extensions