Skip to Main Content

text-generation-webui

text-generation-webui is currently the most feature-rich text generation workbench in the community.

It includes many core features:

  • Interact with models using chat, interactive notebooks, and conversations.
  • Integrated with multiple model runtime environments, supporting various model formats and runtime environments such as peft, llama.cpp, GPTQ-for-LLaMa.
  • Provides GUI support for fine-tuning model training, including training peft LoRA.
  • Extensible capabilities, other community developers can integrate with text-generation-webui through development extensions.