Features
The core feature of text-generation-webui is text generation, which includes the following capabilities:
- Interactive communication with the model through chat, interactive notes, and conversation
- Integration with multiple model runtime environments, supporting various model formats and runtime environments such as peft, llama.cpp, and GPTQ-for-LLaMa
- GUI support for fine-tuning model training, including training for peft LoRA
- Extensibility, allowing other community developers to integrate with text-generation-webui through development of extensions
📄️ Interactive Mode
text-generation-webui supports several different interactive modes.
📄️ Extensions/Plugins
text-generation-webui supports various plugins.