A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models. - text-generation-webui/cmd_windows.bat at main · nrvo/text-generation-webui
AMD users:https://rentry.org/eq3hg git clone https://github.com/oobabooga/text-generation-webui cd text-generation-webui pip install -r requirements.txt Note For bitsandbytes and--load-in-8bitto work on Linux/WSL, this dirty fix is currently necessary:oobabooga#400 (comment) ...
= "Windows" llama-cpp-python==0.1.33; platform_system != "Windows" https://github.com/abetlen/llama-cpp-python/releases/download/v0.1.33/llama_cpp_python-0.1.33-cp310-cp310-win_amd64.whl; platform_system == "Windows" 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18...
57; platform_system != "Windows" https://github.com/abetlen/llama-cpp-python/releases/download/v0.1.57/llama_cpp_python-0.1.57-cp310-cp310-win_amd64.whl; platform_system == "Windows" llama-cpp-python==0.1.62; platform_system != "Windows" https://github.com/abetlen/llama-c...
= "Windows" https://github.com/jllllll/bitsandbytes-windows-webui/releases/download/wheels/bitsandbytes-0.38.1-py3-none-win_amd64.whl; platform_system == "Windows" # llama-cpp-python (CPU only, no AVX2) https://github.com/oobabooga/llama-cpp-python-cuBLAS-wheels/releases/download/cpu...
cmd_windows.bat cmd_wsl.bat convert-to-safetensors.py download-model.py one_click.py requirements.txt requirements_amd.txt requirements_amd_noavx2.txt requirements_apple_intel.txt requirements_apple_silicon.txt requirements_cpu_only.txt requirements_cpu_only_noavx2.txt ...
win_amd64.whl; platform_system == "Windows" and python_version == "3.11" https://github.com/oobabooga/llama-cpp-python-cuBLAS-wheels/releases/download/cpu/llama_cpp_python-0.2.69+cpuavx-cp310-cp310-win_amd64.whl; platform_system == "Windows" and python_version == "3.10" # AMD ...
AMD users: https://rentry.org/eq3hg 3. Install the web UI git clone https://github.com/oobabooga/text-generation-webui cd text-generation-webui pip install -r requirements.txt Note For bitsandbytes and --load-in-8bit to work on Linux/WSL, this dirty fix is currently necessary: oo...
AMD users: https://rentry.org/eq3hg3. Install the web UIgit clone https://github.com/oobabooga/text-generation-webui cd text-generation-webui pip install -r requirements.txt Alternative: manual Windows installationAs an alternative to the recommended WSL method, you can install the web UI ...
AMD users: https://rentry.org/eq3hg3. Install the web UIgit clone https://github.com/oobabooga/text-generation-webui cd text-generation-webui pip install -r requirements.txt Alternative: manual Windows installationAs an alternative to the recommended WSL method, you can install the web UI ...