For bitsandbytes and --load-in-8bit to work on Linux/WSL, this dirty fix is currently necessary: oobabooga#400 (comment) Alternative: manual Windows installation As an alternative to the recommended WSL method, you can install the web UI natively on Windows using this guide. It will be ...