https://github.com/jllllll/bitsandbytes-windows-webui/releases/download/wheels/bitsandbytes-0.41.1-py3-none-win_amd64.whl; platform_system == "Windows" 2 comments on commitc375c75 OwnerAuthor oobaboogacommented onc375c75Feb 16, 2024
( File "/home/tony/AI/text_gen/oobabooga_linux_gpu/installer_files/env/lib/python3.10/subprocess.py", line 526, in run raise CalledProcessError(retcode, process.args, subprocess.CalledProcessError: Command '['ninja', '-v']' returned non-zero exit status 1. The above exception was the ...
//github.com/oobabooga/torch-grammar.git /tmp/pip-req-build-aeyje2et ++ pwd + current_dir=/home/dewi/code/text-generation-webui + [[ /home/dewi/code/text-generation-webui == \/\m\n\t\/\c* ]] + /usr/bin/git clone --filter=blob:none --quiet https://github.com/oobabooga/...
HappyCatKittenopened this issueMar 6, 2023· 3 comments HappyCatKittencommentedMar 6, 2023• edited This works on Linux with 3090 python server.py --load-in-8bit --model LLaMa-7B python server.py --model LLaMa-7B However this doesnt work. ...
Describe the bug not sure why. REinstalled cuda 11.7 (after using --uninstall as well as bin\cuda_uninstaller), and getting an error on latest commit when I try to pip install -r requirements.txt ERROR: llama_cpp_python_cuda-0.2.6+cu117-...