def is_cublasLt_compatible(cc): has_cublaslt = False if cc is not None: cc_major, cc_minor = cc.split('.') #if int(cc_major) < 7 or (int(cc_major) == 7 and int(cc_minor) < 5): #CUDASetup.add_log_entry("WARNING: Compute capability < 7.5 detected! Only slow 8-bit mat...
NameError: name 'cuda_setup' is not defined #124 Closed w-firm opened this issue Jan 16, 2023· 3 comments Comments w-firm commented Jan 16, 2023 👍 2 evelinedurom commented Jan 17, 2023 @w-firm I think Its an issue with the GPU. Make sure you are using a Turing or ...
from .cuda_setup.main import evaluate_cuda_setup File "C:\Onlyfans-Silvia-Tongana\kohya_ss\venv\lib\site-packages\bitsandbytes\cuda_setup\main.py", line 21, in from .paths import determine_cuda_runtime_lib_path ModuleNotFoundError: No module named 'bitsandbytes.cuda_setup.paths' During...
CUDA_VERSION=118 make cuda11x python setup.py install CUDA SETUP: Setup Failed! /usr/local/lib/python3.10/dist-packages/bitsandbytes/cuda_setup/main.py:149: UserWarning: /usr/lib64-nvidia did not contain ['libcudart.so', 'libcudart.so.11.0', 'libcudart.so.12.0'] as expected! Searching ...
CUDA Setup failed despite CUDA being available. Please run the following command to get more information: python -m bitsandbytes Inspect the output of the command and see if you can locate CUDA libraries. You might need to add them
Theload_in_4bitproblem seems working with thatbitsandbytes. This is how I created the environment on window 10: conda create --name=llama_2 python=3.11 Then I installed: pip3 install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cu121 python -m pip install bit...
/home/win10-ubuntu/anaconda3/lib/python3.10/site-packages/bitsandbytes/cuda_setup/main.py:136: UserWarning: /home/win10-ubuntu/anaconda3 did not contain libcudart.so as expected! Searching further paths... warn(msg) CUDA exception! Error...
CUDA Setup failed despite CUDA being available. Please run the following command to get more information: python -m bitsandbytes Inspect the output of the command and see if you can locate CUDA libraries. You might need to add them
CUDA SETUP: Solution 1: To solve the issue the libcudart.so location needs to be added to the LD_LIBRARY_PATH variable CUDA SETUP: Solution 1a): Find the cuda runtime library via: find / -name libcudart.so 2>/dev/null CUDA SETUP: Solution 1b): Once the library is found add it to...
OSError: /home/USER/.conda/envs/bits-env/bin/../lib/libstdc++.so.6: version `GLIBCXX_3.4.32' not found (required by /home/USER/Documents/temp/bitsandbytes/bitsandbytes/libbitsandbytes_hip_nohipblaslt.so) CUDA Setup failed despite CUDA being available. Please run the following command ...