python -m bitsandbytes and submit this information together with your error trace to: https://github.com/TimDettmers/bitsandbytes/issues bin /datadrive/anaconda3/lib/python3.10/site-packages/bitsandbytes/libbitsandbytes_cuda122.so False CUDA_SETUP: WARNING! libcudart.so not found in any envir...
maybe python -m bitsandbytes useful info CUDA SETUP: Loading binary D:\Toolkit\conda\envs\textgen\lib\site-packages\bitsandbytes\libbitsandbytes_cuda122.dll... Could not find module 'D:\Toolkit\conda\envs\textgen\lib\site-packages\bitsandbytes\libbitsandbytes_cuda122.dll' (or one of i...