/usr/local/lib/python3.10/dist-packages/bitsandbytes/cextension.py:31: UserWarning: The installed version of bitsandbytes was compiled without GPU support. 8-bit optimizers, 8-bit multiplication, and GPU quantization are unavailable. warn("The installed version of bitsandbytes was compiled without...
During handling of the above exception, another exception occurred:Traceback (most recent call last): File"TensorRT-LLM/examples/llama/build.py", line 33,in<module>from weight import (get_scaling_factors, load_from_awq_llama, load_from_binary, File"TensorRT-LLM/examples/llama/weight.py", li...