llm_load_tensors: VRAM used: 1637.37 MB ...GGML_ASSERT: D:\a\llama-cpp-python-cuBLAS-wheels\llama-cpp-python-cuBLAS-wheels\vendor\llama.cpp\ggml-cuda.cu:5925: falseActivity jllllll commented on Oct 12, 2023 jllllll on Oct 12, 2023 Owner What model are you trying to load? This...
Ignoring llama-cpp-python: markers 'platform_system == "Windows"' don't match your environment Ignoring llama-cpp-python-cuda: markers 'platform_system == "Windows"' don't match your environment ERROR: llama_cpp_python_cuda-0.2.6+cu117-cp310-cp310-manylinux_2_31_x86_64.whl is not a ...