尝试在Python脚本或交互式环境中导入auto-gptq,以确保没有导入错误。 python import auto_gptq 如果以上步骤仍然无法解决问题,可能需要检查你的Python环境设置,或者确认auto-gptq包是否确实存在并且可用。如果这是一个私有或内部使用的包,可能需要联系包的维护者以获取安装帮助。
But when I tried doingpython run_localGPT.py --device_type mps, it gave meNo module named 'auto_gptq'. So, I tried installing it in the terminal, which gave me Using cached auto_gptq-0.5.1.tar.gz (112 kB) Preparing metadata (setup.py) ... error error: subprocess-exited-with-err...
ModuleNotFoundError Traceback (most recent call last) [<ipython-input-3-0547849ae4a2>](https://localhost:8080/#) in <cell line: 2>() 1 # initialize without metadata filter ---> 2 from gpt_index.storage.storage_context import StorageContext 3 4 5 vector_store = PineconeVectorStore( Mod...
* The name will remain mywork.local The error was -> The RPC server is unavailable* If I restart the PC I get the following error when trying to log on a domain account, only allowing me to use local accounts: The security database on the server does not have a computer account for...
\Gpt\Langchain-Chatchat\server\knowledge_base\migrate.py", line 1, in <module> from configs.model_config import EMBEDDING_MODEL, DEFAULT_VS_TYPE File "I:\Gpt\Langchain-Chatchat\configs\__init__.py", line 1, in <module> from .basic_config import * ModuleNotFoundError: No module named...
chore: add GitHub metadata (#1085) Oct 23, 2023 Makefile feat(scripts): Wipe qdrant and obtain db Stats command (#1783) Apr 2, 2024 README.md Update README.md Nov 14, 2024 docker-compose.yaml fix: 503 when private gpt gets ollama service (#2104) ...
I'm getting the same error on colab withTheBloke-Dolphin-2.1-mistral-7B-GPTQwhich was working... @bitsnapssame problem here. did you find any solution? Not yet, I believe this is something to do with mistral/transformer/huggingface issue (not vllm), I'm not even able to run mistral...
After installing the linux-surface kernel on my Surface Book 3, the bluetooth adapter is no longer recognized. In the Bluetooth settings, it just says "No Bluetooth Found. Plug in a dongle to use Bluetooth." Environment Hardware model: S...
Client: Windows 10 build 19541.1000 Server: Fedora 30 Workstation Package versions: xorgxrdp-0.2.13-1.fc30.x86_64 xrdp-selinux-0.9.13-1.fc30.x86_64 xrdp-0.9.13-1.fc30.x86_64 Issue: When connecting to the Fedora 30 machine via mstsc and x...
gptq: true # This will attempt to quantize the model down to 8 bits and use adam 8 bit optimizer load_in_8bit: true # Use bitsandbytes 4 bit load_in_4bit: # Use CUDA bf16 bf16: true # bool or 'full' for `bf16_full_eval`. require >=ampere ...