vllm-project/vllm-ncclPublic archive NotificationsYou must be signed in to change notification settings Fork2 Star17 Code Issues2 Pull requests Actions Projects Security Insights Additional navigation options Files main vllm_nccl .gitignore LICENSE ...
A high-throughput and memory-efficient inference and serving engine for LLMs - vllm/csrc/custom_all_reduce_test.cu at main · isuyu/vllm
2.19,>=2.18 (from vllm) Downloading vllm_nccl_cu12-2.18.1.0.4.0.tar.gz (6.2...
同样的错误也发生在我身上。这个bug还在持续吗？
Solutions By company size Enterprises Small and medium teams Startups By use case DevSecOps DevOps CI/CD View all use cases By industry Healthcare Financial services Manufacturing Government View all industries View all solutions Resources Topics AI DevOps Security Software Development...
Search or jump to... Search code, repositories, users, issues, pull requests... Provide feedback We read every piece of feedback, and take your input very seriously. Include my email address so I can be contacted Cancel Submit feedback Saved searches Use saved searches to filter your...
We read every piece of feedback, and take your input very seriously. Include my email address so I can be contacted Cancel Submit feedback Saved searches Use saved searches to filter your results more quickly Cancel Create saved search Sign in Sign up Reseting focus {...
[Build] Disable sm_90a in cu11 (vllm-project#5141) May 31, 2024 CONTRIBUTING.md [Misc] Define common requirements (vllm-project#3841) Apr 5, 2024 Dockerfile [Doc][Build] update after removing vllm-nccl (vllm-project#5103) May 30, 2024 ...
Using cached nvidia_cusparse_cu11-11.7.4.91-py3-none-manylinux1_x86_64.whl (173.2 MB) Collecting nvidia-nccl-cu11==2.14.3 (from torch>=2.0.0->vllm) Using cached nvidia_nccl_cu11-2.14.3-py3-none-manylinux1_x86_64.whl (177.1 MB) ...
GPU 2: NVIDIA A100-SXM4-80GB GPU 3: NVIDIA A100-SXM4-80GB Nvidia driver version: 535.86.10 cuDNN version: Probably one of the following: /usr/lib/x86_64-linux-gnu/libcudnn.so.8.9.0 /usr/lib/x86_64-linux-gnu/libcudnn_adv_infer.so.8.9.0 ...