vLLM (the same version as vllm-ascend) Getting Started Please refer to QuickStart and Installation for more details. Contributing See CONTRIBUTING for more details, which is a step-by-step guide to help you set
vllm-ascendPublic Community maintained hardware plugin for vLLM on Ascend Python757Apache-2.0193161(3 issues need help)69UpdatedJun 13, 2025 vllmPublic A high-throughput and memory-efficient inference and serving engine for LLMs Python49,537Apache-2.07,9541,927(12 issues need help)720UpdatedJun ...
CANNAscend NPU OpenCLAdreno GPU RPCAll Obtaining and quantizing models TheHugging Faceplatform hosts anumber of LLMscompatible withllama.cpp: Trending LLaMA You can either manually download the GGUF file or directly use anyllama.cpp-compatible models fromHugging Faceor other model hosting sites, su...
This repository was archived by the owner on Feb 18, 2025. It is now read-only. cosdt/vllm-ascendPublic archive NotificationsYou must be signed in to change notification settings Fork6 Star12 Apache-2.0 license starsforks NotificationsYou must be signed in to change notification settings ...
ascend_orangepi 40Branches44Tags Code Folders and files Name Last commit message Last commit date Latest commit Cannot retrieve latest commit at this time. History 3,434 Commits .buildkite [Build] skip renaming files for release wheels pipeline (vllm-project… ...
See vLLM official support: https://github.com/vllm-project/vllm-ascend - vllm-ascend/examples at main · cosdt/vllm-ascend
pythonchataimcpbigdatasanicechartsdifyragvue3text2sqlllmchatgptvllmollamaqwendeepseek-r1large-model-data-assistant UpdatedMay 29, 2025 JavaScript vllm-project/vllm-ascend Sponsor Star702 Code Issues Pull requests Community maintained hardware plugin for vLLM on Ascend ...
Your current environment 使用quay.io/ascend/vllm-ascend:v0.7.3-dev镜像部署DeepSeek-R1-Distill-Qwen-32B,会报如下错误: INFO 03-11 02:47:04 init.py:30] Available plugins for group vllm.platform_plugins: INFO 03-11 02:47:04 init.py:32] name=ascend, valu...
Your current environment 启动vllm serve服务化后出现ERROR ERROR 04-28 16:10:09 camem.py:69] Failed to import vllm_ascend_C:No module named 'vllm_ascend.vllm_ascend_C' 🐛 Describe the bug ERROR 04-28 16:10:09 camem.py:69] Failed to import vllm_asce...
Yikun/vllm-ascend projects Search all projects Search results 0 Open 0 Closed Sort No open projects Footer © 2025 GitHub, Inc. Footer navigation Terms Privacy Security Status Docs Contact Manage cookies Do not share my personal information ...