github-actionsreleased this09 Dec 06:12 ·13 commitsto main since this release v0.3.4-cu124 ea4d86a fix(ci): update macos runner image to non-deprecated version 2leizil and lelofraser reacted with thumbs up emoji3ali0une, John6666cat, and Jxspa reacted with heart emoji ...
cu121: CUDA 12.1 cu122: CUDA 12.2 cu123: CUDA 12.3 cu124: CUDA 12.4 For example, to install the CUDA 12.1 wheel: pip install llama-cpp-python \ --extra-index-url https://abetlen.github.io/llama-cpp-python/whl/cu121Metal To install with Metal (MPS), set the LLAMA_METAL=on envir...
v0.3.4-cu123 v0.3.4-cu124 v0.3.4 v0.3.4-metal v0.3.3 v0.3.2 v0.3.2-metal v0.3.1 v0.3.1-metal v0.3.0 v0.3.0-metal v0.2.90 v0.2.90-cu121 v0.2.90-cu122 克隆/下载 HTTPSSSHSVNSVN+SSH 该操作需登录 Gitee 帐号,请先登录后再操作。
pip install --no-cache-dir llama-cpp-python==0.2.77 --extra-index-url https://abetlen.github.io/llama-cpp-python/whl/cu124/ Thanks alot. pip install --no-cache-dir llama-cpp-python==0.2.85 --extra-index-url https://abetlen.github.io/llama-cpp-python/whl/cu122 worked for me. ...
v0.3.4-cu124 fix(ci): update macos runner image to non-deprecated version Assets 10 Loading 👍 1 ️ 2 3 people reacted v0.3.4-cu123 09 Dec 06:19 github-actions v0.3.4-cu123 ea4d86a Compare v0.3.4-cu123 fix(ci): update macos runner image to non-deprecated version...
- `cu122`: CUDA 12.2 - `cu123`: CUDA 12.3 - `cu124`: CUDA 12.4 - `cu124`: CUDA 12.5 - `cu125`: CUDA 12.5 For example, to install the CUDA 12.1 wheel: 0 comments on commit 49b1e73 Please sign in to comment. Footer © 2024 GitHub, Inc. Footer navigation Terms Privacy ...
47 - ./scripts/releases-to-pep-503.sh index/whl/cu125 '^[v]?[0-9]+\.[0-9]+\.[0-9]+-cu124$' 48 - ./scripts/releases-to-pep-503.sh index/whl/cu126 '^[v]?[0-9]+\.[0-9]+\.[0-9]+-cu124$' 47 + # ./scripts/releases-to-pep-503.sh index/whl/cu125 '^[v...
cu121: CUDA 12.1 cu122: CUDA 12.2 cu123: CUDA 12.3 cu124: CUDA 12.4 cu125: CUDA 12.5 For example, to install the CUDA 12.1 wheel: pip install llama-cpp-python \ --extra-index-url https://abetlen.github.io/llama-cpp-python/whl/cu121 Metal To install with Metal (MPS), set the...
cu121: CUDA 12.1 cu122: CUDA 12.2 cu123: CUDA 12.3 cu124: CUDA 12.4 cu125: CUDA 12.5 For example, to install the CUDA 12.1 wheel: pip install llama-cpp-python \ --extra-index-url https://abetlen.github.io/llama-cpp-python/whl/cu121 Metal To install with Metal (MPS), set the...
cu121: CUDA 12.1 cu122: CUDA 12.2 cu123: CUDA 12.3 cu124: CUDA 12.4 For example, to install the CUDA 12.1 wheel: pip install llama-cpp-python \ --extra-index-url https://abetlen.github.io/llama-cpp-python/whl/cu121 Metal To install with Metal (MPS), set theGGML_METAL=onenvironme...