sudo docker pull rocm/pytorch:latest 自己制作rocm docker镜像,可参考:rocm-ubuntu20.04 docker镜像制作 4.docker run 脚本 #docker run MY_CONTAINER="richard-pytorch-rocm" IMAES="rocm/pytorch:latest" num=`docker ps -a|grep "$MY_CONTAINER" | wc -l` echo $num echo $MY_CONTAINER if [ 0 -eq...
# CPU 或 Nvidia GPU 运行 docker pull ollama/ollama:0.3.0 # AMD 显卡运行 docker pull ollama/ollama:0.3.0-rocm 针对不同的设备,我们的运行指令也需要有不同的调整: # 默认 CPU 模式运行 docker run -d -v ollama:/root/.ollama -p 11434:11434 --name ollama ollama/ollama # Nvidia GPU ...
docker pull ollama/ollama:rocm不过,我个人还是建议,我们始终使用具体的版本的镜像,来确保我们的运行环境是明确的,运行环境可维护性,使用类似下面的方式下载镜像。# CPU 或 Nvidia GPU 运行docker pull ollama/ollama:0.3.0# AMD 显卡运行docker pull ollama/ollama:0.3.0-rocm...
Use rocm/pytorch:latest d66e2f0 jithunnair-amd requested review from jeffra and awan-10 as code owners December 15, 2022 22:01 jeffra approved these changes Dec 15, 2022 View reviewed changes jeffra merged commit 7e2103f into deepspeedai:master Dec 15, 2022 Quentin-Anthony added a com...
# CPU 或 Nvidia GPU 运行dockerpull ollama/ollama:0.3.0# AMD 显卡运行dockerpull ollama/ollama:0.3.0-rocm 针对不同的设备,我们的运行指令也需要有不同的调整: 代码语言:bash AI代码解释 # 默认 CPU 模式运行dockerrun-d-vollama:/root/.ollama-p11434:11434--nameollama ollama/ollama# Nvidia GPU...
❱ echo "import torch\nprint(torch.randn(1, device='cuda'))" | docker run --security-opt seccomp=unconfined --device /dev/kfd --device /dev/dri -i --rm rocm/pytorch:rocm6.1_ubuntu22.04_py3.10_pytorch_2.1.2 python Traceback (most recent call last): ...
pytorch.org/whl/rocm5.7/torchvision-0.18.1%2Brocm5.7-cp312-cp312-linux_x86_64.whl (65.5 MB) ━━━ 65.5/65.5 MB 1.6 MB/s eta 0:00:00 Downloading https://download.pytorch.org/whl/cu121/torchvision-0.18.1%2Bcu121-cp312-cp312-linux_x86_64.whl (7.0 MB) ━━━ 7.0/7.0 MB 2.2...
# CPU 或 Nvidia GPU 运行docker pull ollama/ollama:0.3.0# AMD 显卡运行docker pull ollama/ollama:0.3.0-rocm 针对不同的设备,我们的运行指令也需要有不同的调整: # 默认 CPU 模式运行docker run -d -v ollama:/root/.ollama -p 11434:11434 --name ollama ollama/ollama# Nvidia GP...
ARG BASE_IMAGE=gpustack/rocm-base:rocm6.2_ubuntu20.04_py3.10_pytorch2.6.0_vllm0.6.6.post1 FROM $BASE_IMAGE ARG TARGETPLATFORM ENV DEBIAN_FRONTEND=noninteractive RUN apt-get update && apt-get install -y \ python3-venv \ tzdata \ iproute2 \ build-essential \ && apt-get cle...
# https://github.com/ROCm/rocm-examples/blob/rocm-6.3.0/Dockerfiles/hip-libraries-rocm-ubuntu.Dockerfile ARG UBUNTU_VERSION=22.04 ARG ROCM_VERSION=6.2.4 ARG BASE_IMAGE=rocm/dev-ubuntu-${UBUNTU_VERSION}:${ROCM_VERSION} # Default ROCm ARCHes to build vLLM for. ARG PYTORCH_ROCM_ARC...