Dockerfile.ubi: use CUDA 12.1 instead of 12.4 dtrifiro added 5 commits August 12, 2024 18:31 deps: bump vllm-tgis-adapter to 0.2.4 a58d5f2 Dockerfile.ubi: force using python-installed cuda runtime libraries 6b47904 Dockerfile: use uv pip everywhere (it's faster) 2d71e49 Dock...
&& python3 -m pip install -r tools/ci_build/github/linux/docker/inference/x86_64/python/cpu/scripts/requirements.txt \ && /bin/bash ./build.sh --allow_running_as_root --skip_submodule_sync \ --use_cuda --cuda_home /usr/local/cuda --cudnn_home /usr/lib/x86_64-linux-gnu/ \ ...
To build docker image: git clone https://github.com/microsoft/onnxruntime cd onnxruntime/dockerfiles docker build -t onnxruntime-cuda -f Dockerfile.cuda .. To launch the docker image built from previous step (and mount the code directory to run a unit test below): cd .. docker run...
# to build this docker image: # docker build -f Dockerfile.opencv-gpu-cuda-12 -t ghcr.io/hybridgroup/opencv:4.10.0-gpu-cuda-12 . # docker build --build-arg OPENCV_VERSION="4.x" --build-arg OPENCV_FILE="https://github.com/opencv/opencv/archive/refs/heads/4.x.zip" --build-arg...
thumnail_cuda Build docker build -t ffmpeg . Usage Run the container mounting the current directory to /workspace processing input.mp4 to output.mp4 without any hardware acceleration docker run --rm -it \ --volume $PWD:/workspace \ ffmpeg -i input.mp4 output.avi docker run --rm -it --...
Are you only able to use CUDA versions that are above your host's? 2. Steps to reproduce the issue Running the following command: docker run --rm --gpus all nvidia/cuda:10.2-base nvidia-smi Results in the following output: Unable to find image 'nvidia/cuda:10.2-base' locally 10.2-...
Hi nvidia-docker team, When I use "CUDA Multi-Process Service" aka MPS in nvidia-docker environment, I want to know how should I set the env CUDA_MPS_ACTIVE_THREAD_PERCENTAGE. There were some situations that multi-gpus are needed for one...
I use: Ubuntu 16.04 GeForce GTX 1080 Ti nvidia driver version: 384.130 Tensorflow and other cuda related code run without any problem. But in Docker, I have the following problem. When I run sudo docker run --runtime=nvidia -it --rm tensorflow/tensorflow:latest-gpu python -c "import tens...
To use onediff in docker pytorch/pytorch:2.2.2-cuda12.1-cudnn8-runtime you need add LD_LIBRARY_PATH to load libcudnn_cnn_infer.so.8 export LD_LIBRARY_PATH=/opt/conda/pkgs/pytorch-2.2.2-py3.10_cuda12.1_cudnn8.9.2_0/lib/python3.10/site-pac...
The official repo of Qwen (通义千问) chat & pretrained large language model proposed by Alibaba Cloud. - Add Docker image for CUDA-12.1. · ai-learn-use/Qwen@23a01b0