Self Checks This is only for bug report, if you would like to ask a question, please head to Discussions. I have searched for existing issues search for existing issues, including closed ones. I confirm that I am using English to submit ...
I encountered the same problem (/usr/bin/ld: cannot find -lcudart) in a new conda environment, but previous solutions didn't work for me. On the one hand, there is no lib64 folder in this environment, and the lib folder contains "libcudart.so" and "libcudart.so.11". Among them, I...
✅ Cannot connect to certain online services after april 2019 Windows update:Hi A few months ago I got an Acer Predator Triton 500. After the april windows updates I was not able to connect to certain online services anymore...
karlbernard2commentedJun 21, 2023 Whatever I try, I get: RuntimeError: Cannot find CUDA at CUDA_HOME: /usr/local/cuda. CUDA must be available in order to build the package. --- WARNING: Discarding https://files.pythonhosted.org/packages/39/a1/42e126432a166dcca8d93c430a5c733b1734f4e0...
but now that I got it up and running with the docker container, and have a working configuration, I will try to determine correct steps for manual installation within next few days, and report back (even if I can't find working manual steps, I will at least provide what else I tried,...
(6.5 MB) Collecting triton==2.0.0 Using cached https://download.pytorch.org/whl/triton-2.0.0-1-cp310-cp310-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (63.3 MB) Collecting networkx Using cached networkx-3.1-py3-none-any.whl (2.1 MB) Collecting filelock Using cached filelock-3.12...
there was an additional environment in the install directory that included triton 2.1. Once I found this issue posted, I used Anaconda to activate the path to the installation directory, which shows up in Anaconda as "env". I performed a pip install triton==2.0 and the oobabooga program exe...
but CMake did not find one. Could not find a package configuration file provided by "pybind11" with any of the following names: pybind11Config.cmake pybind11-config.cmake Add the installation prefix of "pybind11" to CMAKE_PREFIX_PATH or set ...
Runninglocate libcudart.so.11.0does not find anything inside the CUDA docker image. Because we have CUDA 12 installed I guess 5. Conclusion CUDA version is really sensible for vLLM to work. It would be really helpful for vLLM to provide a bit of documentation around it, e.g.: ...
❓ Questions and Help When I tried either pip install or build from source, I get this issue: × python setup.py egg_info did not run successfully. │ exit code: 1 ╰─> [18 lines of output] Traceback (most recent call last): File "<string>",...