...Download model many times when use VLLM_USE_MODELSCOPE and...
Your current environment The output of `python collect_env.py` Your output of `python collect_env.py` here 🐛 Describe the bug When using VLLM_USE_MODELSCOPE and the tensor-parallel-size > 1, I found that vllm will download the model many...