另外看下您的显存能否跑7b模型，vllm安装，https://docs.vllm.ai/en/latest/getting_started/installation.html#build-from-source此回答整理自钉群“魔搭ModelScope开发者联盟群 ①”
pip uninstall swift pip install ms-swift -U 此回答整理自钉群“魔搭ModelScope开发者联盟群 ①”"
vllm-project/vllmPublic Sponsor NotificationsYou must be signed in to change notification settings Fork5.1k Star33.3k Code Issues1.2k Pull requests454 Discussions Actions Security Insights Additional navigation options New issue Closed HuichiZhouopened this issueAug 2, 2024· 2 comments ...