请先安装git和lfs,如果显卡资源有限,可以下载internlm-chat-20b-4bit cd /data/models/ git lfs clone https://www.modelscope.cn/Shanghai_AI_Laboratory/internlm2-chat-20b.git #git lfs clone https://www.modelscope.cn/Shanghai_AI_Laboratory/internlm2-chat-20b-4bit.git # 预处理模型文件,根据...
Checklist 1. I have searched related issues but cannot get the expected help. 2. The bug has not been fixed in the latest version. Describe the bug 双卡V100 使用 lmdeploy cli 部署InternLM2-Chat-20B服务, 运行一段时间后,请求报错: an illegal memory access w