root@container-2b7811b9ae-030121cb:~# ls autodl-pub autodl-tmp miniconda3 tf-logs root@container-2b7811b9ae-030121cb:~# cd autodl-tmp/yolov5/VOCdevkit/ root@container-2b7811b9ae-030121cb:~/autodl-tmp/yolov5/VOCdevkit# ls VOC2007 root@container-2b7811b9ae-030121cb:~/autodl-tmp/yolov5/...
cp -r ./* /root/autodl-tmp/tensorrtllm_backend/triton_model_repo/tensorrt_llm/1 然后将tensorrtllm_backend/triton_model_repo/tensorrt_llm里面的engine路径换成你现在的路径,也就是/root/autodl-tmp/tensorrtllm_backend/triton_model_repo/tensorrt_llm/1。 启动服务 cd ~/autodl-tmp/tensorrtllm_backend ...
要是48G 申请一个就可以,要是 24G 显存需申请2个显卡才可以。 apt update && apt install -y git-lfs net-tools# 一定要保证有大磁盘空间:cd /root/autodl-tmpgit clone https://www.modelscope.cn/Shanghai_AI_Laboratory/internlm2-chat-20b.git# 1,安装 torch 模块,防止依赖多次下载pip3 install torc...