[INFO|modeling_utils.py:3783] 2023-12-12 09:03:50,971 >> All the weights of LlamaForCausalLM were initialized from the model checkpoint at /media/models/models/deepseek-ai/deepseek-coder-33b-instruct. If your t
Use FastChat to start the deepseek-coder-33b-instruct model, send a stream request and got an error response. If set stream=False, you can print a good response If change to other models, it also works with stream Start cmd: python3 -m f...
libc++abi: terminating due to uncaught exception of type std::out_of_range: unordered_map::at: key not found zsh: abort ./build/bin/main -m ./deepseek-coder-33b-instruct/ggml-model-Q8_0.gguf --seed