使用了Xeon处理器、一块主板和16GB主内存。我可以很好地运行DeepSeek-V2 16b。
jason@jason-LOQ-15APH8:~$ ollama run deepseek-coder-v2 Error: llama runner process has terminated: signal: aborted (core dumped) CUDA error: CUBLAS_STATUS_NOT_INITIALIZED current device: 0, in function cublas_handle at /go/src/github.com/ollama/ollama/llm/llama.cpp/ggml-cuda/common.cuh...
"deepseek-coder-v2:16b", "deepseek-coder-v2:236b", "falcon2", "falcon2:11b", "firefunction-v2", "firefunction-v2:70b", "gemma", "gemma:2b", "gemma:7b", "gemma2", "gemma2:2b", "gemma2:9b", "gemma2:27b", "llama2", "llama2:7b", "llama2:13b", "llama2:70b", "llam...
Run the binary file in your terminal Using this command omdd get deepseek-coder-v2:latest. Wait for the tool to fetch the download link. Install Ollama Models First make sure to create a backup of your current models. Where are ollama models stored? Store your models and your manifest ...
DeepSeek (MoE) 7B/16B/67B q_proj,v_proj deepseek Falcon 7B/40B/180B query_key_value falcon Gemma/CodeGemma 2B/7B q_proj,v_proj gemma InternLM2 7B/20B wqkv intern2 LLaMA 7B/13B/33B/65B q_proj,v_proj - LLaMA-2 7B/13B/70B q_proj,v_proj llama2 LLaMA-3 8B/70B q_proj,v_...
Run the binary file in your terminal Using this command omdd get deepseek-coder-v2:latest. Wait for the tool to fetch the download link. Install Ollama Models First make sure to create a backup of your current models. Where are ollama models stored? Store your models and your manifest ...