time=2024-06-16T15:00:22.313+02:00 level=WARN source=types.go:395 msg="invalid option provided" option="" ggml_cuda_compute_forward: RMS_NORM failed CUDA error: shared object initialization failed current device: 0, in function ggml_cuda_compute_forward at /build/ollama/src/ollama-rocm/...
Hello! Is there a plan to add this for/api/chat? I just figured I am using it, and I am getting messages| time=2024-08-11T20:01:52.188Z level=WARN source=types.go:507 msg="invalid option provided" option=keep_alive Sorry, something went wrong. ...
source code as you receive it, in any medium, provided that you conspicuously and appropriately publish on each copy an appropriate copyright notice and disclaimer of warranty; keep intact all the notices that refer to this License and to the absence of any warranty; ...
For this you need to set the OpenAI base-url: `spring.ai.openai.chat.base-url=http://localhost:11434` and select one of the provided Ollama models: `spring.ai.openai.chat.options.model=mistral`. Check the link:https://github.com/spring-projects/spring-ai/blob/main/models/spring-ai-ope...
For other models, RouteLLM supports any provider that has an OpenAI-compatible interface, which includes a wide-range of both closed and open-source models running locally or in the cloud. Once you have an OpenAI-compatible endpoint, set...
We read every piece of feedback, and take your input very seriously. Include my email address so I can be contacted Cancel Submit feedback Saved searches Use saved searches to filter your results more quickly Cancel Create saved search Sign in Sign up Reseting focus {...
I crop the image you provided to keep only the part with the text in Black and White and asked Llava : can you give me the text written on this image? /Users/igor/Documents/readme ... .png The result is: The image contains text that appears to be instructions for filtering packages...
ATTRIBUTION = "Data provided by http://jsonplaceholder.typicode.com/" CONF_BASE_URL = "base_url" CONF_CHAT_MODEL = "chat_model" CONF_PROMPT = "prompt" CONF_TOP_K = "top_k" CONF_TOP_P = "top_p" CONF_CTX_SIZE = "ctx_size" CONF_MAX_TOKENS = "max_tokens" CONF_TEMPERATURE = "...
}# Check if no arguments were provided # if [ $# -eq 0 ]; then # usage # exit 1 # fi# Parse arguments while [[ $# -gt 0 ]]; do key="$1"case $key in --enable-gpu*) enable_gpu=true value=$(extract_value "$key") gpu_count=${value:-1} ...
We read every piece of feedback, and take your input very seriously. Include my email address so I can be contacted Cancel Submit feedback Saved searches Use saved searches to filter your results more quickly Cancel Create saved search Sign in Sign up Reseting focus {...