A simple one-file way to run various GGML and GGUF models with KoboldAI's UI - cuda : supports running on CPU for GGML_USE_CUBLAS=ON build (#3946) · LostRuins/koboldcpp@46876d2
A 3rd party testground for KoboldCPP, a simple one-file way to run various GGML/GGUF models with KoboldAI's UI. (for KCCP Frankenstein, in CPU mode, CUDA, CLBLAST, or VULKAN) - Nexesenex/kobold.cpp