Download KoboldAI https://github.com/henk717/KoboldAI, 5a. Download Automatic1111 Stable Diffusion WebUI: https://github.com/AUTOMATIC1111/stable-diffusion-webui 5b. Start KoboldAi, get models, load them Start automatic1111's stable diffusion webui, add the flag --api and --medvram to...
AI models. It offers the standard array of tools, including Memory, Author's Note, World Info, Save & Load, adjustable AI settings, formatting options, and the ability to import existing AI Dungeon adventures. You can also turn on Adventure mode and play the game like AI Dungeon Unleashed....
KoboldCPP is a program used for running offline LLM's (AI models). However it does not include any offline LLM's so we will have to download one separately. Running KoboldCPP and other offline AI services uses up a LOT of computer resources. ...
AI models. It offers the standard array of tools, including Memory, Author's Note, World Info, Save & Load, adjustable AI settings, formatting options, and the ability to import existing AI Dungeon adventures. You can also turn on Adventure mode and play the game like AI Dungeon Unleashed....
Most models these days are done with no groupsize to reduce size, and will need a groupsize of "None".Run Cell 2. This will download the model, and will also take about ten minutes. Don't be fooled. The second cell will output text stating "Done" but it isn't actually done until...
The official docker can be found athttps://hub.docker.com/r/koboldai/koboldcpp If you're building your own docker, remember to set CUDA_DOCKER_ARCH or enable LLAMA_PORTABLE Obtaining a GGUF model KoboldCpp uses GGUF models. They are not included with KoboldCpp, but you can download GG...
(KoboldAI/KoboldAI-Client#112) henk717committedFeb 20, 2022 1 parent27cf59bcommit7c67882 Show file tree Hide file tree Showing2 changed fileswith4 additionsand0 deletions. Whitespace Ignore whitespace Split Unified .gitignore models models go here.txt ...
["Nerybus 13B (NSFW)", "KoboldAI/OPT-13B-Nerybus-Mix", "32GB", False], ["Erebus 13B (NSFW)", "KoboldAI/OPT-13B-Erebus", "32GB", False], ["Shinen FSD 13B (NSFW)", "KoboldAI/fairseq-dense-13B-Shinen", "32GB", False], ["Nerybus 6.7B (NSFW)", "KoboldAI/OPT-6.7B-Nery...
The official docker can be found at https://hub.docker.com/r/koboldai/koboldcpp If you're building your own docker, remember to set CUDA_DOCKER_ARCH or enable LLAMA_PORTABLE Obtaining a GGUF model KoboldCpp uses GGUF models. They are not included here, but you can download GGUF files...
Hotfix 1.83.1 - Fixed crashes in non-gguf models due to autoguess adapter. Also reverts to single process only when not in admin mode. To use, download and run thekoboldcpp.exe, which is a one-file pyinstaller. If you don't need CUDA, you can usekoboldcpp_nocuda.exewhich is much...