Since v1.60, provides native image generation with StableDiffusion.cpp, you can load any SD1.5 or SDXL .safetensors model and it will provide an A1111 compatible API to use. I try to keep backwards compatibility with ALL past llama.cpp models. But you are also encouraged to reconvert/upda...
Lastly the all the features of our userscript API are documented inside the API Documentation files inside the userscripts folder. For our TPU versions keep in mind that scripts modifying AI behavior relies on a different way of processing that is slower than if you leave these userscripts disab...
llama.cpp web server is a lightweight OpenAI API compatible HTTP server that can be used to serve local models and easily connect them to existing clients. Bindings: Python: abetlen/llama-cpp-python Go: go-skynet/go-llama.cpp Node.js: withcatai/node-llama-cpp JS/TS (llama.cpp server...
Lastly the all the features of our userscript API are documented inside the API Documentation files inside the userscripts folder. For our TPU versions keep in mind that scripts modifying AI behavior relies on a different way of processing that is slower than if you leave these userscripts disab...
Since v1.60, provides native image generation with StableDiffusion.cpp, you can load any SD1.5 or SDXL .safetensors model and it will provide an A1111 compatible API to use. I plan to keep backwards compatibility with ALL past llama.cpp AND alpaca.cpp models. But you are also encouraged...
bool random_prompt = false; // do not randomize prompt if none provided bool use_color = false; // use color to distinguish generations and inputs bool interactive = false; // interactive mode bool interactive_specials = false; // whether to allow special tokens from user, during interactiv...
Lastly the all the features of our userscript API are documented inside the API Documentation files inside the userscripts folder. For our TPU versions keep in mind that scripts modifying AI behavior relies on a different way of processing that is slower than if you leave these userscripts disab...
Lastly the all the features of our userscript API are documented inside the API Documentation files inside the userscripts folder. For our TPU versions keep in mind that scripts modifying AI behavior relies on a different way of processing that is slower than if you leave these userscripts disab...
Lastly the all the features of our userscript API are documented inside the API Documentation files inside the userscripts folder. For our TPU versions keep in mind that scripts modifying AI behavior relies on a different way of processing that is slower than if you leave these userscripts disab...
Lastly the all the features of our userscript API are documented inside the API Documentation files inside the userscripts folder. For our TPU versions keep in mind that scripts modifying AI behavior relies on a different way of processing that is slower than if you leave these userscripts disab...