./main -m ./models/13B/ggml-model-q4_0.gguf -n 256 --grammar-file grammars/json.gbnf -p 'Request: schedule a call at 8pm; Command:' The grammars/ folder contains a handful of sample grammars. To write your own, check out the GBNF Guide. For authoring more complex JSON grammars...
https://fosdem.org/2024/schedule/event/fosdem-2024-2706-build-your-first-clang-compilation-database-plugin/ TraceCode: Trace a build to find out which source files are built in a binary https://github.com/nexB/tracecode-toolkit Debug your build by tracing and reversing: stracing your buil...
// whether or not there is going to be a next value generated (co_yield)// in coroutine via C++ getter (operator () below) is to execute/resume// coroutine until the next co_yield point (or let it fall off end).// Then we store/cache result in promise to allow getter (operator...
float sched; // schedule multiplier (fixed, decay or warmup) float decay; // weight decay for AdamW, use 0.0f to disable int decay_min_ndim; // minimum number of tensor dimension to apply weight decay float alpha; // learning rate float beta1; float beta2; float eps; // ...
./main -m ./models/13B/ggml-model-q4_0.gguf -n 256 --grammar-file grammars/json.gbnf -p 'Request: schedule a call at 8pm; Command:' The grammars/ folder contains a handful of sample grammars. To write your own, check out the GBNF Guide....
https://fosdem.org/2024/schedule/event/fosdem-2024-2392-rocgdb-gdb-and-amdgpu-debugging/ SecurityTube GDB Expert (SGDE) Walkthroughs: https://github.com/chaitanyakrishna/Securitytube-Gnu-Debugger-Expert Course Videos: http://www.securitytube.net/tags/sgde https://www.youtube.com/playlist?lis...
Mar 30, 2024 build.zig wpm : portable unicode tolower (ggerganov#6305) Mar 27, 2024 codecov.yml cov : disable comment in PRs (ggerganov#2989) Sep 3, 2023 convert-hf-to-gguf.py update version Apr 2, 2024 convert-llama-ggml-to-gguf.py convert : automatically fall back to HfVocab...
./main -m ./models/13B/ggml-model-q4_0.gguf -n 256 --grammar-file grammars/json.gbnf -p 'Request: schedule a call at 8pm; Command:' The grammars/ folder contains a handful of sample grammars. To write your own, check out the GBNF Guide....
[2024 Mar 13] Add llama_synchronize() + llama_context_params.n_ubatch https://github.com/ggerganov/llama.cpp/pull/6017 [2024 Mar 8] llama_kv_cache_seq_rm() returns a bool instead of void, and new llama_n_seq_max() returns the upper limit of acceptable seq_id in batches (relevan...
Saved searches Use saved searches to filter your results more quickly Cancel Create saved search Sign in Sign up Reseting focus {{ message }} MCGlatency / MCGlatency.github.io Public Notifications You must be signed in to change notification settings Fork 0 Star 0 ...