gguf-v0.14.0 … b3063 GalunidauthoredMay 31, 2024 1 parentc8047d5commit0515ad9 Showing1 changed filewith6 additionsand1 deletion. 7 changes: 6 additions & 1 deletion7convert-hf-to-gguf.py Original file line numberDiff line numberDiff line change ...
logger.info("Usage: python convert_hf_to_gguf_update.py <huggingface_token>") sys.exit(1) # TODO: add models here, base models preferred models = [ {"name": "llama-spm", "tokt": TOKENIZER_TYPE.SPM, "repo": "https://huggingface.co/meta-llama/Llama-2-7b-hf", }, {"na...
* convert-hf-to-gguf-update: automate updating * convert-hf-to-gguf-update: improve download * share requests session for performance * create directories only when needed, don't skip downloads when empty directory encountered * be more graceful about errorsmaster...
logger.info("Usage: python convert_hf_to_gguf_update.py <huggingface_token>") sys.exit(1) # TODO: add models here, base models preferred models = [ {"name": "llama-spm", "tokt": TOKENIZER_TYPE.SPM, "repo": "https://huggingface.co/meta-llama/Llama-2-7b-hf", }, {"na...
1 change: 1 addition & 0 deletions 1 requirements/requirements-convert-hf-to-gguf.txt Original file line numberDiff line numberDiff line change @@ -1,2 +1,3 @@ -r ./requirements-convert.txt torch~=2.1.1 einops~=0.7.0 0 comments on commit da3b9ba Please sign in to comment. Foo...
convert-*.py: GGUF Naming Convention Refactor and Metadata Override Refactor (ggerganov#7499) 3 peopleauthoredJul 18, 2024 Verified 672a6f1 Commits on Jul 16, 2024 convert_hf : faster lazy safetensors (ggerganov#8482) compiladeauthoredJul 16, 2024 Verified 7acfd4e Commits on Jul 15...
from torch import Tensor if 'NO_LOCAL_GGUF' not in os.environ: sys.path.insert(1, str(Path(__file__).parent / 'gguf-py')) import gguf from convert import LlamaHfVocab, permute logger = logging.getLogger("hf-to-gguf") ### MODEL DEFINITIONS ### class Sentenc...
Eval bug: when using convert_hf_to_gguf.py convert llama-3.2-11B-vision to gguf #10681 Open cqray1990 opened this issue Dec 6, 2024· 0 comments Open Eval bug: when using convert_hf_to_gguf.py convert llama-3.2-11B-vision to gguf #10681 cqray1990 opened this issue Dec 6...
2 changes: 1 addition & 1 deletion 2 convert_hf_to_gguf.py Original file line numberDiff line numberDiff line change @@ -2719,7 +2719,7 @@ def set_vocab(self): for line in lines: parts = line.split(' ') assert len(parts) >= 3 _, token, token_len = int(parts[0]), ast...
29 changes: 27 additions & 2 deletions 29 convert-hf-to-gguf.py Original file line numberDiff line numberDiff line change @@ -1416,8 +1416,32 @@ def set_vocab(self): self.gguf_writer.add_add_space_prefix(add_prefix)special_vocab = gguf.SpecialVocab(self.dir_model, n_vocab=len(...