gptq Create de-config.sh f2e9360· Nov 29, 2023 History5 Commits config.gpg Update config.gpg Nov 29, 2023 de-config.sh Create de-config.sh Nov 29, 2023 test.mp3 Add files via upload Nov 27, 2023 yecai59.mp3 Add files via upload Nov 27, 2023 ...
针对你提到的错误“ValueError: Cannot find the config file for GPTQ”,我们可以按照以下步骤进行排查和解决: 确认错误信息来源: 首先,需要确认这个错误是由哪个模块或哪段代码抛出的。从错误信息来看,很可能是在使用GPTQ模型时,系统无法找到对应的配置文件。 定位配置文件位置: 通常,模型配置文件(如config.json...
GPTQModel v0.9.10-dev0 main branch has merged dynamic, per layer/module support of different gptq bits, sym, desc_act using a regex style definition. This is a work in process and we are awaiting f...
git config --global user.name userName git config --global user.email userEmail Qwen2.5-Coder-32B-Instruct-GPTQ-Int4 / config.json config.json1.23 KB 一键复制编辑原始数据按行查看历史 JustinLin610提交于3个月前.update tokenizer_config.json,config.json,generation_config.json ...
git config --global user.name userName git config --global user.email userEmail main Qwen2-7B-Instruct-GPTQ-Int4 / tokenizer_config.json tokenizer_config.json1.26 KB 一键复制编辑原始数据按行查看历史 feihu.hf提交于8个月前.upload weights ...
Meta-Llama-3.1-8B-Instruct-GPTQ-INT4 / config.json config.json1.05 KB 一键复制编辑原始数据按行查看历史 Alvaro Bartolome提交于6个月前.Upload folder using huggingface_hub 12345678910111213141516171819202122232425262728293031323334353637383940414243444546 {
git config --global user.name userName git config --global user.email userEmail main Qwen2-VL-7B-Instruct-GPTQ-Int4 / config.json config.json1.32 KB 一键复制编辑原始数据按行查看历史 yangapku提交于5个月前.feat(model) upload model
"exllama_config": { "version": 1 }, "group_size": 128, "max_input_length": null, "model_seqlen": null, "module_name_preceding_first_block": null, "modules_in_block_to_quantize": null, "pad_token_id": null, "quant_method": "gptq", "sym": true, "tokenizer...
Qwen2-VL-7B-Instruct-GPTQ-Int8 / config.json config.json1.32 KB 一键复制编辑原始数据按行查看历史 yangapku提交于5个月前.feat(model) upload model 123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657 { "_name_or_path":"Qwen/Qwen2-VL-7B-Instruct-319-PRO", ...
"quantization_config":{ "bits":8, "damp_percent":0.1, "dataset":null, "desc_act":false, "group_size":128, "modules_in_block_to_quantize":null, "quant_method":"gptq", "sym":true, "true_sequential":true }, "rms_norm_eps":1e-06, ...