With the latest version of bitsandbytes (0.39.0) library, isn't it possible to serialize 4-bit models then? Thus this section should be updated to allow the user to save these models. https://github.com/huggingface/transformers/blob/68d5...
尝试使用trainer.save_model(model_path)保存模型预计在使用 trainer.save_model(model_path) 保存模型时,将保存包括 model.bin 在内的所有必需文件。观察到只保存了training_args.bin、model.safetensors和config.json文件,而没有包含model.bin。huggingface-transformers huggingface fine-tuning huggingface-trainer 1...
HuggingFace Transformers Error When Saving Model: TypeError: Object of type method is not JSON serializable 4 Training loss is not decreasing for roberta-large model but working perfectly fine for roberta-base, bert-base-uncased 4 ALBERT not converging - HuggingFace 1 If I train...
transformers-4.34 python-3.11 Who can help? @ArthurZucker Information The official example scripts My own modified scripts Tasks An officially supported task in theexamplesfolder (such as GLUE/SQuAD, ...) My own task or dataset (give details below) ...
raw_inputs=["I've been waiting for a HuggingFace course my whole life.","I hate this so much!",]inputs=tokenizer(raw_inputs,padding=True,truncation=True,return_tensors="pt")print(inputs) 不用担心tokens补齐和截断操作(也是设置tokenzier参数啦,so easy!),后续会进行讲解。目前需要读者记住的...
I use the model: https://huggingface.co/taide/TAIDE-LX-7B-Chat to fine-tune, but always got the error. training is OK, but model.save_pretrained_gguf failed. ==((===))== Unsloth: Fast Llama patching release 2024.4 \ /| GPU: NVIDIA GeFor...
View details amyeroberts merged commit cffa2b9 into huggingface:main Jul 9, 2024 20 checks passed kallewoof deleted the 202407-save-pretrained-tqdm branch July 9, 2024 14:40 Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment Reviewers amy...
Hello, the correct way to save the intermediate checkpoints for PEFT when using Trainer would be to use Callbacks. An example is shown here:https://github.com/huggingface/peft/blob/main/examples/int8_training/peft_bnb_whisper_large_v2_training.ipynb ...
huggingface/transformersPublic NotificationsYou must be signed in to change notification settings Fork26k Star131k Code Issues988 Pull requests439 Actions Projects26 Security Insights Additional navigation options New issue Loading a model saved withTFGPT2LMHeadModel.save_pretrainedwithGPT2LMHeadModel.from...
works on 4.33.3 (with tokenizers==0.13.3), fails on main (with tokenizers==0.14.0) Who can help? @ArthurZucker Information The official example scripts My own modified scripts Tasks An officially supported task in the examples folder (such as GLUE/SQuAD, ...) My own task or dataset ...