尝试使用trainer.save_model(model_path)保存模型预计在使用 trainer.save_model(model_path) 保存模型时,将保存包括 model.bin 在内的所有必需文件。观察到只保存了training_args.bin、model.safetensors和config.json文件,而没有包含model.bin。huggingface-transformers huggingface fine-tuning huggingface-trainer 1...
Also using safetensors did not reduce the model size after merging. I am using HuggingFace 4.30 PEFT 0.5.0 kiamesdavies commented Oct 22, 2023 Same Issue with LLama 2 models both 7b and 13b SankhaSubhra commented Oct 22, 2023 • edited Try with dtype=torch.bfloat16 (i.e. during ...