GitHub Sponsors Fund open source developers The ReadME Project GitHub community articles Repositories Topics Trending Collections Enterprise Enterprise platform AI-powered developer platform Available add-ons Advanced Security Enterprise-grade security features GitHub Copilot Enterprise-grade AI features...
SUMMARY: * Fix examples script failure https://github.com/neuralmagic/llm-compressor-testing/actions/runs/13350457472/job/37286313648 for `llm-compressor/examples/trl_mixin/ex_trl_distillation.py` * Update code with respect to #1161 PROBLEM: 1. ```bash TypeError: GSM8KDataset.__init__() got...
Have a question about this project?Sign up for a free GitHub account to open an issue and contact its maintainers and the community. Sign up for GitHub By clicking “Sign up for GitHub”, you agree to ourterms of serviceandprivacy statement. We’ll occasionally send you account related ema...
pip install -U transformers pip install -U datasets git clone https://github.com/EleutherAI/lm-evaluation-harness cd lm-evaluation-harness pip install -e . python main.py \ --model hf-causal \ --model_args pretrained=$MODEL_PATH \ --output_path $OUTPUT_PATH/results.json \ --tasks bool...
Public repo for HF blog posts. Contribute to Knight7561/hf-blog development by creating an account on GitHub.
github.com/huggingface/ Supervised Fine-tuning Trainer SFT Trainer 是transformers.Trainer的子类,增加了处理PeftConfig的逻辑 一、在数据集合上二次预训练,对整个序列进行微调 from transformers import AutoModelForCausalLM from datasets import load_dataset from trl import SFTTrainer dataset = load_dataset(...
https://github.com/huggingface/trl/pull/2940/files#r1967113819 If yes, feel free to merge if I'm offline :) 👍 1 Merge branch 'main' into fix-liger-sft Verified 5be79a3 qgallouedec changed the title Fix LigerKernel for SFTTrainer 🐯 Fix LigerKernel for SFTTrainer Feb 24, 2025...
You should pass the validation set in the same format as the training dataset as they are treated the same under the hood. Hope this helps! Hi I also have same questions, I use this function as the prompt then the loss turn to 0 when I start training, what should I do?
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment Reviewers No reviews Assignees No one assigned Labels None yet Projects None yet Milestone No milestone Development Successfully merging this pull request may close these issues. None yet ...
Code Folders and files Name Last commit message Last commit date Latest commit olson-ibm and anhuong Replace shutil.copytree() to fix permission error (#251) Jul 27, 2024 7dfd4e7·Jul 27, 2024 History 232 Commits .github add dependabot.yml ...