GitHub is where people build software. More than 150 million people use GitHub to discover, fork, and contribute to over 420 million projects.
litgpt finetune \ --config https://raw.githubusercontent.com/Lightning-AI/litgpt/main/config_hub/finetune/llama-2-7b/lora.yaml✅ Use configs to customize training Configs let you customize training for all granular parameters like: # The path to the base model's checkpoint directory to ...
litgpt lit_gpt model.py on74b8df0 User selector All users Datepicker All time Commits on Dec 15, 2023 Switch MoE implementation (#823) carmocca authoredDec 15, 2023 · Verified 74b8df0 Modeling fixes for heterogeneous devices (#814) ...
main .github config_hub extensions litgpt tests tutorials developer-docs examples images 0_to_litgpt.md convert_hf_checkpoint.md convert_lit_models.md deploy.md download_model_weights.md evaluation.md finetune.md finetune_adapter.md finetune_full.md ...
Code Pull requests Actions Projects Security Insights Additional navigation options Files main .github config_hub extensions litgpt tests tutorials developer-docs examples images 0_to_litgpt.md convert_hf_checkpoint.md convert_lit_models.md deploy.md ...
litgpt pretrain pythia-14m \ --config https://raw.githubusercontent.com/Lightning-AI/litgpt/main/config_hub/pretrain/debug.yaml Pretrain on custom data The simplest way to get started with pretraining on a small custom dataset is by using the TextFiles data module, which lets you pretra...
⚡ main ~/litgpt litgpt chat checkpoints/google/gemma-2b {'access_token': None, 'checkpoint_dir': PosixPath('checkpoints/google/gemma-2b'), 'compile': False, 'max_new_tokens': 50, 'multiline': False, 'precision': None, 'quantize': None, 'temperature': 0.8, 'top_k': 50, 'to...
.github config_hub extensions litgpt tests tutorials developer-docs examples images 0_to_litgpt.md convert_hf_checkpoint.md convert_lit_models.md deploy.md download_model_weights.md evaluation.md finetune.md finetune_adapter.md finetune_full.md finetune_lora.md inference.md oom.md prepare_data...
Make sure quantization is used correctly by@rasbtin#1585 Improve mathstral tests by@rasbtin#1589 Fixes an issue where the LitGPT Python API was consuming too much memory by@rasbtin#1590 Increase version number for 0.4.5 release by@rasbtin#1591 ...
Encounter an error while trying to run Vicuna model: ` :~/workspace/lit-gpt$ python chat/base.py --checkpoint_dir checkpoints/lmsys/vicuna-7b-v1.3 Loading model 'checkpoints/lmsys/vicuna-7b-v1.3/lit_model.pth' with {'org': 'lmsys', 'name...