per_device_train_batch_size=1, # auto_find_batch_size=True, gradient_accumulation_steps=3, num_train_epochs=1, learning_rate=2e-4, fp16=False, bf16=False, save_total_limit=4, logging_steps=5, save_strategy='steps', weight_decay=0, push_to_hub=False, disable_tqdm=True, no_cuda=n...
Step1: Prepare train dataset # Process the data into a form similar to ./data/demo.txt Step2: Modifying configuration files # ./configs/xxx.yaml # Modify the values of parameters such as batch_size, filelist_path, save_dir, device Step3: Start training process Refer to Pytorch Lightning do...