dataset_manifest is None, "--dataset-manifest must not be specified if --dataset-type='synthetic'" if args.val_data is not None and args.global_val_batch_size is None: # Make sure that val batch size is set to micro batch size args.global_val_batch_size = args.global_batch_size /...
The total number of tokens requested in max_tokens plus the number of prompt tokens sent in messages must not exceed the context window token limit of model requested. If left unspecified, then the model will generate tokens until either it reaches its stop token or the end of its context ...