raise ValueError("Please specify the wandb experiment name!") import wandb # Update the wandb save_dir if args.wandb_save_dir: save_dir = args.wandb_save_dir else: # Defaults to the save dir. save_dir = os.path.join(args.save, 'wandb') wandb_kwargs = { 'dir': os.path.join(arg...
Describe the bug When working on a distributed setup wandb seems to be using the /tmp directory to store some things and the directory specified in the dir argument. Here is how I initialize the wandb run if global_rank == 0: import wand...