environ['SLURM_CPUS_PER_TASK']) // 2 ### hangs if this is commented: # torch.set_num_threads(1) ### spawn_context = torch.multiprocessing.spawn(main, nprocs=gpu_count, join=True) adrianeboyd mentioned this issue Nov 22, 2019 BERT Model (German) does not work in multiprocessing mod...