nemo-megatron-launcher

2025-03-04 11:49:49

拼音 [ 拼音 ]

NeMo-Megatron-Launcher/README.md at master · roclark/NeMo...

NeMo Megatron launcher and tools. Contribute to roclark/NeMo-Megatron-Launcher development by creating an account on GitHub.
t5/mt5 configs changes · NVIDIA/NeMo-Megatron-Launcher@90ef6...

2 changes: 1 addition & 1 deletion 2 launcher_scripts/conf/training/mt5/11b.yaml @@ -54,7 +54,7 @@ exp_manager: model: # model parallelism micro_batch_size: 8 micro_batch_size: 24 global_batch_size: 1920 # will use more micro batches to reach global batch size tensor_model_...
...images for the readme · roclark/NeMo-Megatron-Launcher@...

NeMo Megatron launcher and tools. Contribute to roclark/NeMo-Megatron-Launcher development by creating an account on GitHub.