DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective. - DeepSpeed/deepspeed/env_report.py at master · xingyaoww/DeepSpeed
Breadcrumbs EnvPipe /DeepSpeed / README.mdTop File metadata and controls Preview Code Blame executable file· 225 lines (165 loc) · 21.1 KB Raw Latest News DeepSpeed trained the world's most powerful language models (MT-530B, BLOOM); learn how. [2022/10] DeepSpeed-MII: instant speedup ...
add device config env for the accelerator (microsoft#5396) … 9186a48 umchand pushed a commit to umchand/DeepSpeed that referenced this pull request May 20, 2024 add device config env for the accelerator (microsoft#5396) … 7357f8e dbyoung18 pushed a commit to dbyoung18/DeepSpeed that...
microsoft / DeepSpeed Public Notifications Fork 4.1k Star 35.3k Code Issues 956 Pull requests 122 Discussions Actions Projects Security Insights New issue Explictly set device when reusing dist env #6696 Merged tjruwase merged 1 commit into master from tohtana/fix_ranks_in_reused_...
loadams synchronize #7071 saurabhkoshatwar:bugfix/env_export Status Action required Total duration – Artifacts – This workflow is awaiting approval from a maintainer in #7071 nv-accelerate-v100.yml on: pull_request unit-tests Oh hello! Nice to see you. Made with ️ by humans...
Why the script path of the other machine is the script path of the local machine when opening deepspeed's multi-machine multi-card mode, how to open multi-machine multi-card normally, here is my running script and hostfile configuration script.sh #! /bin/bash set -e export NCCL_IB_DISABL...
.pylintrc .readthedocs.yml .style.yapf CODEOWNERS CODE_OF_CONDUCT.md CONTRIBUTING.md LICENSE MANIFEST.in MANIFEST_win.in README.md SECURITY.md install.sh setup.cfg setup.py version.txt Megatron-DeepSpeed benchmark .gitignore README.mdBreadcrumbs EnvPipe /DeepSpeed / MANIFEST.in Latest commit ...
Megatron-DeepSpeed benchmark .gitignore README.md Breadcrumbs EnvPipe /DeepSpeed / setup.cfg Latest commit sjchoi1 artifactMay 11, 2023 0def188· May 11, 2023 HistoryHistory File metadata and controls Code Blame 3 lines (3 loc) · 111 Bytes Raw [options.entry_points] pytest_randomly.ra...
casys-kaist / EnvPipe Public Notifications Fork 5 Star 24 Code Issues 1 Pull requests Actions Projects Security Insights Commits BreadcrumbsHistory for EnvPipe DeepSpeed README.md onmain User selector All users DatepickerAll time Commit History End of commit history for this file...
loadams synchronize #7071 saurabhkoshatwar:bugfix/env_export Status Action required Total duration – Artifacts – This workflow is awaiting approval from a maintainer in #7071 nv-pre-compile-ops.yml on: pull_request unit-tests Oh hello! Nice to see you. Made with ️ by humans...