Contributor mvpatel2000 commented Apr 29, 2024 • edited by pytorch-bot bot 🐛 Describe the bug The new distributed APIs get_model_state_dict/set_model_state_dict require running at least one forward pass in order to call _lazy_init. For example, from torch.distributed.fsdp._runtime_...
pytorch-bot bot added ciflow/inductor oncall: distributed release notes: distributed (fsdp) labels Dec 16, 2024 awgu added a commit that referenced this pull request Dec 16, 2024 [FSDP2] Clamp reduce_dtype in lazy init … fabc214 awgu added release notes: distributed (fsdp2) and rem...
使用机器学习库(如TensorFlow或PyTorch)来构建和训练一个简单的神经网络模型 2025-04-05 08:50:46 积分:1 一个用于大数据处理的自动化脚本 它使用Apache Spark作为处理引擎,并假定已经配置好了相应的Spark环境 2025-04-05 14:06:36 积分:1 使用Verdaccio实现npm私有化 2025-04-05 15:24:42 积分:1 ...
pytorch/pytorchPublic NotificationsYou must be signed in to change notification settings Fork23.5k Star87.4k Assign User on Comment enable lazy init for MTIA#82795 Sign in to view logs Triggered via issueSeptember 30, 2024 14:50 facebook-github-bot ...
pytorch/pytorchPublic NotificationsYou must be signed in to change notification settings Fork22.7k Star84.4k New issue Add a XPU UT to ensure lazy init#129638 Closed guangyeywants to merge4commits intogh/guangyey/46/basefromgh/guangyey/46/head ...
Tensors and Dynamic neural networks in Python with strong GPU acceleration - Add deprecated warning for lazyInitXXX API · pytorch/pytorch@14fc6b7
import subprocess import sys import tempfile import unittest Expand DownExpand Up@@ -131,6 +132,46 @@ def run(rank): ) self.assertRegex(stderr, "Cannot re-initialize XPU in forked subprocess.") def test_lazy_init(self): """Validate that no XPU calls are made during `import torch`...
2 changes: 1 addition & 1 deletion 2 tensoradapter/pytorch/torch.cpp Original file line numberDiff line numberDiff line change @@ -28,7 +28,7 @@ TA_EXPORTS void CPURawDelete(void* ptr) { #ifdef DGL_USE_CUDA TA_EXPORTS void* CUDARawAlloc(size_t nbytes, cudaStream_t stream) { at...
Motivation As titled. Additional Context Align to CUDA.
pytorch-botbotadded thetopic: not user facingtopic categorylabelJun 27, 2024 guangyeyaddedciflow/xpuRun XPU CI tasksciflow/trunkTrigger trunk jobs on your pull requestlabelsJun 27, 2024 guangyeyadded a commit that referenced this pull requestJun 27, 2024 ...