🚀 Feature Hi, it seems that once one send a Tensor to the GPU memory, it is not possible to release the memory usage of the GPU back to zero. example: import torch tm = torch.Tensor([1,2]).to("cuda") !nvidia-smi |===...
Tensors and Dynamic neural networks in Python with strong GPU acceleration - remove allow-untyped-defs from torch/distributed/_shard/sharded_tensor/shard.py · pytorch/pytorch@eaa2482
1. update date of nightly package 20250125< Thanks for sending a pull request What type of PR is...
from_tensor(x, multipliers={0: 4, 1: 4}) 2615 - assert hasattr(pad_x, "multipliers"), breakpoint() 2616 - eager_out = f(pad_x) 2617 - 2618 - for _ in range(3): 2619 - compiled_out = compiled_f(pad_x) 2620 - compiled_out = compiled_f(pad_x) 2621 - 2622...
Tensors and Dynamic neural networks in Python with strong GPU acceleration - Remove unnecessary tensor clone · pytorch/pytorch@67cb36c
remove padded tensor test #85979 Sign in to view logs Summary Jobs get-label-type manywheel-py3_9-cuda11_8-build build manywheel-py3_9-cuda12_6-build build manywheel-py3_9-cuda12_8-build build manywheel-py3_9-cuda11_8-test manywheel-py3_9-cuda12_6-test manywheel...
Summary: unwrap_tensor_subclass is incorporated in export stack natively after pytorch/pytorch#127431 so we can remove this workaround now Test Plan: python test/quantization/test_quant_api.py pyth...
Tensors and Dynamic neural networks in Python with strong GPU acceleration - [BE][Ez]: Remove redundant empty tensor copies in meta-reg (#147978) · pytorch/pytorch@f423531
Stack from ghstack (oldest at bottom): -> Remove aoti_torch_cpu__weight_int4pack_mm_cpu_tensor #148834 Move aoti_torch_cpu__weight_int4pack_mm_cpu_tensor to not be mangled … da6777c pytorch-bot bot commented Mar 9, 2025 • edited 🔗 Helpful Links 🧪 See artifacts and ...
torch A Tensor library like NumPy, with strong GPU support torch.autograd A tape-based automatic differentiation library that supports all differentiable Tensor operations in torch torch.jit A compilation stack (TorchScript) to create serializable and optimizable models from PyTorch code torch.nn A neu...