Check Labels Support torch.compile rng selective activation checkpointing with cudagraph #379070 Sign in to view logs Summary Jobs Check labels Run details Usage Workflow file Triggered via pull request February 26, 2025 21:16 pytorchmergebot unlabeled #146878 gh/eellison/759/head Status Su...
🐛 Describe the bug my repro: import torch import torch._dynamo as dynamo @dynamo.optimize() def func(): a = torch.rand(1,1,1) b = a.repeat(10, 1, 1) c = a.repeat_interleave(repeats=10, dim=0) return b, c b, c = func() torch.equal(b, c) t...
🚀 The feature, motivation and pitch It would be pretty awesome if torch.compile would work with the zig C++ compiler which is invoked as zig c++ which uses llvm under the hood so should be (mostly?) fine compatibility-wise. I want to dep...
When I start the Mixtral model with --enable-torch-compile, I get the following error File "/usr/local/lib/python3.10/dist-packages/vllm/model_executor/custom_op.py", line 16, in forward return self._forward_method(*args, **kwargs) TypeError: fused_moe_forward_native() takes from 6 ...
🐛 Describe the bug torch.compile is not supported on Windows. torch.compile has dependency triton: triton-lang/triton#1640 Expected outcome Document the requirements to fix torch.compile.
Tensors and Dynamic neural networks in Python with strong GPU acceleration - `torch.compile` support for `CXX="zig c++"` · pytorch/pytorch@72f2b29
Checklist 1. If the issue you raised is not a feature but a question, please raise a discussion at https://github.com/sgl-project/sglang/discussions/new/choose Otherwise, it will be closed. 2. Please use English, otherwise it will be clo...
🚀 The feature, motivation and pitch In Recommender model, there are usually thousands of input feature. And all these features have their own preprocess methods, which are able to be paralleled. Alternatives Truely, TorchScript support i...
🐛 Describe the bug torch.compile doesn't support permute(*tensor) import torch import torch.nn as nn torch.manual_seed(420) class MyModel(torch.nn.Module): def forward(self, input): permute = torch.tensor([0, 2, 1]) x = input.permute(*pe...
Tensors and Dynamic neural networks in Python with strong GPU acceleration - Support basic TorchBind in aot_compile and aoti_compile_and_package · pytorch/pytorch@0728785