https://pytorch.org/docs/stable/notes/cuda.html#graph-memory-management File "/root/trt/TensorRT/py/torch_tensorrt/dynamo/runtime/_TorchTensorRTModule.py", line 274, in forward outputs: List[torch.Tensor] = torch.ops.tensorrt.execute_engine( File "/root/.pyenv/versions/3.10.14/lib/python3.1...
Description We have a pytorch GNN model that we run on an Nvidia GPU with TensorRT (TRT). For the scatter_add operation we are using the scatter elements plugin for TRT. We are now trying to quantize it. We are following the same procedu...
I tried to use tensorrt for inference in the neural network inference code that originally used libtorch, but I got an error.bool model_deploy::LoadTRTModel(std::string& s_model_path) { try { // load TRT Model*** auto s_enginepath = s_model_path.c_str(); std::ifstream fs_File(...