tensorrt.BuilderFlag Valid modes that the builder can enable when creating an engine from a network definition. Members: FP16 : Enable FP16 layer selection INT8 : Enable Int8 layer selection DEBUG : Enable debugging of layers via synchronizing after every layer GPU_FALLBACK : Enable layers...
batchSize); config->setMaxWorkspaceSize(16_MiB); config->setFlag(BuilderFlag::kGPU_FALLBACK); config->setFlag(BuilderFlag::kSTRICT_TYPES); if (mParams.fp16) { config->setFlag(BuilderFlag::kFP16); } if (mParams.int8) { config->setFlag(BuilderFlag::kINT8); } samplesCommon::...
allow_gpu_fallback (bool)– [EXPERIMENTAL] When DLA is enabled, whether to allow layers to fall back to GPU if they cannot be run on DLA. Has no effect if DLA is not enabled. Defaults to False. profiling_verbosity (trt.ProfilingVerbosity)– The verbosity of NVTX annotations in the gener...
used for set_calibration_profile.calib_profile=profile.fill_defaults(network)config.add_optimization_profile(calib_profile.to_trt(builder,network))newline="\n"sep=",\n"G_LOGGER.info(f"Configuring with profiles:[\n"f"{util.indent_block(sep.join([f'Profile{index}:{newline}{util.indent_block...
allow_gpu_fallback(bool) – [EXPERIMENTAL] When DLA is enabled, whether to allow layers to fall back to GPU if they cannot be run on DLA. Has no effect if DLA is not enabled. Defaults to False. profiling_verbosity(trt.ProfilingVerbosity) – The verbosity of NVTX annotations in the gener...
get_flag(self:tensorrt.tensorrt.IBuilderConfig,flag:tensorrt.tensorrt.BuilderFlag)→bool Check if a build mode flag is set. Parameters flag– The flag to check. Returns Aboolindicating whether the flag is set. get_memory_pool_limit(self:tensorrt.tensorrt.IBuilderConfig,pool:tensorrt.tensorrt....
Valid modes that the builder can enable when creating an engine from a network definition. Members: FP16 : Enable FP16 layer selection BF16 : Enable BF16 layer selection INT8 : Enable Int8 layer selection DEBUG : Enable debugging of layers via synchronizing after every layer GPU_FALLBACK ...
layer– The layer to set the DeviceType of device_type– The DeviceType the layer must execute on set_flag(self:tensorrt.tensorrt.IBuilderConfig,flag:tensorrt.tensorrt.BuilderFlag)→None Add the input builder mode flag to the already enabled flags. ...