问题标签 [tensorrt-python]
For questions regarding programming in ECMAScript (JavaScript/JS) and its various dialects/implementations (excluding ActionScript). Note JavaScript is NOT the same as Java! Please include all relevant tags on your question; e.g., [node.js], [jquery], [json], [reactjs], [angular], [ember.js], [vue.js], [typescript], [svelte], etc.
tensorrt - Install tensorrt with custom plugins
I'm able to install the desired version of TensorRT from official nvidia guide (https://docs.nvidia.com/deeplearning/tensorrt/install-guide/index.html#maclearn-net-repo-install)
But I need some custom plugins. Fortunately I found the desired and added to folder plugin https://github.com/NVIDIA/TensorRT/tree/master/plugin and registered it. Now I do not understand how to build and install tensorrt with added plugin. On the official repo on github https://github.com/NVIDIA/TensorRT there is an instruction, but it describes steps to build a docker image with tensorrt.
So the question is how to build tensorrt with custom plugin and install it on ubuntu?
multithreading - 带有grpc多线程错误的tensorRT，如何解决？
描述
环境
TensorRT 版本：8.2.3.0 NVIDIA GPU：gtx 1080ti NVIDIA 驱动程序版本：470.103.01 CUDA 版本：11.4 CUDNN 版本：8.2 操作系统：Linux 18.06 Python 版本（如果适用）：3.8.0 Tensorflow 版本（如果适用）： PyTorch 版本（如果适用）：1.10 裸机或容器（如果有，版本）：
grpc服务器代码
grpc 存根初始化
trt_model 初始化代码
你好。我正在通过 grpc 使用 TensorRT。但是在grpc的多线程函数中设置max_worker后，当多个客户端进来请求时，会出现如下错误。在 max_worker=1 的情况下，不会发生错误。你能帮我吗？