TensorRT 推理时提示This container was built for NVIDIA Driver Release 470.42 or later 解决方法
之前已經在TensorRT7.2.1下將模型轉換為trt格式的文件,現在一臺新服務器上使用tensorrt8.0.1的容器部署,同樣是T4顯卡下,出現下面的問題:
This container was built for NVIDIA Driver Release 470.42 or later, but version 460.91.03 was detected and compatibility mode is UNAVAILABLE.?
查詢了tensorrt8.0.1容器的官方文檔 ,有下面一行:
Release 21.07 is based on?NVIDIA CUDA 11.4.0, which requires?NVIDIA Driver?release 470 or later.??However, if you are running on Data Center GPUs (formerly Tesla), for example, T4, you may use NVIDIA driver release 418.40 (or later R418), 440.33 (or later R440), 450.51 (or later R450), or 460.27 (or later R460).?
地址:
https://docs.nvidia.com/deeplearning/tensorrt/container-release-notes/rel_21-07.html#rel_21-07
說明是driver版本不匹配。
解決方法
1、在tensorrt8.0.1容器里重新將模型轉換為trt模型,模型可以轉換成功,運行時也沒有報錯,但是推理結果不正確(一定要核對推理結果是否正確),說明該方法不可行。
2、在新服務器上重新安裝tensorrt7.2.1容器,在里面進行推理,結果正確,此方法成功解決。
方法總結
tensorrt版本的NVIDIA Driver需求要與服務器的NVIDIA Driver相匹配,不然即使轉換成功,也會導致推理的結果不正確。我服務器的NVIDIA Driver版本為460.91.03,官方文檔上tensorrt7.2.1的要求是
Release 20.11 is based on?NVIDIA CUDA 11.1.0, which requires?NVIDIA Driver?release 455 or later.?
?所以能正確推理出結果。
總結原因,沒有認真了解tensorrt版本與NVIDIA Driver版本的匹配性,導致部署時走了彎路。
總結
以上是生活随笔為你收集整理的TensorRT 推理时提示This container was built for NVIDIA Driver Release 470.42 or later 解决方法的全部內容,希望文章能夠幫你解決所遇到的問題。
- 上一篇: 任务间同步 | 信号量、互斥量和事件集
- 下一篇: 启动rabbitmq,遇到发生系统错误2