mirrors/mmdeploy
1
0
Fork 0
mirror of https://github.com/open-mmlab/mmdeploy.git synced 2025-01-14 08:09:43 +08:00
Code Issues Projects Releases Wiki Activity
mmdeploy/docs/backends/tensorrt.md
q.yao 1d47688b32
[Docs]: Add sphinx document (#109) 
* Add document structure

* better zh_cn document

* add build example, update requirement

* add readme

* add usage

* fix end of file

* fix codebase names, add TODO
2021-10-09 14:10:42 +08:00

616 B
Raw Blame History

TensorRT Support

Installation

Install TensorRT

Please install TensorRT 8 follow install-guide.

Build custom ops

Some custom ops are created to support models in OpenMMLab, the custom ops can be build as follow:

cd ${MMDEPLOY_DIR}
mkdir build
cd build
cmake -DBUILD_TENSORRT_OPS=ON ..
make -j$(nproc)

If you haven't install TensorRT in default path, Please add -DTENSORRT_DIR flag in cmake.

 cmake -DBUILD_TENSORRT_OPS=ON -DTENSORRT_DIR=${TENSORRT_DIR} ..
 make -j$(nproc)

Convert model