mirror of
https://github.com/open-mmlab/mmdeploy.git
synced 2025-01-14 08:09:43 +08:00
1d47688b32
* Add document structure * better zh_cn document * add build example, update requirement * add readme * add usage * fix end of file * fix codebase names, add TODO
29 lines
616 B
Markdown
29 lines
616 B
Markdown
## TensorRT Support
|
|
|
|
### Installation
|
|
|
|
#### Install TensorRT
|
|
|
|
Please install TensorRT 8 follow [install-guide](https://docs.nvidia.com/deeplearning/tensorrt/install-guide/index.html).
|
|
|
|
#### Build custom ops
|
|
|
|
Some custom ops are created to support models in OpenMMLab, the custom ops can be build as follow:
|
|
|
|
```bash
|
|
cd ${MMDEPLOY_DIR}
|
|
mkdir build
|
|
cd build
|
|
cmake -DBUILD_TENSORRT_OPS=ON ..
|
|
make -j$(nproc)
|
|
```
|
|
|
|
If you haven't install TensorRT in default path, Please add `-DTENSORRT_DIR` flag in cmake.
|
|
|
|
```bash
|
|
cmake -DBUILD_TENSORRT_OPS=ON -DTENSORRT_DIR=${TENSORRT_DIR} ..
|
|
make -j$(nproc)
|
|
```
|
|
|
|
### Convert model
|