mmdeploy/configs/_base_/backends/tensorrt_int8.py
q.yao fd40119694
[Feature] TensorRT int8 support (#35)
* fix custom ops support, fix multiple mark bug, add name mapping

* check if the value_info need to be added

* remove unnecessary print

* add nms implement

* two stage split wip

* add two stage split

* add split retinanet visualize

* add two stage split (wip)

* finish two stage split

* fix lint

* move parse string to mmdeploy.utils

* add func mark count dict

* use assert_cfg_valid

* update func count before add Mark

* fix dynamic shape support

* add calib data generator

* create calib dataset

* finish end2end int8

* add split two stage tensorrt visualize
2021-08-19 12:56:00 +08:00

6 lines
171 B
Python

_base_ = ['./tensorrt.py']
create_calib = True
calib_params = dict(calib_file='calib_data.h5')
tensorrt_params = dict(shared_params=dict(fp16_mode=True, int8_mode=True))