4c0b36b7ff
[Refactor] Refactor config v1 ( #80 )
...
* [Refactor] Refactor configs according to new standard (#67 )
* modify cfg and cfg_util
* modify tensorrt config
* fix bug
* lint
* Fix
1. Delete print
2. Modify the return value from "False, None" to "None" and related code
3. Rename 2 get functions
* modify apply_marks
* [Feature] Refactor ocr config (#71 )
* add text detection config refactor
* add text recognition refactor
* add static exporting for mmocr
* fix lint
* set max space in child config
* use Sequence[int] instead
* add assert input_shape
* fix static bug and add ppl ort and trt static (#77 )
* [Feature] Refine setup.py (#61 )
* add setup.py and related files
* lint
* Edit requirements
* modify onnx version
* modify according to comments
* [Refactor] Refactor mmseg configs (#73 )
* refactor mmseg config
* change create_input
* fix lint
* fix lint
* fix lint
* fix yapf
* fix yapf
* update export
* remove Segmentation
* remove tast assert
* add onnx_config
* remove hardcode
* Inherit with static
* Remove blank line
* Add segmentation task enum
* add assert task
* mmocr version 0.3.0 (#79 )
* add dump_info
* [Feature]: Refactor config in mmdet (#75 )
* support onnxruntime
* add two stage
* test two-stage ort and ppl
* update fcos post_params
* fix calib
* test ok with maskrcnn dynamic
* add empty line
* add static into config filename
* add input_shape to create_input in mmdet
* add static to some configs
* remove todo codes
* remove partition config in base
* refactor create_input
* rename task name in mmdet
* return None if input_shape is None
* add size info into mmdet configs filenames
* reorganize mmdet configs
* add object detection task for mmdet
* rename get_mmdet_params
* keep naming style consistent
* update post_params for fcos
* fix typo in ncnn config
* [Refactor] Refactor mmedit static config (#78 )
* add static cfg
* update create_input
* [Refactor]: Refactor mmcls configs (#74 )
* refactor mmcls2.0
* fix classify_tensorrt_dynamic.py
* fix classify_tensorrt_dynmic.py
* classify_tensorrt_dynamic_int8.py
* fix file name
* fix ncnn ppl
* updata prepare_input.py
* update utils.py
* updata constant.py
* add
* fix prepare_input.py
* fix prepare_input.py
* add static config file
* add blank lines
* fix prepare_input.py(wait test)
* fix input_shape(wait test)
* Update prepare_input.py
* fix classification_tensorrt_dynamic(wait test)
* fix classification_tensorrt_dynamic_int8(wait test)
* fix classification_tensorrt_static_int8(wait test)
* Rename classification_tensorrt_dynamic.py to classification_tensorrt_dynamic-224x224-224x224.py
* Rename classification_tensorrt_dynamic_int8.py to classification_tensorrt_dynamic_int8-224x224-224x224.py
* Rename classification_tensorrt_dynamic_int8-224x224-224x224.py to classification_tensorrt_int8_dynamic_224x224-224x224.py
* Rename classification_tensorrt_dynamic-224x224-224x224.py to classification_tensorrt_dynamic_224x224-224x224.py
* Rename classification_tensorrt_static.py to classification_tensorrt_static_224x224.py
* Rename classification_tensorrt_static_int8.py to classification_tensorrt_int8_static_224x224.py
* Update prepare_input.py
* Rename classification_tensorrt_dynamic_224x224-224x224.py to classification_tensorrt_dynamic-224x224-224x224.py
* Rename classification_tensorrt_int8_dynamic_224x224-224x224.py to classification_tensorrt_int8-dynamic_224x224-224x224.py
* Rename classification_tensorrt_int8-dynamic_224x224-224x224.py to classification_tensorrt_int8_dynamic-224x224-224x224.py
* Rename classification_tensorrt_int8_static_224x224.py to classification_tensorrt_int8_static-224x224.py
* Rename classification_tensorrt_static_224x224.py to classification_tensorrt_static-224x224.py
* Update prepare_input.py
* Update prepare_input.py
* Update prepare_input.py
* Update prepare_input.py
* Update prepare_input.py
* Update prepare_input.py
* Update prepare_input.py
* change logging msg
Co-authored-by: maningsheng <mnsheng@yeah.net>
* fix
* fix else branch
* fix bug for trt in mmseg
* enable dump trt info
* fix trt static for mmdet
* remove two-stage_partition_tensorrt_static-800x1344 config
* fix wrong backend in ppl config
* fix partition calibration
Co-authored-by: Yifan Zhou <singlezombie@163.com>
Co-authored-by: AllentDan <41138331+AllentDan@users.noreply.github.com>
Co-authored-by: hanrui1sensetime <83800577+hanrui1sensetime@users.noreply.github.com>
Co-authored-by: RunningLeon <maningsheng@sensetime.com>
Co-authored-by: VVsssssk <88368822+VVsssssk@users.noreply.github.com>
Co-authored-by: maningsheng <mnsheng@yeah.net>
Co-authored-by: AllentDan <AllentDan@yeah.net>
2021-09-16 10:26:09 +08:00
aba6ad5da7
[Feature] Support FCOS and FSAF for mmdetection ncnn deployment ( #63 )
...
* support ncnn mmdet fcos.py
* support fsaf
* fix_lint
* fix yapf
* fix clang-format
* Delete output_ncnn.jpg
* Delete output_pytorch.jpg
* remove comments and fix typo
* fix blank line
* Fix typo
* Remove unnessisary comments
* Add comment
* Add comments
2021-09-14 20:10:18 +08:00
667318c268
[Fix] mmdet bugs recover ( #64 )
...
* support ncnn mmdet fcos.py
* support fsaf
* fix_lint
* fix yapf
* fix clang-format
* fix bugs
* to master
* Fix topk 2-2
recover 2 input 2 output version to support mmdet
* Fix FCN Argmax adaptive output
* Add comments for adaptive output
2021-09-09 13:44:55 +08:00
56bc1242b2
[Feature] Add NCNN on MMSegmentation ( #55 )
...
* fix custom ops support, fix multiple mark bug, add name mapping
* check if the value_info need to be added
* remove unnecessary print
* add nms implement
* two stage split wip
* add two stage split
* add split retinanet visualize
* add two stage split (wip)
* finish two stage split
* fix lint
* move parse string to mmdeploy.utils
* add calib data generator
* create calib dataset
* finish end2end int8
* add split two stage tensorrt visualize
* first
* fix0
* fix1
* dirty work
* wip
* add allocator
* finally done!
* lint
* fix lint
* better gather
* better onnx2ncnn
* fix tensorslice bugs
* fix lint
* fix clang-format
* remove comments
* fix expand
* int param
* fix lint
* [Fix] NCNN TensorSlice op bugs (#42 )
* fix custom ops support, fix multiple mark bug, add name mapping
* check if the value_info need to be added
* remove unnecessary print
* add nms implement
* two stage split wip
* add two stage split
* add split retinanet visualize
* add two stage split (wip)
* finish two stage split
* fix lint
* move parse string to mmdeploy.utils
* add calib data generator
* create calib dataset
* finish end2end int8
* add split two stage tensorrt visualize
* fix tensorslice bugs
* fix lint
* fix clang-format
* remove comments
* int param
* fix lint
Co-authored-by: grimoire <yaoqian@sensetime.com>
* add two stage ncnn support
* remove unused ops
* git unused config
* remove no_grad, should add in refactor
* add ncnn wrapper
* fix lint
* size return tuple
* Resolve grammar error
* Fix lint
* Trim Trailing Whitespace
* fix trim
* add argmax to topk
* add ArgMax parse
* add ncnn mmseg deploy cfg
* utils add ncnn mmseg
* add ncnn
* fix lint
* fix yapf
* fix clang-format-9
* remove debugging code
Co-authored-by: grimoire <yaoqian@sensetime.com>
Co-authored-by: grimoire <streetyao@live.com>
Co-authored-by: maningsheng <mnsheng@yeah.net>
2021-09-03 15:19:54 +08:00
e73d9fb50b
[Feature] Add mmocr ncnn support ( #53 )
...
* first
* fix0
* fix1
* dirty work
* wip
* add allocator
* finally done!
* lint
* fix lint
* better gather
* better onnx2ncnn
* fix expand
* [Fix] NCNN TensorSlice op bugs (#42 )
* fix custom ops support, fix multiple mark bug, add name mapping
* check if the value_info need to be added
* remove unnecessary print
* add nms implement
* two stage split wip
* add two stage split
* add split retinanet visualize
* add two stage split (wip)
* finish two stage split
* fix lint
* move parse string to mmdeploy.utils
* add calib data generator
* create calib dataset
* finish end2end int8
* add split two stage tensorrt visualize
* fix tensorslice bugs
* fix lint
* fix clang-format
* remove comments
* int param
* fix lint
Co-authored-by: grimoire <yaoqian@sensetime.com>
* add two stage ncnn support
* remove unused ops
* git unused config
* remove no_grad, should add in refactor
* add ncnn wrapper
* fix lint
* size return tuple
* Resolve grammar error
* Fix lint
* Trim Trailing Whitespace
* fix trim
* update wrapper
* remove logs
* remove
* csrc optimize
* add ncnn dbnet support
* finish crnn support
* add comment
Co-authored-by: hanrui1sensetime <83800577+hanrui1sensetime@users.noreply.github.com>
2021-09-03 15:16:20 +08:00
823ca38646
[Feature] Add NCNN mmdetection support ( #49 )
...
* first
* fix0
* fix1
* dirty work
* wip
* add allocator
* finally done!
* lint
* fix lint
* better gather
* better onnx2ncnn
* fix expand
* [Fix] NCNN TensorSlice op bugs (#42 )
* fix custom ops support, fix multiple mark bug, add name mapping
* check if the value_info need to be added
* remove unnecessary print
* add nms implement
* two stage split wip
* add two stage split
* add split retinanet visualize
* add two stage split (wip)
* finish two stage split
* fix lint
* move parse string to mmdeploy.utils
* add calib data generator
* create calib dataset
* finish end2end int8
* add split two stage tensorrt visualize
* fix tensorslice bugs
* fix lint
* fix clang-format
* remove comments
* int param
* fix lint
Co-authored-by: grimoire <yaoqian@sensetime.com>
* add two stage ncnn support
* remove unused ops
* git unused config
* remove no_grad, should add in refactor
* add ncnn wrapper
* fix lint
* size return tuple
* Resolve grammar error
* Fix lint
* Trim Trailing Whitespace
* fix trim
* update wrapper
* remove logs
* remove
* csrc optimize
Co-authored-by: hanrui1sensetime <83800577+hanrui1sensetime@users.noreply.github.com>
2021-08-26 18:40:14 +08:00
8fe8056080
[Feature] Add trt ort mdcn plugins ( #43 )
...
* add trt mdcn plugin
* add onnxruntime mdcn op
* add mdcn trt ort plugins
* fix lint
* remove comment
* remove plugin condition lines
* apply new form
* use serialized_size
2021-08-25 10:17:21 +08:00
e05521c933
[Feature] Merge NCNN deployment to grimoire based on mmcls - revert [ #25 ]( https://github.com/grimoire/deploy_prototype/pull/25 ) ( #30 )
...
* add
* change VulkanSDK to 1.2.176.1
* add ncnn cmakelist
* add ncnn source code as third party
* add all ncnn
* ncnn compile passed
* onnx2ncnn correctly
* fix code style
* merge_as_grimoire_design, only backend_ops, manually register.
* remove data and test sh
* remove build example
* remove config ncnn
* remove onnx2ncnn intermediate files
* remove other files auto-generated
* remove vulkan tools
* remove Vulkan, gitignore new rules, __init__ new lines
* rollback __init__ to grimoire
* remove pytorch version pending
* grimoire comments reply 1, 3, 4
* reply comment 5,6,7
* add auto definer, add python register
* fix lint
* add ncnn deploy support
* add model_wrapper, fix a typo bug, and add code comment for onnx2ncnn(WIP)
* add model wrapper ncnn
* fix lint
* fix pep8
* fix pre-commit-config.yaml paths
* fix import
* fix lint
* remove sys.path.append
* remove sys
* isort fix
* fix double quoted
* fix trailing space
* try fix isort
* fix clang-format-9
* fix requests
* fix all comments
* Fix typo
* test code for grimoire
* fix ops register
* new definere
* fix visualization of mmcls
* remove temp
* fix flake8
* fix seed-isort-config
* fix thirdparty
* fix thirdparty
* fix yapf
* fix third_party_sort
* fix third party
* fix clang-format
* try fix clang-format
* try to fix clang format 9 customreshape
* try fix clang-format-9
* try fix clang-format-9
* try fix clang-format-9
* try fix ext
* fix onnx2ncnn
* Fix comments
* Fix Comments
* Fix Comments
* Fix Comments
* Fix conflict
* Fix flake8
* Update .isort.cfg
* Update ncnn_ext.cpp
* Update ncnn_ext.cpp
* fix missing ncnn backend code
* delete out of date comments of gather.cpp
* add DeployBaseClassifier
* add return -100 error
* clear out-of-date to do comments
Co-authored-by: 韩睿 <SENSETIME\hanrui1@cn0614008774l.domain.sensetime.com>
Co-authored-by: grimoire <yaoqian@sensetime.com>
Co-authored-by: grimoire <streetyao@live.com>
2021-08-05 14:06:47 +08:00
90ce7207da
[Feature] Support Mask R-CNN with ONNX Runtime and TensorRT ( #24 )
...
* add grid_sampler plugin
* update test_mixins to support maskrcnn
* add config for maskrcnn exporting to onnx
* fix lints
* fix lint
* resolve comments
* fix lint
* fix lint
* fix lint
* support trt8
* move mark to single_stage
* fix lint
* remove mark in single stage
2021-07-28 19:02:43 +08:00
53916af4e3
fix multilevel roi align on trt8
2021-07-28 18:45:21 +08:00
6ff8e96e71
add TRT8 support ( #23 )
2021-07-28 11:27:07 +08:00
77080bd931
fix onnxruntime roi_align on onnxruntime1.8
2021-07-26 15:57:13 +08:00
04a8046864
[Feature] add register for ort custom op ( #21 )
...
* add register for ort custom op
* ort_mmcv_util->ort_util
* ortApi->kOrtApi
2021-07-23 17:16:07 +08:00
b9e64f9e1c
Add trt instance norm plugin ( #16 )
...
* add trt instance norm plugin
* last line empty
* fix clang format
* fix grid_sample clang format
* remove redundant
* fix lint
* refine codes
* fix clang format
* clang format
* clang format
* clang format
2021-07-16 16:05:09 +08:00
3fa94f4424
[Feature] better tensorrt cpp code ( #11 )
...
* better tensorrt cpp code
* fix end of file
2021-07-12 10:01:52 +08:00
8408ae2bcf
[Feature] Multi level roi align ( #9 )
...
* add multi level roi align
* better trt plugin code
* fix lint
* optimizer trt_multi_level_roi_align.cpp
* fix lint
2021-07-09 13:56:50 +08:00
8fd4ef4d47
remove unused flag, fix lint
2021-06-29 10:23:52 +08:00
e08dbf26b3
add CI
2021-06-29 10:10:15 +08:00
5998d24766
[Feature] Add TensorRT batched NMS support ( #3 )
...
* add trt batched_nms plugin
* update trt batched nms
2021-06-25 19:31:16 +08:00
6eb2e89016
update cmakelists
2021-06-21 10:34:48 +08:00
93408c7cd8
add type annotation
...
add onnxruntime plugin support, add more custom ops
update function_rewriter, enable use origin function
add setup.cfg
update setup.cfg
2021-06-16 15:36:58 +08:00
1e47821e49
add backend plugin build system
2021-06-15 20:44:45 +08:00
q.yao
hanrui1sensetime
AllentDan
RunningLeon
grimoire