Commit Graph

73 Commits (86a50e343a3a45d7bc2ba3256100accc4973e71d)

Author SHA1 Message Date
q.yao 2b98040b26
[Feature] Refactor v1 (#56)
* [Refactor] add enum class and use functions to get configuration (#40)

* add task and codebase enum class

* use funcitons to get config

* Refactor wrappers of mmcls and mmseg (#41)

* move wrappers of cls & det to apis

* remove get_classes_from_config

* rename onnx_helper to onnx_utils

* move import to outside of class

* refactor ortwrappers

* Refactor build dataset and dataloader for mmseg (#44)

* refactor build_dataset and build_dataloader for mmcls and mmseg

* remove repeated classes

* set build_dataloader with shuffle=False

* [Refactor] pplwrapper and mmocr refactor (#46)

* add

* add pplwrapper and refactor mmocr

* fix lint

* remove unused arguments

* apply dict input for pplwrapper and ortwrapper

* add condition before import ppl and ort stuff

* update ppl (#51)

* Refactor return value and extract_model (#54)

* remove ret_value

* refactor extract_model

* fix typo

* resolve comments

* [Refactor] Refactor model inference pipeline (#52)

* move attribute_to_dict to extract_model

* simplify the inference and visualization

* remove unused import

* [Feature] Support SRCNN in mmedit with ONNXRuntime and TensorRT (#45)

* finish mmedit-ort

* edit __init__ files

* add noqa

* add tensorrt support

* 1. Rename "base.py"
2. Move srcnn.py to correct directory

* fix bugs

* remove figures

* align to refactor-v1

* update comment in srcnn

* fix lint

* newfunc -> new_func

* Add visualize.py

split visualize() in each codebase

* fix lint

* fix lint

* remove unnecessary code in ORTRestorer

* remove .api

* edit super(), remove dataset

* [Refactor]: Change name of split to partition (#57)

* refactor mmcls configs

* refactor mmdet configs and split params

* rename rest split to partition from master

* remove base.py

* fix init of inference class

* fix mmocr init, add show_result alias

Co-authored-by: AllentDan <41138331+AllentDan@users.noreply.github.com>
Co-authored-by: RunningLeon <maningsheng@sensetime.com>
Co-authored-by: Yifan Zhou <singlezombie@163.com>
2021-09-01 15:43:49 +08:00
RunningLeon e5dc959276
[Feature]: Support PSPNet with static shape in ORT and TRT (#39)
* support pspnet with static shape

* set default as None to --test-img
2021-08-20 13:39:03 +08:00
q.yao fd40119694
[Feature] TensorRT int8 support (#35)
* fix custom ops support, fix multiple mark bug, add name mapping

* check if the value_info need to be added

* remove unnecessary print

* add nms implement

* two stage split wip

* add two stage split

* add split retinanet visualize

* add two stage split (wip)

* finish two stage split

* fix lint

* move parse string to mmdeploy.utils

* add func mark count dict

* use assert_cfg_valid

* update func count before add Mark

* fix dynamic shape support

* add calib data generator

* create calib dataset

* finish end2end int8

* add split two stage tensorrt visualize
2021-08-19 12:56:00 +08:00
AllentDan 7c465654b9
[Feature] Add dbnet18 and crnn support (#36)
* add mmocr

re-orgnize codes

save codes

save codes

save codes

add dbnet18

* fix lint

* support crnn

* fix lint

* resolve comments

* resolve conflicts

* resolve module registry error

* test

* resolve comments

* fix lint

* use algrithm_type and add dataset evaluation

* suit newest mmocr

* fix lint and remove trt version check
2021-08-19 11:53:00 +08:00
q.yao 4c8c34d354
[Feature] Enable faster rcnn split onnxruntime (#27)
* fix custom ops support, fix multiple mark bug, add name mapping

* check if the value_info need to be added

* remove unnecessary print

* add nms implement

* two stage split wip

* add two stage split

* add split retinanet visualize

* add two stage split (wip)

* finish two stage split

* fix lint

* move parse string to mmdeploy.utils

* add func mark count dict

* use assert_cfg_valid

* update func count before add Mark

* fix dynamic shape support
2021-08-13 10:06:28 +08:00
hanrui1sensetime f8b62ae4d0
[Feature] Support NCNN inference tests (#34)
* add inference test

* fix for review comments

* add inference test results table

* fix grammer errors

* fix typo
2021-08-12 17:38:38 +08:00
hanrui1sensetime e05521c933
[Feature] Merge NCNN deployment to grimoire based on mmcls - revert [#25](https://github.com/grimoire/deploy_prototype/pull/25) (#30)
* add

* change VulkanSDK to 1.2.176.1

* add ncnn cmakelist

* add ncnn source code as third party

* add all ncnn

* ncnn compile passed

* onnx2ncnn correctly

* fix code style

* merge_as_grimoire_design, only backend_ops, manually register.

* remove data and test sh

* remove build example

* remove config ncnn

* remove onnx2ncnn intermediate files

* remove other files auto-generated

* remove vulkan tools

* remove Vulkan, gitignore new rules, __init__ new lines

* rollback __init__ to grimoire

* remove pytorch version pending

* grimoire comments reply 1, 3, 4

* reply comment 5,6,7

* add auto definer, add python register

* fix lint

* add ncnn deploy support

* add model_wrapper, fix a typo bug, and add code comment for onnx2ncnn(WIP)

* add model wrapper ncnn

* fix lint

* fix pep8

* fix pre-commit-config.yaml paths

* fix import

* fix lint

* remove sys.path.append

* remove sys

* isort fix

* fix double quoted

* fix trailing space

* try fix isort

* fix clang-format-9

* fix requests

* fix all comments

* Fix typo

* test code for grimoire

* fix ops register

* new definere

* fix visualization of mmcls

* remove temp

* fix flake8

* fix seed-isort-config

* fix thirdparty

* fix thirdparty

* fix yapf

* fix third_party_sort

* fix third party

* fix clang-format

* try fix clang-format

* try to fix clang format 9 customreshape

* try fix clang-format-9

* try fix clang-format-9

* try fix clang-format-9

* try fix ext

* fix onnx2ncnn

* Fix comments

* Fix Comments

* Fix Comments

* Fix Comments

* Fix conflict

* Fix flake8

* Update .isort.cfg

* Update ncnn_ext.cpp

* Update ncnn_ext.cpp

* fix missing ncnn backend code

* delete out of date comments of gather.cpp

* add DeployBaseClassifier

* add return -100 error

* clear out-of-date to do comments

Co-authored-by: 韩睿 <SENSETIME\hanrui1@cn0614008774l.domain.sensetime.com>
Co-authored-by: grimoire <yaoqian@sensetime.com>
Co-authored-by: grimoire <streetyao@live.com>
2021-08-05 14:06:47 +08:00
AllentDan f607f1965b
[Feature] Align datasets (#29)
* add test tool and re-orgnize apis.utils

* handle topk and refine codes

* add cls export and test support

* fix lint

* move ort into wrapper

* resolve conflicts

* resolve comments

* resolve conflicts

* resolve comments and padding mrcnn

* resolve comments
2021-08-03 17:12:44 +08:00
q.yao ff39377833
[Feature] Retinanet split support (#19)
* prepare for split

* mark multiclass nms

* redesign mark decorator to handle input/output names better (#17)

* redesign mark decorator to handle input/output names better

* fixed a bug in rename_value; robustify extract_model

* fix lint

* fix log in deploy pipeline

* fix onnxruntime config

* fix lint

* update connect init

* rename is_inspecting

* simplify function_mark

Co-authored-by: Li Zhang <lzhang329@gmail.com>
2021-07-23 13:18:32 +08:00
AllentDan 9647ab12db
Add cls visualization (#18)
* add cls visualization tool

* fix lint

* remove reduandant

* align result
2021-07-22 09:58:53 +08:00
RunningLeon 10a2385d01
Support exporting to ONNX for Faster R-CNN (#20)
* update rewriter for rpn head

* new nms implement

* update bbox_head to support fasterrcnn with tensorrt

* rewrite SingleRoIExtractor

* remove unnecessary import

* fix fcos and bbox_nms

* resolve comments

* resolve comments

Co-authored-by: grimoire <yaoqian@sensetime.com>
2021-07-21 19:46:23 +08:00
AllentDan 1718501b4f
[Feature] Support fsaf fcos (#14)
* add fcos and fsaf

* remove is_in_onnx_export

* fix lint

* fix lint

* remove forwards
2021-07-13 20:13:39 +08:00
RunningLeon c4b7dad2ec
add visualization for mmdet (#13)
* add visualization for mmdet

* resolve comments

* update code, enable visualize on nvidia driver>11

Co-authored-by: grimoire <yaoqian@sensetime.com>
2021-07-13 17:21:02 +08:00
RunningLeon 9f0e2d4339
changed codebase structure (#10)
* add delta2bbox rewriter

* rename onnx2trt

* add rewriter: anchor_generator_single_level_grid_priors

* Revert "add rewriter: anchor_generator_single_level_grid_priors"

This reverts commit ac7cf272942c4787bf143c0d67e414b0d2603b75.

* update comments

* remove clamp rewriter

* remove unused func

* reconstruct codes

* remomve mark

* create export package for codebases

* remove grid_sampler symbolic

* reorganize nms parts

* fix conflicts

* update unittest
2021-07-12 16:26:44 +08:00
lzhangzz 66300c0c74
Supports setting input/output names explicitly via mark decorator (#4)
* setting names of inputs and outputs via mark decorator

* fix bug in mark, move extract_model to mmdeploy/apis and add test cases

* remove fsaf rewrite, which is not needed any more after recent changes

* replace print with log and add fixture to clear test tmp file
2021-07-07 14:15:26 +08:00
q.yao 27880afdcd
[Feature] better retinanet support (#5)
* better retinanet support

* prepare split export tensorrt

* optimizer cfg

* free anchor when static shape

* fix docstring
2021-07-01 11:42:07 +08:00
grimoire e08dbf26b3 add CI 2021-06-29 10:10:15 +08:00
lzhangzz ef41f69553
add model splitting support (#1)
* add function marker and model extractor

* add fsaf split & partial mask rcnn split, import extract.py

* 1. add value renaming  2. add apply_marks in config to turn on/off marks

* rewind changes on pytorch2onnx.py

Co-authored-by: q.yao <streetyao@live.com>
2021-06-28 20:35:15 +08:00
q.yao 6c47ee3d2a
add tensorrt support (#2) 2021-06-23 13:14:28 +08:00
maningsheng 2317ee659a support retinanet pytorch2onnx 2021-06-17 17:37:08 +08:00
grimoire b777d27bcf add return value in deploy.py 2021-06-17 17:26:32 +08:00
grimoire 3bf3b9cdda fix lint 2021-06-17 15:29:12 +08:00
grimoire 12792727e7 add configs, add convert pipeline 2021-06-17 15:28:23 +08:00