lzhangzz
46bfe0ac87
[Feature] New pipeline & executor for SDK ( #497 )
...
* executor prototype
* add split/when_all
* fix GCC build
* WIP let_value
* fix let_value
* WIP ensure_started
* ensure_started & start_detached
* fix let_value + when_all combo on MSVC 142
* fix static thread pool
* generic just, then, let_value, sync_wait
* minor
* generic split and when_all
* fully generic sender adapters
* when_all: workaround for GCC7
* support legacy spdlog
* fix memleak
* bulk
* static detector
* fix bulk & first pipeline
* bulk for static thread pools
* fix on MSVC
* WIP async batch submission
* WIP collation
* async batch
* fix detector
* fix async detector
* fix
* fix
* debug
* fix cuda allocator
* WIP type erased executor
* better type erasure
* simplify C API impl
* Expand & type erase TC
* deduction guide for type erased senders
* fix GCC build
* when_all for arrays of Value senders
* WIP pipeline v2
* WIP pipeline parser
* WIP timed batch operation
* add registry
* experiment
* fix pipeline
* naming
* fix mem-leak
* fix deferred batch operation
* WIP
* WIP configurable scheduler
* WIP configurable scheduler
* add comment
* parse scheduler config
* force link schedulers
* WIP pipeable sender
* WIP CPO
* ADL isolation and dismantle headers
* type erase single thread context
* fix MSVC build
* CPO
* replace decay_t with remove_cvref_t
* structure adjustment
* structure adjustment
* apply CPOs & C API rework
* refine C API
* detector async C API
* adjust detector async C API
* # Conflicts:
# csrc/apis/c/detector.cpp
* fix when_all for type erased senders
* support void return for Then
* async detector
* fix some CPOs
* minor
* WIP rework capture mechanism for type erased types
* minor fix
* fix MSVC build
* move expand.h to execution
* make `Expand` pipeable
* fix type erased
* un-templatize `_TypeErasedOperation`
* re-work C API
* remove async_detector C API
* fix pipeline
* add flatten & unflatten
* fix flatten & unflatten
* add aync OCR demo
* config executor for nodes & better executor API
* working async OCR example
* minor
* dynamic batch via scheduler
* dynamic batch on `Value`
* fix MSVC build
* type erase dynamic batch scheduler
* sender as Python Awaitable
* naming
* naming
* add docs
* minor
* merge tmp branch
* unify C APIs
* fix ocr
* unify APIs
* fix typo
* update async OCR demo
* add v3 API text recognizer
* fix v3 API
* fix lint
* add license info & reformat
* add demo async_ocr_v2
* revert files
* revert files
* resolve link issues
* fix scheduler linkage for shared libs
* fix license header
* add docs for `mmdeploy_executor_split`
* add missing `mmdeploy_executor_transfer_just` and `mmdeploy_executor_execute`
* make `TimedSingleThreadContext` header only
* fix lint
* simplify type-erased sender
2022-06-01 14:10:43 +08:00
lzhangzz
640aa03538
Support Windows ( #106 )
...
* minor changes
* support windows
* fix GCC build
* fix lint
* reformat
* fix Windows build
* fix GCC build
* search backend ops for onnxruntime
* fix lint
* fix lint
* code clean-up
* code clean-up
* fix clang build
* fix trt support
* fix cmake for ncnn
* fix cmake for openvino
* fix SDK Python API
* handle ops for other backends (ncnn, trt)
* handle SDK Python API library location
* robustify linkage
* fix cuda
* minor fix for openvino & ncnn
* use CMAKE_CUDA_ARCHITECTURES if set
* fix cuda preprocessor
* fix misc
* fix pplnn & pplcv, drop support for pplcv<0.6.0
* robustify cmake
* update build.md (#2 )
* build dynamic modules as module library & fix demo (partially)
* fix candidate path for mmdeploy_python
* move "enable CUDA" to cmake config for demo
* refine demo cmake
* add comment
* fix ubuntu build
* revert docs/en/build.md
* fix C API
* fix lint
* Windows build doc (#3 )
* check in docs related to mmdeploy build on windows
* update build guide on windows platform
* update build guide on windows platform
* make path of thirdparty libraries consistent
* make path consistency
* correct build command for custom ops
* correct build command for sdk
* update sdk build instructions
* update doc
* correct build command
* fix lint
* correct build command and fix lint
Co-authored-by: lvhan <lvhan@pjlab.org>
* trailing whitespace (#4 )
* minor fix
* fix sr sdk model
* fix type deduction
* fix cudaFree after driver shutting down
* update ppl.cv installation warning (#5 )
* fix device allocator threshold & fix lint
* update doc (#6 )
* update ppl.cv installation warning
* missing 'git clone'
Co-authored-by: chenxin <chenxin2@sensetime.com>
Co-authored-by: zhangli <zhangli@sensetime.com>
Co-authored-by: lvhan028 <lvhan_028@163.com>
Co-authored-by: lvhan <lvhan@pjlab.org>
2022-02-24 20:08:44 +08:00
lzhangzz
56e32fdf63
improve shape checking ( #315 )
2021-12-21 20:16:40 +08:00
lzhangzz
43e6714f47
[SDK] Fix asan errors ( #308 )
...
* fix several heap-use-after-free bugs
* rebase master
* add option for sanitizers
* rebase master
* fix conflicts
2021-12-21 10:47:21 +08:00
lvhan028
3be1779e66
Refactor tests ( #283 )
...
* fix sdk model's pipeline.json
* resize INT64 mask
* refactor unit tests
* fix api in model.h
* remove 'customs' from meta info
* fix zip model
* fix clang-format issue
* put tc on each backend into a SECTION
* change SECTION title
* add DYNAMIC_SECTION for capi unit test
* change 'devices' to 'device_names'
* change trt to tensorrt
* remove uncessary check
* add color_type 'color_ignore_orientation' which is used in ocr
* 'min_width', 'max_width' and 'backend' might be null in pipeline config
* fix clang-format issue
* remove useless code
2021-12-17 19:57:37 +08:00
lzhangzz
a494a6f6ff
[SDK] sync changes according to performance benchmarks ( #297 )
...
* sync SDK changes according to performance benchmarks
* fix end-of-file lint
* fix clang-format issue
* fix clang-format by adding 'clang-format off'
* remove useless casts
* remove 'data' argument of 'operator()'
* change 'Tensor2Img' to 'TensorToImg' according to spec
* correct tensor's name according spec
Co-authored-by: lvhan028 <lvhan_028@163.com>
2021-12-16 13:51:22 +08:00
