* [Fix] Fix example standalone build for msvc (#1626) * fix example build for msvc * move /Zc:__cplusplus to core * [FIX] Fix csharp net48 and batch inference (#1370) * fix csharp net48 * add missing file * update * fix batch inference * update demo * update * update version * update nuget package version & fix project name * build monolithic SDK by default (#1577) * Fix debug build for PoseTracker (#1601) * [Fix] Fix aligned allocations on Android (#1612) * fix android alignment * fix typo * fix size * Fix build error on windows-cuda platform (#1598) * [Fix] Relax module adapter template constraints (#1366) * relax module adapter constraint * remove forwarding `operator()` * fix YOLOV5Head naming Co-authored-by: Li Zhang <lzhang329@gmail.com>
Usage
step 0. install the local nuget package
You should build csharp api first, it will generate a nuget package, or you can download our prebuit package. You may refer to this on how to install local nuget package.
step 1. Add runtime dll to the system path
If you built csharp api from source and didn't build static lib, you should add the built dll to your system path. The same is to opencv, etc.
And don't forget to install backend dependencies. Take tensorrt backend as example, you have to install cudatoolkit, cudnn and tensorrt. The version of backend dependencies that our prebuit nuget package used will be offered in release note.
backend | dependencies |
---|---|
tensorrt | cudatoolkit, cudnn, tensorrt |
onnxruntime | onnxruntime / onnxruntime-gpu |
step 2. Open Demo.sln and build solution.
step 3. Prepare the model.
You can either convert your model according to this tutorial or download the test models from OneDrive or BaiduYun. The web drive contains onnx and tensorrt models and the test models are converted under environment of cuda11.1 + cudnn8.2.1 + tensorrt 8.2.3.0 + GTX2070s.
Note:
- a) If you want to use the tensorrt model from the link, make sure your environment and your gpu architecture is same with above.
- b) When you use the downloaded onnx model, you have to edit
deploy.json
, editend2end.engine
toend2end.onnx
andtensorrt
toonnxruntime
.
step 4. Set one project as startup project and run it.