OpenMMLab Model Deployment Framework
 
 
 
 
 
 
Go to file
ichitaka a1a19f0fc1
Fixed typo for install commands for TensorRT runtime (#1025)
* Fixed typo for install commands for TensorRT runtime

* Apply typo-fix on 'cn' documentation

Co-authored-by: Tümer Tosik <tumer_t@hotmail.de>
2022-09-15 20:23:07 +08:00
.circleci [Enhancement] build sdk python api in standard-alone manner (#810) 2022-08-02 10:23:48 +08:00
.github New issue template (#1007) 2022-09-07 16:00:37 +08:00
cmake [Feature] TorchScript SDK backend (#890) 2022-08-29 18:01:18 +08:00
configs Add RKNN support. (#865) 2022-09-06 11:48:39 +08:00
csrc/mmdeploy [Fix] Add isolated option for TorchScript SDK backend (#1002) 2022-09-06 12:24:07 +08:00
demo
docker improvement(dockerfile): use make -j$(nporc) when build ncnn (#840) 2022-08-05 10:33:14 +08:00
docs Fixed typo for install commands for TensorRT runtime (#1025) 2022-09-15 20:23:07 +08:00
mmdeploy Fix `RoIAlignFunction` error for CoreML backend (#1029) 2022-09-14 17:50:37 +08:00
requirements fix mmdeploy builder on windows (#1018) 2022-09-09 15:03:55 +08:00
resources [Doc] How to write a customized TensorRT plugin (#290) 2022-08-22 14:00:28 +08:00
service/snpe
tests Add RKNN support. (#865) 2022-09-06 11:48:39 +08:00
third_party
tools docs(scripts): update auto install desc (#1036) 2022-09-14 17:49:29 +08:00
.clang-format
.codespell_ignore.txt [Feature] Ascend backend (#747) 2022-09-05 12:08:36 +08:00
.gitignore [Feature] Add option to fuse transform. (#741) 2022-09-05 20:29:18 +08:00
.gitmodules
.pre-commit-config.yaml
.pylintrc
.readthedocs.yml
CITATION.cff
CMakeLists.txt bump version to v0.8.0 (#1009) 2022-09-07 10:53:50 +08:00
LICENSE
MANIFEST.in
README.md Add RKNN support. (#865) 2022-09-06 11:48:39 +08:00
README_zh-CN.md Add RKNN support. (#865) 2022-09-06 11:48:39 +08:00
requirements.txt
setup.cfg [Feature] Ascend backend (#747) 2022-09-05 12:08:36 +08:00
setup.py Support setup on environment with no PyTorch (#843) 2022-08-01 17:52:02 +08:00

README.md

 
OpenMMLab website HOT      OpenMMLab platform TRY IT OUT
 

docs badge codecov license issue resolution open issues

English | 简体中文

Introduction

MMDeploy is an open-source deep learning model deployment toolset. It is a part of the OpenMMLab project.

Main features

Fully support OpenMMLab models

The currently supported codebases and models are as follows, and more will be included in the future

Multiple inference backends are available

Models can be exported and run in the following backends, and more will be compatible

ONNX Runtime TensorRT ppl.nn ncnn OpenVINO LibTorch snpe Ascend Core ML RKNN more
✔️ ✔️ ✔️ ✔️ ✔️ ✔️ ✔️ ✔️ ✔️ ✔️ benchmark

Efficient and scalable C/C++ SDK Framework

All kinds of modules in the SDK can be extended, such as Transform for image processing, Net for Neural Network inference, Module for postprocessing and so on

Documentation

Please read getting_started for the basic usage of MMDeploy. We also provide tutoials about:

Benchmark and Model zoo

You can find the supported models from here and their performance in the benchmark.

Contributing

We appreciate all contributions to MMDeploy. Please refer to CONTRIBUTING.md for the contributing guideline.

Acknowledgement

We would like to sincerely thank the following teams for their contributions to MMDeploy:

Citation

If you find this project useful in your research, please consider citing:

@misc{=mmdeploy,
    title={OpenMMLab's Model Deployment Toolbox.},
    author={MMDeploy Contributors},
    howpublished = {\url{https://github.com/open-mmlab/mmdeploy}},
    year={2021}
}

License

This project is released under the Apache 2.0 license.

Projects in OpenMMLab

  • MMCV: OpenMMLab foundational library for computer vision.
  • MIM: MIM installs OpenMMLab packages.
  • MMClassification: OpenMMLab image classification toolbox and benchmark.
  • MMDetection: OpenMMLab detection toolbox and benchmark.
  • MMDetection3D: OpenMMLab's next-generation platform for general 3D object detection.
  • MMRotate: OpenMMLab rotated object detection toolbox and benchmark.
  • MMSegmentation: OpenMMLab semantic segmentation toolbox and benchmark.
  • MMOCR: OpenMMLab text detection, recognition, and understanding toolbox.
  • MMPose: OpenMMLab pose estimation toolbox and benchmark.
  • MMHuman3D: OpenMMLab 3D human parametric model toolbox and benchmark.
  • MMSelfSup: OpenMMLab self-supervised learning toolbox and benchmark.
  • MMRazor: OpenMMLab model compression toolbox and benchmark.
  • MMFewShot: OpenMMLab fewshot learning toolbox and benchmark.
  • MMAction2: OpenMMLab's next-generation action understanding toolbox and benchmark.
  • MMTracking: OpenMMLab video perception toolbox and benchmark.
  • MMFlow: OpenMMLab optical flow toolbox and benchmark.
  • MMEditing: OpenMMLab image and video editing toolbox.
  • MMGeneration: OpenMMLab image and video generative models toolbox.
  • MMDeploy: OpenMMLab model deployment framework.