2021-12-16 19:22:14 +08:00
< div align = "center" >
2021-12-23 20:14:35 +08:00
< img src = "resources/mmdeploy-logo.png" width = "450" / >
2022-01-13 10:19:21 +08:00
< div > < / div >
< div align = "center" >
< b > < font size = "5" > OpenMMLab website< / font > < / b >
< sup >
< a href = "https://openmmlab.com" >
< i > < font size = "4" > HOT< / font > < / i >
< / a >
< / sup >
< b > < font size = "5" > OpenMMLab platform< / font > < / b >
< sup >
< a href = "https://platform.openmmlab.com" >
< i > < font size = "4" > TRY IT OUT< / font > < / i >
< / a >
< / sup >
< / div >
< div > < / div >
2021-12-16 19:22:14 +08:00
< / div >
2021-12-27 11:20:26 +08:00
[](https://mmdeploy.readthedocs.io/en/latest/)
[](https://github.com/open-mmlab/mmdeploy/actions)
[](https://codecov.io/gh/open-mmlab/mmdeploy)
[](https://github.com/open-mmlab/mmdeploy/blob/master/LICENSE)
[](https://github.com/open-mmlab/mmdeploy/issues)
[](https://github.com/open-mmlab/mmdeploy/issues)
2021-10-09 14:10:42 +08:00
## Introduction
2021-06-11 13:26:05 +08:00
2021-10-09 14:10:42 +08:00
English | [简体中文 ](README_zh-CN.md )
MMDeploy is an open-source deep learning model deployment toolset. It is
a part of the [OpenMMLab ](https://openmmlab.com/ ) project.
2021-12-16 19:22:14 +08:00
< div align = "center" >
2021-12-23 20:14:35 +08:00
< img src = "resources/introduction.png" width = "800" / >
2021-12-16 19:22:14 +08:00
< / div >
2021-12-23 16:18:16 +08:00
2021-10-09 14:10:42 +08:00
### Major features
2021-12-16 19:22:14 +08:00
- **Fully support OpenMMLab models**
2021-10-25 16:37:33 +08:00
2021-12-16 19:22:14 +08:00
We provide a unified model deployment toolbox for the codebases in OpenMMLab. The supported codebases are listed as below, and more will be added in the future
- [x] MMClassification
- [x] MMDetection
- [x] MMSegmentation
- [x] MMEditing
- [x] MMOCR
2021-10-09 14:10:42 +08:00
2021-12-16 19:22:14 +08:00
- **Multiple inference backends are available**
2021-10-25 16:37:33 +08:00
2021-12-16 19:22:14 +08:00
Models can be exported and run in different backends. The following ones are supported, and more will be taken into consideration
- [x] ONNX Runtime
- [x] TensorRT
- [x] PPLNN
- [x] ncnn
- [x] OpenVINO
2021-07-01 17:32:33 +08:00
2021-12-16 19:22:14 +08:00
- **Efficient and highly scalable SDK Framework by C/C++**
2021-10-25 16:37:33 +08:00
2021-12-16 19:22:14 +08:00
All kinds of modules in SDK can be extensible, such as `Transform` for image processing, `Net` for Neural Network inference, `Module` for postprocessing and so on
2021-07-01 17:32:33 +08:00
2021-10-09 14:10:42 +08:00
## License
2021-07-10 16:16:11 +08:00
2021-10-09 14:10:42 +08:00
This project is released under the [Apache 2.0 license ](LICENSE ).
2021-07-10 16:16:11 +08:00
2021-12-16 19:22:14 +08:00
## Installation
2021-07-01 17:32:33 +08:00
2021-12-31 14:36:55 +08:00
Please refer to [build.md ](https://mmdeploy.readthedocs.io/en/latest/build.html ) for installation.
2021-10-09 14:10:42 +08:00
2021-12-16 19:22:14 +08:00
## Getting Started
2021-12-21 13:59:07 +08:00
2021-12-31 14:36:55 +08:00
Please see [getting_started.md ](https://mmdeploy.readthedocs.io/en/latest/get_started.html ) for the basic usage of MMDeploy. We also provide other tutorials for:
2021-12-23 11:25:45 +08:00
2021-12-31 14:36:55 +08:00
- [how to convert model ](https://mmdeploy.readthedocs.io/en/latest/tutorials/how_to_convert_model.html )
- [how to write config ](https://mmdeploy.readthedocs.io/en/latest/tutorials/how_to_write_config.html )
- [how to support new models ](https://mmdeploy.readthedocs.io/en/latest/tutorials/how_to_support_new_models.html )
- [how to measure performance of models ](https://mmdeploy.readthedocs.io/en/latest/tutorials/how_to_measure_performance_of_models.html )
2021-10-09 14:10:42 +08:00
2021-12-31 14:36:55 +08:00
Please refer to [FAQ ](https://mmdeploy.readthedocs.io/en/latest/faq.html ) for frequently asked questions.
2021-07-01 17:32:33 +08:00
2021-12-23 11:25:45 +08:00
## Benchmark and model zoo
2021-12-31 14:36:55 +08:00
Results and supported model list are available in the [benchmark ](https://mmdeploy.readthedocs.io/en/latest/benchmark.html ) and [model list ](https://mmdeploy.readthedocs.io/en/latest/supported_models.html ).
2021-12-23 11:25:45 +08:00
2021-12-16 19:22:14 +08:00
## Contributing
2021-07-01 17:32:33 +08:00
2021-12-16 19:22:14 +08:00
We appreciate all contributions to improve MMDeploy. Please refer to [CONTRIBUTING.md ](.github/CONTRIBUTING.md ) for the contributing guideline.
2021-08-10 17:04:58 +08:00
2021-12-16 19:22:14 +08:00
## Acknowledgement
2021-08-10 17:04:58 +08:00
2021-12-29 19:24:03 +08:00
We would like to sincerely thank the following teams for their contributions to [MMDeploy ](https://github.com/open-mmlab/mmdeploy ):
- [OpenPPL ](https://github.com/openppl-public )
- [OpenVINO ](https://github.com/openvinotoolkit/openvino )
2021-07-01 17:32:33 +08:00
2021-10-27 15:03:40 +08:00
## Citation
If you find this project useful in your research, please consider cite:
```BibTeX
@misc {=mmdeploy,
2021-12-16 19:22:14 +08:00
title={OpenMMLab's Model Deployment Toolbox.},
2021-10-27 15:03:40 +08:00
author={MMDeploy Contributors},
howpublished = {\url{https://github.com/open-mmlab/mmdeploy}},
year={2021}
}
```
2021-10-09 14:10:42 +08:00
## Projects in OpenMMLab
2021-07-01 17:32:33 +08:00
2021-10-09 14:10:42 +08:00
- [MMCV ](https://github.com/open-mmlab/mmcv ): OpenMMLab foundational library for computer vision.
- [MIM ](https://github.com/open-mmlab/mim ): MIM Installs OpenMMLab Packages.
- [MMClassification ](https://github.com/open-mmlab/mmclassification ): OpenMMLab image classification toolbox and benchmark.
- [MMDetection ](https://github.com/open-mmlab/mmdetection ): OpenMMLab detection toolbox and benchmark.
- [MMDetection3D ](https://github.com/open-mmlab/mmdetection3d ): OpenMMLab's next-generation platform for general 3D object detection.
- [MMSegmentation ](https://github.com/open-mmlab/mmsegmentation ): OpenMMLab semantic segmentation toolbox and benchmark.
- [MMAction2 ](https://github.com/open-mmlab/mmaction2 ): OpenMMLab's next-generation action understanding toolbox and benchmark.
- [MMTracking ](https://github.com/open-mmlab/mmtracking ): OpenMMLab video perception toolbox and benchmark.
- [MMPose ](https://github.com/open-mmlab/mmpose ): OpenMMLab pose estimation toolbox and benchmark.
- [MMEditing ](https://github.com/open-mmlab/mmediting ): OpenMMLab image and video editing toolbox.
- [MMOCR ](https://github.com/open-mmlab/mmocr ): A Comprehensive Toolbox for Text Detection, Recognition and Understanding.
- [MMGeneration ](https://github.com/open-mmlab/mmgeneration ): OpenMMLab image and video generative models toolbox.
2021-12-16 19:22:14 +08:00
- [MMFlow ](https://github.com/open-mmlab/mmflow ): OpenMMLab optical flow toolbox and benchmark.
- [MMFewShot ](https://github.com/open-mmlab/mmfewshot ): OpenMMLab FewShot Learning Toolbox and Benchmark.
- [MMHuman3D ](https://github.com/open-mmlab/mmhuman3d ): OpenMMLab Human Pose and Shape Estimation Toolbox and Benchmark.
2021-12-24 15:26:50 +08:00
- [MMSelfSup ](https://github.com/open-mmlab/mmselfsup ): OpenMMLab self-supervised learning Toolbox and Benchmark.
- [MMRazor ](https://github.com/open-mmlab/mmrazor ): OpenMMLab Model Compression Toolbox and Benchmark.
2021-12-29 19:24:03 +08:00
- [MMDeploy ](https://github.com/open-mmlab/mmdeploy ): OpenMMLab Model Deployment Framework.
2022-02-23 20:18:30 +08:00
- [MMRotate ](https://github.com/open-mmlab/mmrotate ): OpenMMLab rotated object detection toolbox and benchmark.