Commit Graph

169 Commits (ec91893931b5bb77766de0cc53e37fdc80b4b3eb)
 

Author SHA1 Message Date
Sixiao Zheng ec91893931
[Feature] Official implementation of SETR (#531)
* Adjust vision transformer backbone architectures;

* Add DropPath, trunc_normal_ for VisionTransformer implementation;

* Add class token buring intermediate period and remove it during final period;

* Fix some parameters loss bug;

* * Store intermediate token features and impose no processes on them;

* Remove class token and reshape entire token feature from NLC to NCHW;

* Fix some doc error

* Add a arg for VisionTransformer backbone to control if input class token into transformer;

* Add stochastic depth decay rule for DropPath;

* * Fix output bug when input_cls_token=False;

* Add related unit test;

* Re-implement of SETR

* Add two head -- SETRUPHead (Naive, PUP) & SETRMLAHead (MLA);

* * Modify some docs of heads of SETR;

* Add MLA auxiliary head of SETR;

* * Modify some arg of setr heads;

* Add unit test for setr heads;

* * Add 768x768 cityscapes dataset config;

* Add Backbone: SETR -- Backbone: MLA, PUP, Naive;

* Add SETR cityscapes training & testing config;

* * Fix the low code coverage of unit test about heads of setr;

* Remove some rebundant error capture;

* * Add pascal context dataset & ade20k dataset config;

* Modify auxiliary head relative config;

* Modify folder structure.

* add setr

* modify vit

* Fix the test_cfg arg position;

* Fix some learning schedule bug;

* optimize setr code

* Add arg: final_reshape to control if converting output feature information from NLC to NCHW;

* Fix the default value of final_reshape;

* Modify arg: final_reshape to arg: out_shape;

* Fix some unit test bug;

* Add MLA neck;

* Modify setr configs to add MLA neck;

* Modify MLA decode head to remove rebundant structure;

* Remove some rebundant files.

* * Fix the code style bug;

* Remove some rebundant files;

* Modify some unit tests of SETR;

* Ignoring CityscapesCoarseDataset and MapillaryDataset.

* Fix the activation function loss bug;

* Fix the img_size bug of SETR_PUP_ADE20K

* * Fix the lint bug of transformers.py;

* Add mla neck unit test;

* Convert vit of setr out shape from NLC to NCHW.

* * Modify Resize action of data pipeline;

* Fix deit related bug;

* Set find_unused_parameters=False for pascal context dataset;

* Remove arg: find_unused_parameters which is False by default.

* Error auxiliary head of PUP deit

* Remove the minimal restrict of slide inference.

* Modify doc string of Resize

* Seperate this part of code to a new PR #544

* * Remove some rebundant codes;

* Modify unit tests of SETR heads;

* Fix the tuple in_channels of mla_deit.

* Modify code style

* Move detailed definition of auxiliary head into model config dict;

* Add some setr config for default cityscapes.py;

* Fix the doc string of SETR head;

* Modify implementation of SETR Heads

* Remove setr aux head and use fcn head to replace it;

* Remove arg: img_size and remove last interpolate op of heads;

* Rename arg: conv3x3_conv1x1 to kernel_size of SETRUPHead;

* non-square input support for setr heads

* Modify config argument for above commits

* Remove norm_layer argument of SETRMLAHead

* Add mla_align_corners for MLAModule interpolate

* [Refactor]Refactor of SETRMLAHead

* Modify Head implementation;

* Modify Head unit test;

* Modify related config file;

* [Refactor]MLA Neck

* Fix config bug

* [Refactor]SETR Naive Head and SETR PUP Head

* [Fix]Fix the lack of arg: act_cfg and arg: norm_cfg

* Fix config error

* Refactor of SETR MLA, Naive, PUP heads.

* Modify some attribute name of SETR Heads.

* Modify setr configs to adapt new vit code.

* Fix trunc_normal_ bug

* Parameters init adjustment.

* Remove redundant doc string of SETRUPHead

* Fix pretrained bug

* [Fix] Fix vit init bug

* Add some vit unit tests

* Modify module import

* Remove norm from PatchEmbed

* Fix pretrain weights bug

* Modify pretrained judge

* Fix some gradient backward bugs.

* Add some unit tests to improve code cov

* Fix init_weights of setr up head

* Add DropPath in FFN

* Finish benchmark of SETR

1. Add benchmark information into README.MD of SETR;

2. Fix some name bugs of vit;

* Remove DropPath implementation and use DropPath from mmcv.

* Modify out_indices arg

* Fix out_indices bug.

* Remove cityscapes base dataset config.

Co-authored-by: sennnnn <201730271412@mail.scut.edu.cn>
Co-authored-by: CuttlefishXuan <zhaoxinxuan1997@gmail.com>
2021-06-23 09:39:29 -07:00
Junjun2016 3e70d93285
Merge pull request #618 from Junjun2016/fix_typos
[Fix] Fix typos
2021-06-22 19:10:01 +08:00
Junjun2016 3f1c36069d fix typos 2021-06-22 19:07:55 +08:00
Junjun2016 256b955c76
Merge pull request #612 from Junjun2016/modify_metafile
[Enhancement] Change inference time from 'fps' to 'ms/im' in metafile
2021-06-22 13:38:16 +08:00
Junjun2016 f513253de9
Merge pull request #613 from Junjun2016/add_pr_template
[Enhancement] Add PR template
2021-06-22 04:07:02 +08:00
Junjun2016 865b309186 fix lint error 2021-06-22 00:41:31 +08:00
Junjun2016 e71766c344 add_pr_template 2021-06-21 22:31:59 +08:00
Junjun2016 3856453537 change inference time from fps to ms/im 2021-06-21 22:08:03 +08:00
sennnnn 0c4c3b790d
[Fix] Fix some vit init bugs (#609)
* [Fix] Fix vit init bug

* Add some vit unit tests

* Modify module import

* Fix pretrain weights bug

* Modify pretrained judge

* Add some unit tests to improve code cov

* Optimize code

* Fix vit unit test
2021-06-19 15:53:13 -07:00
Amrit Krishnan 458fc7897f
Add fixes to Dockerfile (#607) 2021-06-19 08:31:19 -07:00
Junjun2016 00769136ad
fix typo and link (#608)
Co-authored-by: hejunjun <hejunjun@pjlab.org>
2021-06-18 11:58:55 -07:00
sennnnn 8f8abe373f
[Refactor] Using mmcv transformer bricks to refactor vit. (#571)
* [Refactor] Using mmcv bricks to refactor vit

* Follow the vit code structure from mmclassification

* Add MMCV install into CI system.

* Add  to 'Install MMCV' CI item

* Add 'Install MMCV_CPU' and 'Install MMCV_GPU CI' items

* Fix & Add

1. Fix low code coverage of vit.py;

2. Remove HybirdEmbed;

3. Fix doc string of VisionTransformer;

* Add helpers unit test.

* Add converter to convert vit pretrain weights from timm style to mmcls style.

* Clean some rebundant code and refactor init

1. Use timm style init_weights;

2. Remove to_xtuple and trunc_norm_;

* Add comments for VisionTransformer.init_weights()

* Add arg: pretrain_style to choose timm or mmcls vit pretrain weights.
2021-06-17 10:41:25 -07:00
sennnnn 608f842996
[Feature] Move 'Install MMCV' to a independent CI item. (#602)
* [Feature] Move 'Install MMCV' to a independent CI item.

* Merge MMCV install into MMSEG dependencies install

* Fix bug of 'Install MMCV'

* Remove duplicate CI items

* Fix torch device

* Split cpu env and gpu env into two CI project

* Fix some mmdet related bugs

* Fix mmcv-full install bug of build_cpu CI project.
2021-06-17 07:57:46 -07:00
Jerry Jiarui XU 26032167e0
Bump to v0.14.1 (#604) 2021-06-16 21:49:56 -07:00
Jerry Jiarui XU 0c5b026db1
[Refactor]: Unified parameter initialization (#567)
* [Refactor]: Unified parameter initialization

* fixed pretrained
2021-06-16 21:41:29 -07:00
Jerry Jiarui XU 5d46314844
Bump to v0.14 (#580) 2021-06-02 18:43:08 -07:00
Yinhao Li 9dd3e15f83
[feature]: Able to use save_best option (#575)
* Add  save_best option in eval_hook.

* Update meta to fix best model can not test bug

* refactor with _do_evaluate

* remove redundent

* add meta

Co-authored-by: Jiarui XU <xvjiarui0826@gmail.com>
2021-06-02 16:25:26 -07:00
谢昕辰 a95f6d8173
[Feature] support mim (#549)
* dice loss

* format code, add docstring and calculate denominator without valid_mask

* minor change

* restore

* add metafile

* add manifest.in and add config at setup.py

* add requirements

* modify manifest

* modify manifest

* Update MANIFEST.in

* add metafile

* add metadata

* fix typo

* Update metafile.yml

* Update metafile.yml

* minor change

* Update metafile.yml

* add subfix

* fix mmshow

* add more  metafile

* add config to model_zoo

* fix bug

* Update mminstall.txt

* [fix] Add models

* [Fix] Add collections

* [fix] Modify collection name

* [Fix] Set datasets to unet metafile

* [Fix] Modify collection names

* complement inference time
2021-05-31 15:07:24 -07:00
q.yao dc5d53b7f3
[Feature] Update deploy test tools (#553)
* add trt test tool

* create deploy_test, update document

* fix with isort

* move import inside __init__

* remove comment, fix doc

* update document
2021-05-24 20:37:46 -07:00
Edward 66b0525378
DeepLab V3 did not present in CVPR 2017 (#560)
https://openaccess.thecvf.com/CVPR2017 does not contain DeepLabV3
2021-05-18 09:44:41 -07:00
sennnnn 63a9516b94
Add compatible MMSegmentation and MMCV version table. (#558) 2021-05-17 10:43:13 -07:00
sennnnn 524425cf93
[Feature] Add results2img, format_results for ade dataset (#544)
* [Feature] Add results2img, format_results for ade dataset.

* clean rebundant code.
2021-05-16 19:29:28 -07:00
q.yao 8558163753
fix verify bugs (#547)
* fix verify bugs

* rename args
2021-05-12 21:14:41 -07:00
q.yao 805eda81ea
add onnx to tensorrt tools (#542) 2021-05-11 20:02:27 -07:00
谢昕辰 584f5a7def
support loading deit weights (#538) 2021-05-08 20:34:18 -07:00
Ziyi Wu db44d16e02
infer batch size using len(result) in test function (#532) 2021-05-06 08:16:46 -07:00
RangiLyu 4403923db1
fix typo (#533) 2021-05-06 08:16:06 -07:00
sennnnn aa9b609f11
Add option for output shape of ViT (#530)
* Add arg: final_reshape to control if converting output feature information from NLC to NCHW;

* Fix the default value of final_reshape;

* Modify arg: final_reshape to arg: out_shape;

* Fix some unit test bug;
2021-05-05 22:49:28 -07:00
Jerry Jiarui XU f884489120
Bump to v0.13 (#529) 2021-05-05 16:56:19 -07:00
谢昕辰 f9336032a5
Use MMCV's EvalHook in MMSegmentation (#438)
* mmcv eval hook

* mmcv evalhook compatible

* add warnings

* inherit from base class

* fix unitest

* adapt to mmcv 1.3.1

* fixed unittest

* set by_epoch=False

* fixed efficient test

* update docstring

Co-authored-by: Jiarui XU <xvjiarui0826@gmail.com>
2021-05-05 16:19:54 -07:00
sshuair e16e0e303b
add metric mFscore (#509)
* add mFscore and refactor the metrics return value

* fix linting

* some docstring and name fix
2021-04-30 11:34:57 -07:00
sennnnn cf2cb542f7
Adjust vision transformer backbone architectures (#524)
* Adjust vision transformer backbone architectures;

* Add DropPath, trunc_normal_ for VisionTransformer implementation;

* Add class token buring intermediate period and remove it during final period;

* Fix some parameters loss bug;

* * Store intermediate token features and impose no processes on them;

* Remove class token and reshape entire token feature from NLC to NCHW;

* Fix some doc error

* Add a arg for VisionTransformer backbone to control if input class token into transformer;

* Add stochastic depth decay rule for DropPath;

* * Fix output bug when input_cls_token=False;

* Add related unit test;

* * Add arg: out_indices to control model output;

* Add unit test for DropPath;

* Apply suggestions from code review

Co-authored-by: Jerry Jiarui XU <xvjiarui0826@gmail.com>
2021-04-30 10:37:47 -07:00
Ziyi Wu cef8a4f611
[Enhance] Support reading class_weight from file in loss functions to help MMDet3D (#513)
* support reading class_weight from file in loss function

* add unit test of loss with class_weight from file

* minor fix

* move get_class_weight to utils
2021-04-29 01:04:15 -07:00
Ziyi Wu 768f704517
[Enhance] Replace data_dict calling 'img' key to support MMDet3D (#514)
* remove dict calling img key for compatibility

* fix unit test

* infer batch size using len(result) to be consistent with mmcv
2021-04-29 01:01:34 -07:00
q.yao bdf5adf2ce
[Feature] add onnxruntime test tool (#498)
* add onnxruntime test tool, update pytorch2onnx to support slice export

* onnx convert with custom output shape, update test code

* update pytorch2onnx, add rescale_shape support, add document

* update doc for lint error fixing

* remove cpu flag in ort_test.py

* change class name, fix cuda error

* remote comment

* fix bug of torch2onnx

* mIOU to mIoU
2021-04-28 20:38:01 -07:00
Jerry Jiarui XU d568d06e75
[Refactor] Use MMCV MODEL_REGISTRY (#515)
* [Refactor] Use MMCV MODEL_REGISTRY

* fixed args
2021-04-27 23:51:09 -07:00
Jerry Jiarui XU 2da3da47ed
Add QR Code in Chinese README.md (#506) 2021-04-25 19:15:13 -07:00
谢昕辰 98ef5ac705
add upsample neck (#512)
* init

* upsample v1.0

* fix errors

* change to in_channels list

* add unittest, docstring, norm/act config and rename

Co-authored-by: xiexinch <test767803@foxmail.com>
2021-04-24 21:22:09 -07:00
sennnnn 84fb600d47
Fix "the output num_classes of auxiliary head is not same as num_classes of ground truth seg_map". (#488)
* Fix "the output num_classes of auxiliary head is not match num_classes of ground truth seg_map".

* Fix spelling mistake;

* Modify "model download link", "log link";
2021-04-24 15:31:29 -07:00
Jerry Jiarui XU dc3dcb0b34
comment tag (#505) 2021-04-24 09:58:59 -07:00
sennnnn 838b6472d0
Add some publish information of implemented models (#508)
* Add some publish information

* Fix some readme omission.
2021-04-24 09:58:15 -07:00
Jerry Jiarui XU 89f8a6a410
[Bug fix] fixed fp16 inference (#497)
* fixed fp16

* update fps
2021-04-24 09:57:33 -07:00
谢昕辰 5b33faa146
support transformer backbone (#465)
* vit backbone

* fix lint

* add docstrings and fix pretrained pos_embed dim not match prob

* add unittest for vit

* fix lint

* add vit based fcn configs

* fix import error

* support multiple resolution input images

* upsample pos_embed at init_weights

* support resize pos_embed at evaluation

* fix training errors

* add more unitest code for vit backbone

* unitest for uncovered code

* add norm_eval unittest

* refactor _pos_embeding

* minor change

* change var name

* rafactor init_weight

* load weights after resize

* ignore 'module' in pretrain checkpoint

* add with_cp

* add with_cp

Co-authored-by: Jiarui XU <xvjiarui0826@gmail.com>
2021-04-21 20:19:55 -07:00
sshuair 03f2a254dc
more docs about tools pytorch2torchscript and print_config (#499)
* Description of arguments about tools pytorch2torchscript and print_config

* fix docs lint
2021-04-21 16:09:59 -07:00
quincylin1 27342fd709
add mmocr link (#501) 2021-04-21 16:08:59 -07:00
sennnnn 83d312e87a
Add support for Pascal Context 59 classes (#459)
* Add support for Pascal Context 59 classes (#459)

* Create PascalContextDataset59 class in mmseg/datasets/pascal_context.py;

* Set reduce_zero_label=True for train_pipeline and PascalContextDataset59;

* Add some configs for Pascal-Context 59 classes training and testing;

* Try to solve the problem about "fence(IoU)=nan grass(IoU)=0";

* Continue(1): Try to solve the problem about "fence(IoU)=nan grass(IoU)=0";

* ignore files and folders named tempxxx;

* Continue(2): Try to solve the problem about "fence(IoU)=nan grass(IoU)=0";

* Modify the calculation of IoU;

* Modify the CLASSES order of PascalContextDataset;

* Add "fcn", "deeplabv3", "deeplabv3+", "pspnet" config file for model training based on PascalContextDataset59;

Add some ignore items in ".gitignore";

* fix the bug "test_cfg specified in both outer field and model field " of pspnet config file;

* * Clean unnecessary codes;

* Add weighs link, config link, log link and evaluation results about PascalContextDataset59 in README.md

* Add command line argument: "-p | --port", this arg can change the transmit port when you transmit data to distributed machine.

* * Remove rebundant config files;

* Remove "-p|--port" command argument;

Co-authored-by: Jiarui XU <xvjiarui0826@gmail.com>
2021-04-19 21:20:54 -07:00
Ziyi Wu 1483720cc0
add BaseSegmentor import to segmentors/__init__.py (#495) 2021-04-19 08:52:42 -07:00
sshuair 8f37e558c9
add tool pytorch2torchscript (#469)
* add tool pytorch2torchscript

* fix the assert message for pytorch version.
2021-04-19 08:51:49 -07:00
Jerry Jiarui XU 67eee62609
Fix sem_fpn and unet README.md (#492) 2021-04-18 02:56:53 -07:00
sennnnn fb24bf54b6
Fix mIoU calculatiton range (#471)
* Fix fence(IoU) = 0 when training on PascalContextDataset59;

* Add a test case in test_metrics() of tests/test_metrics.py to test the bug caused by torch.histc;

* Update tests/test_metrics.py

Co-authored-by: Jerry Jiarui XU <xvjiarui0826@gmail.com>

Co-authored-by: Jerry Jiarui XU <xvjiarui0826@gmail.com>
2021-04-14 08:37:23 -07:00