Commit Graph

227 Commits (100830e5efc06f259b347d55edda90f3e75c14f1)

Author SHA1 Message Date
l1aoxingyu d9d6e19b2c fix: fix bugs about import of torch version 2021-09-21 21:42:00 +08:00
ViokingTung 2cac19ce31
fix num_vis type error bug in visualizer.py (#566) 2021-09-02 14:30:18 +08:00
liaoxingyu 7e652fea2a feat: Add contiguous parameters support
Support contiguous parameters to train faster. It can split parameters into different contiguous groups by freeze_layer, lr and weight decay.
2021-07-05 11:10:37 +08:00
keith 44d1e04e9a
Added: mobilenetv3 backbone (#525) 2021-06-30 14:49:28 +08:00
liaoxingyu 10b04b75ff Support lazy loading in dataset
Add an option for lazy loading, which will parse the data when using it. Specifically, when calling `dataset.query`, it will start to parse the query data, and `train` and `gallery` will not be parsed in advanced. This is useful when you want to run on test dataset but train dataset is large.

See examples in market1501.py
2021-06-17 16:59:02 +08:00
liaoxingyu d792a69f3f bugfix for veriwild and vehicleid
Change `camids` from string to int when evaluation, otherwise, it will raise AttributeError

#497
2021-06-17 16:52:47 +08:00
liaoxingyu ac6256887c Merge branch 'master' of github.com:L1aoXingyu/fast-reid 2021-06-17 16:07:17 +08:00
liaoxingyu 62ad5e1a8b bugfix for cuda tensor to numpy
Move cuda tensor to host memory in predictor which can be used for following process.
2021-06-17 16:05:45 +08:00
Jinkai Zheng f2286e7f55
Updated the way of reading VERI-Wild's TXT files (#507)
Reviewed by: @L1aoXingyu
2021-06-11 13:46:46 +08:00
liaoxingyu 4f90197336 add logger for pretrain model downloading 2021-06-08 15:57:47 +08:00
liaoxingyu 7ed6240e2c fix ReidEvalution too much memory cost
Move `matches` matrix computation in each iteration to reduce the extra memory cost

#420 #404
2021-06-08 15:41:43 +08:00
liaoxingyu de81b3dbaa fix ClasEvalution too much memory cost
Compute total number of correct predictions on each batch avoiding keeping all predicted logits, which will cost too much memory when the number of classes is large

#503
2021-06-07 15:48:47 +08:00
liaoxingyu 8f8cbf9411 fix lr scheduler warning when amp training
Skip lr scheduler when this iteration creates NaN gradients
2021-06-02 16:35:46 +08:00
liaoxingyu 2d2279be6a refactor freeze training condition 2021-06-02 15:55:35 +08:00
liaoxingyu 0572765085 fix for lint_python 2021-05-31 17:40:33 +08:00
liaoxingyu 54f96ba78a fix for lint_python 2021-05-31 17:36:56 +08:00
liaoxingyu 6300bd756e Bugfix for cls_layer
In `any_softmax`, all operations are in-place, so pass into the `logits.clone()` to prevent outside logits changed.
2021-05-31 17:32:24 +08:00
liaoxingyu 91ff631184 Minor changes
Some minor changes, such as class name changing, remove extra blank line, etc.
2021-05-31 17:27:14 +08:00
liaoxingyu 8ab3554958 Support self-distill with EMA updated model 2021-05-31 17:17:24 +08:00
liaoxingyu 256721cfde Impl `freezebb` in optimizer's step()
Make impl. of `freezebb` consistent with impl. of grad clip, and both are implemented through step() in optimizer
2021-05-31 17:15:26 +08:00
liaoxingyu 07b8251ccb Support gradient clip
Follow detectron2's instruction and add gradient clip in step function of optimizer
2021-05-31 17:11:37 +08:00
liaoxingyu 2cabc3428a Support vision transformer backbone 2021-05-31 17:08:57 +08:00
liaoxingyu 2b65882447 change way of layer freezing
Remove `find_unused_parameters` in DDP and add a new step function in optimizer for freezing backbone. It will accelerate training speed in this way.
2021-05-25 15:57:09 +08:00
Sherlock Liao ff8a958fff
bugfix for `plain_train_net.py` and lr scheduler step (#484) 2021-05-11 15:46:17 +08:00
Xingyu Liao 46b0681313
fix randompatch (#470) 2021-04-21 17:08:16 +08:00
liaoxingyu 0c8e3d9805 update imbalanced sampler
Summary: add a new sampler, which is useful for imbalanced or long-tail dataset. This refers to ufoym/imbalanced-dataset-sampler.
2021-04-21 17:05:10 +08:00
Xingyu Liao 1dce15efad
faster dataloader with pre-fetch and cuda stream (#456)
Summary: add a background thread to create a generator with pre-fetch, and create a new cuda stream to copy tensor from cpu to gpu in parallel.

Reviewed by: l1aoxingyu
2021-04-12 15:03:35 +08:00
liaoxingyu 55300730e1 update fastreid v1.2 readme and changelog 2021-04-06 20:09:13 +08:00
liaoxingyu 44cee30dfc update fastreid v1.2
Summary:
1. refactor dataloader and heads
2. bugfix in fastattr, fastclas, fastface and partialreid
3. partial-fc supported in fastface
2021-04-02 21:33:13 +08:00
Xingyu Liao fb36b23678
bugfix for attribute project (#450)
Summary: refactor sample weight in attribute recognition;
change all options to False in defaults.py and modify yaml files
2021-03-31 17:07:19 +08:00
Xie Jingyi 25cfa88fd9
Fix bug: COMBINEALL should add extra prefix to avoid pid conflictions (#447) 2021-03-30 15:49:52 +08:00
Xingyu Liao be0a089e1f
bugfix & merge classification transforms (#448)
Summary: change heads definition in project and config file, merge classification transforms into default transforms
2021-03-30 15:47:14 +08:00
Xingyu Liao 890224f25c
support classification in fastreid (#443)
Summary: support classification and refactor build_dataloader which can support explicit parameters passing
2021-03-26 20:17:39 +08:00
Xingyu Liao 15c556c43a
remove apex dependency (#442)
Summary: Use Pytorch1.6(or above) built-in amp training
2021-03-23 12:12:35 +08:00
Xingyu Liao 883fd4aede
add configurable decorator & linear loss decouple (#441)
Summary: Add configurable decorator which can call `Baseline` with `Baseline(cfg)` or `Baseline(cfg, heads=heads, ...)`
Decouple linear and loss computation for partial-fc support.

Reviewed By: l1aoxingyu
2021-03-23 12:10:06 +08:00
Xingyu Liao 9b5af4166e
support repvgg (#429)
Summary:
* support repvgg backbone, and verify the consistency of train mode and eval mode
* onnx export logger style modification
2021-03-11 14:23:24 +08:00
liaoxingyu f57c5764e3 support multi-node training 2021-03-09 20:07:28 +08:00
liaoxingyu 68c190b53c replace list in evaluator process with dict 2021-03-09 20:07:13 +08:00
liaoxingyu 96fd58c48f update vehicleid and veriwild datasets 2021-02-26 19:26:48 +08:00
liaoxingyu 52b75b7974 update prid and grid datasets 2021-02-26 19:26:38 +08:00
liaoxingyu 77a91b1204 feat: support multi-teacher kd
Summary: support multi-teacher kd with logits and overhaul distillation
2021-01-29 17:25:31 +08:00
liaoxingyu 6b4b935ce4 fix augmix warning
Summary: add array.clone to avoid warning about numpy array not writable
2021-01-29 11:50:33 +08:00
liaoxingyu b786001ebd add mobilenetv2 support 2021-01-26 18:17:01 +08:00
liaoxingyu ef6ebf451b refactor apex import 2021-01-23 15:35:48 +08:00
liaoxingyu a53fd17874 update docs 2021-01-23 15:25:58 +08:00
liaoxingyu b5c3c0a24d update docs 2021-01-22 21:11:19 +08:00
liaoxingyu e26182e6ec make lr warmup by iter
Summary: change warmup way by iter not by epoch, which will make it more flexible when training small epochs
2021-01-22 11:17:21 +08:00
liaoxingyu 7e83d3175f update README.md
Summary: add information about fastreid V1.0
2021-01-18 11:44:55 +08:00
liaoxingyu 15e1729a27 update fastreid V1.0 2021-01-18 11:36:38 +08:00
liaoxingyu c49414bb9f fix SE layer of basicblock in resnet (#375)
Summary: SE layer defined in `__init__` but not used in `forward`

close #375
2021-01-04 10:46:54 +08:00