Commit Graph

82 Commits (fbb5c25c5f6850b67de112c89371c6f7e38efad1)

Author SHA1 Message Date
rrjia fbb5c25c5f
Merge 9b656c3da2 into c9bc3ceb2f 2024-08-30 16:24:46 +08:00
Xinchen Liu 817c748e8c
Update build.py (#692) 2023-04-05 09:07:49 +08:00
rrjia 9b656c3da2
Update build.py
训练过程中,内存一直增长,到后期会把整个服务器的内存都占完,初步分析将上述两个增强关闭后,内存使用会正常,具体是因为哪个方法,因为哪个实现有问题,暂时还没有时间分析
2022-07-28 17:48:27 +08:00
xyliao 10a5f38aaa
fix(dataloader): delete background threading when dataloader is freed (#583) 2021-10-01 16:14:36 +08:00
l1aoxingyu d9d6e19b2c fix: fix bugs about import of torch version 2021-09-21 21:42:00 +08:00
liaoxingyu 10b04b75ff Support lazy loading in dataset
Add an option for lazy loading, which will parse the data when using it. Specifically, when calling `dataset.query`, it will start to parse the query data, and `train` and `gallery` will not be parsed in advanced. This is useful when you want to run on test dataset but train dataset is large.

See examples in market1501.py
2021-06-17 16:59:02 +08:00
liaoxingyu d792a69f3f bugfix for veriwild and vehicleid
Change `camids` from string to int when evaluation, otherwise, it will raise AttributeError

#497
2021-06-17 16:52:47 +08:00
Jinkai Zheng f2286e7f55
Updated the way of reading VERI-Wild's TXT files (#507)
Reviewed by: @L1aoXingyu
2021-06-11 13:46:46 +08:00
liaoxingyu 91ff631184 Minor changes
Some minor changes, such as class name changing, remove extra blank line, etc.
2021-05-31 17:27:14 +08:00
Xingyu Liao 46b0681313
fix randompatch (#470) 2021-04-21 17:08:16 +08:00
liaoxingyu 0c8e3d9805 update imbalanced sampler
Summary: add a new sampler, which is useful for imbalanced or long-tail dataset. This refers to ufoym/imbalanced-dataset-sampler.
2021-04-21 17:05:10 +08:00
Xingyu Liao 1dce15efad
faster dataloader with pre-fetch and cuda stream (#456)
Summary: add a background thread to create a generator with pre-fetch, and create a new cuda stream to copy tensor from cpu to gpu in parallel.

Reviewed by: l1aoxingyu
2021-04-12 15:03:35 +08:00
liaoxingyu 55300730e1 update fastreid v1.2 readme and changelog 2021-04-06 20:09:13 +08:00
liaoxingyu 44cee30dfc update fastreid v1.2
Summary:
1. refactor dataloader and heads
2. bugfix in fastattr, fastclas, fastface and partialreid
3. partial-fc supported in fastface
2021-04-02 21:33:13 +08:00
Xie Jingyi 25cfa88fd9
Fix bug: COMBINEALL should add extra prefix to avoid pid conflictions (#447) 2021-03-30 15:49:52 +08:00
Xingyu Liao be0a089e1f
bugfix & merge classification transforms (#448)
Summary: change heads definition in project and config file, merge classification transforms into default transforms
2021-03-30 15:47:14 +08:00
Xingyu Liao 890224f25c
support classification in fastreid (#443)
Summary: support classification and refactor build_dataloader which can support explicit parameters passing
2021-03-26 20:17:39 +08:00
liaoxingyu 96fd58c48f update vehicleid and veriwild datasets 2021-02-26 19:26:48 +08:00
liaoxingyu 52b75b7974 update prid and grid datasets 2021-02-26 19:26:38 +08:00
liaoxingyu 6b4b935ce4 fix augmix warning
Summary: add array.clone to avoid warning about numpy array not writable
2021-01-29 11:50:33 +08:00
liaoxingyu a53fd17874 update docs 2021-01-23 15:25:58 +08:00
liaoxingyu b5c3c0a24d update docs 2021-01-22 21:11:19 +08:00
liaoxingyu 15e1729a27 update fastreid V1.0 2021-01-18 11:36:38 +08:00
liaoxingyu 20a01f2545 fix grayscale image input problem
Summary: handle grayscale images mixed in RGB images by adding the image channels
2020-12-28 14:45:09 +08:00
liaoxingyu 8083547613 add kwargs for convenient dataset parameters passing (#290)
Summary: make it more easy for passing dataset kwargs through `build_reid_train_loader`
2020-12-28 14:39:08 +08:00
Xingyu Liao 0428a270e3
update veri dataset
Summary: update veri dataset reference information

Reviewed By: l1aoxingyu
2020-12-22 18:01:37 +08:00
liaoxingyu 04fe9fb2d8 add saivt dataset 2020-12-22 15:47:08 +08:00
liaoxingyu e8739a667e update AirportALERT dataset
Summary: add more IDs from the single camera
2020-12-22 15:36:50 +08:00
Xinchen Liu 218a007b6a
Update veri.py 2020-12-21 16:19:06 +08:00
liaoxingyu a327a70f0d v0.3 update
Summary:
1. change DPP training in apex way;
2. make warmup scheduler by iter and lr scheduler by epoch;
3. replace random erasing with torchvision implementation;
4. naming modification in config file
2020-12-07 14:19:20 +08:00
liaoxingyu2 42cadaeebc update backbone and config
Summary: update resnet backbone for adaptation caffe export; modify effnet loading keyword
2020-11-06 10:58:38 +08:00
liaoxingyu 10cbaab155 support finetuning from trained models
Summary: add a flag for supporting finetuning model from the trained weights, and it's very useful when performing across domain reid
2020-09-28 17:10:10 +08:00
liaoxingyu 3024cea3a3 add more datasets
Summary: add wildtracker.py datasets and cuhk_sysu.py datasets.
2020-09-28 17:05:40 +08:00
liaoxingyu 154a06b875 refactor code 2020-09-23 19:31:46 +08:00
liaoxingyu 919a515eb7 fix combine all training 2020-09-09 15:28:21 +08:00
liaoxingyu 866a196d19 add more datasets support 2020-09-01 16:13:12 +08:00
liaoxingyu f06c8b2ed9 fix bug: make CJ works #239
fix #239
2020-08-25 11:31:49 +08:00
liaoxingyu 5ea89bf607 fix bug in sampler
Summary: remove set, which will lead to a bug in random choice.
2020-08-21 14:54:17 +08:00
liaoxingyu 9844760d7f fix naive sampler time-consuming problem
Summary: list.remove has O(n) time complexity and use set instead.
2020-08-20 15:44:26 +08:00
liaoxingyu 2c0320da1a fix bug in pid_dict
Summary: id index will be different in different machine.
This will lead to different fc layer when training on different machine.
2020-08-20 15:41:14 +08:00
liaoxingyu a5550d7725 fix balanced sampler bug
Summary: fix typing error in balanced sampler with missing `len` in ret.
2020-08-19 16:28:10 +08:00
liaoxingyu 9c667d1a0f add pretrain_path support in backbone 2020-08-14 14:00:26 +08:00
liaoxingyu e0cf8ac56e fix sampler problem #217
Fix problem about periodic long waiting time when number of images is large.

In the old version, it will prepare the whole epoch indices when finishing one epoch.
Now it changes to prepare the current batch indices.
2020-08-14 13:57:22 +08:00
liaoxingyu 57ebf75f83 fix bug about changing cfg values 2020-08-10 10:29:24 +08:00
liaoxingyu d516d59fb5 fix autoaug total_iter bug #219
max_epoch does not convert to max_iter when needing to build dataloader first
add extra convert in `build_reid_train_loader`
2020-08-09 19:43:01 +08:00
liaoxingyu d1c20cbe50 fix pre-train model bugs
fix bugs locks when downloading pre-train model
2020-08-04 15:56:36 +08:00
liaoxingyu 977aa4a357 update model url 2020-07-31 14:59:37 +08:00
liaoxingyu 65169b40bd support ddp testing 2020-07-30 20:15:28 +08:00
liaoxingyu 16655448c2 onnx/trt support
Summary: change model pretrain mode and support onnx/TensorRT export
2020-07-29 17:43:39 +08:00
liaoxingyu 3f35eb449d minor update 2020-07-14 11:58:06 +08:00