Commit Graph

269 Commits (49abc722fc4204d57e81b2f4db98f024ad6474cc)

Author SHA1 Message Date
Glenn Jocher 92c9b72832
Matplotlib AGG backend (#1413) 2020-11-16 16:34:07 +01:00
Glenn Jocher 548a98a391
Recursive directories dataset capability (#1408)
* Recursive directories dataset capability

* x.split('.')[-1]

* f += glob.glob(f"{p}{os.sep}**.*", recursive=True)

* f += glob.glob(str(p / '**.*'), recursive=True)

* remove . from image and vid formats

* .txt to txt

* str(p / '**' / '*.*')
2020-11-16 16:24:57 +01:00
Glenn Jocher 9c91aeae10
W&B logging add hyperparameters (#1399)
* W&B logging add hyperparameters

* hyp bug fix and image logging updates

* if plots and wandb:

* cleanup

* wandb/ gitignore add

* cleanup 2

* cleanup 3

* move wandb import to top of file

* wandb evolve

* update import

* wandb.run.finish()

* default anchors: 3
2020-11-16 13:35:34 +01:00
Glenn Jocher 9f27902368 Improved FLOPS computation (#1398) 2020-11-14 14:48:55 +01:00
Glenn Jocher d8f5fcfe87
Improved FLOPS computation (#1398)
* Improved FLOPS computation

* update comment
2020-11-14 14:39:46 +01:00
Glenn Jocher fe341fa44d
Utils reorganization (#1392)
* Utils reorganization

* Add new utils files

* cleanup

* simplify

* reduce datasets.py

* remove evolve.sh

* loadWebcam cleanup
2020-11-14 11:50:32 +01:00
Glenn Jocher c4addd7761
Unified '/project/name' results saving (#1377)
* Project/name update

* Update ci-testing.yml

* address project with path separator failure mode

* Project/name update

* address project with path separator failure mode

* Update ci-testing.yml

* detect.py default --name bug fix

* missing rstrip PR

* train/exp0 to train/exp
2020-11-12 23:37:46 +01:00
Glenn Jocher 67bf9a974e
Replace 'ground truth' with 'labels' (#1337)
* Replace 'ground truth' with 'labels'

* Using torch... update
2020-11-10 14:15:03 +01:00
Glenn Jocher 19e2482458
PyTorch version to screen and cleanup (#1325)
* Create flatten_recursive() helper function

* cleanup

* print torch version
2020-11-09 12:24:11 +01:00
Glenn Jocher 4821d076e2
Increment train, test, detect runs/ (#1322)
* Increment train, test, detect runs/

* Update ci-testing.yml

* inference/images to data/images

* move images

* runs/exp to runs/train/exp

* update 'results saved to %s' str
2020-11-08 19:39:05 +01:00
Glenn Jocher d3e7778151 imap bug fix 2020-11-07 02:27:31 +01:00
Glenn Jocher 194f16844e Multi-threaded image caching 2020-11-07 02:18:18 +01:00
Glenn Jocher ea7e78cb11
Grid indices overflow bug fix (#1316) 2020-11-06 19:17:50 +01:00
Glenn Jocher fed5d9cdfb
Grid indices overflow bug fix (#1313) 2020-11-06 13:40:11 +01:00
Glenn Jocher 2062765e06
auto-download v3.1 models (#1259) 2020-11-01 20:11:41 +01:00
Glenn Jocher c8c5ef36c9
PyTorch 1.7.0 Compatibility Updates (#1233)
* torch 1.7.0 compatibility updates

* add inference verification
2020-10-28 15:03:50 +01:00
Glenn Jocher 453acdec67 Update tensorboard logging 2020-10-26 01:08:33 +01:00
Glenn Jocher 8e9b3d0205
Precision-Recall Curve feature update #1206 2020-10-25 12:59:16 +01:00
Glenn Jocher ed85038c38
Precision-Recall Curve feature update (#1206)
* Precision-Recall Curve feature update

* sentinel value update
2020-10-25 12:55:52 +01:00
Glenn Jocher 481d46cffb Improved corruption handling during scan and cache (#999) 2020-10-24 15:09:19 +02:00
Glenn Jocher d61930e017 Improved corruption handling during scan and cache (#999) 2020-10-24 14:50:50 +02:00
Shiwei Song 9291daa6f7
fix padding for rectangular inference (#1165)
Co-authored-by: swsong <swsong@stratosphere.mobi>
2020-10-19 12:22:22 +02:00
Glenn Jocher 3b57cb5641
Simplified inference (#1153) 2020-10-15 20:10:08 +02:00
Jirka Borovec c67e72200e
fix compatibility for hyper config (#1146)
* fix/hyper

* Hyp giou check to train.py

* restore general.py

* train.py overwrite fix

* restore general.py and pep8 update

Co-authored-by: Glenn Jocher <glenn.jocher@ultralytics.com>
2020-10-15 15:05:58 +02:00
Glenn Jocher 4d3680c81d
Minor import and spelling updates (#1133) 2020-10-13 17:24:27 +02:00
Jirka Borovec 00917a6225
update expt name comment and folder parsing for training (#978)
* comment

* fix parsing

* fix evolve

* folder

* tqdm

* Update train.py

* Update train.py

* reinstate anchors into meta dict

anchor evolution is working correctly now

* reinstate logger

prefer the single line readout for concise logging, which helps simplify notebook and tutorials etc.

Co-authored-by: Glenn Jocher <glenn.jocher@ultralytics.com>
2020-10-13 14:10:21 +02:00
Glenn Jocher 0ada058f63
Generalized regression criterion renaming (#1120) 2020-10-11 17:25:17 +02:00
Glenn Jocher 5fac5ad165
Precision-Recall Curve Feature Addition (#1107)
* initial commit

* Update general.py

Indent update

* Update general.py

refactor duplicate code

* 200 dpi
2020-10-09 14:50:59 +02:00
Glenn Jocher 124f0e8212 torchvision nms bug fix 2020-10-06 15:09:24 +02:00
Glenn Jocher 883924d9dc classifier, export, torch seed updates 2020-10-06 14:54:02 +02:00
Jiacong Fang c5d2331897
Fix increment_dir to use run_xxx for logdir (#1058)
* Fix increment_dir to use run_xxx for logdir 

Rerunning train.py with logdir in the form of `run_xxx` causes index slicing in
```
n = max([int(x[len(dir):x.find('_') if '_' in Path(x).name else None]) for x in d]) + 1  # increment
```
to underflow.

* Replace find with rfind
2020-10-05 15:46:32 +02:00
haoyuefan 7220cee1d1
mosaic4 bottom left image fix (#1021)
fix a bug in load_mosaic
2020-09-23 09:51:33 -07:00
Guilhen 702c4fa53e
adding the configuration to deploy yolov5 in in app engine (#964)
* add the configuration to deploy yolov5 in a docker container in app engine on google cloud

* remove the duplicated requirements, place the google app engine files in utils

* remove the unused requirements

Co-authored-by: guilhembau <guilhem@6dbytes.com>
2020-09-22 11:48:44 -07:00
Glenn Jocher 89655a84f2 .fuse() gradient introduction bug fix 2020-09-20 11:57:19 -07:00
Glenn Jocher 5a9c5c1d3b add mosaic and warmup to hyperparameters (#931) 2020-09-13 14:08:06 -07:00
Glenn Jocher f1c63e2784 add mosaic and warmup to hyperparameters (#931) 2020-09-13 14:03:54 -07:00
Glenn Jocher 806e75f2b1 self.label_files bug fix (#958) 2020-09-13 11:38:23 -07:00
Glenn Jocher c54e39464c
check_file() assert unique 2020-09-11 14:33:06 -07:00
Glenn Jocher 720645d96a LoadImagesAndLabels() /images/ to /labels/ fix (#928) 2020-09-10 12:29:05 -07:00
Glenn Jocher d49c52eee3 _RepeatSampler outside of InfiniteDataLoader 2020-09-10 12:27:35 -07:00
Glenn Jocher 9c0efdde9f glob.glob(recursive=True) search (#917) 2020-09-06 22:52:28 -07:00
Glenn Jocher bc1fd13a7a gsutil cp hyp evolution bug fix (#876) 2020-09-03 20:29:08 -07:00
Glenn Jocher 44cdcc7e0b hyp['anchors'] evolution update 2020-09-03 12:54:22 -07:00
Glenn Jocher ffe9eb4238 remove if platform.system() == 'Darwin' checks 2020-09-03 11:41:33 -07:00
tkianai c5969f79f5
add support for DWConv fuse operation (#898)
* the value should be a list to unpacking

* filter the None labels

* update readme to remove apex dependency

* add support for DWConv fuse operation
2020-09-01 22:18:42 -07:00
Glenn Jocher d3f9bf2bb7 Update datasets.py 2020-09-01 17:02:47 -07:00
NanoCode012 1e15aad6f9
Add InfiniteDataLoader class (#876)
* Add InfiniteDataLoader

Only initializes at first epoch. Saves time.

* Moved class to a better location
2020-08-31 11:01:25 -07:00
Glenn Jocher 987c226849 seaborn plotting correlogram addition 2020-08-29 15:13:58 -07:00
rafale77 9776e70988
torch.ops.torchvision.nms (#860)
Don't load the entire torchvision library just for nms when the function is already in the torch library.
2020-08-27 11:13:41 -07:00
Glenn Jocher 31d6c389f2 Update general.py plot_evolution() 2020-08-25 23:08:14 -07:00
Willie Maddox 455f7b8f76
Update general.py (#823)
Fixes #822

`init_seeds` from `torch_utils` import is being overwritten by function `init_seeds` in `general.py`
2020-08-25 13:01:17 -07:00
Glenn Jocher 5a7d79fbe6
Update general.py bbox_iou() with eps improvements (#736)
eps reduced to 1e-9 for additional precaution.
2020-08-25 12:56:39 -07:00
Glenn Jocher 82ed33a052 generalize webcam detection with opt.source.isnumeric() (yolov3 #1462) 2020-08-25 11:07:38 -07:00
Glenn Jocher 4d7f222f73 Update export.py with v3.0 Hardswish() support 2020-08-24 21:47:49 -07:00
Glenn Jocher 8666bc507e Create evolve.sh for infinite hyp evolution 2020-08-24 20:27:28 -07:00
Glenn Jocher 71209a6099 exportable Hardswish() implementation 2020-08-22 16:59:31 -07:00
Glenn Jocher f7e075fe93 gsutil cp yaml when evolving to GCP bucket 2020-08-22 15:47:39 -07:00
Glenn Jocher 9dbaa1bbbe Update plot_results() 2020-08-22 15:32:05 -07:00
Glenn Jocher ea5e97fb9b
FP16 NMS (#814) 2020-08-21 14:44:25 -07:00
Glenn Jocher b42e8a531b optimize imports 2020-08-20 21:17:40 -07:00
Glenn Jocher 5e0b90de8f CIoU nan bug fix (#736) 2020-08-20 10:37:55 -07:00
Glenn Jocher ebafd1ead5
single command --resume (#756)
* single command --resume

* else check files, remove TODO

* argparse.Namespace()

* tensorboard lr

* bug fix in get_latest_run()
2020-08-17 16:28:43 -07:00
Francisco Ingham 26c3b11fdc
Update torch_utils.py (#751) 2020-08-16 13:58:59 -07:00
Glenn Jocher f5da528d28 reformat code 2020-08-14 11:53:44 -07:00
Quan Lin 66744a0df1
Update utils/google_utils.py (#733)
To download weights from v3.0 instead of v2.0
2020-08-13 18:44:14 -07:00
Glenn Jocher 916d4aad9a
v3.0 Release (#725)
* initial commit

* remove yolov3-spp from test.py study

* update study --img range

* update mAP

* cleanup and speed updates

* update README plot
2020-08-13 14:25:05 -07:00
Hatovix 56c2c344ff
Fix list paths (#721)
* Add list paths on check_dataset

* missing raise statement

* Update general.py

Co-authored-by: Glenn Jocher <glenn.jocher@ultralytics.com>
2020-08-12 18:53:38 -07:00
Marc a925f283a7
max workers for dataloader (#722) 2020-08-12 13:57:36 -07:00
Glenn Jocher d2da523053 Merge remote-tracking branch 'origin/master' 2020-08-11 20:11:58 -07:00
Glenn Jocher 9f482cbcb8 utils.general comment updates/bug fixes 2020-08-11 20:11:44 -07:00
Marc 1f92422e20
Github release assets model autodownload (#711)
* assets autodownload

* Update google_utils.py

* Update google_utils.py

* Update google_utils.py

* Update google_utils.py

* Update google_utils.py

Co-authored-by: Glenn Jocher <glenn.jocher@ultralytics.com>
2020-08-11 17:17:24 -07:00
NanoCode012 4949401a94
Fix redundant outputs via Logging in DDP training (#500)
* Change print to logging

* Clean function set_logging

* Add line spacing

* Change leftover prints to log

* Fix scanning labels output

* Fix rank naming

* Change leftover print to logging

* Reorganized DDP variables

* Fix type error

* Make quotes consistent

* Fix spelling

* Clean function call

* Add line spacing

* Update datasets.py

* Update train.py

Co-authored-by: Glenn Jocher <glenn.jocher@ultralytics.com>
2020-08-11 11:18:45 -07:00
tkianai 542833c997
Filter the None labels (#705)
* the value should be a list to unpacking

* filter the None labels
2020-08-11 11:15:48 -07:00
tkianai 9ae868364a
the value should be a list to unpacking (#688) 2020-08-10 11:23:48 -07:00
Glenn Jocher 41523e2c91
Dataset autodownload feature addition (#685)
* initial commit

* move download scripts into data/scripts

* new check_dataset() function in general.py

* move check_dataset() out of with context

* Update general.py

* DDP update

* Update general.py
2020-08-09 20:52:57 -07:00
Glenn Jocher 3c6e2f7668
Single-source training (#680)
* Single-source training

* Extract hyperparameters into seperate files

* weight decay scientific notation yaml reader bug fix

* remove import glob

* intersect_dicts() implementation

* 'or' bug fix

* .to(device) bug fix
2020-08-09 02:12:44 -07:00
Glenn Jocher 3fcd365ba3 Fix curl download on Windows (#669) 2020-08-07 12:13:55 -07:00
NanoCode012 fe5b3f8712
Fix curl download on Windows (#669)
* Update ci-testing.yml

* Fix windows download

* Fix cookie and curl download issue from gdrive

* Revert "Update ci-testing.yml"

This reverts commit 7389d2238d.

* Update google_utils.py

PEP8

* Update google_utils.py

Co-authored-by: Glenn Jocher <glenn.jocher@ultralytics.com>
2020-08-07 12:10:59 -07:00
Glenn Jocher 7eaf225d55 zero-target training bug fix (#609) 2020-08-05 13:35:31 -07:00
Glenn Jocher f346da9f2b update activations.py 2020-08-03 17:18:31 -07:00
Jirka Borovec d5b6416c87
Explicit Imports (#498)
* expand imports

* optimize

* miss

* fix
2020-08-02 15:47:36 -07:00
Glenn Jocher ec7a926163 AutoAnchor update to display anchors/target 2020-08-02 14:38:45 -07:00
Glenn Jocher d989bc9260 remove NBSP 2020-08-02 14:23:05 -07:00
Glenn Jocher 023e37807c hyperparameter evolution update (#566) 2020-08-02 13:18:03 -07:00
Glenn Jocher 64e6d199ba hyperparameter evolution update (#566) 2020-08-02 13:17:26 -07:00
Glenn Jocher 305c6a028a compute_loss() leaf variable update 2020-08-02 10:30:43 -07:00
Glenn Jocher c1a2a7a411 hyperparameter evolution bug fix (#566) 2020-08-01 23:00:10 -07:00
Glenn Jocher e32abb5fb9 hyperparameter evolution bug fix (#566) 2020-08-01 19:15:48 -07:00
Glenn Jocher 127cbeb3f5 hyperparameter expansion to flips, perspective, mixup 2020-08-01 13:47:54 -07:00
Glenn Jocher 23d2bde01f leaf variable --single-cls training bug fix (#593) 2020-08-01 11:42:41 -07:00
Glenn Jocher bcd452c482 replace random_affine() with random_perspective()
Signed-off-by: Glenn Jocher <glenn.jocher@ultralytics.com>
2020-07-31 15:53:52 -07:00
Glenn Jocher bb87276d80
update build_targets() (#589)
Signed-off-by: Glenn Jocher <glenn.jocher@ultralytics.com>
2020-07-31 14:34:13 -07:00
Liu Changyu c020875b17
PyTorch 1.6.0 update with native AMP (#573)
* PyTorch have Automatic Mixed Precision (AMP) Training.

* Fixed the problem of inconsistent code length indentation

* Fixed the problem of inconsistent code length indentation

* Mixed precision training is turned on by default
2020-07-31 10:52:45 -07:00
Glenn Jocher c8892672a7 Funnel ReLU (FReLU) @staticmethod bug fix (#556)
Signed-off-by: Glenn Jocher <glenn.jocher@ultralytics.com>
2020-07-30 17:38:15 -07:00
Glenn Jocher 131782a2aa Funnel ReLU (FReLU) (#556)
Signed-off-by: Glenn Jocher <glenn.jocher@ultralytics.com>
2020-07-30 17:35:34 -07:00
AlexWang1900 4b074d9d9d
Funnel ReLU (FReLU) (#556)
* fix #541 #542

* Update train.py

* Add Frelu

* Update activations.py

PEP8 and format updates for commonality with models.common.Conv()

* Update activations.py

Update case

* Update activations.py

Co-authored-by: Glenn Jocher <glenn.jocher@ultralytics.com>
2020-07-30 17:25:49 -07:00
YuriRibeiro 7d78b17a69
Fix utils.py nonzero() warning (#551) 2020-07-29 12:14:11 -07:00
AlexWang1900 a209a32019
Fix bug #541 #542 (#545)
* fix #541 #542

* Update train.py

Co-authored-by: Glenn Jocher <glenn.jocher@ultralytics.com>
2020-07-28 18:31:01 -07:00
Glenn Jocher 0032af2980
Update utils.py strip_optimizer() (#509) 2020-07-24 19:26:56 -07:00
Glenn Jocher 1d17b9af0f
update yolo.py TTA flexibility and extensibility (#506)
* update yolo.py TTA flexibility and extensibility

* Update scale_img()
2020-07-24 11:42:23 -07:00