fad27c0046
Update DDP for `torch.distributed.run` with `gloo` backend ( #3680 )
...
* Update DDP for `torch.distributed.run`
* Add LOCAL_RANK
* remove opt.local_rank
* backend="gloo|nccl"
* print
* print
* debug
* debug
* os.getenv
* gloo
* gloo
* gloo
* cleanup
* fix getenv
* cleanup
* cleanup destroy
* try nccl
* return opt
* add --local_rank
* add timeout
* add init_method
* gloo
* move destroy
* move destroy
* move print(opt) under if RANK
* destroy only RANK 0
* move destroy inside train()
* restore destroy outside train()
* update print(opt)
* cleanup
* nccl
* gloo with 60 second timeout
* update namespace printing
2021-06-19 16:30:25 +02:00
bfb2276b1d
Slightly modify CLI execution ( #3687 )
...
* Slightly modify CLI execution
This simple change makes it easier to run the primary functions of this
repo (train/detect/test) from within Python. An object which represents
`opt` can be constructed and fed to the `main` function of each of these
modules, rather than having to call the lower level functions directly,
or run the module as a script.
* Update export.py
Add CLI parsing update for more convenient module usage within Python.
Co-authored-by: Lewis Belcher <lb@desupervised.io>
2021-06-19 12:06:59 +02:00
fa29125f18
`is_coco` list fix ( #3646 )
2021-06-16 22:56:16 +02:00
4695ca8314
Refactoring cleanup ( #3565 )
...
* Refactoring cleanup
* Update test.py
2021-06-09 22:50:27 +02:00
a9553c04a7
Refactor test.py arguments ( #3558 )
...
* remove opt from test()
* pass kwargs
* update comments
* revert accidental default change
* multiple --img options
* add comments
2021-06-09 21:36:10 +02:00
4ef9261870
Remove redundant speed/study `half` argument ( #3557 )
2021-06-09 16:30:01 +02:00
5948f20a3d
Update test.py profiling ( #3555 )
...
* Update test.py profiling
* half_precision to half
* inplace
2021-06-09 16:25:17 +02:00
63157d214d
Remove `is_coco` argument from `test()` ( #3553 )
2021-06-09 15:09:51 +02:00
958ab92dc1
Remove `opt` from `create_dataloader()`` ( #3552 )
2021-06-09 13:14:56 +02:00
ef0b5c9d29
On-demand `pycocotools` pip install ( #3547 )
2021-06-09 11:22:21 +02:00
c6b51f4189
Update FP16 `--half` argument for test.py and detect.py ( #3532 )
...
* Update FP16 `--half` argument for test.py and detect.py
* Update detect.py
2021-06-08 18:47:13 +02:00
f3c3d2ce5d
Merge `develop` branch into `master` ( #3518 )
...
* update ci-testing.yml (#3322 )
* update ci-testing.yml
* update greetings.yml
* bring back os matrix
* update ci-testing.yml (#3322 )
* update ci-testing.yml
* update greetings.yml
* bring back os matrix
* Enable direct `--weights URL` definition (#3373 )
* Enable direct `--weights URL` definition
@KalenMike this PR will enable direct --weights URL definition. Example use case:
```
python train.py --weights https://storage.googleapis.com/bucket/dir/model.pt
```
* cleanup
* bug fixes
* weights = attempt_download(weights)
* Update experimental.py
* Update hubconf.py
* return bug fix
* comment mirror
* min_bytes
* Update tutorial.ipynb (#3368 )
add Open in Kaggle badge
* `cv2.imread(img, -1)` for IMREAD_UNCHANGED (#3379 )
* Update datasets.py
* comment
Co-authored-by: Glenn Jocher <glenn.jocher@ultralytics.com>
* COCO evolution fix (#3388 )
* COCO evolution fix
* cleanup
* update print
* print fix
* Create `is_pip()` function (#3391 )
Returns `True` if file is part of pip package. Useful for contextual behavior modification.
```python
def is_pip():
# Is file in a pip package?
return 'site-packages' in Path(__file__).absolute().parts
```
* Revert "`cv2.imread(img, -1)` for IMREAD_UNCHANGED (#3379 )" (#3395 )
This reverts commit 21a9607e00#3422 )
* Update README.md
* Changing FLOPS to FLOPs.
Co-authored-by: BuildTools <unconfigured@null.spigotmc.org>
* Parse URL authentication (#3424 )
* Parse URL authentication
* urllib.parse.unquote()
* improved error handling
* improved error handling
* remove %3F
* update check_file()
* Add FLOPs title to table (#3453 )
* Suppress jit trace warning + graph once (#3454 )
* Suppress jit trace warning + graph once
Suppress harmless jit trace warning on TensorBoard add_graph call. Also fix multiple add_graph() calls bug, now only on batch 0.
* Update train.py
* Update MixUp augmentation `alpha=beta=32.0` (#3455 )
Per VOC empirical results https://github.com/ultralytics/yolov5/issues/3380#issuecomment-853001307 by @developer0hye
* Add `timeout()` class (#3460 )
* Add `timeout()` class
* rearrange order
* Faster HSV augmentation (#3462 )
remove datatype conversion process that can be skipped
* Add `check_git_status()` 5 second timeout (#3464 )
* Add check_git_status() 5 second timeout
This should prevent the SSH Git bug that we were discussing @KalenMike
* cleanup
* replace timeout with check_output built-in timeout
* Improved `check_requirements()` offline-handling (#3466 )
Improve robustness of `check_requirements()` function to offline environments (do not attempt pip installs when offline).
* Add `output_names` argument for ONNX export with dynamic axes (#3456 )
* Add output names & dynamic axes for onnx export
Add output_names and dynamic_axes names for all outputs in torch.onnx.export. The first four outputs of the model will have names output0, output1, output2, output3
* use first output only + cleanup
Co-authored-by: Samridha Shrestha <samridha.shrestha@g42.ai>
Co-authored-by: Glenn Jocher <glenn.jocher@ultralytics.com>
* Revert FP16 `test.py` and `detect.py` inference to FP32 default (#3423 )
* fixed inference bug ,while use half precision
* replace --use-half with --half
* replace space and PEP8 in detect.py
* PEP8 detect.py
* update --half help comment
* Update test.py
* revert space
Co-authored-by: Glenn Jocher <glenn.jocher@ultralytics.com>
* Add additional links/resources to stale.yml message (#3467 )
* Update stale.yml
* cleanup
* Update stale.yml
* reformat
* Update stale.yml HUB URL (#3468 )
* Stale `github.actor` bug fix (#3483 )
* Explicit `model.eval()` call `if opt.train=False` (#3475 )
* call model.eval() when opt.train is False
call model.eval() when opt.train is False
* single-line if statement
* cleanup
Co-authored-by: Glenn Jocher <glenn.jocher@ultralytics.com>
* check_requirements() exclude `opencv-python` (#3495 )
Fix for 3rd party or contrib versions of installed OpenCV as in https://github.com/ultralytics/yolov5/issues/3494 .
* Earlier `assert` for cpu and half option (#3508 )
* early assert for cpu and half option
early assert for cpu and half option
* Modified comment
Modified comment
* Update tutorial.ipynb (#3510 )
* Reduce test.py results spacing (#3511 )
* Update README.md (#3512 )
* Update README.md
Minor modifications
* 850 width
* Update greetings.yml
revert greeting change as PRs will now merge to master.
Co-authored-by: Piotr Skalski <SkalskiP@users.noreply.github.com>
Co-authored-by: SkalskiP <piotr.skalski92@gmail.com>
Co-authored-by: Peretz Cohen <pizzaz93@users.noreply.github.com>
Co-authored-by: tudoulei <34886368+tudoulei@users.noreply.github.com>
Co-authored-by: chocosaj <chocosaj@users.noreply.github.com>
Co-authored-by: BuildTools <unconfigured@null.spigotmc.org>
Co-authored-by: Yonghye Kwon <developer.0hye@gmail.com>
Co-authored-by: Sam_S <SamSamhuns@users.noreply.github.com>
Co-authored-by: Samridha Shrestha <samridha.shrestha@g42.ai>
Co-authored-by: edificewang <609552430@qq.com>
2021-06-08 10:22:10 +02:00
61ea23c3fe
Implement `@torch.no_grad()` decorator ( #3312 )
...
* `@torch.no_grad()` decorator
* Update detect.py
2021-05-24 13:23:09 +02:00
f2de1ad2aa
Comment fix ( #3058 )
...
Co-authored-by: kepler62f <>
2021-05-07 12:28:55 +02:00
a833ee2a46
Update check_requirements() exclude list ( #2974 )
2021-04-29 21:16:23 +02:00
3665c0f59b
test.py native --single-cls ( #2928 )
2021-04-25 20:05:16 +02:00
b40dd99167
Explicit opt function arguments ( #2817 )
...
* more explicit function arguments
* fix typo in detect.py
* revert import order
* revert import order
* remove default value
2021-04-22 18:17:30 +02:00
f7bc685c2c
Implement yaml.safe_load() ( #2876 )
...
* Implement yaml.safe_load()
* yaml.safe_dump()
2021-04-21 14:34:45 +02:00
c949fc86d1
Detection cropping+saving feature addition for detect.py and PyTorch Hub ( #2827 )
...
* Update detect.py
* Update detect.py
* Update greetings.yml
* Update cropping
* cleanup
* Update increment_path()
* Update common.py
* Update detect.py
* Update detect.py
* Update detect.py
* Update common.py
* cleanup
* Update detect.py
Co-authored-by: Glenn Jocher <glenn.jocher@ultralytics.com>
2021-04-20 23:51:08 +02:00
fd1679975b
add option to disable half precision in test.py ( #2507 )
...
Co-authored-by: Glenn Jocher <glenn.jocher@ultralytics.com>
2021-03-29 17:15:26 +02:00
8f6e447729
Fix Indentation in test.py ( #2614 )
...
* Fix Indentation in test.py
* CI fix
* Comply with PEP8: 80 characters per line
2021-03-26 20:47:11 +01:00
e8fc97aa38
Improved W&B integration ( #2125 )
...
* Init Commit
* new wandb integration
* Update
* Use data_dict in test
* Updates
* Update: scope of log_img
* Update: scope of log_img
* Update
* Update: Fix logging conditions
* Add tqdm bar, support for .txt dataset format
* Improve Result table Logger
* Init Commit
* new wandb integration
* Update
* Use data_dict in test
* Updates
* Update: scope of log_img
* Update: scope of log_img
* Update
* Update: Fix logging conditions
* Add tqdm bar, support for .txt dataset format
* Improve Result table Logger
* Add dataset creation in training script
* Change scope: self.wandb_run
* Add wandb-artifact:// natively
you can now use --resume with wandb run links
* Add suuport for logging dataset while training
* Cleanup
* Fix: Merge conflict
* Fix: CI tests
* Automatically use wandb config
* Fix: Resume
* Fix: CI
* Enhance: Using val_table
* More resume enhancement
* FIX : CI
* Add alias
* Get useful opt config data
* train.py cleanup
* Cleanup train.py
* more cleanup
* Cleanup| CI fix
* Reformat using PEP8
* FIX:CI
* rebase
* remove uneccesary changes
* remove uneccesary changes
* remove uneccesary changes
* remove unecessary chage from test.py
* FIX: resume from local checkpoint
* FIX:resume
* FIX:resume
* Reformat
* Performance improvement
* Fix local resume
* Fix local resume
* FIX:CI
* Fix: CI
* Imporve image logging
* (:(:Redo CI tests:):)
* Remember epochs when resuming
* Remember epochs when resuming
* Update DDP location
Potential fix for #2405
* PEP8 reformat
* 0.25 confidence threshold
* reset train.py plots syntax to previous
* reset epochs completed syntax to previous
* reset space to previous
* remove brackets
* reset comment to previous
* Update: is_coco check, remove unused code
* Remove redundant print statement
* Remove wandb imports
* remove dsviz logger from test.py
* Remove redundant change from test.py
* remove redundant changes from train.py
* reformat and improvements
* Fix typo
* Add tqdm tqdm progress when scanning files, naming improvements
Co-authored-by: Glenn Jocher <glenn.jocher@ultralytics.com>
2021-03-23 00:44:50 +01:00
f4197214aa
Update test.py --task train val study ( #2453 )
...
* Update test.py --task train val study
* update argparser --task
2021-03-12 22:08:42 -08:00
f01f3223d5
Integer printout ( #2450 )
...
* Integer printout
* test.py 'Labels'
* Update train.py
2021-03-12 13:35:44 -08:00
cd30d838eb
Update test.py ( #2319 )
2021-02-27 15:28:23 -08:00
71dd2768f2
Improved model+EMA checkpointing 2 ( #2295 )
2021-02-24 21:03:21 -08:00
ec1d8496ba
Improved model+EMA checkpointing ( #2292 )
...
* Enhanced model+EMA checkpointing
* update
* bug fix
* bug fix 2
* always save optimizer
* ema half
* remove model.float()
* model half
* carry ema/model in fp32
* rm model.float()
* both to float always
* cleanup
* cleanup
2021-02-24 18:26:46 -08:00
e27ca0d845
Update minimum stride to 32 ( #2266 )
2021-02-21 21:46:42 -08:00
c09964c27c
Update inference default to multi_label=False ( #2252 )
...
* Update inference default to multi_label=False
* bug fix
* Update plots.py
* Update plots.py
2021-02-19 15:39:09 -08:00
be9edffded
Update test.py --task speed and study ( #2099 )
...
* Add --speed benchmark
* test range 256 - 1536
* update
* update
* update
* update
2021-01-31 13:58:49 -08:00
f639e14e4d
Metric-Confidence plots feature addition ( #2057 )
...
* Metric-Confidence plots feature addition
* cleanup
* Metric-Confidence plots feature addition
* cleanup
* Update run-once lines
* cleanup
* save all 4 curves to wandb
2021-01-27 17:10:53 -08:00
2a835c79a9
Update run-once lines ( #2058 )
2021-01-27 16:01:24 -08:00
59c21c7bcb
W&B log epoch ( #1946 )
...
* W&B log epoch
* capitalize
* W&B log epoch
* capitalize
* Update train.py
New try using https://docs.wandb.ai/library/log#incremental-logging
* Update train.py
* Update test.py
* Update train.py
* Update plots.py
* Update train.py
* Update train.py
* label plot step -1
* update
* update
* update
* update
* update
* update
* Update train.py
* Update train.py
2021-01-26 21:16:01 -08:00
d68afedb32
Confusion matrix native image-space fix ( #2046 )
...
Make sure the labels and predictions are equally scaled on confusion_matrix.process_batch
2021-01-26 13:39:19 -08:00
046c37e465
verbose on final_epoch ( #1997 )
2021-01-20 18:27:38 -08:00
91c30e4eff
Update test.py with yaml.SafeLoader ( #1969 )
2021-01-18 10:46:46 -08:00
ca9babb8e6
Add ComputeLoss() class ( #1950 )
2021-01-15 13:50:24 -08:00
dd03b20ba5
colorstr() updates ( #1909 )
...
* W&B ImportError message fix
* colorstr() updates
* colorstr() updates
* colorstr() default to 'blue', 'bold'
* train: magenta
* train: blue
2021-01-12 10:33:15 -08:00
3e25f1e9e5
auto-verbose if nc <=20 ( #1869 )
2021-01-07 15:47:28 -08:00
e77c77f580
Add check_requirements() ( #1853 )
...
* Add check_requirements()
* add import
* parameterize filename
* add to detect, test
2021-01-06 16:35:40 -08:00
86f4247515
Hybrid auto-labelling support ( #1646 )
2020-12-08 18:15:39 -08:00
791dadb51c
Pycocotools best.pt after COCO train ( #1616 )
...
* Pycocotools best.pt after COCO train
* cleanup
2020-12-06 14:58:33 +01:00
b6ed1104a6
Daemon thread plotting ( #1561 )
...
* Daemon thread plotting
* remove process_batch
* plot after print
2020-11-30 16:44:14 +01:00
0f2057ed33
Targets scaling bug fix ( #1529 )
2020-11-26 18:33:28 +01:00
e9a0ae6f19
Cache bug fix ( #1513 )
...
* Caching bug fix #1508
* np.zeros((0,5)) x2
2020-11-25 20:33:14 +01:00
0a3ff71ae0
Confusion matrix ( #1474 )
...
* initial commit
* add plotting
* matrix to cpu
* bug fix
* update plot
* update plot
* update plot
* update plot
* update plot
* update plot
* update plot
* update plot
* update plot
* update plot
* update plot
* update plot
* cleanup
* cleanup
* cleanup
* cleanup
* cleanup
* cleanup
* cleanup
* cleanup
* cleanup
* cleanup
* cleanup
* cleanup
* cleanup
* seaborn pandas to requirements.txt
* seaborn pandas to requirements.txt
* update wandb plotting
* remove pandas
* if plots
* if plots
* if plots
* if plots
* if plots
* initial commit
* add plotting
* matrix to cpu
* bug fix
* update plot
* update plot
* update plot
* update plot
* update plot
* update plot
* update plot
* update plot
* update plot
* update plot
* update plot
* update plot
* cleanup
* cleanup
* cleanup
* cleanup
* cleanup
* cleanup
* cleanup
* cleanup
* cleanup
* cleanup
* cleanup
* cleanup
* cleanup
* seaborn pandas to requirements.txt
* seaborn pandas to requirements.txt
* update wandb plotting
* remove pandas
* if plots
* if plots
* if plots
* if plots
* if plots
* Cat apriori to autolabels
* cleanup
2020-11-23 15:27:14 +01:00
95fa65339f
Cat apriori to autolabels ( #1484 )
2020-11-23 13:38:47 +01:00
201bafc7cf
Sync train and test iou_thresh ( #1465 )
...
* Sync train and test iou_thresh
* Sync train and test iou_thresh
* weights names .lower()
* Notebook update
2020-11-21 12:38:35 +01:00
a70e554fc3
Remove redundant downloads mirror ( #1461 )
2020-11-20 13:10:56 +01:00
225845e781
Update test.py for IoU in native image-space ( #1439 )
...
* Update test.py for IoU in native image-space
* remove redundant
* gn to device
* remove output scale_coords
* --img-size correction
* update
* native-space labels
* pred to predn
* remove clip_coords()
2020-11-18 22:50:21 +01:00
Glenn Jocher
lb-desupervised
Mai Thanh Minh
kepler62f
fcakyon
Burhan
Benjamin Fineran
Ayush Chaurasia
ramonhollands
Abhiram V