Until more ops are fully supported this update will allow for seamless MPS inference (but slower MPS to CPU transfer before NMS, so slower NMS times).
Partially resolves https://github.com/ultralytics/yolov5/issues/9596
Signed-off-by: Glenn Jocher <glenn.jocher@ultralytics.com>
Signed-off-by: Glenn Jocher <glenn.jocher@ultralytics.com>
* Add segment line predictions
Signed-off-by: Glenn Jocher <glenn.jocher@ultralytics.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* Update
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* Update
Signed-off-by: Glenn Jocher <glenn.jocher@ultralytics.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
* Update Requirements with PyTorch CUDA
Added --extra-index-url https://download.pytorch.org/whl/cu116 URL to requirements file for ease of creating venv with CUDA enabled PyTorch. Otherwise CPU PyTorch is installed an unable to use local GPUs.
Signed-off-by: David A. Macey <davidamacey@gmail.com>
* Update requirements.txt
Signed-off-by: Glenn Jocher <glenn.jocher@ultralytics.com>
* Update requirements.txt
Signed-off-by: Glenn Jocher <glenn.jocher@ultralytics.com>
Signed-off-by: David A. Macey <davidamacey@gmail.com>
Signed-off-by: Glenn Jocher <glenn.jocher@ultralytics.com>
Co-authored-by: Glenn Jocher <glenn.jocher@ultralytics.com>
* Try to fix DDP mAP drop by setting generator's seed to RANK
* Fix default activation bug
* Update dataloaders.py
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* Update dataloaders.py
Co-authored-by: Glenn Jocher <glenn.jocher@ultralytics.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
* update coco128-seg comments
* Enables detect.py to use Triton for inference
Triton Inference Server is an open source inference serving software
that streamlines AI inferencing.
https://github.com/triton-inference-server/server
The user can now provide a "--triton-url" argument to detect.py to use
a local or remote Triton server for inference.
For e.g., http://localhost:8000 will use http over port 8000
and grpc://localhost:8001 will use grpc over port 8001.
Note, it is not necessary to specify a weights file to use Triton.
A Triton container can be created by first exporting the Yolov5 model
to a Triton supported runtime. Onnx, Torchscript, TensorRT are
supported by both Triton and the export.py script.
The exported model can then be containerized via the OctoML CLI.
See https://github.com/octoml/octo-cli#getting-started for a guide.
* added triton client to requirements
* fixed support for TFSavedModels in Triton
* reverted change
* Test CoreML update
Signed-off-by: Glenn Jocher <glenn.jocher@ultralytics.com>
* Update ci-testing.yml
Signed-off-by: Glenn Jocher <glenn.jocher@ultralytics.com>
* Use pathlib
Signed-off-by: Glenn Jocher <glenn.jocher@ultralytics.com>
* Refacto DetectMultiBackend to directly accept triton url as --weights http://...
Signed-off-by: Glenn Jocher <glenn.jocher@ultralytics.com>
* Deploy category
Signed-off-by: Glenn Jocher <glenn.jocher@ultralytics.com>
* Update detect.py
Signed-off-by: Glenn Jocher <glenn.jocher@ultralytics.com>
* Update common.py
Signed-off-by: Glenn Jocher <glenn.jocher@ultralytics.com>
* Update common.py
Signed-off-by: Glenn Jocher <glenn.jocher@ultralytics.com>
* Update predict.py
Signed-off-by: Glenn Jocher <glenn.jocher@ultralytics.com>
* Update predict.py
Signed-off-by: Glenn Jocher <glenn.jocher@ultralytics.com>
* Update predict.py
Signed-off-by: Glenn Jocher <glenn.jocher@ultralytics.com>
* Update triton.py
Signed-off-by: Glenn Jocher <glenn.jocher@ultralytics.com>
* Update triton.py
Signed-off-by: Glenn Jocher <glenn.jocher@ultralytics.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* Add printout and requirements check
* Cleanup
Signed-off-by: Glenn Jocher <glenn.jocher@ultralytics.com>
* triton fixes
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* fixed triton model query over grpc
* Update check_requirements('tritonclient[all]')
* group imports
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* Fix likely remote URL bug
* update comment
* Update is_url()
* Fix 2x download attempt on http://path/to/model.pt
Signed-off-by: Glenn Jocher <glenn.jocher@ultralytics.com>
Co-authored-by: glennjocher <glenn.jocher@ultralytics.com>
Co-authored-by: Gaz Iqbal <giqbal@octoml.ai>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
* import re
Signed-off-by: Glenn Jocher <glenn.jocher@ultralytics.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
Signed-off-by: Glenn Jocher <glenn.jocher@ultralytics.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
* Add `RandomResizedCrop(ratio)`
* Update ratio
* Update ratio
* Update ratio
* Update ratio
* Update ratio
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* Create augmentations.py
Signed-off-by: Glenn Jocher <glenn.jocher@ultralytics.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* Update augmentations.py
Signed-off-by: Glenn Jocher <glenn.jocher@ultralytics.com>
Signed-off-by: Glenn Jocher <glenn.jocher@ultralytics.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
* Segmentation `polygons2masks_overlap()` in `np.int32`
May resolve https://github.com/ultralytics/yolov5/issues/9461
WARNING: Masks should be uint8 for fastest speed, change needs profiling results to determine impact.
@AyushExel @Laughing-q
Signed-off-by: Glenn Jocher <glenn.jocher@ultralytics.com>
* Update dataloaders.py
Signed-off-by: Glenn Jocher <glenn.jocher@ultralytics.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
Signed-off-by: Glenn Jocher <glenn.jocher@ultralytics.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
* TensorFlow macOS AutoUpdate
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
* Standardize warnings
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Update ClassificationModel default training imgsz=224
To match classify/val.py and classify/predict.py
Helps https://github.com/ultralytics/yolov5/issues/9462
Signed-off-by: Glenn Jocher <glenn.jocher@ultralytics.com>
Signed-off-by: Glenn Jocher <glenn.jocher@ultralytics.com>
* Optimize imports
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* Reformat
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
* Detect() and Segment() fixes for CoreML and Paddle
Signed-off-by: Glenn Jocher <glenn.jocher@ultralytics.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
Signed-off-by: Glenn Jocher <glenn.jocher@ultralytics.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Glenn Jocher
dependabot[bot]
David A. Macey
Forever518
Gaz Iqbal
zombob
FeiGeChuanShu
曾逸夫（Zeng Yifu）
Dhruv Nair
mucunwuxian
Junjie Zhang