Glenn Jocher
|
264d860f8d
|
ACON activation function (#2893)
* ACON Activation Function
## 🚀 Feature
There is a new activation function [ACON (CVPR 2021)](https://arxiv.org/pdf/2009.04759.pdf) that unifies ReLU and Swish.
ACON is simple but very effective, code is here: https://github.com/nmaac/acon/blob/main/acon.py#L19

The improvements are very significant:

## Alternatives
It also has an enhanced version meta-ACON that uses a small network to learn beta explicitly, which may influence the speed a bit.
## Additional context
[Code](https://github.com/nmaac/acon) and [paper](https://arxiv.org/pdf/2009.04759.pdf).
* Update activations.py
|
2021-04-22 17:26:05 +02:00 |
Glenn Jocher
|
fea9c9b80c
|
nn.SiLU() citation correction (#1713)
|
2021-01-06 20:58:41 -08:00 |
Glenn Jocher
|
6bd5e8bca7
|
nn.SiLU() export support (#1713)
|
2020-12-16 17:55:57 -08:00 |
Glenn Jocher
|
94a7f55c4e
|
FReLU bias=False bug fix (#1666)
|
2020-12-10 13:06:15 -08:00 |
Glenn Jocher
|
fe341fa44d
|
Utils reorganization (#1392)
* Utils reorganization
* Add new utils files
* cleanup
* simplify
* reduce datasets.py
* remove evolve.sh
* loadWebcam cleanup
|
2020-11-14 11:50:32 +01:00 |
Glenn Jocher
|
4d7f222f73
|
Update export.py with v3.0 Hardswish() support
|
2020-08-24 21:47:49 -07:00 |
Glenn Jocher
|
71209a6099
|
exportable Hardswish() implementation
|
2020-08-22 16:59:31 -07:00 |
Glenn Jocher
|
916d4aad9a
|
v3.0 Release (#725)
* initial commit
* remove yolov3-spp from test.py study
* update study --img range
* update mAP
* cleanup and speed updates
* update README plot
|
2020-08-13 14:25:05 -07:00 |
Glenn Jocher
|
f346da9f2b
|
update activations.py
|
2020-08-03 17:18:31 -07:00 |
Glenn Jocher
|
c8892672a7
|
Funnel ReLU (FReLU) @staticmethod bug fix (#556)
Signed-off-by: Glenn Jocher <glenn.jocher@ultralytics.com>
|
2020-07-30 17:38:15 -07:00 |
Glenn Jocher
|
131782a2aa
|
Funnel ReLU (FReLU) (#556)
Signed-off-by: Glenn Jocher <glenn.jocher@ultralytics.com>
|
2020-07-30 17:35:34 -07:00 |
AlexWang1900
|
4b074d9d9d
|
Funnel ReLU (FReLU) (#556)
* fix #541 #542
* Update train.py
* Add Frelu
* Update activations.py
PEP8 and format updates for commonality with models.common.Conv()
* Update activations.py
Update case
* Update activations.py
Co-authored-by: Glenn Jocher <glenn.jocher@ultralytics.com>
|
2020-07-30 17:25:49 -07:00 |
Glenn Jocher
|
c5966abba8
|
glob search bug fix #77
|
2020-06-15 12:08:57 -07:00 |
Lornatang
|
54795a4f0a
|
fix problem
|
2020-06-15 16:11:06 +08:00 |
Glenn Jocher
|
1e84a23f38
|
initial commit
|
2020-05-29 17:04:54 -07:00 |