1667 Commits

Author SHA1 Message Date
Ross Wightman
f225ae8e59 Update README with model results and attribution. Make scheduler factory bit more robust to arg differences, add noise to plateau lr and fix min/max. 2020-06-12 13:33:12 -07:00
Ross Wightman
d1b5dddad1
Merge pull request #155 from rwightman/densenet_update_and_more
DenseNet updates, EvoNorms,  VovNet, activation factory and more. Includes PR #142
2020-06-11 17:01:19 -07:00
Ross Wightman
39f27c1add Almost ready to merge, vovnet typo, version bump, readme addition 2020-06-11 15:41:58 -07:00
Ross Wightman
151679c2f1 Add custom grad tests, fix cut & paste error with hard_mish ME, add a few more pytorch act fns to factory 2020-06-11 14:49:23 -07:00
Ross Wightman
6c7932fe75 Update sotabench.py, tweak VovNet cfg 2020-06-11 14:34:25 -07:00
Ross Wightman
d3ee3de96a Update validation script first batch prime and clear cuda cache between multi-model runs 2020-06-11 13:34:21 -07:00
Ross Wightman
0aca08384f Update regnet cfg keys to match model names so registry works properly 2020-06-09 14:37:45 -07:00
Ross Wightman
b41b8d0108 Update results csv files 2020-06-09 14:36:24 -07:00
Antoine Broyelle
78fa0772cc Leverage python hierachical logger
with this update one can tune the kind of logs generated by timm but
training and inference traces are unchanged
2020-06-09 18:28:48 +01:00
Ross Wightman
13c0a6290e Add ESE-VovNet39 weights, 79.32 top-1 2020-06-06 22:50:21 -07:00
Ross Wightman
4ddde1d3a4 Fix two regressions 2020-06-05 11:04:51 -07:00
Ross Wightman
a7e8cadd15 Remove pointless densenet configs, add an iabn version of 264 as it makes more sense to try someday... 2020-06-03 17:13:52 -07:00
Ross Wightman
e78daf586a better densenet121 and densenetblur121d weights 2020-06-03 13:30:03 -07:00
Ross Wightman
7be299504f Add missing feature_info() on MobileNetV3, make hook feature output order/type consistent with bottleneck (list, decreasing fmap size) 2020-06-03 00:00:37 -07:00
Ross Wightman
88129b2569 Add set_layer_config contextmgr to adjust all layer configs at once, use in create_module with new args. Remove a few old warning causing constant annotations for jit. 2020-06-02 21:06:10 -07:00
Ross Wightman
f28170df3f Fix an an untested change, remove a debug print 2020-06-01 17:26:42 -07:00
Ross Wightman
eb7653614f Monster commit, activation refactor, VoVNet, norm_act improvements, more
* refactor activations into basic PyTorch, jit scripted, and memory efficient custom auto
* implement hard-mish, better grad for hard-swish
* add initial VovNet V1/V2 impl, fix #151
* VovNet and DenseNet first models to use NormAct layers (support BatchNormAct2d, EvoNorm, InplaceIABN)
* Wrap IABN for any models that use it
* make more models torchscript compatible (DPN, PNasNet, Res2Net, SelecSLS) and add tests
2020-06-01 17:16:52 -07:00
Ross Wightman
ff94ffce61 Merge branch 'master' into densenet_update_and_more 2020-05-26 00:02:57 -07:00
Ross Wightman
5966654052 Update requirements so PyTorch 1.4 is min, add separate sotabench reqs to force 1.4 and prevent error with 1.5 2020-05-24 13:28:03 -07:00
Ross Wightman
0ea53cecc3 Merge branch 'master' into densenet_update_and_more 2020-05-22 16:18:10 -07:00
Ross Wightman
6441e9cc1b Fix memory_efficient mode for DenseNets. Add AntiAliasing (Blur) support for DenseNets and create one test model. Add lr cycle/mul params to train args. 2020-05-22 16:16:45 -07:00
Ross Wightman
d79ac48626 Update sotabench.py 2020-05-22 14:42:43 -07:00
Ross Wightman
e881383b4e
Merge pull request #154 from rwightman/tests_bugfixes
Add backward and default_cfg tests and fix a few issues found. Fix #153
2020-05-21 19:44:12 -07:00
Ross Wightman
4d13db538f Add x48d ResNext101s to test exclude for ubuntu 2020-05-21 19:13:41 -07:00
Ross Wightman
4212cd3b9f Another attempt at getting Ubuntu test runner to work 2020-05-21 18:55:10 -07:00
Ross Wightman
20329f2630 Bring down test resolutions to see if we can at least do a fwd on the L2 models 2020-05-21 16:49:46 -07:00
Ross Wightman
3873ea710e Minor test change 2020-05-21 15:51:47 -07:00
Ross Wightman
afb6bd0669 Add backward and default_cfg tests and fix a few issues found. Fix #153 2020-05-21 15:30:58 -07:00
Ross Wightman
ea2e59ca36
Merge pull request #150 from rwightman/regnet
Add RegNet models and weights
2020-05-18 00:26:40 -07:00
Ross Wightman
50658b9a67 Add RegNet models and weights 2020-05-18 00:08:52 -07:00
Ross Wightman
7df83258c9 Merge branch 'master' into densenet_update_and_more 2020-05-13 23:34:44 -07:00
Ross Wightman
dab9935b36
Merge pull request #148 from rwightman/drop_block_improve
Improve dropblock impl, add fast variant, better AMP speed, inplace…
v0.1-regnet
2020-05-13 16:30:34 -07:00
Ross Wightman
1904ed8fec Improve dropblock impl, add fast variant, and better AMP speed, inplace, batchwise... few ResNeSt cleanups 2020-05-13 15:17:08 -07:00
Ross Wightman
63addb741f
Merge pull request #146 from rwightman/inceptionv3_fix
Remove annoying torchvision InceptionV3 dependency on scipy and insanely slow tru…
2020-05-12 22:03:37 -07:00
Ross Wightman
17270c69b9 Remove annoying InceptionV3 dependency on scipy and insanely slow trunc_norm init. Bring InceptionV3 code into this codebase and use upcoming torch trunch_norm_ init. 2020-05-12 21:59:34 -07:00
Ross Wightman
c4ca016656
Merge pull request #145 from rwightman/resnest
ResNeSt
2020-05-12 13:38:29 -07:00
Ross Wightman
208e7912f7 Missed one of the abalation model entrypoints, update README 2020-05-12 13:36:31 -07:00
Ross Wightman
5bd1ad13e7 Refactor test indent 2020-05-12 13:07:46 -07:00
Ross Wightman
9cc289f18c Exclude EfficientNet-L2 models from test 2020-05-12 13:07:03 -07:00
Ross Wightman
2f884a0ce5 Add resnest14, resnest26, and two of the abalation grouped resnest50 models 2020-05-12 12:21:52 -07:00
Ross Wightman
f4cdc2ac31 Add ResNeSt models 2020-05-11 23:27:09 -07:00
Ross Wightman
780860d140 Add norm_act factory method, move JIT of norm layers to factory 2020-05-09 22:09:21 -07:00
Ross Wightman
14edacdf9a DenseNet converted to support ABN (norm + act) modules. Experimenting with EvoNorm, IABN 2020-05-09 18:26:41 -07:00
Ross Wightman
e545bb9401
Update test_inference.py
Not six min
2020-05-07 10:15:49 -07:00
Ross Wightman
305a2db705
Update test_inference.py
Make the timeout 5-min for now, see if we can get a pass...
2020-05-07 10:14:24 -07:00
Ross Wightman
022ed001f3 Update DenseNet to latest in Torchvision (torchscript compat, checkpointing, proper init). Start adding ehanced configurability, stem options... 2020-05-07 09:57:48 -07:00
Ross Wightman
14e01b878c
Merge pull request #143 from michalwols/master
Setup Github Action to instantiate and run a forward pass with each registered model.
2020-05-07 09:47:13 -07:00
michal
8c77f14cae Install cpu version of torch on ubuntu 2020-05-07 01:09:16 -04:00
michal
69d725c9fe Basic forward pass test for all registered models 2020-05-07 00:20:58 -04:00
michal
8da43e0617 Install extra dependencies required by some models and log test durations 2020-05-07 00:20:34 -04:00