Commit Graph

697 Commits (6853b07bbdaacaffaa23613399cdaf823621d688)
 

Author SHA1 Message Date
Ross Wightman da1b90e5c9 Update results csvs with latest run 2020-10-29 07:55:13 -07:00
Ross Wightman 736f209e7d Update vision transformers to be compatible with official code. Port official ViT weights from jax impl. 2020-10-26 18:42:11 -07:00
Ross Wightman 7613094fb5 Add ViT to sotabench 2020-10-22 16:07:22 -07:00
Ross Wightman 477a78ed81 Fix optimizer factory regressin for optimizers like sgd/momentum that don't have an eps arg 2020-10-22 15:59:47 -07:00
Ross Wightman 27a93e9de7 Improve test crop for ViT models. Small now 77.85, added base weights at 79.35 top-1. 2020-10-21 23:35:25 -07:00
Ross Wightman d4db9e7977 Add small vision transformer weights. 77.42 top-1. 2020-10-21 12:14:12 -07:00
Ross Wightman ccfb5751ab
Merge pull request #255 from mrT23/master
Adding ASL (asymmetric loss)
2020-10-16 20:26:33 -07:00
talrid 27fadaa922 asymmetric_loss 2020-10-16 17:12:28 +03:00
talrid 79e727e07a Merge branch 'master' of https://github.com/mrT23/pytorch-image-models 2020-10-16 16:55:14 +03:00
mrT23 8331fac688
Merge pull request #2 from rwightman/master
merge original
2020-10-16 16:55:00 +03:00
Ross Wightman 70ae7f0cc2
Merge pull request #250 from rwightman/vision_transformer
Vision Transformer
2020-10-13 15:29:37 -07:00
Ross Wightman be53107e8a Update README, ensure vit excluded from all tests (not ready) 2020-10-13 14:51:08 -07:00
Ross Wightman f31933cb37 Initial Vision Transformer impl w/ patch and hybrid variants. Refactor tuple helpers. 2020-10-13 13:33:44 -07:00
Ross Wightman 9305313291 Default to old checkpoint format for now, still want compatibility with older torch ver for released models 2020-10-13 12:58:04 -07:00
Ross Wightman a4d8fea61e Add model based wd skip support. Improve cross version compat of optimizer factory. Fix #247 2020-10-13 12:49:47 -07:00
Ross Wightman 80078c47bb Add Adafactor and Adahessian optimizers, cleanup optimizer arg passing, add gradient clipping support. 2020-10-09 17:24:43 -07:00
Ross Wightman fcb6258877 Add missing leaky_relu layer factory defn, update Apex/Native loss scaler interfaces to support unscaled grad clipping. Bump ver to 0.2.2 for pending release. 2020-10-02 16:19:39 -07:00
Ross Wightman 186075ef03
Merge pull request #244 from hollance/master
Bug fix: test_time_pool would be set to a non-False value
2020-10-02 15:53:48 -07:00
Matthijs Hollemans f04bdc8c8e don't forget this file 2020-10-02 23:23:44 +02:00
Matthijs Hollemans 8ffdc5910a test_time_pool would be set to a non-False value even if test-time pooling is not available 2020-10-02 22:56:15 +02:00
Ross Wightman 4be5b51e0a Missed moving some seresnet -> legacy in sotabench. Check sotabench cache. 2020-09-25 15:51:04 -07:00
Ross Wightman e8e2d9cabf Add DropPath (stochastic depth) to ReXNet and VoVNet. RegNet DropPath impl tweak and dedupe se args. 2020-09-24 18:20:36 -07:00
Ross Wightman e8ca45854c More models in sotabench, more control over sotabench run, dataset filename extraction consistency 2020-09-24 15:56:57 -07:00
Ross Wightman 9c406532bd Add EfficientNet-EdgeTPU-M (efficientnet_em) model trained natively in PyTorch. More sotabench fiddling. 2020-09-23 17:12:07 -07:00
Ross Wightman 3681c5c4dd Another sotabench.py debug iter 2020-09-18 23:46:46 -07:00
Ross Wightman 08029852d9 Sotabench debugging 2020-09-18 22:14:51 -07:00
Ross Wightman c40384f5bd Add ResNet weights. 80.5 (top-1) ResNet-50-D, 77.1 ResNet-34-D, 72.7 ResNet-18-D. 2020-09-18 12:05:37 -07:00
Ross Wightman e39bf6ef59
Merge pull request #237 from rwightman/utils_cleanup
Utils refactor, more cutmix modes / change mode arg
2020-09-11 13:29:18 -07:00
Ross Wightman 47a7b3b5b1 More flexible mixup mode, add 'half' mode. 2020-09-07 20:03:06 -07:00
Ross Wightman 532e3b417d Reorg of utils into separate modules 2020-09-07 13:58:09 -07:00
Ross Wightman 9ce42d5c5a
Update README.md 2020-09-03 10:48:25 -07:00
Ross Wightman 0729dbe865
Update README.md 2020-09-03 10:48:11 -07:00
Ross Wightman 33f8a1bf36 Updated README, add wide_resnet50_2 and seresnext50_32x4d weights 2020-09-03 10:45:17 -07:00
Ross Wightman 5247eb37a7
Merge pull request #233 from rwightman/torchamp
Native Torch AMP and channels_last support for train.py and validate.py
2020-09-02 17:42:41 -07:00
Ross Wightman 751b0bba98 Add global_pool (--gp) arg changes to allow passing 'fast' easily for train/validate to avoid channels_last issue with AdaptiveAvgPool 2020-09-02 16:13:47 -07:00
Ross Wightman 9c297ec67d Cleanup Apex vs native AMP scaler state save/load. Cleanup CheckpointSaver a bit. 2020-09-02 15:12:59 -07:00
Ross Wightman 80c9d9cc72 Add 'fast' global pool option, remove redundant SEModule from tresnet, normal one is now 'fast' 2020-09-02 09:11:48 -07:00
Ross Wightman 90a01f47d1 hrnet features_only pretrained weight loading issue. Fix #232. 2020-09-01 17:37:55 -07:00
Ross Wightman 110a7c4982 AdaptiveAvgPool2d -> mean((2,3)) for all SE/attn layers to avoid NaN with AMP + channels_last layout. See https://github.com/pytorch/pytorch/issues/43992 2020-09-01 16:05:32 -07:00
Ross Wightman c2cd1a332e Improve torch amp support and add channels_last support for train/validate scripts 2020-08-31 17:58:16 -07:00
Ross Wightman 1d34a0a851 Merge branch 'master' of https://github.com/tgisaturday/pytorch-image-models into torchamp 2020-08-30 18:16:47 -07:00
Ross Wightman 6d158adfe9
Update README.md 2020-08-26 15:15:51 -07:00
datamining99 5f563ca4df fix save_checkpoint bug with native amp 2020-08-22 11:31:50 +09:00
datamining99 d98967ed5d add support for native torch AMP in torch 1.6 2020-08-22 09:44:23 +09:00
Ross Wightman 470220b1f4 Fix MobileNetV3 crash with global_pool='', output consistent with other models but not equivalent due to efficient head. 2020-08-18 14:11:30 -07:00
Ross Wightman fc8b8afb6f Fix a silly bug in Sample version of EvoNorm missing x* part of swish, update EvoNormBatch to accumulated unbiased variance. 2020-08-13 18:25:01 -07:00
Ross Wightman fa26f6c1cf
Update README.md 2020-08-12 23:26:59 -07:00
Ross Wightman f614df7921 Bump version to 0.2.1 and update README 2020-08-12 18:05:07 -07:00
Ross Wightman b423bc8362
Merge pull request #218 from rwightman/cutmix
CutMix + MixUp overhaul
2020-08-12 17:17:41 -07:00
Ross Wightman 8c9814e3f5 Final cleanup of mixup/cutmix. Element/batch modes working with both collate (prefetcher active) and without prefetcher. 2020-08-12 17:01:32 -07:00