Ross Wightman f31933cb37 Initial Vision Transformer impl w/ patch and hybrid variants. Refactor tuple helpers.

2020-10-13 13:33:44 -07:00

..

data

More models in sotabench, more control over sotabench run, dataset filename extraction consistency

2020-09-24 15:56:57 -07:00

loss

Fix some attributions, add copyrights to some file docstrings

2020-07-27 13:44:56 -07:00

models

Initial Vision Transformer impl w/ patch and hybrid variants. Refactor tuple helpers.

2020-10-13 13:33:44 -07:00

optim

Add model based wd skip support. Improve cross version compat of optimizer factory. Fix #247

2020-10-13 12:49:47 -07:00

scheduler

Merge branch 'logger' into features. Change 'logger' to '_logger'.

2020-07-27 18:00:46 -07:00

utils

Add Adafactor and Adahessian optimizers, cleanup optimizer arg passing, add gradient clipping support.

2020-10-09 17:24:43 -07:00

__init__.py

Monster commit, activation refactor, VoVNet, norm_act improvements, more

2020-06-01 17:16:52 -07:00

version.py

Add missing leaky_relu layer factory defn, update Apex/Native loss scaler interfaces to support unscaled grad clipping. Bump ver to 0.2.2 for pending release.

2020-10-02 16:19:39 -07:00