Ross Wightman 9bcd65181b Add exponential moving average for model weights + few other additions and cleanup ...

* ModelEma class added to track an EMA set of weights for the model being trained
* EMA handling added to train, validation and clean_checkpoint scripts
* Add multi checkpoint or multi-model validation support to validate.py
* Add syncbn option (APEX) to train script for experimentation
* Cleanup interface of CheckpointSaver while adding ema functionality

2019-06-07 15:39:36 -07:00

..

__init__.py

Remove adabound optimizer, never got it working well on larger datasets

2019-05-14 18:35:43 -07:00

adam_tf.py

MobileNetV3 appears correct based on paper update, cleaned up comments and compacted last block def

2019-05-15 08:53:27 -07:00

nadam.py

Update a few comment, add some references

2019-04-12 23:16:49 -07:00

optim_factory.py

Remove adabound optimizer, never got it working well on larger datasets

2019-05-14 18:35:43 -07:00

rmsprop_tf.py

Add exponential moving average for model weights + few other additions and cleanup

2019-06-07 15:39:36 -07:00