Fredo Guan 81ca323751

Davit update formatting and fix grad checkpointing (#7) ...

fixed head to gap->norm->fc as per convnext, along with option for norm->gap->fc
failed tests due to clip convnext models, davit tests passed

2023-01-15 14:34:56 -08:00

..

__init__.py

Davit update formatting and fix grad checkpointing (#7)

2023-01-15 14:34:56 -08:00

agc.py

…

checkpoint_saver.py

…

clip_grad.py

…

cuda.py

…

decay_batch.py

…

distributed.py

…

jit.py

…

log.py

…

metrics.py

…

misc.py

Davit update formatting and fix grad checkpointing (#7)

2023-01-15 14:34:56 -08:00

model_ema.py

…

model.py

Davit update formatting and fix grad checkpointing (#7)

2023-01-15 14:34:56 -08:00

random.py

…

summary.py

Scheduler update, add v2 factory method, support scheduling on updates instead of just epochs. Add LR to summary csv. Add lr_base scaling calculations to train script. Fix #1168

2022-10-07 10:43:04 -07:00