Ross Wightman 4cd7fb88b2 clip gradients with update

2023-04-19 23:36:20 -07:00

..

__init__.py

Davit update formatting and fix grad checkpointing (#7)

2023-01-15 14:34:56 -08:00

agc.py

Initial AGC impl. Still testing.

2021-02-15 23:22:44 -08:00

checkpoint_saver.py

Fix #387 so that checkpoint saver works with max history of 1. Add checkpoint-hist arg to train.py.

2021-01-31 20:14:51 -08:00

clip_grad.py

…

cuda.py

clip gradients with update

2023-04-19 23:36:20 -07:00

decay_batch.py

Add bulk_runner script and updates to benchmark.py and validate.py for better error handling in bulk runs (used for benchmark and validation result runs). Improved batch size decay stepping on retry...

2022-07-18 18:04:54 -07:00

distributed.py

Refactor device handling in scripts, distributed init to be less 'cuda' centric. More device args passed through where needed.

2022-09-23 16:08:59 -07:00

jit.py

disable nvfuser for jit te/legacy modes (for PT 1.12+)

2022-07-13 10:34:34 -07:00

log.py

Reorg of utils into separate modules

2020-09-07 13:58:09 -07:00

metrics.py

…

misc.py

…

model_ema.py

Add separate set and update method to ModelEmaV2

2020-12-03 10:05:09 -08:00

model.py

Davit update formatting and fix grad checkpointing (#7)

2023-01-15 14:34:56 -08:00

onnx.py

Add onnx utils and export code, tweak padding and conv2d_same for better dynamic export with recent PyTorch

2023-04-11 17:03:57 -07:00

random.py

…

summary.py

…