Ross Wightman e748805be3 Add regex matching support to AttentionExtract. Add return_dict support to graph extractors and use returned output in AttentionExtractor

2024-05-22 14:33:39 -07:00

..

__init__.py

Add AttentionExtract helper module

2024-05-04 14:10:00 -07:00

agc.py

…

attention_extract.py

Add regex matching support to AttentionExtract. Add return_dict support to graph extractors and use returned output in AttentionExtractor

2024-05-22 14:33:39 -07:00

checkpoint_saver.py

Fix #387 so that checkpoint saver works with max history of 1. Add checkpoint-hist arg to train.py.

2021-01-31 20:14:51 -08:00

clip_grad.py

…

cuda.py

clip gradients with update

2023-04-19 23:36:20 -07:00

decay_batch.py

Add bulk_runner script and updates to benchmark.py and validate.py for better error handling in bulk runs (used for benchmark and validation result runs). Improved batch size decay stepping on retry...

2022-07-18 18:04:54 -07:00

distributed.py

Tweak dist_backend to use device_type (before possible :)

2024-05-15 08:49:25 -07:00

jit.py

…

log.py

…

metrics.py

…

misc.py

…

model_ema.py

Fix #2127 move to ema device

2024-04-10 21:29:09 -07:00

model.py

MobileOne and FastViT weights on HF hub, more code cleanup and tweaks, features_only working. Add reparam flag to validate and benchmark, support reparm of all models with fuse(), reparameterize() or switch_to_deploy() methods on modules

2023-08-23 22:50:37 -07:00

onnx.py

Add support for dynamo based onnx export

2024-03-13 12:05:26 -07:00

random.py

…

summary.py

Allow training w/o validation split set

2024-01-08 09:38:42 -08:00