Commit Graph

9 Commits (main)

Author SHA1 Message Date
Byeongho Heo 0db467b09c cosub bugfix 2023-08-11 19:28:19 +09:00
Hugo Touvron 732fc6378a
add cosub 2023-05-22 11:23:40 +02:00
Hugo Touvron 4da66916c7
Add files via upload 2022-05-08 20:06:44 +02:00
Francisco Massa a8e90967a3
Add option to finetune on larger resolution (#43)
* Add option for finetuning a model

* Fixes

* Keep model in eval mode during finetuning

* Only skip head weights if size mismatch

* Remove finetune-epochs

Might not be needed

* Raise error if distillation + finetune are enabled
2021-01-15 10:13:52 +01:00
Francisco Massa 8eae3269da
Add Knowledge-Distillation (#42)
* Add knowledge distillation

* Bugfix

* Bugfix

* Make names more readable and use single torch.cat call

* Remove criterion.train() in engine

The teacher should stay in eval mode

* Change default argument for teacher-model

* Return the average of classifiers during inference

* Cleanup unused code

* Add docstring for DistillationLoss

* Remove warnings from newer PyTorch

Also uses more stable variant, instead of using softmax + log, use directly log_softmax
2021-01-13 14:19:23 +01:00
Changlin Li b06fcba6bf
Support parallelized evaluation (#24)
* support parallelized evaluation

* remove shuffle arg of loader val, add sampler val in non-dist branch

* replace timm eval sampler with torch sampler

* add logger synchronizing to support parallelized evaluation

* add command line argument dist-eval and warning
2021-01-08 11:05:39 +01:00
Francisco Massa 0c4b8f60bd Change LICENSE to Apache 2.0 2021-01-08 10:51:58 +01:00
sanjaydatasciencedojo 4e91d2588f
Remove unused libraries (#9) 2020-12-27 21:43:54 +01:00
Francisco Massa 1d38fa4c37 Initial commit 2020-12-23 10:47:58 -08:00