mirrors
/
deit
mirror of https://github.com/facebookresearch/deit
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
46 Commits
2 Branches
0 Tags
9.1 MiB
Commit Graph

46 Commits (6fa7ef60b4144b1e78f2cdb05598dce950e16ba6)
 

Author SHA1 Message Date
Hugo Touvron 6fa7ef60b4
Update resmlp_models.py 2021-06-10 17:59:43 +02:00
Hugo Touvron 37cf44c581
Update README.md 2021-06-10 17:58:27 +02:00
Hugo Touvron bfe21d2671
Add files via upload 2021-06-10 17:57:55 +02:00
Hugo Touvron 5b9e31db23
add resmlp 2021-06-10 17:57:44 +02:00
Hugo Touvron 094e79047a
add resmlp 2021-06-10 17:57:03 +02:00
Hugo Touvron cb29b5efd5
Add XXS models 2021-04-14 09:07:53 +02:00
Hugo Touvron 542e05e021
Update README_cait.md 2021-04-12 08:03:12 +02:00
Hugo Touvron 0176669156
remove unused args 2021-04-12 07:52:27 +02:00
Hugo Touvron bd59da1f5f
Update README.md 2021-04-09 16:46:40 +02:00
Hugo Touvron 4fcfe17ec3
add cait models and README 2021-04-09 16:45:17 +02:00
Hugo Touvron 7e0acbca7b
add cait fig 2021-04-09 16:39:57 +02:00
Francisco Massa ab5715372d
Add deit_base_distilled_patch16_384 (#55) 2021-01-18 12:19:47 +01:00
Francisco Massa 84f7cf316f
Add Colab for inference (#54) 2021-01-18 11:37:44 +01:00
rv 23c7d85da9
Update README.md 2021-01-18 10:52:28 +01:00
Francisco Massa 277659c937
Add distilled and finetuned models to MODEL_ZOO (#50) 
* Add results to README

* Add new model URLs

* Fill table with new models

* Use details in README

* Add URLs in the command-lines

* Add Training commands

* Bugfix

* Add models to hubconf

* Fix models
 2021-01-18 10:43:54 +01:00
Matthijs Douze 0e32bfec3f
Merge pull request #53 from fmassa/update-figure 
Update figure with newer models
 2021-01-18 10:37:53 +01:00
Francisco Massa 7771d70fd8 Update figure with new models 2021-01-18 10:19:35 +01:00
Francisco Massa 1f961b060a
Fix no-weight-decay in optimizer (#52) 2021-01-16 11:53:29 +01:00
Francisco Massa ac2b171ba0
Add copyright headers to losses.py (#51) 2021-01-15 12:06:11 +01:00
Francisco Massa adc7f1e849
Add loss_scaler to checkpoints (#49) 
Ensure bit-wise reproducibility when rescheduling jobs
 2021-01-15 10:52:41 +01:00
Francisco Massa a8e90967a3
Add option to finetune on larger resolution (#43) 
* Add option for finetuning a model

* Fixes

* Keep model in eval mode during finetuning

* Only skip head weights if size mismatch

* Remove finetune-epochs

Might not be needed

* Raise error if distillation + finetune are enabled
 2021-01-15 10:13:52 +01:00
Francisco Massa d9932c08b5 Update .gitignore 2021-01-13 15:58:31 -08:00
Francisco Massa 726f061615 Fix lint 2021-01-13 05:45:38 -08:00
Francisco Massa 8eae3269da
Add Knowledge-Distillation (#42) 
* Add knowledge distillation

* Bugfix

* Bugfix

* Make names more readable and use single torch.cat call

* Remove criterion.train() in engine

The teacher should stay in eval mode

* Change default argument for teacher-model

* Return the average of classifiers during inference

* Cleanup unused code

* Add docstring for DistillationLoss

* Remove warnings from newer PyTorch

Also uses more stable variant, instead of using softmax + log, use directly log_softmax
 2021-01-13 14:19:23 +01:00
Francisco Massa 30eb3186da
Add --output_dir to README (#36) 
This will make it clearer to users that they need to specify it if running without run_with_submitit, so that the results can be saved
 2021-01-11 14:23:46 +01:00
Changlin Li b06fcba6bf
Support parallelized evaluation (#24) 
* support parallelized evaluation

* remove shuffle arg of loader val, add sampler val in non-dist branch

* replace timm eval sampler with torch sampler

* add logger synchronizing to support parallelized evaluation

* add command line argument dist-eval and warning
 2021-01-08 11:05:39 +01:00
Matthijs Douze 38fcfbd863
Merge pull request #27 from fmassa/license-change 
Change LICENSE to Apache 2.0
 2021-01-08 11:02:40 +01:00
Francisco Massa 0c4b8f60bd Change LICENSE to Apache 2.0 2021-01-08 10:51:58 +01:00
Francisco Massa dcd888df20
Update default data-path (#25) 
Points to the new valid location
 2021-01-07 22:18:54 +01:00
Zhiyuan Chen 0282d2a175
Remove drop block args (#23) 
timm's Vision Transformer does not support drop block
 2021-01-07 17:28:41 +01:00
sanjaydatasciencedojo 4e91d2588f
Remove unused libraries (#9) 2020-12-27 21:43:54 +01:00
Hugo Touvron 93ec3bc31e
Update README.md 2020-12-26 15:39:09 +01:00
rv f277626fd3
Update README.md 2020-12-24 17:30:54 -04:00
rv a853fc091b
Update README.md 2020-12-24 17:29:59 -04:00
rv 1010d7ff0b
Update README.md 2020-12-24 14:03:56 -04:00
rv 510f492b42
Update README.md 2020-12-24 14:02:31 -04:00
rv 2aefd8fc86
Update README.md 2020-12-23 22:20:46 -04:00
rv 347345390b
Update README.md 2020-12-23 22:01:24 -04:00
Francisco Massa 0ce0ad3c6f Use main branch instead of master for torchhub 2020-12-23 14:12:50 -08:00
rv d4527cf9a1
Update README.md 2020-12-23 17:52:45 -04:00
rv bca0e06708
Update README.md 2020-12-23 17:43:32 -04:00
rv 67bf427de7
Update README.md 2020-12-23 17:43:15 -04:00
rv 6eacc0e792
Update README.md 2020-12-23 17:42:14 -04:00
rv 72f0506b8b
Update README.md 2020-12-23 17:41:57 -04:00
rv b110ec28fd
Update README.md 2020-12-23 17:41:21 -04:00
Francisco Massa 1d38fa4c37 Initial commit 2020-12-23 10:47:58 -08:00