mmpretrain/configs/deit/deit-small-distilled_pt-4xb256_in1k.py

_base_ = './deit-small_pt-4xb256_in1k.py'

# model settings
model = dict(
    backbone=dict(type='DistilledVisionTransformer', arch='deit-small'),
    head=dict(type='DeiTClsHead', in_channels=384),
)
[Feature] Add DeiT backbone and checkpoints. (#576) * Support DeiT backbone. * Use hook to automatically resize pos embed * Update ViT training setting * Add deit configs and update docs * Fix vit arch assertion * Remove useless init function * Add unit tests. * Fix resize_pos_embed for DeiT * Improve according to comments. 2021-12-15 22:44:57 +08:00			`_base_ = './deit-small_pt-4xb256_in1k.py'`

			`# model settings`
			`model = dict(`
			`backbone=dict(type='DistilledVisionTransformer', arch='deit-small'),`
			`head=dict(type='DeiTClsHead', in_channels=384),`
			`)`