Ross Wightman
|
742c2d5247
|
Add Gather-Excite and Global Context attn modules. Refactor existing SE-like attn for consistency and refactor byob/byoanet for less redundancy.
|
2021-05-27 18:03:29 -07:00 |
|
Ross Wightman
|
9a3ae97311
|
Another set of byoanet models w/ ECA channel + SA + groups
|
2021-05-15 22:56:51 -07:00 |
|
Ross Wightman
|
165fb354b2
|
Add initial RedNet model / Involution layer impl for testing
|
2021-05-14 17:16:34 -07:00 |
|
Ross Wightman
|
3ba6b55cb2
|
More adjustments to ByoaNet models for further experiments.
|
2021-05-06 13:59:44 -07:00 |
|
Ross Wightman
|
0721559511
|
Improved (hopefully) init for SA/SA-like layers used in ByoaNets
|
2021-05-04 21:40:39 -07:00 |
|
Ross Wightman
|
9cc7dda6e5
|
Fixup byoanet configs to pass unit tests. Add swin_attn and swinnet26t model for testing.
|
2021-04-29 21:08:37 -07:00 |
|
Ross Wightman
|
e15c3886ba
|
Defaul lambda r=7. Define '26t' stage 4/5 256x256 variants for all of bot/halo/lambda nets for experiment. Add resnet50t for exp. Fix a few comments.
|
2021-04-29 10:58:49 -07:00 |
|
Ross Wightman
|
b3d7580df1
|
Update ByoaNet comments. Fix first Steam feat chs for ByobNet.
|
2021-04-12 12:11:35 -07:00 |
|
Ross Wightman
|
16f7aa9f54
|
Add default_cfg options for min_input_size / fixed_input_size, queries in model registry, and use for testing self-attn models
|
2021-04-12 11:54:22 -07:00 |
|
Ross Wightman
|
ce62f96d4d
|
ByoaNet with bottleneck transformer, lambda resnet, and halo net experiments
|
2021-04-12 09:38:02 -07:00 |