Commit Graph

1258 Commits (ed7aaf8d6dfe1d129c813972c19b9c288f0822c5)

Author SHA1 Message Date
Ross Wightman 39e92f0c0d mobilenet_edgetpu can use group_size override, more consistency in arg wrap/sadface w/ extra group_size arg 2024-08-22 11:44:02 -07:00
Ross Wightman b9f020a509 Allow group_size override for more efficientnet and mobilenetv3 based models 2024-08-21 16:51:38 -07:00
Ross Wightman 17923a66bb Add layer scale to hieradet 2024-08-21 11:23:39 -07:00
Ross Wightman 47e6958263 Add hierdet_small (non sam) model def 2024-08-21 11:05:54 -07:00
Ross Wightman 9fcbf39cdc Add remaining sbb vit betwixt/mediumd fine-tunes 2024-08-21 10:09:38 -07:00
Ross Wightman dc94cca0e5 Remaining Hiera sbb weights uploaded 2024-08-21 10:06:27 -07:00
Ross Wightman a256e50457 Move padding back in front of windowing 2024-08-17 11:22:53 -07:00
Ross Wightman 7d83749207 pool size test fixes 2024-08-17 08:27:13 -07:00
Ross Wightman 1bd92bca0e Add fused_attn flag to HieraDet attn block 2024-08-16 22:57:49 -07:00
Ross Wightman 691bb54443 Larger min input size needed 2024-08-16 17:09:19 -07:00
Ross Wightman de3a91a7a0 Add min_input_size of 128 for hieradet/sam2 2024-08-16 15:13:56 -07:00
Ross Wightman 0b05122cda Fixing hieradet (sam2) tests 2024-08-16 14:33:40 -07:00
Ross Wightman e035381171 Move padding out of windowing code for hieradet, fix torchscript typing issues, make pooling MaxPool unique instances across two modules 2024-08-16 13:36:33 -07:00
Ross Wightman 146c2fbe34 Add resnet50d and efficientnet_b1 ra4 (mnv4) hparam weights 2024-08-16 12:10:00 -07:00
Ross Wightman 962958723c More Hiera updates. Add forward_intermediates to hieradat/sam2 impl. Make both use same classifier module. Add coarse bool to intermediates. 2024-08-16 11:10:04 -07:00
Ross Wightman f2cfb4c677 Add WIP HieraDet impl (SAM2 backbone support) 2024-08-15 17:58:15 -07:00
Ross Wightman a50e53d41f Rename global pos embed for Hiera abswin, factor out commonly used vit weight init fns to layers. Add a channels-last ver of normmlp head. 2024-08-15 17:46:36 -07:00
Ross Wightman 2f3fed43b8 Fix hiera init with num_classes=0, fix weight tag names for sbb2 hiera/vit weights, add LayerScale/LayerScale2d to layers 2024-08-15 11:14:38 -07:00
Ross Wightman fee91fdd41 Update Hiera model for abswin, more stable weight init, layer-scale. ImageNet-12k weights for hiera_small_abswin, and two of the sbb vits with improved reg4 init. 2024-08-14 12:22:40 -07:00
Ross Wightman ac3470188b Add mobilenetv1_125 weights from ra4 / mnv4 hparam series 2024-08-14 08:47:02 -07:00
Ross Wightman a7b0bfc376 exception for unknown arg should have been TypeError 2024-08-12 16:09:36 -07:00
Ross Wightman bd0f79153b Add weights only flag to avoid warning, try to keep bwd compat. Default to True for remote load of pretrained weights, keep False for local checkpoing load to avoid training checkpoint breaks.. fix #2249 2024-08-12 11:41:41 -07:00
Ross Wightman bf781bc3c2
Merge pull request #2245 from dhkim0225/feature/rdnet
Feature: Add RDNet
2024-08-07 16:19:22 -07:00
Ross Wightman 49f6e1da96 Remove eval to avoid safety concerns 2024-08-07 14:54:13 -07:00
Ross Wightman 2d5c9bf60d
Merge pull request #2253 from brendanartley/hgnet-grad-checkpointing
Add gradient checkpointing to hgnets
2024-08-07 12:45:14 -07:00
Ross Wightman e9ef9424f0 Add a few missing __all__ entries. 2024-08-07 09:35:51 -07:00
brendanartley 232a459e36 Added gradient checkpointing to hgnet 2024-08-07 09:22:51 -07:00
dong-hyun ea33d6a74d bugfix pool_size 2024-08-03 09:50:20 +09:00
Ross Wightman 10344625be proj_drop wasn't being called in sam vit 2024-08-02 16:12:02 -07:00
dong-hyun 6fdc9d8243 update code for ci pass 2024-08-02 15:14:40 +09:00
dong-hyun 7a866b6521 update code for torchscript 2024-08-02 09:58:13 +09:00
dong-hyun 8248122f82 add rdnet 2024-08-01 14:54:29 +09:00
dong-hyun 025259024d add rdnet 2024-08-01 14:51:15 +09:00
dong-hyun 225f4f92b3 add rdnet 2024-08-01 14:49:21 +09:00
Ross Wightman 4a10302754 Add mobilenet_edgetpu_v2_m weights 2024-07-28 17:19:36 -07:00
Ross Wightman ab8cb070fc Add xavier_uniform init of MNVC hybrid attention modules. Small improvement in training stability. 2024-07-26 17:03:40 -07:00
Ross Wightman cec70b6779
Merge pull request #2225 from huggingface/small_things
Small things
2024-07-25 20:29:13 -07:00
Ross Wightman 61df3fde89 Wrong hybrid_medium in12k pool sizes 2024-07-25 15:39:21 -07:00
Ross Wightman 9aa2930760 Add latest mobilenetv4 and baseline updates for mobilenetv1 and efficientnet_b0 weights 2024-07-25 14:20:54 -07:00
Ross Wightman 7b6a406474 remove swin debug prints 2024-07-24 21:05:56 -07:00
Ross Wightman 4c531be479 set_input_size(), always_partition, strict_img_size, dynamic mask option for all swin models. More flexibility in resolution, window resizing. 2024-07-24 16:41:31 -07:00
Ross Wightman 8efdc38213 Fix #2242 add checks for out indices with intermediate getter mode 2024-07-23 08:19:09 -07:00
Ross Wightman d2240745d3 Fix issue where feature out_indices out of order after wrapping with FeatureGetterNet due to use of set() 2024-07-22 13:33:30 -07:00
Ross Wightman 2b3f1a4633 Make channels for classic resnet configurable 2024-07-22 10:47:40 -07:00
Ross Wightman 9b2b8014e8 Add weights for test models 2024-07-22 10:08:57 -07:00
Ross Wightman 1a05ed29a1 Add to 'abswin' hiera models for train trials 2024-07-19 11:05:31 -07:00
Ross Wightman 0cbf4fa586 _orig_mod still causing issues even though I thought it was fixed in pytorch, add unwrap / clean helpers 2024-07-19 11:03:45 -07:00
Feraidoon Mehri 4cca568bd8
eva.py: fixed bug in applying attention mask
The mask should be applied before the softmax.
2024-07-19 15:12:04 +03:30
Ross Wightman 3a8a965891 Implement absolute+window pos embed for hiera, resizable but needs new weights 2024-07-18 21:43:37 -07:00
Ross Wightman 392b78aee7 set_input_size initial impl for vit & swin v1. Move HybridEmbed to own location in timm/layers 2024-07-17 15:25:48 -07:00