mirrors/pytorch-image-models
1
0
Fork 0
mirror of https://github.com/huggingface/pytorch-image-models.git synced 2025-06-03 15:01:08 +08:00
Code Issues Projects Releases Wiki Activity

Re-enable mem-efficient/jit activations after torchscript tests

Browse Source
This commit is contained in:
Ross Wightman 2020-02-10 11:59:36 -08:00
parent f902bcd54c
commit 2a7d256fd5
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
timm/models/layers/activations.py
View File

@ -12,7 +12,7 @@ from torch import nn as nn
from torch.nn import functional as F from torch.nn import functional as F
_USE_MEM_EFFICIENT_ISH = False _USE_MEM_EFFICIENT_ISH = True
if _USE_MEM_EFFICIENT_ISH: if _USE_MEM_EFFICIENT_ISH:
# This version reduces memory overhead of Swish during training by # This version reduces memory overhead of Swish during training by
# recomputing torch.sigmoid(x) in backward instead of saving it. # recomputing torch.sigmoid(x) in backward instead of saving it.