Mixed Precision Training
Introduction
@article{micikevicius2017mixed,
title={Mixed precision training},
author={Micikevicius, Paulius and Narang, Sharan and Alben, Jonah and Diamos, Gregory and Elsen, Erich and Garcia, David and Ginsburg, Boris and Houston, Michael and Kuchaiev, Oleksii and Venkatesh, Ganesh and others},
journal={arXiv preprint arXiv:1710.03740},
year={2017}
}
Results and models
| Model |
Params(M) |
Flops(G) |
Mem (GB) |
Top-1 (%) |
Top-5 (%) |
Config |
Download |
| ResNet-50 |
25.56 |
4.12 |
1.9 |
76.30 |
93.07 |
config |
model | log |
8b7d38b243