LKJacky 595849b912
refine sparse gpt, support multiple gpus with fsdp (#520)
* add mmrazor large

* update readme

* add fsdp for opt

* update

* update

* rename

* update args

* support fsdp

* refine

* refine

* refine

* refine

* fix out of memorry bug

---------

Co-authored-by: liukai <your_email@abc.example>
Co-authored-by: Your Name <you@example.com>
2023-04-23 17:03:01 +08:00
..