Ross Wightman d0b45c9b4d Make safetensor import option for now. Improve avg/clean checkpoints ext handling a bit (more consistent).

2023-02-18 16:06:42 -08:00

..

data

Improve support for custom dataset label name/description through HF hub export, via pretrained_cfg

2023-02-08 08:29:20 -08:00

layers

Torchscript fixes/hacks for rms_norm, refactor ParallelScalingBlock with manual combination of input projections, closer paper match

2023-02-16 16:57:42 -08:00

loss

…

models

Make safetensor import option for now. Improve avg/clean checkpoints ext handling a bit (more consistent).

2023-02-18 16:06:42 -08:00

optim

Add multi-tensor (foreach) version of Lion in style of upcoming PyTorch 2.0 optimizers

2023-02-16 15:48:00 -08:00

scheduler

…

utils

Davit update formatting and fix grad checkpointing (#7)

2023-01-15 14:34:56 -08:00

__init__.py

…

version.py

Version 0.8.12dev0

2023-02-16 16:27:29 -08:00