Commit History

Broad improvements
ab12a97

Andrew DalPino commited on

Use Fineweb instead of Openwebtext
3325763

Andrew DalPino commited on

Add MFU estimation for Ampere GPUs
0cc4ecd

Andrew DalPino commited on

Compile before wrapping with FSDP
19b8dfb

Andrew DalPino commited on

Add FSDP
f28a628

Andrew DalPino commited on

Cleanup checkpointing history
160e81f

Andrew DalPino commited on

A little nicer
8c4359f

Andrew DalPino commited on

Merge branch 'main' of https://huggingface.co/andrewdalpino/LightGPT
ec4551f

Andrew DalPino commited on

Remove old license info
dc00b6b

Andrew DalPino commited on

Add metadata to README
c50fdd6
verified

andrewdalpino commited on

Merge branch 'main' of https://huggingface.co/andrewdalpino/LightGPT
305cc73

Andrew DalPino commited on

Initial commit
cac8fe7

Andrew DalPino commited on