Commit History

Make it possible to specify multiple config files (#54)
82ab593
unverified

par-meta commited on

Fix multiprocessing dataloader checkpointing and use it in the train script (#50)
8c61ab5
unverified

par-meta commited on

make sure max_encoder_seq_length matches (#55)
48e4ad0
unverified

Srinivasan Iyer sviyer commited on

Add bpb and n_bytes to metric logging (#41)
fe45f69
unverified

par-meta commited on

Update checkpointing to use fsspec (#39)
afedb16
unverified

par-meta commited on

Add rope fp32 (#43)
739dc71
unverified

Srinivasan Iyer sviyer commited on

Fix distributed all reduce grad norm (#40)
c79b1fd
unverified

par-meta commited on

This includes fixes that make checkpointing and reloading work correctly. (#35)
7044771
unverified

par-meta commited on

Initial codes and scripts for training entropy model (#34)
7622d28
unverified

par-meta commited on

Changes for training entropy model and correcting attention in local models (#25)
6ffeb66
unverified

par-meta commited on

Initial commit
bcc039b

par-meta commited on