infini-gram / constants.py

Commit History

Remove Dolma 1.6
0067690

liujch1998 commited on

Sync changes
8c4a00c

liujch1998 commited on

Sync changes
3649303

liujch1998 commited on

Sync changes
555cd42

liujch1998 commited on

Update constants.py
2ca70fe
verified

liujch1998 commited on

Temporarily taking down Dolma
c31918f
verified

liujch1998 commited on

Add dolma index
506e239

liujch1998 commited on

Add C4 index
2e63f1e

liujch1998 commited on

Sync changes
c4bc2a0

liujch1998 commited on

Sync changes
106f995

liujch1998 commited on

Sync changes
cb08e07

liujch1998 commited on

Add Pile-train
7474206

liujch1998 commited on

Sync changes
9f036ec

liujch1998 commited on

Sync changes
5f2c7e6

liujch1998 commited on

Sync changes
9282a5a

liujch1998 commited on

Add IP-based throttle
0d3c7d8

liujch1998 commited on

Fix corpus token count
3f76bf1

liujch1998 commited on

Sync Q6 updates
26b368d

liujch1998 commited on

Improve description and logging
4641d03

liujch1998 commited on

Change index names
40c12a7

liujch1998 commited on

Change pile-val name to pileval_v3
f35787e

liujch1998 commited on

Customizable consts
e59eb9e

liujch1998 commited on