Spaces:

Dovakiins
/

qwerrwe

Build error

App Files Files Community

qwerrwe / src /axolotl /utils /collators.py

Commit History

Pretrain multipack v2 (#1470)

5aa5097
unverified

winglian commited on Apr 2, 2024

support for true batches with multipack (#1230)

00568c1
unverified

winglian commited on Feb 1, 2024

Multipack simplify for Mixtral (#1142)

6910e6a
unverified

winglian commited on Jan 18, 2024

streaming multipack for pretraining dataset (#959)

553c80f
unverified

jinwonkim93 [email protected]

winglian commited on Jan 6, 2024

support for mamba (#915)

40a6362
unverified

winglian commited on Dec 9, 2023

multipack w batch sampler (#795)

641e6f7
unverified

winglian commited on Nov 8, 2023

Attention mask and position id fixes for packing (#285)

2bb0b78
unverified

winglian commited on Aug 12, 2023