Spaces:

Dovakiins
/

qwerrwe

Build error

App Files Files Community

qwerrwe / src /axolotl /monkeypatch /mistral_attn_hijack_flash.py

Commit History

Unsloth gradient checkpointing offload (#1528)

6319da1
unverified

winglian commited on Apr 16, 2024

Respect sliding_window=None (#1214)

62ca4a2
unverified

DreamGenX commited on Jan 26, 2024

adds llama and mistral dropout support (#858)

db8a8af
unverified

winglian commited on Nov 15, 2023

Mistral: Sliding Window Attention with Flash Attention and Sample Packing (#732)

a045db0
unverified

winglian commited on Oct 16, 2023

fix for flash attn w mistral w/o sammple packing (#648)

b2edaae
unverified

winglian commited on Sep 28, 2023

Mistral flash attn packing (#646)

b6ab8aa
unverified

winglian commited on Sep 27, 2023