Added pip install ninja to accelerate installation of flash-attn (#1461) cae608f unverified melvinebenezer commited on Apr 2, 2024
docs: update link to docs of advance topic in README.md (#1437) 324d59e unverified pphuc25 commited on Mar 25, 2024
chore(config): refactor old mistral config (#1435) f1ebaa0 unverified Nanobit commited on Mar 25, 2024
support galore once upstreamed into transformers (#1409) dd449c5 unverified winglian commited on Mar 19, 2024
Add a config not to shuffle merged dataset (#1394) [skip ci] 43bdc5d unverified seungduk winglian commited on Mar 19, 2024
fix(config): passing gradient_checkpoint_kwargs (#1412) b1e3e1b unverified Nanobit commited on Mar 19, 2024
Fix(readme): Improve README QuickStart info (#1408) f083aed unverified Nanobit commited on Mar 16, 2024
Feat(readme): Add instructions for Google GPU VM instances (#1410) 868c339 unverified Nanobit commited on Mar 16, 2024
add docs for `input_output` format (#1367) [skip ci] ed70a08 unverified hamel commited on Mar 6, 2024
Remove unsupported python version 3.9 from README (#1364) [skip ci] 3765747 unverified Nicolas Rojas commited on Mar 6, 2024
fix for protected model_ namespace w pydantic (#1345) 6b3b271 unverified winglian commited on Feb 28, 2024
Mps mistral lora (#1292) [skip ci] 0f6af36 unverified Maxime Nanobit winglian commited on Feb 27, 2024
ADD: push checkpoints to mlflow artifact registry (#1295) [skip ci] d756534 unverified JohanWork Nanobit winglian commited on Feb 26, 2024
chore: update readme to be more clear (#1326) [skip ci] c6b01e0 unverified Nanobit commited on Feb 26, 2024
fix(readme): Clarify doc for tokenizer_config (#1323) [skip ci] 2ed52bd unverified Nanobit commited on Feb 24, 2024
fix(readme): update inference md link (#1311) [skip ci] 3d2cd80 unverified Nanobit commited on Feb 21, 2024
Add seq2seq eval benchmark callback (#1274) 5a5d474 unverified LeonardoEmili commited on Feb 13, 2024
Scheduler implementation of Continual Pre-Training of Large Language Models: How to (re)warm your model? (#1273) 8430db2 unverified jinwonkim93 commited on Feb 13, 2024
allow the optimizer prune ratio for ReLoRA to be configurable (#1287) 4b997c3 unverified winglian commited on Feb 12, 2024
Add link to axolotl cloud image on latitude (#1275) 4a654b3 unverified winglian commited on Feb 8, 2024
add contact info for dedicated support for axolotl [skip ci] (#1243) dfd1885 unverified winglian commited on Feb 1, 2024
Fix and document test_datasets (#1228) 5787e1a unverified DreamGenX winglian commited on Jan 31, 2024
Feat/chatml add system message (#1117) 98b4762 unverified mhenrichsen Mads Henrichsen winglian commited on Jan 25, 2024
Fine-Tuning Mistral-7b for Real-World Chatbot Applications Using Axolotl (Lora used) (#1155) cc25039 unverified Tilemachos Chatzipapas twenty8th winglian commited on Jan 23, 2024
set fp16 to false if bf16, update bf16: auto in example YAMLs (#1122) [skip ci] 782b6a4 unverified winglian Nanobit commited on Jan 22, 2024
feat(dataset): add config to keep processed dataset in memory (#1152) 3db5f2f unverified Nanobit commited on Jan 20, 2024
Add shifted sparse attention (#973) [skip-ci] 1d70f24 unverified jrc joecummings winglian commited on Jan 18, 2024
Agnostic cloud gpu docker image and Jupyter lab (#1097) ece0211 unverified winglian commited on Jan 16, 2024
Add `layers_to_transform` for `lora_config` (#1118) 8487b97 unverified xzuyn commited on Jan 16, 2024
fix(readme): clarify custom user prompt [no-ci] (#1124) 9cd27b2 unverified Nanobit commited on Jan 16, 2024
Add link on README to Docker Debugging (#1107) 2dc4310 unverified hamel winglian commited on Jan 12, 2024