axolotl-ai-co/rrt-llama-3b-lora-cp-8k
Updated
Axolotl AI
Enterprise
company
AI & ML interests
None defined yet.
Recent Activity
View all activity
axolotl-ai-co's activity
winglian
updated
a
model
about 2 hours ago
winglian
published
a
model
about 2 hours ago
winglian
updated
a
model
about 2 hours ago
winglian
published
a
model
about 2 hours ago
winglian
updated
a
model
about 14 hours ago
winglian
published
a
model
about 14 hours ago
winglian
updated
a
model
about 22 hours ago
winglian
published
a
model
about 22 hours ago
winglian
updated
a
model
1 day ago
winglian
published
a
model
1 day ago
winglian
updated
a
dataset
2 days ago
winglian
published
a
dataset
2 days ago
winglian
updated
a
dataset
6 days ago
Post
Full fine-tuning of Microsoft's Phi2 on a single 4090 is now supported in axolotl. Thanks to
@abacaj
and
@vikhyatk
for their help with gradient checkpointing and flash attention fixes.
alpaca finetune: openaccess-ai-collective/phi2-alpaca
wandb: https://wandb.ai/oaaic/phi2/runs/00pc4ugb?workspace=user-wing-lian
merged PR: https://github.com/OpenAccess-AI-Collective/axolotl/pull/1058
alpaca finetune: openaccess-ai-collective/phi2-alpaca
wandb: https://wandb.ai/oaaic/phi2/runs/00pc4ugb?workspace=user-wing-lian
merged PR: https://github.com/OpenAccess-AI-Collective/axolotl/pull/1058
-
- 8 replies