shisa-ai/cyberagent-Mistral-Nemo-Japanese-Instruct-2408-exl2-6.0bpw
Updated
•
2
Shisa.AI
company
AI & ML interests
None defined yet.
Recent Activity
View all activity
shisa-ai's activity
leonardlin
updated
a
model
about 23 hours ago
leonardlin
published
a
model
about 23 hours ago
leonardlin
updated
a
model
3 months ago
leonardlin
posted
an
update
7 months ago
Post
1930
My weekened project ended up being doing some testing between torchtune, axolotl, and unsloth. I *think* it's a 1:1 comparison of what LoRA fine-tuning performance looks like between the different hardware I have in my dev boxes (4090, 3090, 7900 XTX, W7900) with a few other interesting tidbits.
Tonight I wrote up a WandB report (the panel editor is super broken in Firefox 😔) that sums up some of the more interesting bits from the results: https://wandb.ai/augmxnt/train-bench/reports/torchtune-vs-axolotl-vs-unsloth-Trainer-Comparison--Vmlldzo4MzU3NTAx
Tonight I wrote up a WandB report (the panel editor is super broken in Firefox 😔) that sums up some of the more interesting bits from the results: https://wandb.ai/augmxnt/train-bench/reports/torchtune-vs-axolotl-vs-unsloth-Trainer-Comparison--Vmlldzo4MzU3NTAx
leonardlin
posted
an
update
7 months ago
Post
2481
Maybe of interest, I just finished a long writeup of my weekend project exploring Qwen 2 7B Instruct's Chinese censorship: https://huggingface.co/blog/leonardlin/chinese-llm-censorship-analysis
I also have an accompanying model and dataset (and codebase) for those curious to poke around:
* augmxnt/Qwen2-7B-Instruct-deccp
* augmxnt/deccp
I also have an accompanying model and dataset (and codebase) for those curious to poke around:
* augmxnt/Qwen2-7B-Instruct-deccp
* augmxnt/deccp
leonardlin
updated
10
models
8 months ago
shisa-ai/shisa-v1-qwen2-7b
Text Generation
•
Updated
•
21
•
5
shisa-ai/shisa-v1-llama3-70b-gguf
Updated
•
22
shisa-ai/shisa-v1-llama3-8b-gguf
Updated
•
60
•
1
shisa-ai/shisa-v1-llama3-70b
Text Generation
•
Updated
•
37
•
3
shisa-ai/shisa-v1-llama3-70b.2e5
Text Generation
•
Updated
•
25
•
1
shisa-ai/shisa-v1-llama3-8b.neftune
Text Generation
•
Updated
•
25
shisa-ai/shisa-v1-llama3-8b.lr-5e6
Text Generation
•
Updated
•
27
•
1
shisa-ai/shisa-v1-mistral0.3-7b
Text Generation
•
Updated
•
20
shisa-ai/shisa-v1-phi3-14b
Text Generation
•
Updated
•
23
•
2
shisa-ai/shisa-v1-llama3-8b
Text Generation
•
Updated
•
61
•
5
leonardlin
posted
an
update
8 months ago
Post
1939
Interesting, I've just seen the my first HF spam on one of my new model uploads:
shisa-ai/shisa-v1-llama3-70b - someone has an SEO spam page as a HF space attached to the model!?! Wild. Who do I report this to?
-
- 4 replies
leonardlin
posted
an
update
8 months ago
Post
1610
For those with an interest in JA language models, this Llama 3 70B test ablation looks like it is the current strongest publicly released, commercially usable, open model available. A lot of caveats I know, but it also matches
shisa-ai/shisa-v1-llama3-70b
augmxnt/ultra-orca-boros-en-ja-v1
gpt-3.5-turbo-0125's JA performance, which is worth noting, and is tuned *exclusively* with the old shisa-v1 dataset (so it's chart position will be very short lived).shisa-ai/shisa-v1-llama3-70b
augmxnt/ultra-orca-boros-en-ja-v1
-
- 2 replies
leonardlin
updated
3
models
8 months ago