text
Introducing UNA-SimpleSmaug-34b:
Introducing UNA-SimpleSmaug-34b:
new_line
new_line
text
Based on Smaug-34B-v0.1, capable of slightly outperform his base model and with increased math and reasoning thanks to simple-math dataset.
Based on Smaug-34B-v0.1, capable of slightly outperform his base model and with increased math and reasoning thanks to simple-math dataset.
new_line
text
The model exhibits a great performance across diverse tasks with an excellent and balanced behaviour.
The model exhibits a great performance across diverse tasks with an excellent and balanced behaviour.
new_line
text
It scores 77.41 AVG on the Leaderboard, landing on #1 Position of 34B models.
It scores 77.41 AVG on the Leaderboard, landing on #1 Position of 34B models.
new_line
new_line
text
Available in the hub already:
Available in the hub already:
new_line
resource
https://huggingface.co/fblgit/UNA-SimpleSmaug-34b-v1beta
model
fblgit/UNA-SimpleSmaug-34b-v1beta
https://huggingface.co/fblgit/UNA-SimpleSmaug-34b-v1beta
new_line
resource
https://huggingface.co/datasets/fblgit/simple-math
dataset
fblgit/simple-math
https://huggingface.co/datasets/fblgit/simple-math
new_line
new_line
text
In this case, we applied UNA to the Attention Layers of the model while performing SFT with simple-math on a high complexity generated data of mathematics, proving the effect of simple-math on LLM's.
In this case, we applied UNA to the Attention Layers of the model while performing SFT with simple-math on a high complexity generated data of mathematics, proving the effect of simple-math on LLM's.
Introducing UNA-SimpleSmaug-34b:

Based on Smaug-34B-v0.1, capable of slightly outperform his base model and with increased math and reasoning thanks to simple-math dataset.
The model exhibits a great performance across diverse tasks with an excellent and balanced behaviour.
It scores 77.41 AVG on the Leaderboard, landing on #1 Position of 34B models.

Available in the hub already:
https://huggingface.co/fblgit/UNA-SimpleSmaug-34b-v1beta
https://huggingface.co/datasets/fblgit/simple-math

In this case, we applied UNA to the Attention Layers of the model while performing SFT with simple-math on a high complexity generated data of mathematics, proving the effect of simple-math on LLM's.
❤️
fblgit samusenps macadeliccc osanseviero mrfakename Ji-Ha NeuralNovel taufiqdp merve linuxhackr
https://cdn-avatars.huggingface.co/v1/production/uploads/62e54f0eae9d3f10acb95cb9/VAyk05hqB3OZWXEZW-B0q.png
mrfakename
mrfakename
user
https://cdn-avatars.huggingface.co/v1/production/uploads/6401c8c9f98fbc64bcd7dca1/MOSgc_mPbfUZ-354osy1v.png
FBL
fblgit
user