Symbiotic Intelligence
•
3
emin temiz PRO
etemiz
AI & ML interests
None yet
Recent Activity
posted
an
update
1 day ago
Updated the Hoopoe model which is taking faith related and religious texts in.
https://huggingface.co/etemiz/Hoopoe-8B-Llama-3.1
Faith score went from 8% to 54%. Expect more updates and increase in the score. I also did the instruct fine tuning before adding faith to the model. So some of the improvements may be there because I started with llama 3.1 base and not the instruct.
Here are some comparisons with original Llama 3.1:
updated
a model
1 day ago
etemiz/Hoopoe-8B-Llama-3.1
replied to
their
post
6 days ago
-= DeepSeek V3 =-
After installing the new CUDA toolkit and compiling llama.cpp again I tested DeepSeek V3 yesterday.
In terms of human alignment DeepSeek V3 did worse on:
- health
- fasting
- nostr
- misinfo
- nutrition
did better on:
- faith
- bitcoin
- alternative medicine
- ancient wisdom
compared to DeepSeek 2.5. In my opinion overall it is worse than 2.5. And 2.5 wasn't that great.
There is a general tendency of models getting smarter but at the same time getting less wiser, less human aligned, less beneficial to humans.
I don't know what is causing this. But maybe synthetic dataset use for further training the LLMs makes it more and more detached from humanity. This is not going in the right direction.
My solution is to come up with a curator council to determine the datasets that are closest to human preference. "Humans that care about other humans the most" could be a definition of this dataset. What do you think?
Articles
Organizations
None yet
etemiz's activity
upvoted
an
article
2 months ago
Article
Symbiotic Intelligence
By
•
•
3
upvoted
an
article
4 months ago
Article
Fine-tuning LLMs to 1.58bit: extreme quantization made easy
•
216
upvoted
an
article
5 months ago
Article
Merge Large Language Models with mergekit
By
•
•
89