text
Hello there, 
Hello there, 
new_line
new_line
text
New model released, my goal was to try finetune on the last Llama-3.1-8B-Instruct but not a small train, I wanted to do something useful.
New model released, my goal was to try finetune on the last Llama-3.1-8B-Instruct but not a small train, I wanted to do something useful.
new_line
text
One of the rare model that I didn't made for RP, or in the goal to uncensor it (but I did anyway kek).
One of the rare model that I didn't made for RP, or in the goal to uncensor it (but I did anyway kek).
new_line
new_line
text
The model was trained on 9M Claude conversations ONLY, giving him another writting style.
The model was trained on 9M Claude conversations ONLY, giving him another writting style.
new_line
new_line
resource
https://huggingface.co/Undi95/Meta-Llama-3.1-8B-Claude
model
Undi95/Meta-Llama-3.1-8B-Claude
https://huggingface.co/Undi95/Meta-Llama-3.1-8B-Claude
text
 > OG release fp32, it's the epoch 2
 > OG release fp32, it's the epoch 2
new_line
resource
https://huggingface.co/Undi95/Meta-Llama-3.1-8B-Claude-bf16
model
Undi95/Meta-Llama-3.1-8B-Claude-bf16
https://huggingface.co/Undi95/Meta-Llama-3.1-8B-Claude-bf16
text
 > Base model resharded in bf16 waiting for available quant without issues
 > Base model resharded in bf16 waiting for available quant without issues
new_line
new_line
text
Since it's frustrating to be censored using a local model, orthogonal activation steering was used, trying to force the model to never refuse a prompt.
Since it's frustrating to be censored using a local model, orthogonal activation steering was used, trying to force the model to never refuse a prompt.
new_line
new_line
resource
https://huggingface.co/Undi95/Meta-Llama-3.1-8B-Claude-68fail-3000total
model
Undi95/Meta-Llama-3.1-8B-Claude-68fail-3000total
https://huggingface.co/Undi95/Meta-Llama-3.1-8B-Claude-68fail-3000total
text
 > Uncensored model, refuse 68 times on 3000 toxic prompt
 > Uncensored model, refuse 68 times on 3000 toxic prompt
new_line
resource
https://huggingface.co/Undi95/Meta-Llama-3.1-8B-Claude-39fail-3000total
model
Undi95/Meta-Llama-3.1-8B-Claude-39fail-3000total
https://huggingface.co/Undi95/Meta-Llama-3.1-8B-Claude-39fail-3000total
text
 > Uncensored model, refuse 39 times on 3000 toxic prompt
 > Uncensored model, refuse 39 times on 3000 toxic prompt
new_line
new_line
text
It still refuse some prompt but the majority of them is uncensored. OAS can make a model more dumb or make the base perplexity go higher, so I didn't snipe for 0 refusal.
It still refuse some prompt but the majority of them is uncensored. OAS can make a model more dumb or make the base perplexity go higher, so I didn't snipe for 0 refusal.
new_line
new_line
text
I don't do non-RP model a lot so any feedback is welcome, I would like to re-use this base for some others future project if needed.
I don't do non-RP model a lot so any feedback is welcome, I would like to re-use this base for some others future project if needed.
Hello there, 

New model released, my goal was to try finetune on the last Llama-3.1-8B-Instruct but not a small train, I wanted to do something useful.
One of the rare model that I didn't made for RP, or in the goal to uncensor it (but I did anyway kek).

The model was trained on 9M Claude conversations ONLY, giving him another writting style.

https://huggingface.co/Undi95/Meta-Llama-3.1-8B-Claude > OG release fp32, it's the epoch 2
https://huggingface.co/Undi95/Meta-Llama-3.1-8B-Claude-bf16 > Base model resharded in bf16 waiting for available quant without issues

Since it's frustrating to be censored using a local model, orthogonal activation steering was used, trying to force the model to never refuse a prompt.

https://huggingface.co/Undi95/Meta-Llama-3.1-8B-Claude-68fail-3000total > Uncensored model, refuse 68 times on 3000 toxic prompt
https://huggingface.co/Undi95/Meta-Llama-3.1-8B-Claude-39fail-3000total > Uncensored model, refuse 39 times on 3000 toxic prompt

It still refuse some prompt but the majority of them is uncensored. OAS can make a model more dumb or make the base perplexity go higher, so I didn't snipe for 0 refusal.

I don't do non-RP model a lot so any feedback is welcome, I would like to re-use this base for some others future project if needed.
❤️
Chief-Inspector MarinaraSpaghetti Herman555 John6666 AtonMountlook Ramikan-BR DuckyBlender osanseviero mambiux den0620 win10
https://cdn-avatars.huggingface.co/v1/production/uploads/666627d86cd2ef174a6e2257/QVRd7WN6kVCtT5BDpf8vq.png
Invisietch
invisietch
user
https://cdn-avatars.huggingface.co/v1/production/uploads/63ab1241ad514ca8d1430003/d-43TcOxG-zqAbzrH2m7H.png
Undi
Undi95
user
/avatars/18daa2d580f5f35cf850bc9df8a03755.svg
Sporkness
SporkySporkness
user