text
Hello!
Hello!
new_line
text
The 8B/70B OG Llama-3 models made with the Orthogonal Activation Steering script as been pushed in private.
The 8B/70B OG Llama-3 models made with the Orthogonal Activation Steering script as been pushed in private.
new_line
new_line
text
After multiple test with an empty prompt system, I can confirm it's not uncensored enough, but I wanted to try all the GGUF before (and it take time to do lmao)
After multiple test with an empty prompt system, I can confirm it's not uncensored enough, but I wanted to try all the GGUF before (and it take time to do lmao)
new_line
new_line
text
If you want to try that yourself, here is the script : 
If you want to try that yourself, here is the script : 
link
https://gist.github.com/wassname/42aba7168bb83e278fcfea87e70fa3af
https://gist.github.com/wassname/42aba7168bb83e278fcfea87e70fa3af
new_line
text
And here is the same script that we modified to be able to use it on multiple GPU for 70B : 
And here is the same script that we modified to be able to use it on multiple GPU for 70B : 
link
https://files.catbox.moe/ya4rto.ipynb
https://files.catbox.moe/ya4rto.ipynb
new_line
new_line
text
Llama3-Unholy-8B-OAS don't have the problem as it was already trained to be less censored, but the OG one was really too much censored.
Llama3-Unholy-8B-OAS don't have the problem as it was already trained to be less censored, but the OG one was really too much censored.
new_line
new_line
text
I will try to redo that soon, as it seems to HAVE WORKED for some prompt (as seen on the log, for exemple) but it's not enough.
I will try to redo that soon, as it seems to HAVE WORKED for some prompt (as seen on the log, for exemple) but it's not enough.
new_line
new_line
text
32 entry of the dataset is clearly not enough, but it's okay, I really wanted to try that as it was something new.
32 entry of the dataset is clearly not enough, but it's okay, I really wanted to try that as it was something new.
new_line
text
I could take the Unholy way and retrain the 70B before using OAS but it should work without, that's not the goal.
I could take the Unholy way and retrain the 70B before using OAS but it should work without, that's not the goal.
Hello!
The 8B/70B OG Llama-3 models made with the Orthogonal Activation Steering script as been pushed in private.

After multiple test with an empty prompt system, I can confirm it's not uncensored enough, but I wanted to try all the GGUF before (and it take time to do lmao)

If you want to try that yourself, here is the script : https://gist.github.com/wassname/42aba7168bb83e278fcfea87e70fa3af
And here is the same script that we modified to be able to use it on multiple GPU for 70B : https://files.catbox.moe/ya4rto.ipynb

Llama3-Unholy-8B-OAS don't have the problem as it was already trained to be less censored, but the OG one was really too much censored.

I will try to redo that soon, as it seems to HAVE WORKED for some prompt (as seen on the log, for exemple) but it's not enough.

32 entry of the dataset is clearly not enough, but it's okay, I really wanted to try that as it was something new.
I could take the Unholy way and retrain the 70B before using OAS but it should work without, that's not the goal.
🔥
llama-anon musicurgy Kearm Chief-Inspector Bakanayatsu ucalyptus rooben nschle wassname cosmojg ClayFace thomasgauthier avatar9692 Taylor658 kaz666 ngphuchoangnam vikarti-anatra
https://cdn-avatars.huggingface.co/v1/production/uploads/643344526c2a26ae66d5d5b0/VotgxEYpg6YQ_eMwhMqac.jpeg
dfadf
llama-anon
user
/avatars/72660963812ee19b654fb3111cb7e5ad.svg
Nicholai
nmitchko
user
https://cdn-avatars.huggingface.co/v1/production/uploads/655dc641accde1bbc8b41aec/9sR2Mm7mMsyh_SpSH7ilq.jpeg
Kearm
Kearm
user
https://cdn-avatars.huggingface.co/v1/production/uploads/63ab1241ad514ca8d1430003/d-43TcOxG-zqAbzrH2m7H.png
Undi
Undi95
user
https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/4VOzArmrRaX_DUTxGmm59.jpeg
Charles McSneed
ChuckMcSneed
user
/avatars/9d8683646248f2e3856c4b396945d440.svg
Anon
lmg-anon
user
https://cdn-avatars.huggingface.co/v1/production/uploads/64bb1109aaccfd28b023bcec/fumfSHv9pnW1rMvgQeibP.png
Matthew Andrews
BlueNipples
user
/avatars/7e313aebaddb3ec752ec48b619464f2c.svg
wassname
wassname
user
/avatars/476d1cd6acf5e1e79662bb5a4567c292.svg
Eric Izoita
nytopop
user
https://cdn-avatars.huggingface.co/v1/production/uploads/641dfddf3bae5a77636817c5/2IwNwh9kK98eCHUmOGoWD.png
wing lian
winglian
user
https://cdn-avatars.huggingface.co/v1/production/uploads/6548b80bb3a7efb9391e19e8/DYCJL22AOn8kDLQhi9TaW.png
DreamGen
DreamGenX
user