text
Below we experiment with negative merger weighting (-1.0!) using task arithmetic. Merge formula on the model card and in the repo itself.
Below we experiment with negative merger weighting (-1.0!) using task arithmetic. Merge formula on the model card and in the repo itself.
new_line
new_line
text
This model is steered to behave opposite to what MopeyMule demonstrated.
This model is steered to behave opposite to what MopeyMule demonstrated.
new_line
new_line
text
Based on the implications of the merge technique, we also propose Orthogonalized Vector Adaptation (OVA). We also extract a LoRA of the counter-refusal abliteration steering vector.
Based on the implications of the merge technique, we also propose Orthogonalized Vector Adaptation (OVA). We also extract a LoRA of the counter-refusal abliteration steering vector.
new_line
new_line
text
The resulting merger is not a perfect model, but it's a behaviorally interesting model. The model name was inspired by a Philip K. Dick story.
The resulting merger is not a perfect model, but it's a behaviorally interesting model. The model name was inspired by a Philip K. Dick story.
new_line
resource
https://huggingface.co/grimjim/Llama-3-Perky-Pat-Instruct-8B
model
grimjim/Llama-3-Perky-Pat-Instruct-8B
https://huggingface.co/grimjim/Llama-3-Perky-Pat-Instruct-8B
new_line
new_line
text
Refusal vector weights ready for use:
Refusal vector weights ready for use:
new_line
resource
https://huggingface.co/grimjim/Llama-3-Instruct-abliteration-OVA-8B
model
grimjim/Llama-3-Instruct-abliteration-OVA-8B
https://huggingface.co/grimjim/Llama-3-Instruct-abliteration-OVA-8B
new_line
resource
https://huggingface.co/grimjim/Llama-3-Instruct-abliteration-LoRA-8B
model
grimjim/Llama-3-Instruct-abliteration-LoRA-8B
https://huggingface.co/grimjim/Llama-3-Instruct-abliteration-LoRA-8B
Below we experiment with negative merger weighting (-1.0!) using task arithmetic. Merge formula on the model card and in the repo itself.

This model is steered to behave opposite to what MopeyMule demonstrated.

Based on the implications of the merge technique, we also propose Orthogonalized Vector Adaptation (OVA). We also extract a LoRA of the counter-refusal abliteration steering vector.

The resulting merger is not a perfect model, but it's a behaviorally interesting model. The model name was inspired by a Philip K. Dick story.
https://huggingface.co/grimjim/Llama-3-Perky-Pat-Instruct-8B

Refusal vector weights ready for use:
https://huggingface.co/grimjim/Llama-3-Instruct-abliteration-OVA-8B
https://huggingface.co/grimjim/Llama-3-Instruct-abliteration-LoRA-8B
❤️
s3nh anakin87 John6666 GPT007 Casual-Autopsy
https://cdn-avatars.huggingface.co/v1/production/uploads/626505d493e0b04d75710566/9rfJc9ORXU9J5a42Ev3v6.png
Stefano Fiorucci
anakin87
user
https://cdn-avatars.huggingface.co/v1/production/uploads/65c992424936ab38ecf706b0/aq7vuHFPO1S93fwJk0Cuq.jpeg
Jim Lai
grimjim
user
https://cdn-avatars.huggingface.co/v1/production/uploads/6338187db7ce9192552401c0/6RavOW_10X9tVs4iVqhrX.png
wunein
wunein
user