byroneverson
commited on
Update README.md
Browse files
README.md
CHANGED
@@ -20,7 +20,7 @@ library_name: transformers
|
|
20 |
|
21 |
# glm-4-9b-chat-abliterated
|
22 |
|
23 |
-
## Version 1.1 (Updated 9/1/2024): Layer
|
24 |
|
25 |
Check out the <a href="https://huggingface.co/byroneverson/glm-4-9b-chat-abliterated/blob/main/abliterate-glm-4-9b-chat.ipynb">jupyter notebook</a> for details of how this model was abliterated from glm-4-9b-chat.
|
26 |
|
|
|
20 |
|
21 |
# glm-4-9b-chat-abliterated
|
22 |
|
23 |
+
## Version 1.1 (Updated 9/1/2024): Layer 16 is used for abliteration instead of 20. Refusal mitigation tends to work better with this layer. PCA and cosine similarity tests seem to agree.
|
24 |
|
25 |
Check out the <a href="https://huggingface.co/byroneverson/glm-4-9b-chat-abliterated/blob/main/abliterate-glm-4-9b-chat.ipynb">jupyter notebook</a> for details of how this model was abliterated from glm-4-9b-chat.
|
26 |
|