text
Anthropic introduces "Many-shot Jailbreaking" (MSJ), a new attack on large language models! MSJ exploits long context windows to override safety constraints.
Anthropic introduces "Many-shot Jailbreaking" (MSJ), a new attack on large language models! MSJ exploits long context windows to override safety constraints.
new_line
new_line
text
Key Points:
Key Points:
new_line
text
* Prompts LLMs with hundreds of examples of harmful behavior formatted as a dialogue
* Prompts LLMs with hundreds of examples of harmful behavior formatted as a dialogue
new_line
text
* Generates malicious examples using an uninhibited "helpful-only" model
* Generates malicious examples using an uninhibited "helpful-only" model
new_line
text
* Effective at jailbreaking models like Claude 2.0, GPT-3.5, GPT-4
* Effective at jailbreaking models like Claude 2.0, GPT-3.5, GPT-4
new_line
text
* Standard alignment techniques provide limited protection against long context attacks
* Standard alignment techniques provide limited protection against long context attacks
new_line
new_line
text
Paper: 
Paper: 
link
https://www.anthropic.com/research/many-shot-jailbreaking
https://www.anthropic.com/research/many-shot-jailbreaking
new_line
text
More details in my blog: 
More details in my blog: 
link
https://huggingface.co/blog/vladbogo/many-shot-jailbreaking
https://huggingface.co/blog/vladbogo/many-shot-jailbreaking
new_line
new_line
text
Congrats to the authors for their work!
Congrats to the authors for their work!
Anthropic introduces "Many-shot Jailbreaking" (MSJ), a new attack on large language models! MSJ exploits long context windows to override safety constraints.

Key Points:
* Prompts LLMs with hundreds of examples of harmful behavior formatted as a dialogue
* Generates malicious examples using an uninhibited "helpful-only" model
* Effective at jailbreaking models like Claude 2.0, GPT-3.5, GPT-4
* Standard alignment techniques provide limited protection against long context attacks

Paper: https://www.anthropic.com/research/many-shot-jailbreaking
More details in my blog: https://huggingface.co/blog/vladbogo/many-shot-jailbreaking

Congrats to the authors for their work!
❤️
samusenps nikgr gruber sauravssss
👀
monsoon-nlp gruber
https://cdn-avatars.huggingface.co/v1/production/uploads/634262af8d8089ebaefd410e/pr6KcEebXTo5V2XAlpQNw.png
Fizz 🏳️‍⚧️
Fizzarolli
user
/avatars/eac1b6903a19bf24057e914b03796f46.svg
Saurav singh
sauravssss
user