text
Just published "CryptGPT: A Simple Approach to Privacy-Preserving Language Models Using the Vigenere Cipher".
Just published "CryptGPT: A Simple Approach to Privacy-Preserving Language Models Using the Vigenere Cipher".
new_line
new_line
link
https://huggingface.co/blog/diwank/cryptgpt-part1
https://huggingface.co/blog/diwank/cryptgpt-part1
new_line
new_line
text
tl;dr - we pretrained a gpt-2 tokenizer and model from scratch on a dataset encrypted with Vigenere cipher and it performs as well as regular gpt-2. Except in order to use it, you need to know the encryption key.
tl;dr - we pretrained a gpt-2 tokenizer and model from scratch on a dataset encrypted with Vigenere cipher and it performs as well as regular gpt-2. Except in order to use it, you need to know the encryption key.
new_line
new_line
text
links:
links:
new_line
link
https://github.com/creatorrr/cryptgpt
https://github.com/creatorrr/cryptgpt
new_line
resource
https://huggingface.co/diwank/cryptgpt
model
diwank/cryptgpt
https://huggingface.co/diwank/cryptgpt
new_line
resource
https://huggingface.co/diwank/cryptgpt-large
model
diwank/cryptgpt-large
https://huggingface.co/diwank/cryptgpt-large
Just published "CryptGPT: A Simple Approach to Privacy-Preserving Language Models Using the Vigenere Cipher".

https://huggingface.co/blog/diwank/cryptgpt-part1

tl;dr - we pretrained a gpt-2 tokenizer and model from scratch on a dataset encrypted with Vigenere cipher and it performs as well as regular gpt-2. Except in order to use it, you need to know the encryption key.

links:
https://github.com/creatorrr/cryptgpt
https://huggingface.co/diwank/cryptgpt
https://huggingface.co/diwank/cryptgpt-large
👍
algorithm
🤗
pduf
https://cdn-avatars.huggingface.co/v1/production/uploads/6093a02dc4a92d63a91c5236/yUte6V0FU0BvVFAbON-9n.jpeg
Diwank Tomer
diwank
user
/avatars/744eddaa7dfc34a57df9ce32a78059a0.svg
Tyrone Pierce
piercyy
user