text
Update on the Newsletter of 🤗 Daily Paper
Update on the Newsletter of 🤗 Daily Paper
new_line
new_line
text
Automatic Korean translation is integrated. In the newspaper, "KO" links appear, and it will bring you to the translated version of full paper. This is done with the following workflow.
Automatic Korean translation is integrated. In the newspaper, "KO" links appear, and it will bring you to the translated version of full paper. This is done with the following workflow.
new_line
new_line
text
1. Grasp the list of arXiv IDs from 🤗 Daily Paper API
1. Grasp the list of arXiv IDs from 🤗 Daily Paper API
new_line
text
2. Distribute a number of sub-list of arXiv IDs to VMs (possibly spot instances since the job ends shortly)
2. Distribute a number of sub-list of arXiv IDs to VMs (possibly spot instances since the job ends shortly)
new_line
text
3. Commit & push the translated paper in HTML to the designated GitHub repository
3. Commit & push the translated paper in HTML to the designated GitHub repository
new_line
text
4. Newsletter will include the links to the HTML of each paper
4. Newsletter will include the links to the HTML of each paper
new_line
new_line
text
Job distribution to a number of VMs are super easily done with [dstack]( 
Job distribution to a number of VMs are super easily done with [dstack]( 
link
https://dstack.ai/
https://dstack.ai/
text
 ), and the translation sub-workflow is done through 1) download PDF of each paper with arxiv-dl package, 2) PDF => text with nougat-ocr package, 3) a custom trained model( 
 ), and the translation sub-workflow is done through 1) download PDF of each paper with arxiv-dl package, 2) PDF => text with nougat-ocr package, 3) a custom trained model( 
resource
https://huggingface.co/nlp-with-deeplearning/enko-t5-small-v0
model
nlp-with-deeplearning/enko-t5-small-v0
https://huggingface.co/nlp-with-deeplearning/enko-t5-small-v0
text
 ) in 🤗 transformers to translate the English text into Korean line by line, and 4) reformat the translation into HTML.
 ) in 🤗 transformers to translate the English text into Korean line by line, and 4) reformat the translation into HTML.
new_line
new_line
text
Many people in Korea are not fluent in English but want to learn about new stuff in AI, so they usually use Google Translate or other services. This is why I made this feature for easier and direct access to the SOTA knowledge. 
Many people in Korea are not fluent in English but want to learn about new stuff in AI, so they usually use Google Translate or other services. This is why I made this feature for easier and direct access to the SOTA knowledge. 
new_line
new_line
text
Are there other countries with the similar needs? If so, it would be wonderful to cooperate to support more languages. Please reach out anyone is interested in this.
Are there other countries with the similar needs? If so, it would be wonderful to cooperate to support more languages. Please reach out anyone is interested in this.
new_line
new_line
text
PS; I always wanted to show the usefulness of open ML models by building a well working end to end product, and this newsletter shows it by featuring T5ForConditionalGeneration (translation), SOLAR LLM (summarization). 
PS; I always wanted to show the usefulness of open ML models by building a well working end to end product, and this newsletter shows it by featuring T5ForConditionalGeneration (translation), SOLAR LLM (summarization). 
new_line
new_line
text
if you want to sub to the newsletter
if you want to sub to the newsletter
new_line
text
: 
: 
link
https://groups.google.com/g/hf-daily-paper-newsletter
https://groups.google.com/g/hf-daily-paper-newsletter
new_line
new_line
text
if you want to look into the source codes
if you want to look into the source codes
new_line
text
: 
: 
link
https://github.com/deep-diver/hf-daily-paper-newsletter
https://github.com/deep-diver/hf-daily-paper-newsletter
Update on the Newsletter of 🤗 Daily Paper

Automatic Korean translation is integrated. In the newspaper, "KO" links appear, and it will bring you to the translated version of full paper. This is done with the following workflow.

1. Grasp the list of arXiv IDs from 🤗 Daily Paper API
2. Distribute a number of sub-list of arXiv IDs to VMs (possibly spot instances since the job ends shortly)
3. Commit & push the translated paper in HTML to the designated GitHub repository
4. Newsletter will include the links to the HTML of each paper

Job distribution to a number of VMs are super easily done with [dstack]( https://dstack.ai/ ), and the translation sub-workflow is done through 1) download PDF of each paper with arxiv-dl package, 2) PDF => text with nougat-ocr package, 3) a custom trained model( https://huggingface.co/nlp-with-deeplearning/enko-t5-small-v0 ) in 🤗 transformers to translate the English text into Korean line by line, and 4) reformat the translation into HTML.

Many people in Korea are not fluent in English but want to learn about new stuff in AI, so they usually use Google Translate or other services. This is why I made this feature for easier and direct access to the SOTA knowledge. 

Are there other countries with the similar needs? If so, it would be wonderful to cooperate to support more languages. Please reach out anyone is interested in this.

PS; I always wanted to show the usefulness of open ML models by building a well working end to end product, and this newsletter shows it by featuring T5ForConditionalGeneration (translation), SOLAR LLM (summarization). 

if you want to sub to the newsletter
: https://groups.google.com/g/hf-daily-paper-newsletter

if you want to look into the source codes
: https://github.com/deep-diver/hf-daily-paper-newsletter
❤️
s3nh peterschmidt85 aidystark afrideva clem victor samusenps maywell lunarflu julien-c shrijayan ysharma dillfrescott JUNGU
👍
chansung Siva1306 lunarflu dillfrescott
https://cdn-avatars.huggingface.co/v1/production/uploads/61caeda441f9432649f03ab6/0UdRCrzIqhedZblgfpMBk.png
s3nh
s3nh
user
https://cdn-avatars.huggingface.co/v1/production/uploads/6538119803519fddb4a17e10/ffJMkdx-rM7VvLTCM6ri_.jpeg
samusenps
samusenps
user
https://cdn-avatars.huggingface.co/v1/production/uploads/1659971187637-60d3b57ad7b174177faabd6e.jpeg
chansung park
chansung
user