text
🔥 🔥🔥
🔥 🔥🔥
new_line
text
Excited to announce WizardLM new Paper: Auto Evol-Instruct!
Excited to announce WizardLM new Paper: Auto Evol-Instruct!
new_line
text
new_line
text
🐦 Twitter: 
🐦 Twitter: 
link
https://x.com/WizardLM_AI/status/1812857977122202087
https://x.com/WizardLM_AI/status/1812857977122202087
new_line
text
new_line
text
📃 Paper: 
📃 Paper: 
link
https://arxiv.org/pdf/2406.00770
https://arxiv.org/pdf/2406.00770
new_line
new_line
text
🤖 1. Fully AI-Powered Pipeline
🤖 1. Fully AI-Powered Pipeline
new_line
new_line
text
Auto Evol-Instruct automatically involves an iterative process of optimizing an Evol-Instruct V1 into an optimal one. The pipeline consists of two critical stages: Evol Trajectory Analysis, where the optimizer LLM analyzes the issues and failures exposed in instruction evolution performed by the evol LLM, and Evolving Method Optimization, where the optimizer LLM addresses these issues to progressively develop an effective evolving method. The optimal evolving method is then used to convert the entire instruction dataset into more diverse and complex forms, facilitating improved instruction tuning.
Auto Evol-Instruct automatically involves an iterative process of optimizing an Evol-Instruct V1 into an optimal one. The pipeline consists of two critical stages: Evol Trajectory Analysis, where the optimizer LLM analyzes the issues and failures exposed in instruction evolution performed by the evol LLM, and Evolving Method Optimization, where the optimizer LLM addresses these issues to progressively develop an effective evolving method. The optimal evolving method is then used to convert the entire instruction dataset into more diverse and complex forms, facilitating improved instruction tuning.
new_line
new_line
text
📈2. Scaling Evol-Instruct with Arena Learning
📈2. Scaling Evol-Instruct with Arena Learning
new_line
new_line
text
With Auto Evol-Instruct, the evolutionary synthesis data of WizardLM-2 has scaled up from WizardLM-1 to dozens of domains, covering tasks in all aspects of large language models. This allows Arena Learning to train and learn from an almost infinite pool of high-difficulty instruction data, fully unlocking all the potential of Arena Learning.
With Auto Evol-Instruct, the evolutionary synthesis data of WizardLM-2 has scaled up from WizardLM-1 to dozens of domains, covering tasks in all aspects of large language models. This allows Arena Learning to train and learn from an almost infinite pool of high-difficulty instruction data, fully unlocking all the potential of Arena Learning.
🔥 🔥🔥
Excited to announce WizardLM new Paper: Auto Evol-Instruct!
 
🐦 Twitter: https://x.com/WizardLM_AI/status/1812857977122202087
 
📃 Paper: https://arxiv.org/pdf/2406.00770

🤖 1. Fully AI-Powered Pipeline

Auto Evol-Instruct automatically involves an iterative process of optimizing an Evol-Instruct V1 into an optimal one. The pipeline consists of two critical stages: Evol Trajectory Analysis, where the optimizer LLM analyzes the issues and failures exposed in instruction evolution performed by the evol LLM, and Evolving Method Optimization, where the optimizer LLM addresses these issues to progressively develop an effective evolving method. The optimal evolving method is then used to convert the entire instruction dataset into more diverse and complex forms, facilitating improved instruction tuning.

📈2. Scaling Evol-Instruct with Arena Learning

With Auto Evol-Instruct, the evolutionary synthesis data of WizardLM-2 has scaled up from WizardLM-1 to dozens of domains, covering tasks in all aspects of large language models. This allows Arena Learning to train and learn from an almost infinite pool of high-difficulty instruction data, fully unlocking all the potential of Arena Learning.
🚀
WizardLM YaTharThShaRma999 John6666 AndrewZeng ajibawa-2023 osanseviero mmhamdy Best-codes KingNish AbheekG sohampnow reach-vb Alexandro14 KakaRotting
👍
AndrewZeng mmhamdy AbheekG TitleOS reach-vb davickyz Josiah654
❤️
AbheekG reach-vb liyongsea 1ucky1uke davickyz Josiah654
https://cdn-avatars.huggingface.co/v1/production/uploads/64d323b950310d7ad397fce7/KKGL1Y5ZeQSBTqaeKQCaY.png
Ryan Miller
Meroar
user