text
We’re excited to release Abstract2Appendix v1 10K , a high-quality dataset crafted to enhance the long-context capabilities of Large Language Models (LLMs). This dataset combines thousands of peer reviews from NeurIPS 2023, EMNLP 2023, TMLR, and ICLR 2023, making it a treasure trove of detailed feedback, critical reasoning, and structured academic insights. Our experiments showed that this dataset increased long context ability of phi-3 models! 
We’re excited to release Abstract2Appendix v1 10K , a high-quality dataset crafted to enhance the long-context capabilities of Large Language Models (LLMs). This dataset combines thousands of peer reviews from NeurIPS 2023, EMNLP 2023, TMLR, and ICLR 2023, making it a treasure trove of detailed feedback, critical reasoning, and structured academic insights. Our experiments showed that this dataset increased long context ability of phi-3 models! 
new_line
new_line
text
🌟 Key Highlights:
🌟 Key Highlights:
new_line
new_line
text
	•	Expert Reviews: Aggregated from 3–6 reviews per paper, capturing the most insightful and constructive content.
	•	Expert Reviews: Aggregated from 3–6 reviews per paper, capturing the most insightful and constructive content.
new_line
text
	•	Rich Metadata: we have aggregated the reviews, and also included full parsed paper
	•	Rich Metadata: we have aggregated the reviews, and also included full parsed paper
new_line
text
	•	LLM Ready: Perfect for fine-tuning (We did dpo and sft) 
	•	LLM Ready: Perfect for fine-tuning (We did dpo and sft) 
new_line
new_line
text
🎯 Use Cases:
🎯 Use Cases:
new_line
new_line
text
	•	Fine-tuning models with Direct Preference Optimization (DPO) and Supervised Fine-Tuning (SFT).
	•	Fine-tuning models with Direct Preference Optimization (DPO) and Supervised Fine-Tuning (SFT).
new_line
text
	•	Benchmarking zero-shot and long-context comprehension capabilities.
	•	Benchmarking zero-shot and long-context comprehension capabilities.
new_line
new_line
text
🔗 Explore the dataset: 
🔗 Explore the dataset: 
resource
https://huggingface.co/datasets/alexshengzhili/Abstract2Appendix_v1_10k
dataset
alexshengzhili/Abstract2Appendix_v1_10k
https://huggingface.co/datasets/alexshengzhili/Abstract2Appendix_v1_10k
new_line
new_line
text
This dataset is based on the methodology described in our recent paper, “Abstract2Appendix: Academic Reviews Enhance LLM Long-Context Capabilities”. Check it out for more details! 
This dataset is based on the methodology described in our recent paper, “Abstract2Appendix: Academic Reviews Enhance LLM Long-Context Capabilities”. Check it out for more details! 
link
https://arxiv.org/abs/2411.05232
https://arxiv.org/abs/2411.05232
We’re excited to release Abstract2Appendix v1 10K , a high-quality dataset crafted to enhance the long-context capabilities of Large Language Models (LLMs). This dataset combines thousands of peer reviews from NeurIPS 2023, EMNLP 2023, TMLR, and ICLR 2023, making it a treasure trove of detailed feedback, critical reasoning, and structured academic insights. Our experiments showed that this dataset increased long context ability of phi-3 models! 

🌟 Key Highlights:

	•	Expert Reviews: Aggregated from 3–6 reviews per paper, capturing the most insightful and constructive content.
	•	Rich Metadata: we have aggregated the reviews, and also included full parsed paper
	•	LLM Ready: Perfect for fine-tuning (We did dpo and sft) 

🎯 Use Cases:

	•	Fine-tuning models with Direct Preference Optimization (DPO) and Supervised Fine-Tuning (SFT).
	•	Benchmarking zero-shot and long-context comprehension capabilities.

🔗 Explore the dataset: https://huggingface.co/datasets/alexshengzhili/Abstract2Appendix_v1_10k

This dataset is based on the methodology described in our recent paper, “Abstract2Appendix: Academic Reviews Enhance LLM Long-Context Capabilities”. Check it out for more details! https://arxiv.org/abs/2411.05232
🔥
alexshengzhili John6666