text
A recent paper titled "Finetuned Multimodal Language Models Are High-Quality Image-Text Data Filters" proposes using fine-tuned Multimodal Language Models (MLMs) as high-quality filters for image-text data. 
A recent paper titled "Finetuned Multimodal Language Models Are High-Quality Image-Text Data Filters" proposes using fine-tuned Multimodal Language Models (MLMs) as high-quality filters for image-text data. 
new_line
new_line
text
Key points:
Key points:
new_line
text
* Defines multiple metrics to assess image-text quality from different perspectives like object details, text quality, and semantic understanding.
* Defines multiple metrics to assess image-text quality from different perspectives like object details, text quality, and semantic understanding.
new_line
text
* Leverages GPT-4 and GPT-4V to construct high-quality instruction data for fine-tuning open-source MLMs as effective data filters.
* Leverages GPT-4 and GPT-4V to construct high-quality instruction data for fine-tuning open-source MLMs as effective data filters.
new_line
text
* Fine-tuned MLM filters generate more precise scores, leading to better filtered data and improved performance of pre-trained models on various downstream tasks.
* Fine-tuned MLM filters generate more precise scores, leading to better filtered data and improved performance of pre-trained models on various downstream tasks.
new_line
new_line
text
Congrats to the authors for their work!
Congrats to the authors for their work!
new_line
new_line
text
Paper:  
Paper:  
resource
https://huggingface.co/papers/2403.02677
paper
2403.02677
https://huggingface.co/papers/2403.02677
Finetuned Multimodal Language Models Are High-Quality Image-Text Data
  Filters (2403.02677)
new_line
text
Code: 
Code: 
link
https://github.com/Victorwz/MLM_Filter
https://github.com/Victorwz/MLM_Filter
new_line
text
Dataset: 
Dataset: 
resource
https://huggingface.co/datasets/weizhiwang/mlm_filter_instructions
dataset
weizhiwang/mlm_filter_instructions
https://huggingface.co/datasets/weizhiwang/mlm_filter_instructions
new_line
text
Model: 
Model: 
resource
https://huggingface.co/weizhiwang/mlm-filter-llava-13b-gpt4v
model
weizhiwang/mlm-filter-llava-13b-gpt4v
https://huggingface.co/weizhiwang/mlm-filter-llava-13b-gpt4v
A recent paper titled "Finetuned Multimodal Language Models Are High-Quality Image-Text Data Filters" proposes using fine-tuned Multimodal Language Models (MLMs) as high-quality filters for image-text data. 

Key points:
* Defines multiple metrics to assess image-text quality from different perspectives like object details, text quality, and semantic understanding.
* Leverages GPT-4 and GPT-4V to construct high-quality instruction data for fine-tuning open-source MLMs as effective data filters.
* Fine-tuned MLM filters generate more precise scores, leading to better filtered data and improved performance of pre-trained models on various downstream tasks.

Congrats to the authors for their work!

Paper:  https://huggingface.co/papers/2403.02677
Code: https://github.com/Victorwz/MLM_Filter
Dataset: https://huggingface.co/datasets/weizhiwang/mlm_filter_instructions
Model: https://huggingface.co/weizhiwang/mlm-filter-llava-13b-gpt4v
🤗
Kukedlc rohitdavas thomwolf
👍
samusenps Danielpluto thomwolf
❤️
samusenps thomwolf