text
Panda-70M is a new large-scale video dataset comprising 70 million high-quality video clips, each paired with textual captions, designed to be used as pre-training for video understanding tasks.
Panda-70M is a new large-scale video dataset comprising 70 million high-quality video clips, each paired with textual captions, designed to be used as pre-training for video understanding tasks.
new_line
new_line
text
Key Points:
Key Points:
new_line
text
* Automatic Caption Generation: Utilizes an automatic pipeline with multiple cross-modality teacher models to generate captions for video clips.
* Automatic Caption Generation: Utilizes an automatic pipeline with multiple cross-modality teacher models to generate captions for video clips.
new_line
text
* Fine-tuned Caption Selection: Employs a fine-tuned retrieval model to select the most appropriate caption from multiple candidates for each video clip.
* Fine-tuned Caption Selection: Employs a fine-tuned retrieval model to select the most appropriate caption from multiple candidates for each video clip.
new_line
text
* Improved Performance: Pre-training on Panda-70M shows significant performance gains in video captioning, text-video retrieval, and text-driven video generation.
* Improved Performance: Pre-training on Panda-70M shows significant performance gains in video captioning, text-video retrieval, and text-driven video generation.
new_line
new_line
text
Paper: 
Paper: 
resource
https://huggingface.co/papers/2402.19479
paper
2402.19479
https://huggingface.co/papers/2402.19479
Panda-70M: Captioning 70M Videos with Multiple Cross-Modality Teachers (2402.19479)
new_line
text
Project page: 
Project page: 
link
https://snap-research.github.io/Panda-70M/
https://snap-research.github.io/Panda-70M/
new_line
text
Code: 
Code: 
link
https://github.com/snap-research/Panda-70M
https://github.com/snap-research/Panda-70M
new_line
new_line
text
Congrats to the authors 
Congrats to the authors 
mention
@tschen
tschen
text
, 
, 
mention
@aliaksandr-siarohin
aliaksandr-siarohin
text
 et al. for their work!
 et al. for their work!
Panda-70M is a new large-scale video dataset comprising 70 million high-quality video clips, each paired with textual captions, designed to be used as pre-training for video understanding tasks.

Key Points:
* Automatic Caption Generation: Utilizes an automatic pipeline with multiple cross-modality teacher models to generate captions for video clips.
* Fine-tuned Caption Selection: Employs a fine-tuned retrieval model to select the most appropriate caption from multiple candidates for each video clip.
* Improved Performance: Pre-training on Panda-70M shows significant performance gains in video captioning, text-video retrieval, and text-driven video generation.

Paper: https://huggingface.co/papers/2402.19479
Project page: https://snap-research.github.io/Panda-70M/
Code: https://github.com/snap-research/Panda-70M

Congrats to the authors @tschen, @aliaksandr-siarohin et al. for their work!
👍
toanvu upleader ajibawa-2023 clem Kernel osanseviero dkgee ankur296 ChavyvAkvar tschen
❤️
clem osanseviero tschen nisten sbrandeis
https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/9-X8NlUt6iTeeFy4UoDJZ.png
Lincoln Yin
upleader
user