panda70m video2text region:us
---
tags:
- panda70m
- video2text
---

# How to use?

```bash
huggingface-cli download Ligeng-Zhu/panda70m \
  --local-dir panda70m --repo-type dataset --local-dir-use-symlinks False
```

Then install dependencies

```bash
pip install fire yt_dlp pandas
```

Next pull the videos

```bash
python main.py --csv=<your csv files>
```

or split by shards to accelerate downloading

```bash
python main.py --csv=<your csv files> --shards=0 --total=10
python main.py --csv=<your csv files> --shards=1 --total=10
...
python main.py --csv=<your csv files> --shards=9 --total=10
```