requirements.txt

pandas
plotly
datatrove[s3,hf,io] @ git+https://github.com/huggingface/datatrove.git@filecache_handling