Larger zip file crashes the Streamlit App with no errors
I have two zip files of image classification files that are structurally identical. Approx 200 class folders.The smaller one is around 1GB and uploads and trains fine.The larger one is ~4GB and it crashes the Docker container running the Streamlit app but without any errors. It appears to upload the whole way but then nothing happens and in the terminal the app has died.It says the limit is 10GB. Anyone else experienced this?
2023-05-14T12:15:13Z
you could try running the app locally or on a CPU upgrade as it might need more RAM to process larger files.
2023-05-15T10:17:56Z
this was running locally in the docker container. Is  that what you mean or is there another way?
2023-05-15T15:45:33Z
If I try to run it online with upgraded CPU I get this:An error has occurred: Value out of range: 5154181263
2023-05-15T16:32:01Z
Seems like a zipping issue. Does it decompress fine?
2023-05-15T22:28:00Z
it unzips ok on OSX. Any potential issues zipping from that OS?
2023-05-16T05:52:08Z
I just tested by creating an archive in OSX (although not 4gb in size) so, I dont see a reason why that wont work. Is a smaller zip working fine for you? If yes, I’ll try by creating a larger dataset on my end.
2023-05-16T07:34:54Z
yes  I have a subset which is 1GB and works fine
2023-05-16T10:10:15Z
thanks! im taking a look!
2023-05-16T12:54:48Z
Much appreciated. I just tried with a larger subset at 2.6GB and it also failed in the same wayI’m not sure if it’s related, but it seems like there is an error with the form leading to a erroneous submissionERROR   app has failed due to an exception:ERROR   Traceback (most recent call last):File “/app/src/autotrain/utils.py”, line 120, in wrapperreturn func(*args, **kwargs)File “/app/src/autotrain/app.py”, line 464, in appraise ValueError(“Please upload training images”)ValueError: Please upload training imagesIt still seeeeeems like its working after this appears in the terminal but not 100% sure
2023-05-22T09:42:23Z
did you discover anything? Did it work with a larger upload for you?