Spaces:
Running
on
CPU Upgrade
Is it possible to evaluate a subset?
I'm actually working on part of this dataset. But when I upload my json file with several cases, it will always give me an error.
It's possible, tho I need to twist the code logic a bit. I think we can support this in the next version :-)
@terryyz
First and foremost, Merry Christmas!
Starting today, I tried using the public space for some evaluation work, but the overall process seems to be very slow (in fact, I waited for several hours without getting any results).
The RAM taken seems unusual high as (33~34)/35
Currently, the server is in a restarting state.
Update: 2024/12/24 22:51(MEZ)
After several attempts, I seem to have identified the potential issue.
I uploaded a JSON file in the correct format (one line after another), rather than jsonl. Currently, the server seems to be stuck—it cannot even complete the simplest “evaluate” request. However, after the previous restart, everything went back to normal until I uploaded another JSON file.
There’s also a possibility that the code I uploaded contains a malicious bug, which I truly hope isn’t the case. I look forward to your next restart, and I will be more careful when uploading files.
Thanks a lot.