Dedicated Endpoints error problem
I paid to deploy a Dedicated Endpoints for the chemdfm-13b-v1-0-ycy model, but the request reported an error{'error ':'Request failed during generation: Server error: Unexpected<class 'RuntimeError '>: captures_underground==0 INTERNATIONAL ASSERT FAILED at “/opt/conda/conda bld/Pytorch_1699449201336/work/c10/cuda/CUDAachingallocator. cpp”: 2939, please report a bug to PyTorch. ‘,’ error type ‘:’ generation '}May I ask where I can provide feedback on abnormalities? Can the fees paid for service errors be refunded?
2024-04-12T02:46:59Z
Same error usingGOAT-AI/GOAT-70B-Storytellingwith a dedicated endpoint on AWS of 2x A100s per the recommended config.