Inference Endpoint not starting on HTTP request
Hello! I have an Inference Endpoint that autoscales to 0 after inactivity. Recently I noticed that the model doesn’t start to initialize after hitting the inactive endpoint with an HTTP request nor does it return a 503 as stated by the docs.Is there an updated configuration to allow this behavior?Thank you!
2024-03-05T21:52:46Z
Hi@nick-livefrontThanks for reporting this! We’ll take a look into this and I’ll update you soon.
2024-03-06T07:33:26Z
Having the same issue.