Missing Endpoint for NLI
I think we are missing an API Endpoint for NLI Models likefacebook/bart-large-mnli · Hugging Face- So that we can get the entailment scores of an arbitrary hypothesis. Is that correct?Thank you for any insights!
2023-04-28T06:22:59Z
You can change the model task when deploying the model fromzero-shot-classificationtotext-classification.image889×787 70.6 KB
2023-04-28T12:13:50Z
Thank you, but how does the model know what the premise is and what the hypothesis is? I thought that this is an implementation detail of the model, and so an API that would abstract that away seems to be missing.I found the following thread:How to separate premise and hypothesis in Inference API- It discusses this exact problem. From that thread, it looks to me like its different from model to model.Thank you again for any insights!
2023-04-28T12:40:00Z
If you need more customization you can create a custom handler and define those manually:Create custom Inference Handler
2023-04-28T13:16:18Z
Okay, I realize I probably have used the wrong subforum/category. What category should I use for asking about the freeInference API?As I understand it, for the free Inference API there is a fixed set of tasks:huggingface.coDetailed parametersWe’re on a journey to advance and democratize artificial intelligence through open source and open science.And what task a particular repository can be used for, depends on thepipeline_tagset in theREADME.md.But looking at the above link, for NLI there is no such tag one could use. There is only one fortext-classification, but then again the format required for the NLI Task is unknown. So I feel like an Endpoint is missing there?Thank you