Bug Report: Accelerated API for Conversational Task
Hi there,We faced an issued that when we call an Accelerated API of conversational task in the hub, the parametertemperaturedoesn’t work. We expect that if thetemperatureis set to 80.0, the AI response will be somehow random. But the fact is that the AI response is always fixed for an input, whether thetemperatureis set to 0.0 or 100.0 We can be sure that this is not a spelling error, because if we set thetemperatureto 800.0, the API returns an error stating that thetemperaturerange is 0.0 to 100.0We can be sure that this is not a spelling error, because if we set thetemperatureto 800.0, the API returns an error stating that thetemperaturerange should be 0.0 to 100.0model used:microsoft/DialoGPT-medium · Hugging Facepayload for calling the api:{
        "inputs": {
                "text": "are you ok?",
          },
        "parameters": {
            "min_length": 5,
            "max_length": 280,
            "top_k": 10,
            "top_p": 0.95,
            "temperature": 80.0,
            "repetition_penalty": 50.0,
            "max_time": 5.0
        },
        "options":{
            "use_gpu": False,
            "use_cache": False,
            "wait_for_model": True,
        }
    }