Default parameters when querying models with TGI
I am using theAsyncClient()fromText Generation Inferenceto query a bunch of models including Llama3, Mixtral, Llama2, Vicuna, and Command-R. I am using thegenerate()function from the AsyncClient. I see that unless passed, the value oftop_pandtemperatureare set toNone.However, I am assuming that there must be some defaulttemperatureandtop_psetting. Where do I find this information? Is this model specific or set by TGI?