transformers endpoints_compatible region:us
---
{}
---
TRT-LLM version: v0.7.1, config: 
{
    "repo": "mistralai/Mistral-7B-Instruct-v0.2",
    "args": {
        "max_input_len": 2000,
        "max_output_len": 2000,
        "max_batch_size": 64,
        "tp_size": 1,
        "pp_size": 1
    },
    "quant": "no_quant"
}