transformers endpoints_compatible region:us
# TensorRT-LLM Engine Files for Mistral-7B-instruct-v0.2
This repo contains TensorRT-LLM engine files for Mistral-7B-instruct-v0.2 compiled on Windows 11 in single-GPU mode on a RTX 3080Ti GPU.