license:llama2 region:us
---
inference: false
license: llama2
model_type: llama
model_creator: lmsys
model_link: https://huggingface.co/lmsys/vicuna-13b-v1.5
model_name: Vicuna 13B v1.5
quantized_by: Dala
---

# Vicuna 13B v1.5 - MLC

- Model creator: [lmsys](https://huggingface.co/lmsys)
- Original model: [Vicuna 13B v1.5](https://huggingface.co/lmsys/vicuna-13b-v1.5)

## Description
This repo contains the [MLC](https://mlc.ai/mlc-llm/) compiled parameters for [lmsys's Vicuna 13B v1.5](https://huggingface.co/lmsys/vicuna-13b-v1.5).

It contains several quantizations, each in its own branch:
- main (q4f16_1) <-- You are currently on this branch
- q4f16_2
- q8f16_1
- autogptq_llama_q4f16_1

To run the model, please check out the [MLC instructions](https://mlc.ai/mlc-llm/docs/get_started/try_out.html).
In case the model libraries are not yet available in the [binary lib srepo](https://github.com/mlc-ai/binary-mlc-llm-libs), please obtain them from [this PR](https://github.com/mlc-ai/binary-mlc-llm-libs/pull/15/files)
