---
license: llama3.1
pipeline_tag: text-generation
---

**Llama3.1-Typhoon2-70B**: Thai Large Language Model (Instruct)

**Llama3.1-Typhoon2-70B** is a pretrained only Thai 🇹🇭 large language model with 70 billion parameters, and it is based on Llama3.1-70B.

For technical-report. please see our [arxiv](https://arxiv.org/abs/2412.13702).
*To acknowledge Meta's effort in creating the foundation model and to comply with the license, we explicitly include "llama-3.1" in the model name.

## **Performance**

| Model                   | ThaiExam  | ONET     | IC        | A-Level   | TGAT      | TPAT      | M3Exam    | Math       | Science    | Social     | Thai       |
|--------------------------|-----------|----------|-----------|-----------|-----------|-----------|-----------|------------|------------|------------|------------|
| **Typhoon1.5x 70B instruct**     | 62.96%    | 60.49%   | **71.57%** | 53.54%    | **72.30%** | **56.89%** | **62.54%** | **45.70%** | 62.56%     | 77.73%     | 64.19%     |
| **Llama3.1 70B**         | 60.74%    | 62.34%   | 67.36%    | 53.54%    | 66.15%    | 54.31%    | 60.35%    | 38.91%     | 62.56%     | 76.99%     | 62.96%     |
| **Typhoon2 Llama 3.1 70B base** | **63.39%** | **65.43%** | 69.47%    | **59.84%** | 66.15%    | 56.03%    | 62.33%    | 42.98%     | **63.28%** | **78.60%** | **64.47%** |


## **Model Description**

- **Model type**: A 70B decoder-only model based on Llama architecture.
- **Requirement**: transformers 4.45.0 or newer.
- **Primary Language(s)**: Thai 🇹🇭 and English 🇬🇧
- **License**: [Llama 3.1 Community License](https://github.com/meta-llama/llama-models/blob/main/models/llama3_1/LICENSE)


## **Intended Uses & Limitations**

This model is a pretrained base model. Thus, it may not be able to follow human instructions without using one/few-shot learning or instruction fine-tuning. The model does not have any moderation mechanisms, and may generate harmful or inappropriate responses.

## **Follow us**

**https://twitter.com/opentyphoon**

## **Support**

**https://discord.gg/CqyBscMFpg**

## **Citation**

- If you find Typhoon2 useful for your work, please cite it using:
```
@misc{typhoon2,
      title={Typhoon 2: A Family of Open Text and Multimodal Thai Large Language Models}, 
      author={Kunat Pipatanakul and Potsawee Manakul and Natapong Nitarach and Warit Sirichotedumrong and Surapon Nonesung and Teetouch Jaknamon and Parinthapat Pengpun and Pittawat Taveekitworachai and Adisai Na-Thalang and Sittipong Sripaisarnmongkol and Krisanapong Jirayoot and Kasima Tharnpipitchai},
      year={2024},
      eprint={2412.13702},
      archivePrefix={arXiv},
      primaryClass={cs.CL},
      url={https://arxiv.org/abs/2412.13702}, 
}
```