transformers.js onnx mistral text-generation conversational base_model:Felladrin/TinyMistral-248M-SFT-v4 license:apache-2.0 region:us
---
license: apache-2.0
library_name: "transformers.js"
base_model: Felladrin/TinyMistral-248M-SFT-v4
---

INT8 ONNX version of [Felladrin/TinyMistral-248M-SFT-v4](https://huggingface.co/Felladrin/TinyMistral-248M-SFT-v4) to use with [Transformers.js](https://huggingface.co/docs/transformers.js).

## Usage

```js
import { pipeline } from '@xenova/transformers';

const prompt = `<|im_start|>user
Invited some friends to come home today. Give me some ideas for games to play with them!<|im_end|>
<|im_start|>assistant`;
const generator = await pipeline('text-generation', 'Felladrin/onnx-TinyMistral-248M-SFT-v4');
const output = await generator(prompt, { add_special_tokens: true, max_new_tokens: 128, do_sample: true, penalty_alpha: 0.6, top_k: 4, repetition_penalty: 1.07 });
console.log(output[0].generated_text);
// Sure! Here are a few suggestions for activities that could be added to a game night: 
// 1. Play board games and puzzle games 
// 2. Watch the movie trailer or gameplay videos 
// 3. Play a board game tournament or tournament with friends 
// 4. Watch movies on video or TV shows like Netflix, Hulu, and IFC.<|im_end|>
```
