
Lila - A mix of Mika v2 Instruct Dataset and Nyakura v3 Multi-turn Dataset. Same one used to train as the 70B model, just lacking the additional merge.

Both are extracted parts of Hesperus V2 which is still a work in progress. Well, it's kinda done? but I want to add more to it? yeah, wip.

Compute is thanks to my wallet, and runpod community pod a40s. Yeah that's it. The government also handed me some cash because of some scheme so that's nice, had some money to play around with, well, before I burnt it all due to Gacha games. 

Trained in ShareGPT format due to multi-turn capabilities.

use Vicuna 1.1 prompt format. Alpaca may work fine but give sub-optimal results.

Is it a good model? Subjective. I really had to wrangle the sampler settings to make it work.

Purely experimental, it's for me to mess around and learn with hyperparams and all.

```
User: <Prompt>

Assistant:
```

*Example Prompt:*

```
User: Mr Bot, how does one hit the griddy?

Assistant:
```
{"language": ["en"], "license": "cc-by-nc-4.0"}
gguf en license:cc-by-nc-4.0 region:us