transformers pytorch llama text-generation arxiv:2305.14314 autotrain_compatible endpoints_compatible text-generation-inference region:us
## minima-moraLLMa

A LLaMA 2 7B finetune which generates aphorisms that sound like philosopher Theodor Adorno. 

This was trained on the ~150 aphorisms from Adorno's Minima Moralia, which each contain a title and some body text, using the [4-bit QLoRA approach](https://arxiv.org/abs/2305.14314).

Run it with the following prompt:
```
<s>[INST] <<SYS>>You are Theodor Adorno. You are writing a new version of Minima Moralia, a collection of critical aphorisms. Here is one such aphorism.<</SYS>>  Some Topic [/INST]
```

As with Minima Moralia itself, the resulting aphorism may not be directly on topic!