# LunaLora

This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).

## Merge Details
### Merge Method

This model was merged using the [linear](https://arxiv.org/abs/2203.05482) merge method.

### Models Merged

The following models were included in the merge:
* [w4r10ck/SOLAR-10.7B-Instruct-v1.0-uncensored](https://huggingface.co/w4r10ck/SOLAR-10.7B-Instruct-v1.0-uncensored) + [jeiku/Luna_LoRA_SOLAR](https://huggingface.co/jeiku/Luna_LoRA_SOLAR)

### Configuration

The following YAML configuration was used to produce this model:

```yaml
merge_method: linear
models:
  - model: w4r10ck/SOLAR-10.7B-Instruct-v1.0-uncensored+jeiku/Luna_LoRA_SOLAR
    parameters:
      weight: 1       
dtype: float16

```

{"tags": ["mergekit", "merge"], "base_model": ["w4r10ck/SOLAR-10.7B-Instruct-v1.0-uncensored", "jeiku/Luna_LoRA_SOLAR"]}
transformers safetensors llama text-generation mergekit merge arxiv:2203.05482 base_model:w4r10ck/SOLAR-10.7B-Instruct-v1.0-uncensored base_model:jeiku/Luna_LoRA_SOLAR autotrain_compatible endpoints_compatible text-generation-inference region:us