# This is an experimental model that I made by merging two Llama2 70b models and gluing them together with the mergekit of llama70b. The mergekit is a tool that lets me mix and match different models into one big model, keeping all the smarts and skills of the original models. The llama70b is a huge language model that can make words for all kinds of things and ways, based on the GPT-4 thingy.

The merged model has 55 billion parameters and was made trained on 640GB of vram cluster
{"license": "cc-by-nd-4.0", "tags": ["dpo"], "base_model": []}
transformers safetensors llama text-generation dpo conversational license:cc-by-nd-4.0 autotrain_compatible endpoints_compatible text-generation-inference region:us