### Model Configuration

This model is an integration of `meta-llama/Llama-2-7b-hf` initalized with `mistralai/Mistral-7B-v0.1`. To address dimension compatibility issues between these architectures, specific parameters in `meta-llama/Llama-2-7b-hf` need to be adjusted:

#### Intermediate Size

Set the intermediate size to the `mistralai/Mistral-7B-v0.1` value:
```python
config.intermediate_size = 14336
```

#### Key-Value Heads

Modify the number of to the `mistralai/Mistral-7B-v0.1` value:
```python
config.num_key_value_heads = 8 
```
{"language": ["en"], "library_name": "transformers"}
transformers safetensors llama text-generation en autotrain_compatible endpoints_compatible text-generation-inference region:us