
# falcon7b-linear-equations-merged

This model is a merged version of [falcon7b-linear-equations](https://huggingface.co/Menouar/falcon7b-linear-equations) with QLoRA.

```python
from transformers import AutoTokenizer, AutoModelForCausalLM, pipeline

model = AutoModelForCausalLM.from_pretrained("Menouar/falcon7b-linear-equations-merged")
tokenizer = AutoTokenizer.from_pretrained("Menouar/falcon7b-linear-equations-merged",
                                          device_map="auto",
                                          torch_dtype=torch.float16)

pipe = pipeline("text-generation", model=model, tokenizer=tokenizer)

outputs = pipe("Solve for y: 10 + 4y -9y +5 = 4 +8y - 2y", 
               max_new_tokens=172, 
               do_sample=True, 
               temperature=0.1,
               top_k=50, top_p=0.1,
               eos_token_id=pipe.tokenizer.eos_token_id,
               pad_token_id=pipe.tokenizer.pad_token_id)

for seq in outputs:
    print(f"{seq['generated_text']}")

```
{"license": "apache-2.0", "library_name": "transformers", "tags": ["falcon", "QLoRA", "falcon7b-linear-equations"], "datasets": ["Menouar/LinearEquations"], "pipeline_tag": "text-generation"}
transformers safetensors falcon text-generation QLoRA falcon7b-linear-equations custom_code dataset:Menouar/LinearEquations license:apache-2.0 autotrain_compatible endpoints_compatible text-generation-inference region:us