Remek commited on
Commit
35cb1f7
·
verified ·
1 Parent(s): 227709a

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +44 -0
README.md ADDED
@@ -0,0 +1,44 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language:
3
+ - pl
4
+ license: apache-2.0
5
+ library_name: transformers
6
+ tags:
7
+ - finetuned
8
+ - gguf
9
+ inference: false
10
+ pipeline_tag: text-generation
11
+ ---
12
+ <p align="center">
13
+ <img src="https://huggingface.co/speakleash/Bielik-7B-Instruct-v0.1-GGUF/raw/main/speakleash_cyfronet.png">
14
+ </p>
15
+
16
+ # Bielik-11B-v2.2-Instruct-MLX-4bit
17
+ This model was converted to MLX format from [SpeakLeash](https://speakleash.org/)'s [Bielik-11B-v.2.2-Instruct](https://huggingface.co/speakleash/Bielik-11B-v2.2-Instruct).
18
+
19
+ ## Use with mlx
20
+
21
+ ```bash
22
+ pip install mlx-lm
23
+ ```
24
+
25
+ ```python
26
+ from mlx_lm import load, generate
27
+
28
+ model, tokenizer = load("speakleash/Bielik-11B-v2.2-Instruct-MLX-4bit")
29
+ response = generate(model, tokenizer, prompt="hello", verbose=True)
30
+ ```
31
+
32
+ ### Model description:
33
+
34
+ * **Developed by:** [SpeakLeash](https://speakleash.org/)
35
+ * **Language:** Polish
36
+ * **Model type:** causal decoder-only
37
+ * **Quant from:** [Bielik-11B-v2.2-Instruct](https://huggingface.co/speakleash/Bielik-11B-v2.2-Instruct)
38
+ * **Finetuned from:** [Bielik-11B](https://huggingface.co/speakleash/Bielik-11B)
39
+ * **License:** apache-2.0
40
+
41
+
42
+ ## Contact Us
43
+
44
+ If you have any questions or suggestions, please use the discussion tab. If you want to contact us directly, join our [Discord SpeakLeash](https://discord.gg/3G9DVM39).