Jr23xd23 commited on
Commit
e846463
·
verified ·
1 Parent(s): cedd210

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +79 -18
README.md CHANGED
@@ -1,19 +1,80 @@
1
- ---
2
- base_model: unsloth/Llama-3.2-3B-Instruct
3
- language:
4
- - en
5
- license: apache-2.0
6
- tags:
7
- - text-generation-inference
8
- - transformers
9
- - unsloth
10
- - llama
11
- - trl
12
- ---
13
-
14
- # Uploaded model
15
-
16
- - **Developed by:** Jr23xd23
17
- - **License:** apache-2.0
18
- - **Finetuned from model :** unsloth/Llama-3.2-3B-Instruct
19
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ Math_Arabic_Llama-3.2-3B-Instruct
2
+ Model Description
3
+ Math_Arabic_Llama-3.2-3B-Instruct is a fine-tuned version of the Llama-3.2-3B-Instruct model, specifically optimized for solving mathematical problems in Arabic. This model leverages the power of the Arabic LLaMA Math Dataset to provide accurate and contextually relevant solutions to a wide range of mathematical queries in the Arabic language.
4
+ Key Features
 
 
 
 
 
 
 
 
 
 
 
 
 
 
5
 
6
+ Specialized in Arabic mathematical problem-solving
7
+ Covers a broad spectrum of mathematical topics
8
+ Ideal for educational applications and Arabic-language tutoring systems
9
+ Built on the robust Llama-3.2-3B-Instruct architecture
10
+
11
+ Model Details
12
+
13
+ Architecture: Transformer-based language model
14
+ Task: Text Generation (Instruction Following)
15
+ Language: Arabic
16
+ Base Model: meta-llama/Llama-3.2-3B-Instruct
17
+ Dataset: Arabic LLaMA Math Dataset
18
+ Number of Parameters: 3 billion
19
+ Fine-tuned by: Jr23xd23
20
+
21
+ Training Data
22
+ The model was fine-tuned on the Arabic LLaMA Math Dataset, which comprises 12,496 diverse mathematical examples covering:
23
+
24
+ Basic Arithmetic
25
+ Algebra
26
+ Geometry
27
+ Probability
28
+ Combinatorics
29
+
30
+ Each example in the dataset consists of:
31
+
32
+ An Instruction: The problem statement in Arabic
33
+ A Solution: The corresponding answer in Arabic
34
+
35
+ Intended Use
36
+ Primary Use Cases
37
+
38
+ Solving mathematical problems in Arabic
39
+ Powering educational applications for Arabic-speaking students
40
+ Enhancing Arabic-language tutoring systems
41
+ Facilitating mathematical reasoning tasks in Arabic
42
+
43
+ Usage Example
44
+ Here's how you can use the model with the Hugging Face Transformers library:
45
+ pythonCopyfrom transformers import AutoModelForCausalLM, AutoTokenizer
46
+
47
+ # Load model and tokenizer
48
+ tokenizer = AutoTokenizer.from_pretrained("Jr23xd23/Math_Arabic_Llama-3.2-3B-Instruct")
49
+ model = AutoModelForCausalLM.from_pretrained("Jr23xd23/Math_Arabic_Llama-3.2-3B-Instruct")
50
+
51
+ # Example: Solving a math problem in Arabic
52
+ input_text = "ما هو مجموع الزوايا في مثلث؟" # What is the sum of angles in a triangle?
53
+ inputs = tokenizer(input_text, return_tensors="pt")
54
+ output = model.generate(**inputs, max_length=100)
55
+ print(tokenizer.decode(output[0], skip_special_tokens=True))
56
+ Limitations
57
+
58
+ The model is optimized for mathematical tasks in Arabic and may not perform well on general language tasks.
59
+ Performance may decrease for extremely complex mathematical problems that fall outside the scope of the training dataset.
60
+ The model's responses should be verified for critical applications.
61
+
62
+ Ethical Considerations
63
+
64
+ Users should be aware of potential biases in the training data.
65
+ The model should not be used as the sole decision-maker in high-stakes scenarios.
66
+ Implement appropriate safeguards when deploying this model in educational settings.
67
+
68
+ License
69
+ This model is licensed under the Apache 2.0 License.
70
+ Citation
71
+ If you use this model in your research or projects, please use the following citation:
72
+ bibtexCopy@model{Math_Arabic_Llama_3.2_3B_Instruct,
73
+ title={Math_Arabic_Llama-3.2-3B-Instruct},
74
+ author={Jr23xd23},
75
+ year={2024},
76
+ publisher={Hugging Face},
77
+ url={https://huggingface.co/Jr23xd23/Math_Arabic_Llama-3.2-3B-Instruct},
78
+ }
79
+ Acknowledgements
80
+ We extend our gratitude to the creators of the Arabic LLaMA Math Dataset for providing an invaluable resource that made this fine-tuning possible.