ApostolosK commited on
Commit
3bf7f62
·
verified ·
1 Parent(s): 2528f0a

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +36 -3
README.md CHANGED
@@ -1,3 +1,36 @@
1
- ---
2
- license: mit
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ language:
4
+ - el
5
+ pipeline_tag: text-classification
6
+ ---
7
+ # GreekDeBERTaV3-xsmall
8
+
9
+ GreekDeBERTaV3-xsmall is a compact version of the GreekDeBERTaV3 model, optimized for use in environments with limited computational resources, while still maintaining strong performance on Greek NLP tasks. It is based on the DeBERTaV3 architecture, utilizing Replaced Token Detection (RTD) during pre-training.
10
+
11
+ ## Model Overview
12
+
13
+ - **Model Architecture**: DeBERTaV3-xsmall
14
+ - **Language**: Greek
15
+ - **Pre-training Tasks**: Replaced Token Detection (RTD)
16
+ - **Tokenizer**: SentencePiece Model (spm.model)
17
+
18
+ This smaller version is ideal for use cases where inference time and model size are critical without a significant compromise in performance.
19
+
20
+ ## Files
21
+
22
+ - `config.json`: Configuration file for the model.
23
+ - `pytorch_model.bin`: The PyTorch weights of the smaller model.
24
+ - `spm.model`: The SentencePiece tokenizer model.
25
+ - `vocab.txt`: Vocabulary file for the tokenizer.
26
+ - `tokenizer_config.json`: Tokenizer configuration file.
27
+
28
+ ## How to Use
29
+
30
+ You can use this model with the Hugging Face `transformers` library:
31
+
32
+ ```python
33
+ from transformers import AutoTokenizer, AutoModelForTokenClassification
34
+
35
+ tokenizer = AutoTokenizer.from_pretrained("AI-team-UoA/GreekDeBERTaV3-xsmall")
36
+ model = AutoModelForTokenClassification.from_pretrained("AI-team-UoA/GreekDeBERTaV3-xsmall")