ApostolosK
commited on
Update README.md
Browse files
README.md
CHANGED
@@ -1,3 +1,36 @@
|
|
1 |
-
---
|
2 |
-
license: mit
|
3 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
license: mit
|
3 |
+
language:
|
4 |
+
- el
|
5 |
+
pipeline_tag: text-classification
|
6 |
+
---
|
7 |
+
# GreekDeBERTaV3-xsmall
|
8 |
+
|
9 |
+
GreekDeBERTaV3-xsmall is a compact version of the GreekDeBERTaV3 model, optimized for use in environments with limited computational resources, while still maintaining strong performance on Greek NLP tasks. It is based on the DeBERTaV3 architecture, utilizing Replaced Token Detection (RTD) during pre-training.
|
10 |
+
|
11 |
+
## Model Overview
|
12 |
+
|
13 |
+
- **Model Architecture**: DeBERTaV3-xsmall
|
14 |
+
- **Language**: Greek
|
15 |
+
- **Pre-training Tasks**: Replaced Token Detection (RTD)
|
16 |
+
- **Tokenizer**: SentencePiece Model (spm.model)
|
17 |
+
|
18 |
+
This smaller version is ideal for use cases where inference time and model size are critical without a significant compromise in performance.
|
19 |
+
|
20 |
+
## Files
|
21 |
+
|
22 |
+
- `config.json`: Configuration file for the model.
|
23 |
+
- `pytorch_model.bin`: The PyTorch weights of the smaller model.
|
24 |
+
- `spm.model`: The SentencePiece tokenizer model.
|
25 |
+
- `vocab.txt`: Vocabulary file for the tokenizer.
|
26 |
+
- `tokenizer_config.json`: Tokenizer configuration file.
|
27 |
+
|
28 |
+
## How to Use
|
29 |
+
|
30 |
+
You can use this model with the Hugging Face `transformers` library:
|
31 |
+
|
32 |
+
```python
|
33 |
+
from transformers import AutoTokenizer, AutoModelForTokenClassification
|
34 |
+
|
35 |
+
tokenizer = AutoTokenizer.from_pretrained("AI-team-UoA/GreekDeBERTaV3-xsmall")
|
36 |
+
model = AutoModelForTokenClassification.from_pretrained("AI-team-UoA/GreekDeBERTaV3-xsmall")
|