
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# UmoreskiAI

This model is a fine-tuned version of [DeepPavlov/rubert-base-cased-sentence](https://huggingface.co/DeepPavlov/rubert-base-cased-sentence) on an unknown dataset.
It achieves the following results on the evaluation set:
- Loss: 0.0956
- Roc auc: 0.8014
- Maxf1: 0.4348
- Best Threshold: 0.1332

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 2e-05
- train_batch_size: 8
- eval_batch_size: 8
- seed: 21
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 2

### Training results

| Training Loss | Epoch | Step | Validation Loss | Roc auc | Maxf1  | Best Threshold |
|:-------------:|:-----:|:----:|:---------------:|:-------:|:------:|:--------------:|
| 0.1013        | 1.0   | 993  | 0.0932          | 0.7972  | 0.4358 | 0.1875         |
| 0.0876        | 2.0   | 1986 | 0.0956          | 0.8014  | 0.4348 | 0.1332         |


### Framework versions

- Transformers 4.27.4
- Pytorch 2.0.0+cu118
- Datasets 2.11.0
- Tokenizers 0.12.1

{"language": "ru", "tags": ["generated_from_trainer"], "widget": [{"text": "\u0412 \u0448\u043a\u043e\u043b\u0435 \u0415\u0432\u043a\u043b\u0438\u0434\u0430 \u0434\u0435\u0442\u0438 \u0438\u0437 \u043f\u0430\u0440\u0430\u043b\u043b\u0435\u043b\u044c\u043d\u044b\u0445 \u043a\u043b\u0430\u0441\u0441\u043e\u0432 \u043d\u0438\u043a\u043e\u0433\u0434\u0430 \u043d\u0435 \u043f\u0435\u0440\u0435\u0441\u0435\u043a\u0430\u043b\u0438\u0441\u044c"}, {"text": "\u041a\u0430\u043a \u043e\u0441\u0442\u0430\u043d\u043e\u0432\u0438\u0442\u044c \u0441\u0442\u0440\u0435\u043b\u044c\u0431\u0443 \u0432 \u0448\u043a\u043e\u043b\u0435 ? \u0421\u043a\u0430\u0437\u0430\u0442\u044c, \u0447\u0442\u043e \u0432\u044b \u043d\u0435 \u043a\u0443\u0440\u0438\u0442\u0435."}, {"text": "\u041f\u0430\u0440\u0435\u043d\u044c \u0441 \u0434\u0435\u0432\u0443\u0448\u043a\u043e\u0439 \u043f\u0440\u0438\u0445\u043e\u0434\u044f\u0442 \u043f\u043e\u0441\u043b\u0435 \u0441\u0432\u0438\u0434\u0430\u043d\u0438\u044f \u043a \u043d\u0435\u043c\u0443 \u0434\u043e\u043c\u043e\u0439. \u041e\u043d \u0434\u043e\u0441\u0442\u0430\u0435\u0442 \u043a\u043b\u044e\u0447\u0438, \u0430 \u0434\u0435\u0432\u0443\u0448\u043a\u0430 \u0435\u043c\u0443 \u0433\u043e\u0432\u043e\u0440\u0438\u0442: - \u0422\u044b \u0437\u043d\u0430\u0435\u0448\u044c, \u044f \u0441\u043c\u043e\u0442\u0440\u044e \u043a\u0430\u043a \u043c\u0443\u0436\u0447\u0438\u043d\u0430 \u043e\u0442\u043a\u0440\u044b\u0432\u0430\u0435\u0442 \u0434\u0432\u0435\u0440\u044c \u0438 \u043e\u043f\u0440\u0435\u0434\u0435\u043b\u044f\u044e, \u043f\u043e\u0434\u0445\u043e\u0434\u0438\u043c \u043b\u0438 \u043c\u044b \u0434\u0440\u0443\u0433 \u0434\u0440\u0443\u0433\u0443... \u0415\u0441\u043b\u0438 \u043e\u043d \u0433\u0440\u0443\u0431\u043e \u0432\u0442\u044b\u043a\u0430\u0435\u0442 \u043a\u043b\u044e\u0447 \u0432 \u0434\u0432\u0435\u0440\u044c - \u043e\u043d \u0433\u0440\u0443\u0431\u044b\u0439 \u043b\u044e\u0431\u043e\u0432\u043d\u0438\u043a \u0438 \u043e\u043d \u043d\u0435 \u0434\u043b\u044f \u043c\u0435\u043d\u044f, \u0430 \u0435\u0441\u043b\u0438 \u043e\u043d \u0440\u043e\u043d\u044f\u0435\u0442 \u043a\u043b\u044e\u0447\u0438 \u0438 \u043d\u0435 \u043c\u043e\u0436\u0435\u0442 \u043d\u0430\u0439\u0442\u0438 \u0437\u0430\u043c\u043e\u0447\u043d\u0443\u044e \u0441\u043a\u0432\u0430\u0436\u0438\u043d\u0443, \u043e\u043d \u043d\u0435\u043e\u043f\u044b\u0442\u043d\u044b\u0439 \u043b\u044e\u0431\u043e\u0432\u043d\u0438\u043a \u0438 \u043e\u043d \u0442\u043e\u0436\u0435 \u043d\u0435 \u0434\u043b\u044f \u043c\u0435\u043d\u044f... \u0410 \u0432\u043e\u0442 \u043a\u0430\u043a \u0442\u044b \u043e\u0442\u043a\u0440\u044b\u0432\u0430\u0435\u0448\u044c \u0434\u0432\u0435\u0440\u044c, \u043c\u0438\u043b\u044b\u0439? \u041f\u0430\u0440\u0435\u043d\u044c \u0437\u0430\u0431\u0438\u043b\u0441\u044f \u0432 \u0437\u0430\u043c\u043e\u0447\u043d\u0443\u044e \u0441\u043a\u0432\u0430\u0436\u0438\u043d\u0443, \u0438 \u0442\u043e\u043b\u044c\u043a\u043e \u0440\u043e\u0442 \u0441\u043d\u0430\u0440\u0443\u0436\u0438"}], "model-index": [{"name": "UmoreskiAI", "results": []}]}
transformers pytorch bert text-classification generated_from_trainer ru autotrain_compatible endpoints_compatible region:us
TAGS
#transformers #pytorch #bert #text-classification #generated_from_trainer #ru #autotrain_compatible #endpoints_compatible #region-us 

UmoreskiAI
==========


This model is a fine-tuned version of DeepPavlov/rubert-base-cased-sentence on an unknown dataset.
It achieves the following results on the evaluation set:


* Loss: 0.0956
* Roc auc: 0.8014
* Maxf1: 0.4348
* Best Threshold: 0.1332


Model description
-----------------


More information needed


Intended uses & limitations
---------------------------


More information needed


Training and evaluation data
----------------------------


More information needed


Training procedure
------------------


### Training hyperparameters


The following hyperparameters were used during training:


* learning\_rate: 2e-05
* train\_batch\_size: 8
* eval\_batch\_size: 8
* seed: 21
* optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
* lr\_scheduler\_type: linear
* num\_epochs: 2


### Training results



### Framework versions


* Transformers 4.27.4
* Pytorch 2.0.0+cu118
* Datasets 2.11.0
* Tokenizers 0.12.1



### Training hyperparameters


The following hyperparameters were used during training:


* learning\_rate: 2e-05
* train\_batch\_size: 8
* eval\_batch\_size: 8
* seed: 21
* optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
* lr\_scheduler\_type: linear
* num\_epochs: 2 ### Training results ### Framework versions


* Transformers 4.27.4
* Pytorch 2.0.0+cu118
* Datasets 2.11.0
* Tokenizers 0.12.1
TAGS
#transformers #pytorch #bert #text-classification #generated_from_trainer #ru #autotrain_compatible #endpoints_compatible #region-us 
 ### Training hyperparameters


The following hyperparameters were used during training:


* learning\_rate: 2e-05
* train\_batch\_size: 8
* eval\_batch\_size: 8
* seed: 21
* optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
* lr\_scheduler\_type: linear
* num\_epochs: 2 ### Training results ### Framework versions


* Transformers 4.27.4
* Pytorch 2.0.0+cu118
* Datasets 2.11.0
* Tokenizers 0.12.1
TAGS
#transformers #pytorch #bert #text-classification #generated_from_trainer #ru #autotrain_compatible #endpoints_compatible #region-us 
### Training hyperparameters


The following hyperparameters were used during training:


* learning\_rate: 2e-05
* train\_batch\_size: 8
* eval\_batch\_size: 8
* seed: 21
* optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
* lr\_scheduler\_type: linear
* num\_epochs: 2### Training results### Framework versions


* Transformers 4.27.4
* Pytorch 2.0.0+cu118
* Datasets 2.11.0
* Tokenizers 0.12.1