
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# test.mobilebert-uncased-squadv1

This model takes the same weights as [neuralmagic/mobilebert-uncased-finetuned-squadv1](https://huggingface.co/neuralmagic/mobilebert-uncased-finetuned-squadv1) but is converted to OpenVINO IR format.

Eval results: (pad_to_max_length=True, max_length=384)

- torch model eval_exact_match: 83.9735
- torch model eval_f1: 90.9013



### Framework versions

- Transformers 4.26.0
- Pytorch 1.13.1+cu116
- Datasets 2.8.0
- Tokenizers 0.13.2
- Optimum-intel 1.7.0
- NNCF 2.4.0
- Openvino-dev 2023.0.0.dev20230217


{"tags": ["generated_from_trainer"], "datasets": ["squad"], "model-index": [{"name": "test.mobilebert-uncased-squadv1", "results": [{"task": {"type": "question-answering", "name": "Question Answering"}, "dataset": {"name": "Squadv1", "type": "squadv1", "split": "validation"}, "metrics": [{"type": "f1", "value": 90.9013, "name": "F1"}, {"type": "exact_match", "value": 83.9735, "name": "EM"}]}]}]}
transformers pytorch openvino mobilebert generated_from_trainer dataset:squad model-index endpoints_compatible region:us
TAGS
#transformers #pytorch #openvino #mobilebert #generated_from_trainer #dataset-squad #model-index #endpoints_compatible #region-us 




# test.mobilebert-uncased-squadv1

This model takes the same weights as neuralmagic/mobilebert-uncased-finetuned-squadv1 but is converted to OpenVINO IR format.

Eval results: (pad_to_max_length=True, max_length=384)

- torch model eval_exact_match: 83.9735
- torch model eval_f1: 90.9013



### Framework versions

- Transformers 4.26.0
- Pytorch 1.13.1+cu116
- Datasets 2.8.0
- Tokenizers 0.13.2
- Optimum-intel 1.7.0
- NNCF 2.4.0
- Openvino-dev 2023.0.0.dev20230217


# test.mobilebert-uncased-squadv1

This model takes the same weights as neuralmagic/mobilebert-uncased-finetuned-squadv1 but is converted to OpenVINO IR format.

Eval results: (pad_to_max_length=True, max_length=384)

- torch model eval_exact_match: 83.9735
- torch model eval_f1: 90.9013 ### Framework versions

- Transformers 4.26.0
- Pytorch 1.13.1+cu116
- Datasets 2.8.0
- Tokenizers 0.13.2
- Optimum-intel 1.7.0
- NNCF 2.4.0
- Openvino-dev 2023.0.0.dev20230217
TAGS
#transformers #pytorch #openvino #mobilebert #generated_from_trainer #dataset-squad #model-index #endpoints_compatible #region-us 
 # test.mobilebert-uncased-squadv1

This model takes the same weights as neuralmagic/mobilebert-uncased-finetuned-squadv1 but is converted to OpenVINO IR format.

Eval results: (pad_to_max_length=True, max_length=384)

- torch model eval_exact_match: 83.9735
- torch model eval_f1: 90.9013 ### Framework versions

- Transformers 4.26.0
- Pytorch 1.13.1+cu116
- Datasets 2.8.0
- Tokenizers 0.13.2
- Optimum-intel 1.7.0
- NNCF 2.4.0
- Openvino-dev 2023.0.0.dev20230217
TAGS
#transformers #pytorch #openvino #mobilebert #generated_from_trainer #dataset-squad #model-index #endpoints_compatible #region-us 
# test.mobilebert-uncased-squadv1

This model takes the same weights as neuralmagic/mobilebert-uncased-finetuned-squadv1 but is converted to OpenVINO IR format.

Eval results: (pad_to_max_length=True, max_length=384)

- torch model eval_exact_match: 83.9735
- torch model eval_f1: 90.9013### Framework versions

- Transformers 4.26.0
- Pytorch 1.13.1+cu116
- Datasets 2.8.0
- Tokenizers 0.13.2
- Optimum-intel 1.7.0
- NNCF 2.4.0
- Openvino-dev 2023.0.0.dev20230217