

## Model description

BERT model trained on amino acid sequences for proteins from Uniprot between 50 and 250 amino acids in length

## Intended uses & limitations

This model was solely intended to investigate how BERT performs for MLM with amino acid sequences. Given that the training dataset is comparatively small (~195k samples), the model is not likely to be particularly useful on its own. Potentially, it can be fine tuned for more specific tasks. 


### Framework versions

- Transformers 4.37.0.dev0
- Pytorch 2.1.0+cu121
- Tokenizers 0.15.0

{"tags": ["generated_from_trainer"], "widget": [{"text": "M A T L E K L M K A F E S L K S F Q Q Q Q Q Q Q Q Q Q Q <mask> Q Q Q Q Q Q Q Q Q P P P P P P P P P P P P L P Q P P G S W G A"}], "pipeline_tag": "fill-mask", "model-index": [{"name": "SEQUENCES_BERT", "results": []}]}
transformers tensorboard safetensors roberta fill-mask generated_from_trainer autotrain_compatible endpoints_compatible region:us