mosaicml
/

mosaic-bert-base-seqlen-1024

Model card Files Files and versions Community

mosaic-bert-base-seqlen-1024

3 contributors

History: 15 commits

SFconvertbot's picture

Adding `safetensors` variant of this model

4dbde85 verified 2 months ago

.gitattributes

1.48 kB

initial commit over 1 year ago
LICENSE

11.3 kB

Create LICENSE (#2) 11 months ago
README.md

13.9 kB

Update citation in README about 1 year ago
bert_layers.py

47.3 kB

Upload BertForMaskedLM over 1 year ago
bert_padding.py

6.26 kB

Upload BertForMaskedLM over 1 year ago
config.json

845 Bytes

Change attention_probs_dropout_prob to 0.1 so that triton FlashAttention dependencies are avoided about 1 year ago
configuration_bert.py

1.01 kB

Upload BertForMaskedLM over 1 year ago
flash_attn_triton.py

42.7 kB

Upload BertForMaskedLM over 1 year ago
model.safetensors

550 MB
LFS

Adding `safetensors` variant of this model 2 months ago
pytorch_model.bin
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.FloatStorage"
What is a pickle import?
550 MB
LFS

Upload BertForMaskedLM over 1 year ago