transformers pytorch bert fill-mask arxiv:2311.17492 doi:10.57967/hf/1599 license:apache-2.0 autotrain_compatible endpoints_compatible region:us
---
license: apache-2.0
pipeline_tag: fill-mask
---


# manchuBERT

This is a BERT-base model trained with romanized Manchu data from scratch.


# Data

manchuBERT utilizes the data augmentation method from [Mergen: The First Manchu-Korean Machine Translation Model Trained on Augmented Data](https://arxiv.org/pdf/2311.17492.pdf).

|          **Data**          | **Number of Sentences(before augmentation)** |
|:---------------------------:|:-----------------------:|
|   Manwén Lˇaodàng–Taizong   |          2,220          |
|      Ilan gurun i bithe     |          41,904         |
|      Gin ping mei bithe     |          21,376         |
|      Yùzhì Q¯ıngwénjiàn     |          11,954         |
| Yùzhì Zengdìng Q¯ıngwénjiàn |          18,420         |
|    Manwén Lˇaodàng–Taizu    |          22,578         |
|   Manchu-Korean Dictionary  |          40,583         |




