
# roberta-base-ko

A roberta model trained from the scratch. It has almost the same structure as [roberta-base](https://huggingface.co/roberta-base), but with a few differences.

- hidden_act: `mish`
- position_embedding_type: `relative_key_query`

{"language": "ko", "license": "mit", "pipeline_tag": "fill-mask", "mask_token": "<mask>", "widget": [{"text": "\ub300\ud55c\ubbfc\uad6d\uc758 \uc218\ub3c4\uc778 \uc11c\uc6b8\uc740 \ud604\ub300\uc801\uc778 \uace0\uce35 \ube4c\ub529, \ucca8\ub2e8 \uae30\uc220\uc758 \uc9c0\ud558\ucca0, \ub300\uc911\ubb38\ud654\uc640 \uc0ac\ucc30, \uace0\uad81, \ub178\uc810\uc0c1\uc774 \uacf5\uc874\ud558\ub294 <mask>\uc785\ub2c8\ub2e4."}]}
transformers pytorch safetensors roberta fill-mask ko license:mit autotrain_compatible endpoints_compatible region:us
TAGS
#transformers #pytorch #safetensors #roberta #fill-mask #ko #license-mit #autotrain_compatible #endpoints_compatible #region-us 


# roberta-base-ko

A roberta model trained from the scratch. It has almost the same structure as roberta-base, but with a few differences.

- hidden_act: 'mish'
- position_embedding_type: 'relative_key_query'

# roberta-base-ko

A roberta model trained from the scratch. It has almost the same structure as roberta-base, but with a few differences.

- hidden_act: 'mish'
- position_embedding_type: 'relative_key_query'
TAGS
#transformers #pytorch #safetensors #roberta #fill-mask #ko #license-mit #autotrain_compatible #endpoints_compatible #region-us 
 # roberta-base-ko

A roberta model trained from the scratch. It has almost the same structure as roberta-base, but with a few differences.

- hidden_act: 'mish'
- position_embedding_type: 'relative_key_query'
TAGS
#transformers #pytorch #safetensors #roberta #fill-mask #ko #license-mit #autotrain_compatible #endpoints_compatible #region-us 
# roberta-base-ko

A roberta model trained from the scratch. It has almost the same structure as roberta-base, but with a few differences.

- hidden_act: 'mish'
- position_embedding_type: 'relative_key_query'