khang119966
commited on
Update README.md
Browse files
README.md
CHANGED
@@ -13,7 +13,7 @@ widget:
|
|
13 |
# 5CD-AI/visobert-14gb-corpus
|
14 |
## Overview
|
15 |
<!-- Provide a quick summary of what the model is/does. -->
|
16 |
-
We continually pretrain `uitnlp/visobert` on a merged 14GB dataset
|
17 |
- Internal data (100M comments and 15M posts on Facebook)
|
18 |
- UIT data, which is used to pretrain `uitnlp/visobert`
|
19 |
- MC4 ecommerce
|
|
|
13 |
# 5CD-AI/visobert-14gb-corpus
|
14 |
## Overview
|
15 |
<!-- Provide a quick summary of what the model is/does. -->
|
16 |
+
We continually pretrain `uitnlp/visobert` on a merged 14GB dataset, the training dataset includes:
|
17 |
- Internal data (100M comments and 15M posts on Facebook)
|
18 |
- UIT data, which is used to pretrain `uitnlp/visobert`
|
19 |
- MC4 ecommerce
|