Update README.md
Browse files
README.md
CHANGED
@@ -50,7 +50,19 @@ model = AutoModel.from_pretrained("nlpaueb/sec-bert-base")
|
|
50 |
|
51 |
## Use LEBAL-BERT variants as Language Models
|
52 |
|
53 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
54 |
| ---------------------------------- | ------------ | ------------ |
|
55 |
| Total net sales [MASK] 2% or $5.4 billion during 2019 compared to 2018.
|
56 |
| **BERT-BASE-UNCASED** | decreased | increased (0.221), were (0.131), are (0.103), rose (0.075), of (0.058)
|
|
|
50 |
|
51 |
## Use LEBAL-BERT variants as Language Models
|
52 |
|
53 |
+
| Sample | Masked Token |
|
54 |
+
| --------------------------------------------------- | ------------ |
|
55 |
+
| Total net sales [MASK] 2% or $5.4 billion during 2019 compared to 2018. | decreased
|
56 |
+
|
57 |
+
|
58 |
+
| Model | Predictions (Probability) |
|
59 |
+
| --------------------------------------------------- | ------------ |
|
60 |
+
| **BERT-BASE-UNCASED** | increased (0.221), were (0.131), are (0.103), rose (0.075), of (0.058)
|
61 |
+
| **SEC-BERT-BASE** | increased (0.678), decreased (0.282), declined (0.017), grew (0.016), rose (0.004)
|
62 |
+
| **SEC-BERT-NUM** | increased (0.665), decreased (0.281), grew (0.028), declined (0.015), rose (0.008)
|
63 |
+
| **SEC-BERT-SHAPE** | increased (0.793), decreased (0.145), grew (0.042), declined (0.011), rose (0.003)
|
64 |
+
|
65 |
+
| Model | Masked Token | Predictions (Probability) |
|
66 |
| ---------------------------------- | ------------ | ------------ |
|
67 |
| Total net sales [MASK] 2% or $5.4 billion during 2019 compared to 2018.
|
68 |
| **BERT-BASE-UNCASED** | decreased | increased (0.221), were (0.131), are (0.103), rose (0.075), of (0.058)
|