pytorch generated_from_trainer dataset:bionlp2004 license:apache-2.0 region:us
---
license: apache-2.0
tags:
- generated_from_trainer
datasets:
- bionlp2004
metrics:
- precision
- recall
- f1
- accuracy
model-index:
- name: bert-base-uncased_1_1039_token_headwise
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# bert-base-uncased_1_1039_token_headwise

This model is a fine-tuned version of [bert-base-uncased](https://huggingface.co/bert-base-uncased) on the bionlp2004 dataset.
It achieves the following results on the evaluation set:
- Loss: 0.7082
- Precision: 0.7269
- Recall: 0.7596
- F1: 0.7429
- Accuracy: 0.9313

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 0.001
- train_batch_size: 16
- eval_batch_size: 16
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 500

### Training results

| Training Loss | Epoch | Step  | Validation Loss | Precision | Recall | F1     | Accuracy |
|:-------------:|:-----:|:-----:|:---------------:|:---------:|:------:|:------:|:--------:|
| No log        | 1.0   | 65    | 0.3696          | 0.3899    | 0.4363 | 0.4118 | 0.8645   |
| No log        | 2.0   | 130   | 0.2642          | 0.5334    | 0.6793 | 0.5975 | 0.9087   |
| No log        | 3.0   | 195   | 0.2561          | 0.6154    | 0.6447 | 0.6297 | 0.9128   |
| No log        | 4.0   | 260   | 0.2290          | 0.6377    | 0.7034 | 0.6690 | 0.9261   |
| No log        | 5.0   | 325   | 0.2333          | 0.6567    | 0.7191 | 0.6865 | 0.9252   |
| No log        | 6.0   | 390   | 0.2503          | 0.6601    | 0.7355 | 0.6957 | 0.9241   |
| No log        | 7.0   | 455   | 0.2347          | 0.6643    | 0.7317 | 0.6964 | 0.9290   |
| 0.2402        | 8.0   | 520   | 0.2530          | 0.6651    | 0.7241 | 0.6933 | 0.9284   |
| 0.2402        | 9.0   | 585   | 0.2828          | 0.6476    | 0.7547 | 0.6970 | 0.9231   |
| 0.2402        | 10.0  | 650   | 0.2752          | 0.6853    | 0.6985 | 0.6919 | 0.9236   |
| 0.2402        | 11.0  | 715   | 0.2902          | 0.6817    | 0.7003 | 0.6909 | 0.9249   |
| 0.2402        | 12.0  | 780   | 0.3254          | 0.6492    | 0.7113 | 0.6789 | 0.9192   |
| 0.2402        | 13.0  | 845   | 0.3136          | 0.6856    | 0.6638 | 0.6745 | 0.9242   |
| 0.2402        | 14.0  | 910   | 0.3013          | 0.6657    | 0.7229 | 0.6931 | 0.9262   |
| 0.2402        | 15.0  | 975   | 0.3038          | 0.6879    | 0.7290 | 0.7078 | 0.9280   |
| 0.0852        | 16.0  | 1040  | 0.3190          | 0.6791    | 0.7063 | 0.6924 | 0.9271   |
| 0.0852        | 17.0  | 1105  | 0.3263          | 0.6541    | 0.7394 | 0.6942 | 0.9260   |
| 0.0852        | 18.0  | 1170  | 0.3186          | 0.6854    | 0.7263 | 0.7053 | 0.9281   |
| 0.0852        | 19.0  | 1235  | 0.3428          | 0.6758    | 0.7272 | 0.7006 | 0.9271   |
| 0.0852        | 20.0  | 1300  | 0.3660          | 0.6801    | 0.7043 | 0.6920 | 0.9220   |
| 0.0852        | 21.0  | 1365  | 0.3289          | 0.6802    | 0.7196 | 0.6993 | 0.9282   |
| 0.0852        | 22.0  | 1430  | 0.3304          | 0.6701    | 0.7317 | 0.6996 | 0.9262   |
| 0.0852        | 23.0  | 1495  | 0.3442          | 0.6732    | 0.7437 | 0.7067 | 0.9281   |
| 0.0541        | 24.0  | 1560  | 0.3710          | 0.6784    | 0.7367 | 0.7064 | 0.9272   |
| 0.0541        | 25.0  | 1625  | 0.3351          | 0.6773    | 0.7247 | 0.7002 | 0.9276   |
| 0.0541        | 26.0  | 1690  | 0.3637          | 0.6761    | 0.7398 | 0.7065 | 0.9275   |
| 0.0541        | 27.0  | 1755  | 0.3623          | 0.6610    | 0.7340 | 0.6956 | 0.9253   |
| 0.0541        | 28.0  | 1820  | 0.4048          | 0.6703    | 0.7364 | 0.7018 | 0.9245   |
| 0.0541        | 29.0  | 1885  | 0.3750          | 0.6756    | 0.7254 | 0.6996 | 0.9260   |
| 0.0541        | 30.0  | 1950  | 0.3637          | 0.6782    | 0.7547 | 0.7144 | 0.9287   |
| 0.0414        | 31.0  | 2015  | 0.3530          | 0.6604    | 0.7643 | 0.7086 | 0.9271   |
| 0.0414        | 32.0  | 2080  | 0.3778          | 0.6853    | 0.7419 | 0.7125 | 0.9286   |
| 0.0414        | 33.0  | 2145  | 0.3664          | 0.6740    | 0.7095 | 0.6913 | 0.9251   |
| 0.0414        | 34.0  | 2210  | 0.3695          | 0.6737    | 0.7470 | 0.7085 | 0.9271   |
| 0.0414        | 35.0  | 2275  | 0.3910          | 0.6824    | 0.7432 | 0.7115 | 0.9295   |
| 0.0414        | 36.0  | 2340  | 0.3814          | 0.6707    | 0.7412 | 0.7042 | 0.9263   |
| 0.0414        | 37.0  | 2405  | 0.3774          | 0.6760    | 0.7493 | 0.7108 | 0.9281   |
| 0.0414        | 38.0  | 2470  | 0.4391          | 0.6640    | 0.7504 | 0.7045 | 0.9249   |
| 0.0359        | 39.0  | 2535  | 0.3875          | 0.6797    | 0.7169 | 0.6978 | 0.9269   |
| 0.0359        | 40.0  | 2600  | 0.4387          | 0.6769    | 0.7021 | 0.6893 | 0.9228   |
| 0.0359        | 41.0  | 2665  | 0.4005          | 0.6776    | 0.7131 | 0.6949 | 0.9251   |
| 0.0359        | 42.0  | 2730  | 0.4221          | 0.6899    | 0.7301 | 0.7094 | 0.9271   |
| 0.0359        | 43.0  | 2795  | 0.4041          | 0.7058    | 0.7111 | 0.7085 | 0.9280   |
| 0.0359        | 44.0  | 2860  | 0.4384          | 0.6735    | 0.7198 | 0.6959 | 0.9238   |
| 0.0359        | 45.0  | 2925  | 0.3973          | 0.6865    | 0.7513 | 0.7175 | 0.9292   |
| 0.0359        | 46.0  | 2990  | 0.4180          | 0.6847    | 0.7337 | 0.7083 | 0.9263   |
| 0.0315        | 47.0  | 3055  | 0.3918          | 0.6697    | 0.7650 | 0.7142 | 0.9278   |
| 0.0315        | 48.0  | 3120  | 0.4501          | 0.6971    | 0.7387 | 0.7173 | 0.9282   |
| 0.0315        | 49.0  | 3185  | 0.4052          | 0.6633    | 0.7603 | 0.7085 | 0.9255   |
| 0.0315        | 50.0  | 3250  | 0.4000          | 0.7034    | 0.7407 | 0.7216 | 0.9306   |
| 0.0315        | 51.0  | 3315  | 0.4208          | 0.6809    | 0.7274 | 0.7034 | 0.9269   |
| 0.0315        | 52.0  | 3380  | 0.4207          | 0.6973    | 0.7362 | 0.7162 | 0.9295   |
| 0.0315        | 53.0  | 3445  | 0.4629          | 0.6726    | 0.7410 | 0.7052 | 0.9244   |
| 0.028         | 54.0  | 3510  | 0.4835          | 0.6730    | 0.7128 | 0.6923 | 0.9227   |
| 0.028         | 55.0  | 3575  | 0.4565          | 0.6821    | 0.7209 | 0.7009 | 0.9262   |
| 0.028         | 56.0  | 3640  | 0.4365          | 0.6909    | 0.7351 | 0.7123 | 0.9284   |
| 0.028         | 57.0  | 3705  | 0.4457          | 0.6844    | 0.7221 | 0.7028 | 0.9266   |
| 0.028         | 58.0  | 3770  | 0.4455          | 0.6926    | 0.7266 | 0.7092 | 0.9271   |
| 0.028         | 59.0  | 3835  | 0.4607          | 0.6756    | 0.7441 | 0.7082 | 0.9265   |
| 0.028         | 60.0  | 3900  | 0.4574          | 0.6908    | 0.7221 | 0.7061 | 0.9271   |
| 0.028         | 61.0  | 3965  | 0.4359          | 0.6732    | 0.7473 | 0.7083 | 0.9273   |
| 0.0263        | 62.0  | 4030  | 0.4431          | 0.6921    | 0.7362 | 0.7134 | 0.9279   |
| 0.0263        | 63.0  | 4095  | 0.4631          | 0.6820    | 0.7207 | 0.7008 | 0.9253   |
| 0.0263        | 64.0  | 4160  | 0.4473          | 0.6867    | 0.7398 | 0.7123 | 0.9269   |
| 0.0263        | 65.0  | 4225  | 0.4193          | 0.6793    | 0.7380 | 0.7074 | 0.9281   |
| 0.0263        | 66.0  | 4290  | 0.4733          | 0.6808    | 0.7326 | 0.7058 | 0.9247   |
| 0.0263        | 67.0  | 4355  | 0.5110          | 0.6847    | 0.6868 | 0.6858 | 0.9202   |
| 0.0263        | 68.0  | 4420  | 0.4554          | 0.6948    | 0.7165 | 0.7055 | 0.9261   |
| 0.0263        | 69.0  | 4485  | 0.4947          | 0.6892    | 0.7252 | 0.7067 | 0.9260   |
| 0.0237        | 70.0  | 4550  | 0.4514          | 0.6995    | 0.7265 | 0.7127 | 0.9283   |
| 0.0237        | 71.0  | 4615  | 0.4633          | 0.6811    | 0.7299 | 0.7046 | 0.9249   |
| 0.0237        | 72.0  | 4680  | 0.4369          | 0.6855    | 0.7284 | 0.7063 | 0.9258   |
| 0.0237        | 73.0  | 4745  | 0.4336          | 0.6898    | 0.7491 | 0.7182 | 0.9293   |
| 0.0237        | 74.0  | 4810  | 0.4685          | 0.6838    | 0.7097 | 0.6965 | 0.9259   |
| 0.0237        | 75.0  | 4875  | 0.4324          | 0.7028    | 0.7434 | 0.7225 | 0.9304   |
| 0.0237        | 76.0  | 4940  | 0.4981          | 0.6559    | 0.7120 | 0.6828 | 0.9216   |
| 0.0243        | 77.0  | 5005  | 0.4377          | 0.6961    | 0.7502 | 0.7221 | 0.9299   |
| 0.0243        | 78.0  | 5070  | 0.4363          | 0.6692    | 0.7428 | 0.7041 | 0.9263   |
| 0.0243        | 79.0  | 5135  | 0.4877          | 0.6955    | 0.7315 | 0.7131 | 0.9278   |
| 0.0243        | 80.0  | 5200  | 0.4440          | 0.6932    | 0.7450 | 0.7182 | 0.9284   |
| 0.0243        | 81.0  | 5265  | 0.4880          | 0.6928    | 0.7324 | 0.7121 | 0.9260   |
| 0.0243        | 82.0  | 5330  | 0.4389          | 0.6716    | 0.7351 | 0.7019 | 0.9246   |
| 0.0243        | 83.0  | 5395  | 0.4681          | 0.6731    | 0.7463 | 0.7078 | 0.9257   |
| 0.0243        | 84.0  | 5460  | 0.5041          | 0.6981    | 0.7238 | 0.7107 | 0.9263   |
| 0.0196        | 85.0  | 5525  | 0.4899          | 0.6760    | 0.7454 | 0.7090 | 0.9248   |
| 0.0196        | 86.0  | 5590  | 0.4508          | 0.6796    | 0.7396 | 0.7083 | 0.9272   |
| 0.0196        | 87.0  | 5655  | 0.4639          | 0.6957    | 0.7612 | 0.7270 | 0.9293   |
| 0.0196        | 88.0  | 5720  | 0.5052          | 0.7167    | 0.7052 | 0.7109 | 0.9267   |
| 0.0196        | 89.0  | 5785  | 0.4500          | 0.7028    | 0.7338 | 0.7180 | 0.9286   |
| 0.0196        | 90.0  | 5850  | 0.4773          | 0.6738    | 0.7650 | 0.7165 | 0.9274   |
| 0.0196        | 91.0  | 5915  | 0.4894          | 0.6778    | 0.6957 | 0.6866 | 0.9231   |
| 0.0196        | 92.0  | 5980  | 0.5065          | 0.6633    | 0.7625 | 0.7095 | 0.9250   |
| 0.0204        | 93.0  | 6045  | 0.4610          | 0.6983    | 0.7405 | 0.7188 | 0.9284   |
| 0.0204        | 94.0  | 6110  | 0.4562          | 0.6939    | 0.7421 | 0.7172 | 0.9286   |
| 0.0204        | 95.0  | 6175  | 0.5018          | 0.6847    | 0.7436 | 0.7129 | 0.9261   |
| 0.0204        | 96.0  | 6240  | 0.4578          | 0.6967    | 0.7238 | 0.7099 | 0.9263   |
| 0.0204        | 97.0  | 6305  | 0.4758          | 0.6921    | 0.7578 | 0.7235 | 0.9295   |
| 0.0204        | 98.0  | 6370  | 0.4724          | 0.6786    | 0.7434 | 0.7095 | 0.9272   |
| 0.0204        | 99.0  | 6435  | 0.4887          | 0.6815    | 0.7376 | 0.7085 | 0.9253   |
| 0.019         | 100.0 | 6500  | 0.4965          | 0.6866    | 0.7598 | 0.7213 | 0.9277   |
| 0.019         | 101.0 | 6565  | 0.4829          | 0.6981    | 0.7382 | 0.7175 | 0.9279   |
| 0.019         | 102.0 | 6630  | 0.4491          | 0.6997    | 0.7549 | 0.7263 | 0.9302   |
| 0.019         | 103.0 | 6695  | 0.4637          | 0.6858    | 0.7484 | 0.7157 | 0.9263   |
| 0.019         | 104.0 | 6760  | 0.5521          | 0.7089    | 0.6825 | 0.6955 | 0.9219   |
| 0.019         | 105.0 | 6825  | 0.5193          | 0.6947    | 0.7011 | 0.6979 | 0.9229   |
| 0.019         | 106.0 | 6890  | 0.4682          | 0.6947    | 0.7385 | 0.7160 | 0.9275   |
| 0.019         | 107.0 | 6955  | 0.4664          | 0.7038    | 0.7202 | 0.7119 | 0.9270   |
| 0.0193        | 108.0 | 7020  | 0.5158          | 0.6891    | 0.7122 | 0.7005 | 0.9253   |
| 0.0193        | 109.0 | 7085  | 0.5069          | 0.6761    | 0.7337 | 0.7037 | 0.9251   |
| 0.0193        | 110.0 | 7150  | 0.5207          | 0.7023    | 0.7045 | 0.7034 | 0.9229   |
| 0.0193        | 111.0 | 7215  | 0.5142          | 0.6748    | 0.7443 | 0.7078 | 0.9242   |
| 0.0193        | 112.0 | 7280  | 0.4928          | 0.7003    | 0.7117 | 0.7060 | 0.9262   |
| 0.0193        | 113.0 | 7345  | 0.5048          | 0.6859    | 0.7299 | 0.7072 | 0.9270   |
| 0.0193        | 114.0 | 7410  | 0.4970          | 0.7062    | 0.7319 | 0.7188 | 0.9281   |
| 0.0193        | 115.0 | 7475  | 0.4890          | 0.6929    | 0.7493 | 0.7200 | 0.9276   |
| 0.0159        | 116.0 | 7540  | 0.4921          | 0.6845    | 0.7499 | 0.7157 | 0.9256   |
| 0.0159        | 117.0 | 7605  | 0.5174          | 0.6938    | 0.6944 | 0.6941 | 0.9228   |
| 0.0159        | 118.0 | 7670  | 0.4855          | 0.6961    | 0.7491 | 0.7217 | 0.9276   |
| 0.0159        | 119.0 | 7735  | 0.4858          | 0.6990    | 0.7239 | 0.7113 | 0.9274   |
| 0.0159        | 120.0 | 7800  | 0.4926          | 0.7076    | 0.7529 | 0.7295 | 0.9298   |
| 0.0159        | 121.0 | 7865  | 0.4701          | 0.7045    | 0.7337 | 0.7188 | 0.9294   |
| 0.0159        | 122.0 | 7930  | 0.4705          | 0.7139    | 0.7315 | 0.7226 | 0.9297   |
| 0.0159        | 123.0 | 7995  | 0.4811          | 0.6975    | 0.7565 | 0.7258 | 0.9285   |
| 0.0178        | 124.0 | 8060  | 0.4861          | 0.7013    | 0.7455 | 0.7228 | 0.9290   |
| 0.0178        | 125.0 | 8125  | 0.4886          | 0.6899    | 0.7571 | 0.7219 | 0.9280   |
| 0.0178        | 126.0 | 8190  | 0.5003          | 0.6926    | 0.7551 | 0.7225 | 0.9280   |
| 0.0178        | 127.0 | 8255  | 0.5223          | 0.7013    | 0.7436 | 0.7218 | 0.9277   |
| 0.0178        | 128.0 | 8320  | 0.5101          | 0.7108    | 0.7308 | 0.7207 | 0.9284   |
| 0.0178        | 129.0 | 8385  | 0.5346          | 0.7061    | 0.7220 | 0.7139 | 0.9257   |
| 0.0178        | 130.0 | 8450  | 0.5603          | 0.6904    | 0.7529 | 0.7203 | 0.9259   |
| 0.0132        | 131.0 | 8515  | 0.5077          | 0.7088    | 0.7347 | 0.7215 | 0.9276   |
| 0.0132        | 132.0 | 8580  | 0.4954          | 0.7030    | 0.7302 | 0.7164 | 0.9296   |
| 0.0132        | 133.0 | 8645  | 0.5421          | 0.6945    | 0.7119 | 0.7031 | 0.9264   |
| 0.0132        | 134.0 | 8710  | 0.5303          | 0.6992    | 0.7493 | 0.7234 | 0.9278   |
| 0.0132        | 135.0 | 8775  | 0.5150          | 0.7030    | 0.7405 | 0.7213 | 0.9282   |
| 0.0132        | 136.0 | 8840  | 0.5388          | 0.6603    | 0.7401 | 0.6980 | 0.9228   |
| 0.0132        | 137.0 | 8905  | 0.5005          | 0.6944    | 0.7463 | 0.7194 | 0.9279   |
| 0.0132        | 138.0 | 8970  | 0.5137          | 0.6942    | 0.7482 | 0.7202 | 0.9265   |
| 0.0148        | 139.0 | 9035  | 0.5623          | 0.6976    | 0.7265 | 0.7117 | 0.9250   |
| 0.0148        | 140.0 | 9100  | 0.5130          | 0.6852    | 0.7436 | 0.7132 | 0.9264   |
| 0.0148        | 141.0 | 9165  | 0.5298          | 0.6817    | 0.7448 | 0.7119 | 0.9263   |
| 0.0148        | 142.0 | 9230  | 0.5653          | 0.6702    | 0.7326 | 0.7000 | 0.9232   |
| 0.0148        | 143.0 | 9295  | 0.5240          | 0.6951    | 0.7360 | 0.7149 | 0.9262   |
| 0.0148        | 144.0 | 9360  | 0.5129          | 0.7194    | 0.7450 | 0.7320 | 0.9304   |
| 0.0148        | 145.0 | 9425  | 0.5343          | 0.6809    | 0.7491 | 0.7134 | 0.9261   |
| 0.0148        | 146.0 | 9490  | 0.5193          | 0.6888    | 0.7198 | 0.7039 | 0.9257   |
| 0.0137        | 147.0 | 9555  | 0.5247          | 0.7087    | 0.7011 | 0.7049 | 0.9246   |
| 0.0137        | 148.0 | 9620  | 0.5176          | 0.6948    | 0.7621 | 0.7269 | 0.9273   |
| 0.0137        | 149.0 | 9685  | 0.5340          | 0.7055    | 0.7270 | 0.7161 | 0.9274   |
| 0.0137        | 150.0 | 9750  | 0.5710          | 0.6964    | 0.7358 | 0.7156 | 0.9252   |
| 0.0137        | 151.0 | 9815  | 0.5284          | 0.7119    | 0.7234 | 0.7176 | 0.9279   |
| 0.0137        | 152.0 | 9880  | 0.5471          | 0.6905    | 0.7335 | 0.7113 | 0.9267   |
| 0.0137        | 153.0 | 9945  | 0.5209          | 0.6932    | 0.7427 | 0.7171 | 0.9272   |
| 0.0134        | 154.0 | 10010 | 0.5243          | 0.6907    | 0.7356 | 0.7125 | 0.9262   |
| 0.0134        | 155.0 | 10075 | 0.5613          | 0.7104    | 0.7409 | 0.7253 | 0.9296   |
| 0.0134        | 156.0 | 10140 | 0.5605          | 0.7080    | 0.7202 | 0.7140 | 0.9258   |
| 0.0134        | 157.0 | 10205 | 0.5246          | 0.6943    | 0.7574 | 0.7245 | 0.9291   |
| 0.0134        | 158.0 | 10270 | 0.5370          | 0.6696    | 0.7459 | 0.7057 | 0.9245   |
| 0.0134        | 159.0 | 10335 | 0.5182          | 0.6915    | 0.7347 | 0.7125 | 0.9275   |
| 0.0134        | 160.0 | 10400 | 0.5131          | 0.6984    | 0.7147 | 0.7065 | 0.9264   |
| 0.0134        | 161.0 | 10465 | 0.5083          | 0.7124    | 0.7259 | 0.7191 | 0.9283   |
| 0.0122        | 162.0 | 10530 | 0.5521          | 0.6975    | 0.7392 | 0.7178 | 0.9261   |
| 0.0122        | 163.0 | 10595 | 0.5295          | 0.6910    | 0.7373 | 0.7134 | 0.9261   |
| 0.0122        | 164.0 | 10660 | 0.5166          | 0.7044    | 0.7515 | 0.7272 | 0.9283   |
| 0.0122        | 165.0 | 10725 | 0.5229          | 0.7238    | 0.7126 | 0.7181 | 0.9270   |
| 0.0122        | 166.0 | 10790 | 0.5631          | 0.6881    | 0.7590 | 0.7218 | 0.9258   |
| 0.0122        | 167.0 | 10855 | 0.5600          | 0.7097    | 0.7142 | 0.7120 | 0.9269   |
| 0.0122        | 168.0 | 10920 | 0.5865          | 0.6786    | 0.7301 | 0.7034 | 0.9242   |
| 0.0122        | 169.0 | 10985 | 0.5617          | 0.7166    | 0.6993 | 0.7078 | 0.9249   |
| 0.0112        | 170.0 | 11050 | 0.5454          | 0.7186    | 0.7225 | 0.7205 | 0.9294   |
| 0.0112        | 171.0 | 11115 | 0.5320          | 0.7006    | 0.7401 | 0.7199 | 0.9271   |
| 0.0112        | 172.0 | 11180 | 0.5171          | 0.6898    | 0.7441 | 0.7159 | 0.9283   |
| 0.0112        | 173.0 | 11245 | 0.5290          | 0.7031    | 0.7515 | 0.7265 | 0.9301   |
| 0.0112        | 174.0 | 11310 | 0.4976          | 0.6955    | 0.7659 | 0.7290 | 0.9287   |
| 0.0112        | 175.0 | 11375 | 0.5538          | 0.7037    | 0.7344 | 0.7187 | 0.9275   |
| 0.0112        | 176.0 | 11440 | 0.5517          | 0.6980    | 0.7385 | 0.7177 | 0.9291   |
| 0.0105        | 177.0 | 11505 | 0.5294          | 0.6874    | 0.7571 | 0.7205 | 0.9275   |
| 0.0105        | 178.0 | 11570 | 0.5458          | 0.7025    | 0.7373 | 0.7194 | 0.9274   |
| 0.0105        | 179.0 | 11635 | 0.5323          | 0.6903    | 0.7477 | 0.7178 | 0.9286   |
| 0.0105        | 180.0 | 11700 | 0.5463          | 0.7042    | 0.7529 | 0.7278 | 0.9296   |
| 0.0105        | 181.0 | 11765 | 0.5385          | 0.6939    | 0.7619 | 0.7264 | 0.9279   |
| 0.0105        | 182.0 | 11830 | 0.5186          | 0.6954    | 0.7472 | 0.7204 | 0.9274   |
| 0.0105        | 183.0 | 11895 | 0.5429          | 0.6931    | 0.7661 | 0.7277 | 0.9283   |
| 0.0105        | 184.0 | 11960 | 0.5033          | 0.7035    | 0.7427 | 0.7226 | 0.9304   |
| 0.0096        | 185.0 | 12025 | 0.5510          | 0.7063    | 0.7290 | 0.7175 | 0.9270   |
| 0.0096        | 186.0 | 12090 | 0.5444          | 0.7058    | 0.7461 | 0.7254 | 0.9303   |
| 0.0096        | 187.0 | 12155 | 0.5375          | 0.6940    | 0.7542 | 0.7228 | 0.9289   |
| 0.0096        | 188.0 | 12220 | 0.5489          | 0.7102    | 0.7382 | 0.7239 | 0.9278   |
| 0.0096        | 189.0 | 12285 | 0.5960          | 0.6923    | 0.7223 | 0.7070 | 0.9250   |
| 0.0096        | 190.0 | 12350 | 0.5823          | 0.7116    | 0.7675 | 0.7385 | 0.9287   |
| 0.0096        | 191.0 | 12415 | 0.5430          | 0.7159    | 0.7551 | 0.7350 | 0.9307   |
| 0.0096        | 192.0 | 12480 | 0.5520          | 0.6987    | 0.7517 | 0.7242 | 0.9270   |
| 0.0095        | 193.0 | 12545 | 0.5860          | 0.6911    | 0.7614 | 0.7245 | 0.9260   |
| 0.0095        | 194.0 | 12610 | 0.5421          | 0.6837    | 0.7459 | 0.7135 | 0.9264   |
| 0.0095        | 195.0 | 12675 | 0.5621          | 0.6992    | 0.7477 | 0.7227 | 0.9275   |
| 0.0095        | 196.0 | 12740 | 0.5307          | 0.6807    | 0.7610 | 0.7186 | 0.9269   |
| 0.0095        | 197.0 | 12805 | 0.5398          | 0.6901    | 0.7684 | 0.7272 | 0.9291   |
| 0.0095        | 198.0 | 12870 | 0.5218          | 0.7054    | 0.7292 | 0.7171 | 0.9287   |
| 0.0095        | 199.0 | 12935 | 0.5509          | 0.7039    | 0.7454 | 0.7240 | 0.9288   |
| 0.0094        | 200.0 | 13000 | 0.5395          | 0.7091    | 0.7349 | 0.7218 | 0.9280   |
| 0.0094        | 201.0 | 13065 | 0.5347          | 0.6962    | 0.7427 | 0.7187 | 0.9286   |
| 0.0094        | 202.0 | 13130 | 0.5980          | 0.6966    | 0.7560 | 0.7251 | 0.9271   |
| 0.0094        | 203.0 | 13195 | 0.5151          | 0.6984    | 0.7619 | 0.7288 | 0.9292   |
| 0.0094        | 204.0 | 13260 | 0.5244          | 0.7135    | 0.7455 | 0.7292 | 0.9294   |
| 0.0094        | 205.0 | 13325 | 0.5664          | 0.7054    | 0.7475 | 0.7258 | 0.9292   |
| 0.0094        | 206.0 | 13390 | 0.5729          | 0.7006    | 0.7618 | 0.7299 | 0.9295   |
| 0.0094        | 207.0 | 13455 | 0.5834          | 0.6901    | 0.7508 | 0.7192 | 0.9273   |
| 0.0089        | 208.0 | 13520 | 0.5885          | 0.6816    | 0.7841 | 0.7293 | 0.9277   |
| 0.0089        | 209.0 | 13585 | 0.5586          | 0.7052    | 0.7583 | 0.7308 | 0.9281   |
| 0.0089        | 210.0 | 13650 | 0.5871          | 0.7068    | 0.7353 | 0.7207 | 0.9262   |
| 0.0089        | 211.0 | 13715 | 0.5802          | 0.6929    | 0.7704 | 0.7296 | 0.9290   |
| 0.0089        | 212.0 | 13780 | 0.5821          | 0.7031    | 0.7551 | 0.7281 | 0.9286   |
| 0.0089        | 213.0 | 13845 | 0.5787          | 0.6994    | 0.7497 | 0.7237 | 0.9273   |
| 0.0089        | 214.0 | 13910 | 0.5695          | 0.7156    | 0.7389 | 0.7270 | 0.9278   |
| 0.0089        | 215.0 | 13975 | 0.5749          | 0.7095    | 0.7446 | 0.7266 | 0.9284   |
| 0.0083        | 216.0 | 14040 | 0.5886          | 0.7165    | 0.7011 | 0.7087 | 0.9244   |
| 0.0083        | 217.0 | 14105 | 0.5926          | 0.7061    | 0.7497 | 0.7272 | 0.9276   |
| 0.0083        | 218.0 | 14170 | 0.5653          | 0.7020    | 0.7558 | 0.7279 | 0.9284   |
| 0.0083        | 219.0 | 14235 | 0.5784          | 0.6897    | 0.7612 | 0.7237 | 0.9258   |
| 0.0083        | 220.0 | 14300 | 0.5431          | 0.7095    | 0.7452 | 0.7269 | 0.9295   |
| 0.0083        | 221.0 | 14365 | 0.5665          | 0.7175    | 0.7340 | 0.7257 | 0.9284   |
| 0.0083        | 222.0 | 14430 | 0.5842          | 0.6817    | 0.7536 | 0.7159 | 0.9269   |
| 0.0083        | 223.0 | 14495 | 0.5912          | 0.6896    | 0.7634 | 0.7246 | 0.9268   |
| 0.0082        | 224.0 | 14560 | 0.5530          | 0.6944    | 0.7558 | 0.7238 | 0.9281   |
| 0.0082        | 225.0 | 14625 | 0.5632          | 0.6987    | 0.7567 | 0.7265 | 0.9266   |
| 0.0082        | 226.0 | 14690 | 0.5775          | 0.7042    | 0.7536 | 0.7281 | 0.9284   |
| 0.0082        | 227.0 | 14755 | 0.5711          | 0.7029    | 0.7632 | 0.7318 | 0.9283   |
| 0.0082        | 228.0 | 14820 | 0.5421          | 0.7052    | 0.7639 | 0.7334 | 0.9290   |
| 0.0082        | 229.0 | 14885 | 0.5243          | 0.7023    | 0.7400 | 0.7206 | 0.9276   |
| 0.0082        | 230.0 | 14950 | 0.5334          | 0.7236    | 0.7457 | 0.7345 | 0.9304   |
| 0.0077        | 231.0 | 15015 | 0.5182          | 0.7159    | 0.7527 | 0.7338 | 0.9298   |
| 0.0077        | 232.0 | 15080 | 0.5799          | 0.7046    | 0.7533 | 0.7281 | 0.9290   |
| 0.0077        | 233.0 | 15145 | 0.5645          | 0.72      | 0.7358 | 0.7278 | 0.9279   |
| 0.0077        | 234.0 | 15210 | 0.5880          | 0.7043    | 0.7632 | 0.7326 | 0.9287   |
| 0.0077        | 235.0 | 15275 | 0.5719          | 0.7036    | 0.7623 | 0.7318 | 0.9289   |
| 0.0077        | 236.0 | 15340 | 0.5524          | 0.6983    | 0.7560 | 0.7260 | 0.9287   |
| 0.0077        | 237.0 | 15405 | 0.5634          | 0.7138    | 0.7459 | 0.7295 | 0.9299   |
| 0.0077        | 238.0 | 15470 | 0.5849          | 0.7064    | 0.7531 | 0.7290 | 0.9296   |
| 0.0067        | 239.0 | 15535 | 0.5679          | 0.7168    | 0.7554 | 0.7356 | 0.9307   |
| 0.0067        | 240.0 | 15600 | 0.5597          | 0.7112    | 0.7383 | 0.7245 | 0.9276   |
| 0.0067        | 241.0 | 15665 | 0.5438          | 0.7049    | 0.7583 | 0.7306 | 0.9302   |
| 0.0067        | 242.0 | 15730 | 0.5389          | 0.7134    | 0.7715 | 0.7413 | 0.9316   |
| 0.0067        | 243.0 | 15795 | 0.5709          | 0.7042    | 0.7666 | 0.7341 | 0.9295   |
| 0.0067        | 244.0 | 15860 | 0.5667          | 0.7207    | 0.7684 | 0.7438 | 0.9322   |
| 0.0067        | 245.0 | 15925 | 0.5797          | 0.7064    | 0.7785 | 0.7407 | 0.9308   |
| 0.0067        | 246.0 | 15990 | 0.5750          | 0.7058    | 0.7439 | 0.7244 | 0.9301   |
| 0.0057        | 247.0 | 16055 | 0.5512          | 0.7169    | 0.7455 | 0.7309 | 0.9295   |
| 0.0057        | 248.0 | 16120 | 0.5879          | 0.7164    | 0.7581 | 0.7367 | 0.9301   |
| 0.0057        | 249.0 | 16185 | 0.5835          | 0.7005    | 0.7466 | 0.7228 | 0.9283   |
| 0.0057        | 250.0 | 16250 | 0.5995          | 0.7126    | 0.7430 | 0.7275 | 0.9283   |
| 0.0057        | 251.0 | 16315 | 0.5777          | 0.7165    | 0.7452 | 0.7306 | 0.9297   |
| 0.0057        | 252.0 | 16380 | 0.6438          | 0.7095    | 0.7041 | 0.7068 | 0.9237   |
| 0.0057        | 253.0 | 16445 | 0.5909          | 0.7130    | 0.7607 | 0.7361 | 0.9301   |
| 0.0059        | 254.0 | 16510 | 0.5994          | 0.7028    | 0.7735 | 0.7365 | 0.9298   |
| 0.0059        | 255.0 | 16575 | 0.6400          | 0.6955    | 0.7347 | 0.7146 | 0.9259   |
| 0.0059        | 256.0 | 16640 | 0.6058          | 0.7157    | 0.7367 | 0.7261 | 0.9281   |
| 0.0059        | 257.0 | 16705 | 0.5847          | 0.7112    | 0.7445 | 0.7274 | 0.9287   |
| 0.0059        | 258.0 | 16770 | 0.5671          | 0.7093    | 0.7625 | 0.7349 | 0.9293   |
| 0.0059        | 259.0 | 16835 | 0.5933          | 0.7170    | 0.7556 | 0.7358 | 0.9304   |
| 0.0059        | 260.0 | 16900 | 0.6272          | 0.7131    | 0.7664 | 0.7388 | 0.9300   |
| 0.0059        | 261.0 | 16965 | 0.5712          | 0.7160    | 0.7601 | 0.7374 | 0.9304   |
| 0.0053        | 262.0 | 17030 | 0.5971          | 0.7119    | 0.7659 | 0.7379 | 0.9303   |
| 0.0053        | 263.0 | 17095 | 0.6383          | 0.6756    | 0.7657 | 0.7178 | 0.9259   |
| 0.0053        | 264.0 | 17160 | 0.5686          | 0.7032    | 0.7446 | 0.7233 | 0.9283   |
| 0.0053        | 265.0 | 17225 | 0.5792          | 0.7030    | 0.7421 | 0.7220 | 0.9276   |
| 0.0053        | 266.0 | 17290 | 0.6041          | 0.6967    | 0.7637 | 0.7287 | 0.9292   |
| 0.0053        | 267.0 | 17355 | 0.5978          | 0.6912    | 0.7589 | 0.7234 | 0.9269   |
| 0.0053        | 268.0 | 17420 | 0.5909          | 0.7291    | 0.7274 | 0.7282 | 0.9288   |
| 0.0053        | 269.0 | 17485 | 0.5901          | 0.7180    | 0.7275 | 0.7227 | 0.9276   |
| 0.0057        | 270.0 | 17550 | 0.5717          | 0.7172    | 0.7610 | 0.7385 | 0.9320   |
| 0.0057        | 271.0 | 17615 | 0.6098          | 0.6978    | 0.7623 | 0.7286 | 0.9281   |
| 0.0057        | 272.0 | 17680 | 0.5926          | 0.6875    | 0.7729 | 0.7277 | 0.9285   |
| 0.0057        | 273.0 | 17745 | 0.6437          | 0.6875    | 0.7079 | 0.6975 | 0.9209   |
| 0.0057        | 274.0 | 17810 | 0.5944          | 0.7172    | 0.7526 | 0.7344 | 0.9298   |
| 0.0057        | 275.0 | 17875 | 0.5906          | 0.7072    | 0.7549 | 0.7302 | 0.9293   |
| 0.0057        | 276.0 | 17940 | 0.5991          | 0.7186    | 0.7378 | 0.7281 | 0.9292   |
| 0.0056        | 277.0 | 18005 | 0.6014          | 0.7104    | 0.7301 | 0.7201 | 0.9280   |
| 0.0056        | 278.0 | 18070 | 0.6015          | 0.7129    | 0.7464 | 0.7293 | 0.9287   |
| 0.0056        | 279.0 | 18135 | 0.5949          | 0.6951    | 0.7488 | 0.7209 | 0.9270   |
| 0.0056        | 280.0 | 18200 | 0.6075          | 0.7179    | 0.7349 | 0.7263 | 0.9284   |
| 0.0056        | 281.0 | 18265 | 0.6210          | 0.7281    | 0.7436 | 0.7357 | 0.9291   |
| 0.0056        | 282.0 | 18330 | 0.5559          | 0.7056    | 0.7590 | 0.7313 | 0.9298   |
| 0.0056        | 283.0 | 18395 | 0.5862          | 0.7115    | 0.7416 | 0.7262 | 0.9285   |
| 0.0056        | 284.0 | 18460 | 0.5718          | 0.6846    | 0.7549 | 0.7181 | 0.9274   |
| 0.0047        | 285.0 | 18525 | 0.6232          | 0.6974    | 0.7554 | 0.7253 | 0.9298   |
| 0.0047        | 286.0 | 18590 | 0.5914          | 0.7210    | 0.7558 | 0.7380 | 0.9317   |
| 0.0047        | 287.0 | 18655 | 0.5987          | 0.7054    | 0.7691 | 0.7359 | 0.9290   |
| 0.0047        | 288.0 | 18720 | 0.5748          | 0.7158    | 0.7418 | 0.7286 | 0.9291   |
| 0.0047        | 289.0 | 18785 | 0.5806          | 0.7108    | 0.7718 | 0.7401 | 0.9311   |
| 0.0047        | 290.0 | 18850 | 0.5703          | 0.7148    | 0.7493 | 0.7317 | 0.9310   |
| 0.0047        | 291.0 | 18915 | 0.6137          | 0.7129    | 0.7520 | 0.7319 | 0.9289   |
| 0.0047        | 292.0 | 18980 | 0.6269          | 0.6850    | 0.7619 | 0.7214 | 0.9270   |
| 0.0045        | 293.0 | 19045 | 0.6266          | 0.7234    | 0.7497 | 0.7363 | 0.9297   |
| 0.0045        | 294.0 | 19110 | 0.6222          | 0.7090    | 0.7628 | 0.7349 | 0.9297   |
| 0.0045        | 295.0 | 19175 | 0.6219          | 0.7178    | 0.7544 | 0.7356 | 0.9300   |
| 0.0045        | 296.0 | 19240 | 0.6016          | 0.7105    | 0.7452 | 0.7274 | 0.9290   |
| 0.0045        | 297.0 | 19305 | 0.6085          | 0.7182    | 0.7439 | 0.7308 | 0.9281   |
| 0.0045        | 298.0 | 19370 | 0.6173          | 0.7191    | 0.7347 | 0.7268 | 0.9280   |
| 0.0045        | 299.0 | 19435 | 0.6191          | 0.7060    | 0.7699 | 0.7366 | 0.9304   |
| 0.0047        | 300.0 | 19500 | 0.6290          | 0.7084    | 0.7627 | 0.7345 | 0.9286   |
| 0.0047        | 301.0 | 19565 | 0.6393          | 0.7059    | 0.7529 | 0.7287 | 0.9274   |
| 0.0047        | 302.0 | 19630 | 0.6031          | 0.7145    | 0.7603 | 0.7367 | 0.9306   |
| 0.0047        | 303.0 | 19695 | 0.6039          | 0.7164    | 0.7594 | 0.7373 | 0.9297   |
| 0.0047        | 304.0 | 19760 | 0.6030          | 0.7185    | 0.7441 | 0.7311 | 0.9294   |
| 0.0047        | 305.0 | 19825 | 0.5769          | 0.7150    | 0.7603 | 0.7370 | 0.9309   |
| 0.0047        | 306.0 | 19890 | 0.6012          | 0.7246    | 0.7421 | 0.7333 | 0.9300   |
| 0.0047        | 307.0 | 19955 | 0.6078          | 0.7256    | 0.7581 | 0.7415 | 0.9316   |
| 0.0039        | 308.0 | 20020 | 0.6202          | 0.7305    | 0.7319 | 0.7312 | 0.9303   |
| 0.0039        | 309.0 | 20085 | 0.6358          | 0.6995    | 0.7488 | 0.7233 | 0.9275   |
| 0.0039        | 310.0 | 20150 | 0.6055          | 0.7121    | 0.7520 | 0.7315 | 0.9313   |
| 0.0039        | 311.0 | 20215 | 0.6117          | 0.7273    | 0.7735 | 0.7497 | 0.9329   |
| 0.0039        | 312.0 | 20280 | 0.6420          | 0.7171    | 0.7497 | 0.7331 | 0.9304   |
| 0.0039        | 313.0 | 20345 | 0.6377          | 0.7234    | 0.7374 | 0.7303 | 0.9296   |
| 0.0039        | 314.0 | 20410 | 0.6171          | 0.7145    | 0.7684 | 0.7405 | 0.9310   |
| 0.0039        | 315.0 | 20475 | 0.6080          | 0.7198    | 0.7598 | 0.7393 | 0.9309   |
| 0.0029        | 316.0 | 20540 | 0.6138          | 0.7120    | 0.7592 | 0.7349 | 0.9279   |
| 0.0029        | 317.0 | 20605 | 0.6281          | 0.6997    | 0.7590 | 0.7282 | 0.9270   |
| 0.0029        | 318.0 | 20670 | 0.6142          | 0.7268    | 0.7517 | 0.7390 | 0.9305   |
| 0.0029        | 319.0 | 20735 | 0.6059          | 0.7123    | 0.7670 | 0.7386 | 0.9314   |
| 0.0029        | 320.0 | 20800 | 0.6118          | 0.7174    | 0.7607 | 0.7384 | 0.9313   |
| 0.0029        | 321.0 | 20865 | 0.6140          | 0.6964    | 0.7762 | 0.7341 | 0.9308   |
| 0.0029        | 322.0 | 20930 | 0.6255          | 0.7292    | 0.7331 | 0.7311 | 0.9290   |
| 0.0029        | 323.0 | 20995 | 0.6043          | 0.7250    | 0.7473 | 0.7360 | 0.9309   |
| 0.0038        | 324.0 | 21060 | 0.5779          | 0.7095    | 0.7443 | 0.7265 | 0.9301   |
| 0.0038        | 325.0 | 21125 | 0.6084          | 0.7115    | 0.7636 | 0.7366 | 0.9306   |
| 0.0038        | 326.0 | 21190 | 0.6254          | 0.7091    | 0.7376 | 0.7231 | 0.9277   |
| 0.0038        | 327.0 | 21255 | 0.6108          | 0.7133    | 0.7461 | 0.7293 | 0.9293   |
| 0.0038        | 328.0 | 21320 | 0.5968          | 0.7092    | 0.7581 | 0.7329 | 0.9301   |
| 0.0038        | 329.0 | 21385 | 0.6199          | 0.7259    | 0.7430 | 0.7344 | 0.9301   |
| 0.0038        | 330.0 | 21450 | 0.5808          | 0.7177    | 0.7681 | 0.7420 | 0.9317   |
| 0.0034        | 331.0 | 21515 | 0.6018          | 0.7286    | 0.7495 | 0.7389 | 0.9317   |
| 0.0034        | 332.0 | 21580 | 0.5741          | 0.7236    | 0.7677 | 0.7450 | 0.9324   |
| 0.0034        | 333.0 | 21645 | 0.6533          | 0.7171    | 0.7427 | 0.7297 | 0.9278   |
| 0.0034        | 334.0 | 21710 | 0.6345          | 0.7273    | 0.7589 | 0.7428 | 0.9315   |
| 0.0034        | 335.0 | 21775 | 0.6038          | 0.7153    | 0.7634 | 0.7386 | 0.9311   |
| 0.0034        | 336.0 | 21840 | 0.5935          | 0.7169    | 0.7706 | 0.7428 | 0.9319   |
| 0.0034        | 337.0 | 21905 | 0.6395          | 0.7105    | 0.7668 | 0.7376 | 0.9304   |
| 0.0034        | 338.0 | 21970 | 0.6657          | 0.7239    | 0.7654 | 0.7440 | 0.9313   |
| 0.0024        | 339.0 | 22035 | 0.6201          | 0.7219    | 0.7522 | 0.7367 | 0.9312   |
| 0.0024        | 340.0 | 22100 | 0.6169          | 0.7196    | 0.7726 | 0.7451 | 0.9315   |
| 0.0024        | 341.0 | 22165 | 0.6293          | 0.7145    | 0.7652 | 0.7390 | 0.9312   |
| 0.0024        | 342.0 | 22230 | 0.6227          | 0.7079    | 0.7628 | 0.7343 | 0.9295   |
| 0.0024        | 343.0 | 22295 | 0.6166          | 0.7025    | 0.7704 | 0.7349 | 0.9310   |
| 0.0024        | 344.0 | 22360 | 0.6056          | 0.7067    | 0.7650 | 0.7347 | 0.9299   |
| 0.0024        | 345.0 | 22425 | 0.6378          | 0.7161    | 0.7502 | 0.7327 | 0.9298   |
| 0.0024        | 346.0 | 22490 | 0.6221          | 0.7281    | 0.7464 | 0.7372 | 0.9312   |
| 0.0028        | 347.0 | 22555 | 0.6400          | 0.7185    | 0.7560 | 0.7367 | 0.9294   |
| 0.0028        | 348.0 | 22620 | 0.5877          | 0.7114    | 0.7641 | 0.7368 | 0.9310   |
| 0.0028        | 349.0 | 22685 | 0.6571          | 0.7195    | 0.7400 | 0.7296 | 0.9279   |
| 0.0028        | 350.0 | 22750 | 0.6218          | 0.7225    | 0.7672 | 0.7442 | 0.9320   |
| 0.0028        | 351.0 | 22815 | 0.6104          | 0.7167    | 0.7563 | 0.7360 | 0.9300   |
| 0.0028        | 352.0 | 22880 | 0.5932          | 0.7240    | 0.7745 | 0.7484 | 0.9322   |
| 0.0028        | 353.0 | 22945 | 0.6179          | 0.7197    | 0.7654 | 0.7418 | 0.9314   |
| 0.0024        | 354.0 | 23010 | 0.6408          | 0.7186    | 0.7560 | 0.7368 | 0.9300   |
| 0.0024        | 355.0 | 23075 | 0.6872          | 0.7136    | 0.7499 | 0.7313 | 0.9286   |
| 0.0024        | 356.0 | 23140 | 0.6455          | 0.7247    | 0.7632 | 0.7434 | 0.9322   |
| 0.0024        | 357.0 | 23205 | 0.6436          | 0.7252    | 0.7663 | 0.7452 | 0.9321   |
| 0.0024        | 358.0 | 23270 | 0.6535          | 0.7134    | 0.7502 | 0.7313 | 0.9304   |
| 0.0024        | 359.0 | 23335 | 0.6103          | 0.7283    | 0.7558 | 0.7418 | 0.9311   |
| 0.0024        | 360.0 | 23400 | 0.6041          | 0.7110    | 0.7455 | 0.7278 | 0.9285   |
| 0.0024        | 361.0 | 23465 | 0.6251          | 0.7207    | 0.7500 | 0.7351 | 0.9303   |
| 0.0026        | 362.0 | 23530 | 0.6199          | 0.7286    | 0.7450 | 0.7367 | 0.9322   |
| 0.0026        | 363.0 | 23595 | 0.6266          | 0.7169    | 0.7661 | 0.7407 | 0.9318   |
| 0.0026        | 364.0 | 23660 | 0.6309          | 0.7246    | 0.7461 | 0.7352 | 0.9294   |
| 0.0026        | 365.0 | 23725 | 0.6148          | 0.7271    | 0.7551 | 0.7408 | 0.9304   |
| 0.0026        | 366.0 | 23790 | 0.6224          | 0.7174    | 0.7493 | 0.7330 | 0.9292   |
| 0.0026        | 367.0 | 23855 | 0.6127          | 0.7141    | 0.7630 | 0.7378 | 0.9308   |
| 0.0026        | 368.0 | 23920 | 0.5988          | 0.7294    | 0.7596 | 0.7442 | 0.9331   |
| 0.0026        | 369.0 | 23985 | 0.6042          | 0.7344    | 0.7643 | 0.7490 | 0.9338   |
| 0.0025        | 370.0 | 24050 | 0.6340          | 0.7259    | 0.7619 | 0.7435 | 0.9319   |
| 0.0025        | 371.0 | 24115 | 0.6372          | 0.7307    | 0.7650 | 0.7474 | 0.9334   |
| 0.0025        | 372.0 | 24180 | 0.6162          | 0.7089    | 0.7772 | 0.7415 | 0.9313   |
| 0.0025        | 373.0 | 24245 | 0.6779          | 0.7000    | 0.7735 | 0.7349 | 0.9286   |
| 0.0025        | 374.0 | 24310 | 0.6175          | 0.7245    | 0.7681 | 0.7456 | 0.9331   |
| 0.0025        | 375.0 | 24375 | 0.6254          | 0.7218    | 0.7722 | 0.7461 | 0.9325   |
| 0.0025        | 376.0 | 24440 | 0.6425          | 0.7287    | 0.7502 | 0.7393 | 0.9309   |
| 0.0015        | 377.0 | 24505 | 0.6314          | 0.7338    | 0.7495 | 0.7416 | 0.9325   |
| 0.0015        | 378.0 | 24570 | 0.6191          | 0.7149    | 0.7722 | 0.7424 | 0.9312   |
| 0.0015        | 379.0 | 24635 | 0.6438          | 0.7063    | 0.7590 | 0.7317 | 0.9291   |
| 0.0015        | 380.0 | 24700 | 0.6355          | 0.7217    | 0.7616 | 0.7411 | 0.9321   |
| 0.0015        | 381.0 | 24765 | 0.6429          | 0.7204    | 0.7439 | 0.7320 | 0.9303   |
| 0.0015        | 382.0 | 24830 | 0.6409          | 0.7252    | 0.7619 | 0.7431 | 0.9318   |
| 0.0015        | 383.0 | 24895 | 0.6743          | 0.7289    | 0.7423 | 0.7355 | 0.9302   |
| 0.0015        | 384.0 | 24960 | 0.6780          | 0.7181    | 0.7437 | 0.7307 | 0.9287   |
| 0.0017        | 385.0 | 25025 | 0.6480          | 0.7270    | 0.7544 | 0.7404 | 0.9311   |
| 0.0017        | 386.0 | 25090 | 0.6748          | 0.7276    | 0.7277 | 0.7276 | 0.9285   |
| 0.0017        | 387.0 | 25155 | 0.6960          | 0.7143    | 0.7389 | 0.7264 | 0.9279   |
| 0.0017        | 388.0 | 25220 | 0.6537          | 0.7255    | 0.7504 | 0.7377 | 0.9306   |
| 0.0017        | 389.0 | 25285 | 0.7304          | 0.7127    | 0.7545 | 0.7330 | 0.9280   |
| 0.0017        | 390.0 | 25350 | 0.6923          | 0.7113    | 0.7630 | 0.7362 | 0.9291   |
| 0.0017        | 391.0 | 25415 | 0.6787          | 0.7142    | 0.7596 | 0.7362 | 0.9290   |
| 0.0017        | 392.0 | 25480 | 0.7050          | 0.7406    | 0.7236 | 0.7320 | 0.9278   |
| 0.0013        | 393.0 | 25545 | 0.6789          | 0.7280    | 0.7533 | 0.7404 | 0.9308   |
| 0.0013        | 394.0 | 25610 | 0.6330          | 0.7183    | 0.7690 | 0.7427 | 0.9320   |
| 0.0013        | 395.0 | 25675 | 0.6889          | 0.7213    | 0.7536 | 0.7371 | 0.9299   |
| 0.0013        | 396.0 | 25740 | 0.6299          | 0.7184    | 0.7493 | 0.7335 | 0.9307   |
| 0.0013        | 397.0 | 25805 | 0.6603          | 0.7201    | 0.7621 | 0.7405 | 0.9318   |
| 0.0013        | 398.0 | 25870 | 0.7018          | 0.7230    | 0.7229 | 0.7229 | 0.9275   |
| 0.0013        | 399.0 | 25935 | 0.6745          | 0.7075    | 0.7684 | 0.7367 | 0.9299   |
| 0.0015        | 400.0 | 26000 | 0.6466          | 0.7229    | 0.7744 | 0.7478 | 0.9325   |
| 0.0015        | 401.0 | 26065 | 0.6440          | 0.7292    | 0.7612 | 0.7448 | 0.9329   |
| 0.0015        | 402.0 | 26130 | 0.6509          | 0.7219    | 0.7668 | 0.7437 | 0.9313   |
| 0.0015        | 403.0 | 26195 | 0.6519          | 0.7278    | 0.7571 | 0.7422 | 0.9321   |
| 0.0015        | 404.0 | 26260 | 0.6517          | 0.7241    | 0.7715 | 0.7471 | 0.9317   |
| 0.0015        | 405.0 | 26325 | 0.6455          | 0.7224    | 0.7625 | 0.7419 | 0.9323   |
| 0.0015        | 406.0 | 26390 | 0.6664          | 0.7258    | 0.7675 | 0.7461 | 0.9327   |
| 0.0015        | 407.0 | 26455 | 0.7176          | 0.7249    | 0.7556 | 0.7400 | 0.9297   |
| 0.0012        | 408.0 | 26520 | 0.6886          | 0.7287    | 0.7599 | 0.7440 | 0.9312   |
| 0.0012        | 409.0 | 26585 | 0.6968          | 0.7172    | 0.7513 | 0.7339 | 0.9290   |
| 0.0012        | 410.0 | 26650 | 0.6707          | 0.7260    | 0.7511 | 0.7384 | 0.9309   |
| 0.0012        | 411.0 | 26715 | 0.7018          | 0.7320    | 0.7448 | 0.7384 | 0.9299   |
| 0.0012        | 412.0 | 26780 | 0.6798          | 0.7234    | 0.7587 | 0.7406 | 0.9316   |
| 0.0012        | 413.0 | 26845 | 0.6907          | 0.7160    | 0.7652 | 0.7398 | 0.9303   |
| 0.0012        | 414.0 | 26910 | 0.6880          | 0.7211    | 0.7538 | 0.7371 | 0.9307   |
| 0.0012        | 415.0 | 26975 | 0.6796          | 0.7155    | 0.7536 | 0.7341 | 0.9302   |
| 0.0009        | 416.0 | 27040 | 0.6835          | 0.7220    | 0.7567 | 0.7389 | 0.9309   |
| 0.0009        | 417.0 | 27105 | 0.6773          | 0.7058    | 0.7646 | 0.7340 | 0.9300   |
| 0.0009        | 418.0 | 27170 | 0.6562          | 0.7199    | 0.7684 | 0.7434 | 0.9317   |
| 0.0009        | 419.0 | 27235 | 0.6718          | 0.7220    | 0.7664 | 0.7435 | 0.9321   |
| 0.0009        | 420.0 | 27300 | 0.6761          | 0.7246    | 0.7585 | 0.7412 | 0.9311   |
| 0.0009        | 421.0 | 27365 | 0.6712          | 0.7298    | 0.7659 | 0.7474 | 0.9314   |
| 0.0009        | 422.0 | 27430 | 0.6811          | 0.7302    | 0.7618 | 0.7456 | 0.9309   |
| 0.0009        | 423.0 | 27495 | 0.6950          | 0.7252    | 0.7544 | 0.7395 | 0.9301   |
| 0.0007        | 424.0 | 27560 | 0.7030          | 0.7259    | 0.7627 | 0.7438 | 0.9310   |
| 0.0007        | 425.0 | 27625 | 0.7093          | 0.7064    | 0.7769 | 0.7400 | 0.9294   |
| 0.0007        | 426.0 | 27690 | 0.7105          | 0.7333    | 0.7562 | 0.7446 | 0.9308   |
| 0.0007        | 427.0 | 27755 | 0.7196          | 0.7178    | 0.7789 | 0.7471 | 0.9307   |
| 0.0007        | 428.0 | 27820 | 0.6914          | 0.7217    | 0.7682 | 0.7442 | 0.9314   |
| 0.0007        | 429.0 | 27885 | 0.6860          | 0.7259    | 0.7601 | 0.7426 | 0.9305   |
| 0.0007        | 430.0 | 27950 | 0.6911          | 0.7207    | 0.7722 | 0.7455 | 0.9313   |
| 0.0008        | 431.0 | 28015 | 0.7007          | 0.7286    | 0.7526 | 0.7404 | 0.9299   |
| 0.0008        | 432.0 | 28080 | 0.7129          | 0.7198    | 0.7504 | 0.7348 | 0.9291   |
| 0.0008        | 433.0 | 28145 | 0.6910          | 0.7298    | 0.7569 | 0.7431 | 0.9311   |
| 0.0008        | 434.0 | 28210 | 0.7067          | 0.7208    | 0.7639 | 0.7417 | 0.9298   |
| 0.0008        | 435.0 | 28275 | 0.6896          | 0.7278    | 0.7549 | 0.7411 | 0.9315   |
| 0.0008        | 436.0 | 28340 | 0.7031          | 0.7208    | 0.7749 | 0.7469 | 0.9319   |
| 0.0008        | 437.0 | 28405 | 0.7314          | 0.7204    | 0.7590 | 0.7392 | 0.9297   |
| 0.0008        | 438.0 | 28470 | 0.6934          | 0.7300    | 0.7522 | 0.7409 | 0.9310   |
| 0.0007        | 439.0 | 28535 | 0.7172          | 0.7358    | 0.7392 | 0.7375 | 0.9297   |
| 0.0007        | 440.0 | 28600 | 0.6985          | 0.7287    | 0.7621 | 0.7450 | 0.9313   |
| 0.0007        | 441.0 | 28665 | 0.6903          | 0.7293    | 0.7572 | 0.7430 | 0.9311   |
| 0.0007        | 442.0 | 28730 | 0.6720          | 0.7358    | 0.7599 | 0.7477 | 0.9323   |
| 0.0007        | 443.0 | 28795 | 0.6941          | 0.7353    | 0.7418 | 0.7385 | 0.9304   |
| 0.0007        | 444.0 | 28860 | 0.6800          | 0.7283    | 0.7695 | 0.7483 | 0.9324   |
| 0.0007        | 445.0 | 28925 | 0.6815          | 0.7337    | 0.7639 | 0.7485 | 0.9322   |
| 0.0007        | 446.0 | 28990 | 0.6668          | 0.7249    | 0.7549 | 0.7396 | 0.9311   |
| 0.0008        | 447.0 | 29055 | 0.6607          | 0.7273    | 0.7646 | 0.7455 | 0.9328   |
| 0.0008        | 448.0 | 29120 | 0.7068          | 0.7249    | 0.7661 | 0.7449 | 0.9314   |
| 0.0008        | 449.0 | 29185 | 0.6863          | 0.7221    | 0.7645 | 0.7427 | 0.9312   |
| 0.0008        | 450.0 | 29250 | 0.6756          | 0.7197    | 0.7627 | 0.7406 | 0.9308   |
| 0.0008        | 451.0 | 29315 | 0.6713          | 0.7146    | 0.7708 | 0.7416 | 0.9313   |
| 0.0008        | 452.0 | 29380 | 0.6752          | 0.7307    | 0.7515 | 0.7409 | 0.9303   |
| 0.0008        | 453.0 | 29445 | 0.6649          | 0.7253    | 0.7585 | 0.7415 | 0.9316   |
| 0.0007        | 454.0 | 29510 | 0.6674          | 0.7242    | 0.7686 | 0.7458 | 0.9321   |
| 0.0007        | 455.0 | 29575 | 0.6737          | 0.7309    | 0.7599 | 0.7451 | 0.9316   |
| 0.0007        | 456.0 | 29640 | 0.6754          | 0.7242    | 0.7697 | 0.7462 | 0.9321   |
| 0.0007        | 457.0 | 29705 | 0.6835          | 0.7263    | 0.7585 | 0.7421 | 0.9309   |
| 0.0007        | 458.0 | 29770 | 0.6787          | 0.7277    | 0.7614 | 0.7442 | 0.9319   |
| 0.0007        | 459.0 | 29835 | 0.6670          | 0.7303    | 0.7655 | 0.7475 | 0.9324   |
| 0.0007        | 460.0 | 29900 | 0.6763          | 0.7294    | 0.7585 | 0.7436 | 0.9312   |
| 0.0007        | 461.0 | 29965 | 0.6675          | 0.7286    | 0.7637 | 0.7457 | 0.9326   |
| 0.0004        | 462.0 | 30030 | 0.6649          | 0.7225    | 0.7657 | 0.7435 | 0.9323   |
| 0.0004        | 463.0 | 30095 | 0.6520          | 0.7309    | 0.7607 | 0.7455 | 0.9324   |
| 0.0004        | 464.0 | 30160 | 0.6608          | 0.7285    | 0.7614 | 0.7446 | 0.9322   |
| 0.0004        | 465.0 | 30225 | 0.6873          | 0.7329    | 0.7486 | 0.7407 | 0.9301   |
| 0.0004        | 466.0 | 30290 | 0.6809          | 0.7276    | 0.7646 | 0.7456 | 0.9317   |
| 0.0004        | 467.0 | 30355 | 0.6843          | 0.7306    | 0.7614 | 0.7457 | 0.9316   |
| 0.0004        | 468.0 | 30420 | 0.6933          | 0.7332    | 0.7603 | 0.7465 | 0.9314   |
| 0.0004        | 469.0 | 30485 | 0.6982          | 0.7360    | 0.7571 | 0.7464 | 0.9311   |
| 0.0004        | 470.0 | 30550 | 0.7029          | 0.7274    | 0.7596 | 0.7431 | 0.9308   |
| 0.0004        | 471.0 | 30615 | 0.6756          | 0.7305    | 0.7699 | 0.7497 | 0.9330   |
| 0.0004        | 472.0 | 30680 | 0.6885          | 0.7241    | 0.7664 | 0.7446 | 0.9315   |
| 0.0004        | 473.0 | 30745 | 0.6867          | 0.7277    | 0.7581 | 0.7426 | 0.9310   |
| 0.0004        | 474.0 | 30810 | 0.6772          | 0.7264    | 0.7679 | 0.7466 | 0.9321   |
| 0.0004        | 475.0 | 30875 | 0.6808          | 0.7246    | 0.7753 | 0.7491 | 0.9321   |
| 0.0004        | 476.0 | 30940 | 0.6808          | 0.7239    | 0.7673 | 0.7450 | 0.9318   |
| 0.0004        | 477.0 | 31005 | 0.6904          | 0.7275    | 0.7601 | 0.7435 | 0.9314   |
| 0.0004        | 478.0 | 31070 | 0.6921          | 0.7269    | 0.7598 | 0.7430 | 0.9312   |
| 0.0004        | 479.0 | 31135 | 0.6927          | 0.7261    | 0.7654 | 0.7452 | 0.9315   |
| 0.0004        | 480.0 | 31200 | 0.6969          | 0.7262    | 0.7641 | 0.7446 | 0.9316   |
| 0.0004        | 481.0 | 31265 | 0.7027          | 0.7287    | 0.7576 | 0.7429 | 0.9313   |
| 0.0004        | 482.0 | 31330 | 0.7015          | 0.7269    | 0.7601 | 0.7431 | 0.9313   |
| 0.0004        | 483.0 | 31395 | 0.6975          | 0.7271    | 0.7596 | 0.7430 | 0.9314   |
| 0.0004        | 484.0 | 31460 | 0.6970          | 0.7247    | 0.7648 | 0.7442 | 0.9315   |
| 0.0002        | 485.0 | 31525 | 0.6991          | 0.7257    | 0.7612 | 0.7430 | 0.9312   |
| 0.0002        | 486.0 | 31590 | 0.6969          | 0.7274    | 0.7619 | 0.7442 | 0.9314   |
| 0.0002        | 487.0 | 31655 | 0.7045          | 0.7200    | 0.7599 | 0.7394 | 0.9306   |
| 0.0002        | 488.0 | 31720 | 0.7049          | 0.7221    | 0.7627 | 0.7418 | 0.9309   |
| 0.0002        | 489.0 | 31785 | 0.7044          | 0.7242    | 0.7643 | 0.7437 | 0.9313   |
| 0.0002        | 490.0 | 31850 | 0.7011          | 0.7254    | 0.7650 | 0.7447 | 0.9318   |
| 0.0002        | 491.0 | 31915 | 0.7045          | 0.7252    | 0.7634 | 0.7438 | 0.9316   |
| 0.0002        | 492.0 | 31980 | 0.7050          | 0.7262    | 0.7603 | 0.7429 | 0.9314   |
| 0.0003        | 493.0 | 32045 | 0.7061          | 0.7266    | 0.7623 | 0.7440 | 0.9316   |
| 0.0003        | 494.0 | 32110 | 0.7075          | 0.7253    | 0.7599 | 0.7422 | 0.9314   |
| 0.0003        | 495.0 | 32175 | 0.7079          | 0.7266    | 0.7601 | 0.7430 | 0.9314   |
| 0.0003        | 496.0 | 32240 | 0.7072          | 0.7267    | 0.7594 | 0.7427 | 0.9314   |
| 0.0003        | 497.0 | 32305 | 0.7074          | 0.7265    | 0.7598 | 0.7428 | 0.9314   |
| 0.0003        | 498.0 | 32370 | 0.7093          | 0.7261    | 0.7590 | 0.7422 | 0.9311   |
| 0.0003        | 499.0 | 32435 | 0.7083          | 0.7270    | 0.7596 | 0.7429 | 0.9313   |
| 0.0002        | 500.0 | 32500 | 0.7082          | 0.7269    | 0.7596 | 0.7429 | 0.9313   |


### Framework versions

- Transformers 4.29.2
- Pytorch 2.0.1+cu117
- Datasets 2.12.0
- Tokenizers 0.13.3
