pytorch generated_from_trainer dataset:bionlp2004 license:apache-2.0 region:us
---
license: apache-2.0
tags:
- generated_from_trainer
datasets:
- bionlp2004
metrics:
- precision
- recall
- f1
- accuracy
model-index:
- name: bert-base-uncased_8_1039_token
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# bert-base-uncased_8_1039_token

This model is a fine-tuned version of [bert-base-uncased](https://huggingface.co/bert-base-uncased) on the bionlp2004 dataset.
It achieves the following results on the evaluation set:
- Loss: 0.7191
- Precision: 0.7311
- Recall: 0.7648
- F1: 0.7476
- Accuracy: 0.9327

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 0.001
- train_batch_size: 16
- eval_batch_size: 16
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 500

### Training results

| Training Loss | Epoch | Step  | Validation Loss | Precision | Recall | F1     | Accuracy |
|:-------------:|:-----:|:-----:|:---------------:|:---------:|:------:|:------:|:--------:|
| No log        | 1.0   | 65    | 0.3785          | 0.3534    | 0.4596 | 0.3996 | 0.8659   |
| No log        | 2.0   | 130   | 0.2718          | 0.5366    | 0.6877 | 0.6028 | 0.9072   |
| No log        | 3.0   | 195   | 0.2542          | 0.6101    | 0.6434 | 0.6263 | 0.9140   |
| No log        | 4.0   | 260   | 0.2302          | 0.6304    | 0.7054 | 0.6658 | 0.9248   |
| No log        | 5.0   | 325   | 0.2327          | 0.6415    | 0.7315 | 0.6836 | 0.9255   |
| No log        | 6.0   | 390   | 0.2576          | 0.6277    | 0.7418 | 0.6800 | 0.9193   |
| No log        | 7.0   | 455   | 0.2431          | 0.6615    | 0.7425 | 0.6996 | 0.9263   |
| 0.2489        | 8.0   | 520   | 0.2490          | 0.6756    | 0.7184 | 0.6963 | 0.9276   |
| 0.2489        | 9.0   | 585   | 0.2702          | 0.6773    | 0.7268 | 0.7012 | 0.9262   |
| 0.2489        | 10.0  | 650   | 0.2941          | 0.6335    | 0.6632 | 0.6480 | 0.9193   |
| 0.2489        | 11.0  | 715   | 0.2777          | 0.6975    | 0.7502 | 0.7229 | 0.9305   |
| 0.2489        | 12.0  | 780   | 0.2879          | 0.6850    | 0.7517 | 0.7168 | 0.9290   |
| 0.2489        | 13.0  | 845   | 0.3211          | 0.6839    | 0.6834 | 0.6837 | 0.9240   |
| 0.2489        | 14.0  | 910   | 0.3036          | 0.6808    | 0.6910 | 0.6859 | 0.9259   |
| 0.2489        | 15.0  | 975   | 0.3149          | 0.6666    | 0.7108 | 0.6880 | 0.9241   |
| 0.0766        | 16.0  | 1040  | 0.3416          | 0.6635    | 0.6917 | 0.6773 | 0.9232   |
| 0.0766        | 17.0  | 1105  | 0.3478          | 0.6630    | 0.7302 | 0.6950 | 0.9239   |
| 0.0766        | 18.0  | 1170  | 0.3316          | 0.6703    | 0.7581 | 0.7115 | 0.9273   |
| 0.0766        | 19.0  | 1235  | 0.3510          | 0.6918    | 0.7054 | 0.6985 | 0.9254   |
| 0.0766        | 20.0  | 1300  | 0.3560          | 0.6817    | 0.7299 | 0.7050 | 0.9269   |
| 0.0766        | 21.0  | 1365  | 0.3641          | 0.6678    | 0.7313 | 0.6981 | 0.9262   |
| 0.0766        | 22.0  | 1430  | 0.3408          | 0.6826    | 0.7292 | 0.7051 | 0.9268   |
| 0.0766        | 23.0  | 1495  | 0.3689          | 0.6772    | 0.7238 | 0.6997 | 0.9259   |
| 0.0406        | 24.0  | 1560  | 0.3782          | 0.6674    | 0.7443 | 0.7037 | 0.9259   |
| 0.0406        | 25.0  | 1625  | 0.4102          | 0.6744    | 0.6771 | 0.6758 | 0.9205   |
| 0.0406        | 26.0  | 1690  | 0.3654          | 0.6750    | 0.7297 | 0.7013 | 0.9277   |
| 0.0406        | 27.0  | 1755  | 0.4032          | 0.6721    | 0.7556 | 0.7114 | 0.9253   |
| 0.0406        | 28.0  | 1820  | 0.4372          | 0.6936    | 0.6865 | 0.6900 | 0.9231   |
| 0.0406        | 29.0  | 1885  | 0.3914          | 0.6761    | 0.7290 | 0.7016 | 0.9264   |
| 0.0406        | 30.0  | 1950  | 0.3967          | 0.6844    | 0.7337 | 0.7082 | 0.9266   |
| 0.0307        | 31.0  | 2015  | 0.4035          | 0.6858    | 0.7441 | 0.7138 | 0.9267   |
| 0.0307        | 32.0  | 2080  | 0.4173          | 0.6899    | 0.7461 | 0.7169 | 0.9284   |
| 0.0307        | 33.0  | 2145  | 0.3992          | 0.6826    | 0.7223 | 0.7019 | 0.9280   |
| 0.0307        | 34.0  | 2210  | 0.4192          | 0.6677    | 0.7637 | 0.7125 | 0.9280   |
| 0.0307        | 35.0  | 2275  | 0.4110          | 0.6990    | 0.7373 | 0.7176 | 0.9302   |
| 0.0307        | 36.0  | 2340  | 0.4688          | 0.6739    | 0.7034 | 0.6883 | 0.9210   |
| 0.0307        | 37.0  | 2405  | 0.4203          | 0.6834    | 0.7311 | 0.7065 | 0.9285   |
| 0.0307        | 38.0  | 2470  | 0.4597          | 0.6923    | 0.7452 | 0.7178 | 0.9277   |
| 0.0235        | 39.0  | 2535  | 0.4246          | 0.6790    | 0.7484 | 0.7120 | 0.9264   |
| 0.0235        | 40.0  | 2600  | 0.4335          | 0.6906    | 0.7286 | 0.7091 | 0.9274   |
| 0.0235        | 41.0  | 2665  | 0.4571          | 0.6786    | 0.7239 | 0.7005 | 0.9251   |
| 0.0235        | 42.0  | 2730  | 0.4273          | 0.6930    | 0.7340 | 0.7129 | 0.9282   |
| 0.0235        | 43.0  | 2795  | 0.4471          | 0.6981    | 0.7167 | 0.7073 | 0.9271   |
| 0.0235        | 44.0  | 2860  | 0.4520          | 0.6959    | 0.7290 | 0.7120 | 0.9273   |
| 0.0235        | 45.0  | 2925  | 0.4540          | 0.6946    | 0.7349 | 0.7142 | 0.9272   |
| 0.0235        | 46.0  | 2990  | 0.4478          | 0.6826    | 0.7497 | 0.7146 | 0.9286   |
| 0.0188        | 47.0  | 3055  | 0.4538          | 0.6951    | 0.7414 | 0.7175 | 0.9278   |
| 0.0188        | 48.0  | 3120  | 0.4738          | 0.6954    | 0.7247 | 0.7097 | 0.9276   |
| 0.0188        | 49.0  | 3185  | 0.4915          | 0.7057    | 0.7338 | 0.7195 | 0.9287   |
| 0.0188        | 50.0  | 3250  | 0.4568          | 0.6989    | 0.7382 | 0.7180 | 0.9285   |
| 0.0188        | 51.0  | 3315  | 0.5172          | 0.6901    | 0.7137 | 0.7017 | 0.9223   |
| 0.0188        | 52.0  | 3380  | 0.4803          | 0.6842    | 0.7290 | 0.7059 | 0.9267   |
| 0.0188        | 53.0  | 3445  | 0.4312          | 0.7015    | 0.7405 | 0.7205 | 0.9297   |
| 0.0169        | 54.0  | 3510  | 0.4340          | 0.6825    | 0.7430 | 0.7115 | 0.9286   |
| 0.0169        | 55.0  | 3575  | 0.4535          | 0.6941    | 0.7583 | 0.7248 | 0.9292   |
| 0.0169        | 56.0  | 3640  | 0.4922          | 0.6897    | 0.7630 | 0.7245 | 0.9292   |
| 0.0169        | 57.0  | 3705  | 0.4889          | 0.6900    | 0.7551 | 0.7211 | 0.9283   |
| 0.0169        | 58.0  | 3770  | 0.4814          | 0.6869    | 0.7396 | 0.7123 | 0.9266   |
| 0.0169        | 59.0  | 3835  | 0.4799          | 0.6764    | 0.7659 | 0.7184 | 0.9275   |
| 0.0169        | 60.0  | 3900  | 0.4813          | 0.6687    | 0.7524 | 0.7081 | 0.9275   |
| 0.0169        | 61.0  | 3965  | 0.4561          | 0.7081    | 0.7526 | 0.7296 | 0.9297   |
| 0.0165        | 62.0  | 4030  | 0.4537          | 0.7002    | 0.7360 | 0.7176 | 0.9277   |
| 0.0165        | 63.0  | 4095  | 0.4793          | 0.6933    | 0.7509 | 0.7210 | 0.9268   |
| 0.0165        | 64.0  | 4160  | 0.4645          | 0.7157    | 0.7162 | 0.7159 | 0.9274   |
| 0.0165        | 65.0  | 4225  | 0.4886          | 0.6939    | 0.7169 | 0.7052 | 0.9263   |
| 0.0165        | 66.0  | 4290  | 0.4707          | 0.6714    | 0.7639 | 0.7147 | 0.9253   |
| 0.0165        | 67.0  | 4355  | 0.4768          | 0.6783    | 0.7535 | 0.7139 | 0.9292   |
| 0.0165        | 68.0  | 4420  | 0.4601          | 0.6868    | 0.7430 | 0.7138 | 0.9280   |
| 0.0165        | 69.0  | 4485  | 0.4411          | 0.7076    | 0.7371 | 0.7221 | 0.9301   |
| 0.0134        | 70.0  | 4550  | 0.5118          | 0.6811    | 0.7383 | 0.7085 | 0.9277   |
| 0.0134        | 71.0  | 4615  | 0.4723          | 0.6908    | 0.7455 | 0.7171 | 0.9283   |
| 0.0134        | 72.0  | 4680  | 0.4940          | 0.6939    | 0.7196 | 0.7065 | 0.9257   |
| 0.0134        | 73.0  | 4745  | 0.5030          | 0.6870    | 0.7443 | 0.7145 | 0.9276   |
| 0.0134        | 74.0  | 4810  | 0.4606          | 0.6834    | 0.7398 | 0.7105 | 0.9283   |
| 0.0134        | 75.0  | 4875  | 0.4554          | 0.6904    | 0.7614 | 0.7242 | 0.9305   |
| 0.0134        | 76.0  | 4940  | 0.5056          | 0.6926    | 0.7241 | 0.7080 | 0.9263   |
| 0.0136        | 77.0  | 5005  | 0.5137          | 0.6537    | 0.7371 | 0.6929 | 0.9224   |
| 0.0136        | 78.0  | 5070  | 0.4599          | 0.6891    | 0.7252 | 0.7067 | 0.9264   |
| 0.0136        | 79.0  | 5135  | 0.4919          | 0.6916    | 0.7641 | 0.7260 | 0.9292   |
| 0.0136        | 80.0  | 5200  | 0.4656          | 0.6801    | 0.7513 | 0.7140 | 0.9279   |
| 0.0136        | 81.0  | 5265  | 0.4895          | 0.6856    | 0.7592 | 0.7206 | 0.9282   |
| 0.0136        | 82.0  | 5330  | 0.4975          | 0.69      | 0.7331 | 0.7109 | 0.9268   |
| 0.0136        | 83.0  | 5395  | 0.4889          | 0.6984    | 0.7679 | 0.7315 | 0.9291   |
| 0.0136        | 84.0  | 5460  | 0.4989          | 0.6934    | 0.7446 | 0.7181 | 0.9279   |
| 0.0142        | 85.0  | 5525  | 0.4927          | 0.7045    | 0.7382 | 0.7210 | 0.9292   |
| 0.0142        | 86.0  | 5590  | 0.5044          | 0.6862    | 0.7322 | 0.7085 | 0.9253   |
| 0.0142        | 87.0  | 5655  | 0.4977          | 0.6834    | 0.7434 | 0.7122 | 0.9263   |
| 0.0142        | 88.0  | 5720  | 0.5068          | 0.6750    | 0.7675 | 0.7183 | 0.9275   |
| 0.0142        | 89.0  | 5785  | 0.5193          | 0.6946    | 0.7531 | 0.7227 | 0.9286   |
| 0.0142        | 90.0  | 5850  | 0.5418          | 0.6953    | 0.7497 | 0.7215 | 0.9282   |
| 0.0142        | 91.0  | 5915  | 0.5780          | 0.7030    | 0.7315 | 0.7170 | 0.9273   |
| 0.0142        | 92.0  | 5980  | 0.5278          | 0.6825    | 0.6937 | 0.6880 | 0.9224   |
| 0.0112        | 93.0  | 6045  | 0.5053          | 0.7089    | 0.7333 | 0.7209 | 0.9275   |
| 0.0112        | 94.0  | 6110  | 0.5550          | 0.7067    | 0.6926 | 0.6996 | 0.9231   |
| 0.0112        | 95.0  | 6175  | 0.5253          | 0.6830    | 0.7610 | 0.7199 | 0.9262   |
| 0.0112        | 96.0  | 6240  | 0.5264          | 0.6906    | 0.7495 | 0.7188 | 0.9267   |
| 0.0112        | 97.0  | 6305  | 0.5120          | 0.6988    | 0.7533 | 0.7250 | 0.9284   |
| 0.0112        | 98.0  | 6370  | 0.5490          | 0.7072    | 0.7160 | 0.7116 | 0.9266   |
| 0.0112        | 99.0  | 6435  | 0.4795          | 0.7063    | 0.7526 | 0.7287 | 0.9298   |
| 0.0115        | 100.0 | 6500  | 0.5181          | 0.6969    | 0.7382 | 0.7169 | 0.9281   |
| 0.0115        | 101.0 | 6565  | 0.5245          | 0.6909    | 0.7355 | 0.7125 | 0.9273   |
| 0.0115        | 102.0 | 6630  | 0.5008          | 0.6837    | 0.7704 | 0.7245 | 0.9282   |
| 0.0115        | 103.0 | 6695  | 0.5059          | 0.6833    | 0.7481 | 0.7142 | 0.9267   |
| 0.0115        | 104.0 | 6760  | 0.5299          | 0.7057    | 0.7279 | 0.7166 | 0.9280   |
| 0.0115        | 105.0 | 6825  | 0.4829          | 0.7054    | 0.7416 | 0.7230 | 0.9299   |
| 0.0115        | 106.0 | 6890  | 0.5247          | 0.7062    | 0.7463 | 0.7257 | 0.9284   |
| 0.0115        | 107.0 | 6955  | 0.5306          | 0.7067    | 0.7603 | 0.7325 | 0.9309   |
| 0.0096        | 108.0 | 7020  | 0.5252          | 0.6885    | 0.7481 | 0.7171 | 0.9263   |
| 0.0096        | 109.0 | 7085  | 0.4961          | 0.7094    | 0.7407 | 0.7247 | 0.9306   |
| 0.0096        | 110.0 | 7150  | 0.5659          | 0.6912    | 0.7369 | 0.7133 | 0.9266   |
| 0.0096        | 111.0 | 7215  | 0.5572          | 0.6765    | 0.7682 | 0.7195 | 0.9268   |
| 0.0096        | 112.0 | 7280  | 0.5170          | 0.7190    | 0.7360 | 0.7274 | 0.9305   |
| 0.0096        | 113.0 | 7345  | 0.5140          | 0.6973    | 0.7274 | 0.7120 | 0.9276   |
| 0.0096        | 114.0 | 7410  | 0.5507          | 0.7096    | 0.7520 | 0.7302 | 0.9298   |
| 0.0096        | 115.0 | 7475  | 0.5813          | 0.6944    | 0.7337 | 0.7135 | 0.9271   |
| 0.0087        | 116.0 | 7540  | 0.5431          | 0.7079    | 0.7423 | 0.7247 | 0.9288   |
| 0.0087        | 117.0 | 7605  | 0.5649          | 0.6867    | 0.7596 | 0.7213 | 0.9275   |
| 0.0087        | 118.0 | 7670  | 0.5577          | 0.6856    | 0.7576 | 0.7198 | 0.9267   |
| 0.0087        | 119.0 | 7735  | 0.5189          | 0.7107    | 0.7448 | 0.7273 | 0.9296   |
| 0.0087        | 120.0 | 7800  | 0.4997          | 0.7024    | 0.7268 | 0.7144 | 0.9283   |
| 0.0087        | 121.0 | 7865  | 0.5347          | 0.6838    | 0.7594 | 0.7196 | 0.9274   |
| 0.0087        | 122.0 | 7930  | 0.5074          | 0.6986    | 0.7329 | 0.7154 | 0.9280   |
| 0.0087        | 123.0 | 7995  | 0.5455          | 0.6925    | 0.7661 | 0.7274 | 0.9279   |
| 0.0094        | 124.0 | 8060  | 0.5187          | 0.6858    | 0.7681 | 0.7246 | 0.9295   |
| 0.0094        | 125.0 | 8125  | 0.5379          | 0.6918    | 0.7574 | 0.7231 | 0.9290   |
| 0.0094        | 126.0 | 8190  | 0.5108          | 0.6963    | 0.7500 | 0.7221 | 0.9286   |
| 0.0094        | 127.0 | 8255  | 0.5201          | 0.7093    | 0.7612 | 0.7344 | 0.9300   |
| 0.0094        | 128.0 | 8320  | 0.5498          | 0.6975    | 0.7536 | 0.7245 | 0.9290   |
| 0.0094        | 129.0 | 8385  | 0.5157          | 0.7128    | 0.7464 | 0.7292 | 0.9293   |
| 0.0094        | 130.0 | 8450  | 0.5246          | 0.7044    | 0.7446 | 0.7240 | 0.9281   |
| 0.0083        | 131.0 | 8515  | 0.5290          | 0.6857    | 0.7391 | 0.7114 | 0.9254   |
| 0.0083        | 132.0 | 8580  | 0.5479          | 0.6919    | 0.7400 | 0.7151 | 0.9266   |
| 0.0083        | 133.0 | 8645  | 0.5500          | 0.7084    | 0.7207 | 0.7145 | 0.9279   |
| 0.0083        | 134.0 | 8710  | 0.5646          | 0.6755    | 0.7572 | 0.7140 | 0.9235   |
| 0.0083        | 135.0 | 8775  | 0.5731          | 0.6871    | 0.7290 | 0.7074 | 0.9247   |
| 0.0083        | 136.0 | 8840  | 0.5839          | 0.6946    | 0.7421 | 0.7176 | 0.9279   |
| 0.0083        | 137.0 | 8905  | 0.5546          | 0.6814    | 0.7715 | 0.7236 | 0.9275   |
| 0.0083        | 138.0 | 8970  | 0.5774          | 0.7080    | 0.7205 | 0.7142 | 0.9252   |
| 0.008         | 139.0 | 9035  | 0.5790          | 0.7026    | 0.7585 | 0.7295 | 0.9292   |
| 0.008         | 140.0 | 9100  | 0.5969          | 0.7078    | 0.7389 | 0.7230 | 0.9290   |
| 0.008         | 141.0 | 9165  | 0.5879          | 0.7129    | 0.7335 | 0.7231 | 0.9270   |
| 0.008         | 142.0 | 9230  | 0.5642          | 0.6920    | 0.7749 | 0.7311 | 0.9286   |
| 0.008         | 143.0 | 9295  | 0.5660          | 0.6920    | 0.7317 | 0.7113 | 0.9243   |
| 0.008         | 144.0 | 9360  | 0.5383          | 0.7210    | 0.7454 | 0.7330 | 0.9303   |
| 0.008         | 145.0 | 9425  | 0.5516          | 0.6899    | 0.7625 | 0.7244 | 0.9285   |
| 0.008         | 146.0 | 9490  | 0.5800          | 0.7001    | 0.7504 | 0.7244 | 0.9279   |
| 0.0077        | 147.0 | 9555  | 0.5994          | 0.6904    | 0.7538 | 0.7207 | 0.9271   |
| 0.0077        | 148.0 | 9620  | 0.5490          | 0.6971    | 0.7605 | 0.7274 | 0.9286   |
| 0.0077        | 149.0 | 9685  | 0.5419          | 0.7037    | 0.7331 | 0.7181 | 0.9277   |
| 0.0077        | 150.0 | 9750  | 0.5677          | 0.7030    | 0.7590 | 0.7299 | 0.9286   |
| 0.0077        | 151.0 | 9815  | 0.5506          | 0.7133    | 0.7576 | 0.7348 | 0.9306   |
| 0.0077        | 152.0 | 9880  | 0.5485          | 0.7170    | 0.7531 | 0.7346 | 0.9305   |
| 0.0077        | 153.0 | 9945  | 0.5387          | 0.7140    | 0.7508 | 0.7319 | 0.9305   |
| 0.0074        | 154.0 | 10010 | 0.5367          | 0.7082    | 0.7409 | 0.7242 | 0.9285   |
| 0.0074        | 155.0 | 10075 | 0.5347          | 0.7194    | 0.7434 | 0.7312 | 0.9313   |
| 0.0074        | 156.0 | 10140 | 0.5098          | 0.7002    | 0.7493 | 0.7239 | 0.9303   |
| 0.0074        | 157.0 | 10205 | 0.5244          | 0.7072    | 0.7556 | 0.7306 | 0.9313   |
| 0.0074        | 158.0 | 10270 | 0.5308          | 0.6972    | 0.7459 | 0.7207 | 0.9286   |
| 0.0074        | 159.0 | 10335 | 0.5254          | 0.7082    | 0.7418 | 0.7246 | 0.9302   |
| 0.0074        | 160.0 | 10400 | 0.5290          | 0.7012    | 0.7627 | 0.7306 | 0.9308   |
| 0.0074        | 161.0 | 10465 | 0.5579          | 0.6890    | 0.7450 | 0.7159 | 0.9271   |
| 0.0063        | 162.0 | 10530 | 0.5626          | 0.7027    | 0.7740 | 0.7367 | 0.9286   |
| 0.0063        | 163.0 | 10595 | 0.5592          | 0.6973    | 0.7587 | 0.7267 | 0.9287   |
| 0.0063        | 164.0 | 10660 | 0.5477          | 0.7021    | 0.7484 | 0.7245 | 0.9286   |
| 0.0063        | 165.0 | 10725 | 0.5554          | 0.6906    | 0.7400 | 0.7144 | 0.9269   |
| 0.0063        | 166.0 | 10790 | 0.5559          | 0.7128    | 0.7527 | 0.7322 | 0.9296   |
| 0.0063        | 167.0 | 10855 | 0.5043          | 0.7081    | 0.7333 | 0.7205 | 0.9281   |
| 0.0063        | 168.0 | 10920 | 0.5417          | 0.7009    | 0.7556 | 0.7272 | 0.9287   |
| 0.0063        | 169.0 | 10985 | 0.5428          | 0.7145    | 0.7410 | 0.7275 | 0.9281   |
| 0.0075        | 170.0 | 11050 | 0.5807          | 0.6804    | 0.7576 | 0.7169 | 0.9259   |
| 0.0075        | 171.0 | 11115 | 0.6278          | 0.6838    | 0.7409 | 0.7112 | 0.9255   |
| 0.0075        | 172.0 | 11180 | 0.5789          | 0.7049    | 0.7360 | 0.7201 | 0.9276   |
| 0.0075        | 173.0 | 11245 | 0.5873          | 0.6980    | 0.7256 | 0.7115 | 0.9270   |
| 0.0075        | 174.0 | 11310 | 0.5459          | 0.6911    | 0.7774 | 0.7317 | 0.9290   |
| 0.0075        | 175.0 | 11375 | 0.5281          | 0.7018    | 0.7535 | 0.7267 | 0.9294   |
| 0.0075        | 176.0 | 11440 | 0.5366          | 0.7141    | 0.7506 | 0.7319 | 0.9294   |
| 0.006         | 177.0 | 11505 | 0.5741          | 0.7062    | 0.7531 | 0.7289 | 0.9298   |
| 0.006         | 178.0 | 11570 | 0.5661          | 0.6983    | 0.7589 | 0.7273 | 0.9290   |
| 0.006         | 179.0 | 11635 | 0.5913          | 0.7179    | 0.7373 | 0.7274 | 0.9293   |
| 0.006         | 180.0 | 11700 | 0.5723          | 0.7236    | 0.7452 | 0.7342 | 0.9300   |
| 0.006         | 181.0 | 11765 | 0.6079          | 0.7217    | 0.7405 | 0.7310 | 0.9287   |
| 0.006         | 182.0 | 11830 | 0.5710          | 0.6981    | 0.7162 | 0.7070 | 0.9238   |
| 0.006         | 183.0 | 11895 | 0.5895          | 0.7091    | 0.7468 | 0.7275 | 0.9289   |
| 0.006         | 184.0 | 11960 | 0.5970          | 0.6882    | 0.7652 | 0.7247 | 0.9285   |
| 0.0059        | 185.0 | 12025 | 0.5658          | 0.6849    | 0.7580 | 0.7196 | 0.9278   |
| 0.0059        | 186.0 | 12090 | 0.5282          | 0.6981    | 0.7320 | 0.7147 | 0.9267   |
| 0.0059        | 187.0 | 12155 | 0.5622          | 0.7084    | 0.7502 | 0.7287 | 0.9293   |
| 0.0059        | 188.0 | 12220 | 0.5713          | 0.6991    | 0.7497 | 0.7235 | 0.9289   |
| 0.0059        | 189.0 | 12285 | 0.5848          | 0.6926    | 0.7789 | 0.7332 | 0.9270   |
| 0.0059        | 190.0 | 12350 | 0.5561          | 0.7055    | 0.7657 | 0.7344 | 0.9298   |
| 0.0059        | 191.0 | 12415 | 0.5761          | 0.7040    | 0.7405 | 0.7218 | 0.9269   |
| 0.0059        | 192.0 | 12480 | 0.6216          | 0.6911    | 0.7430 | 0.7161 | 0.9264   |
| 0.0059        | 193.0 | 12545 | 0.6137          | 0.7116    | 0.7459 | 0.7283 | 0.9295   |
| 0.0059        | 194.0 | 12610 | 0.5797          | 0.6929    | 0.7630 | 0.7263 | 0.9289   |
| 0.0059        | 195.0 | 12675 | 0.5176          | 0.7081    | 0.7675 | 0.7366 | 0.9319   |
| 0.0059        | 196.0 | 12740 | 0.5698          | 0.7042    | 0.7356 | 0.7196 | 0.9273   |
| 0.0059        | 197.0 | 12805 | 0.5592          | 0.7042    | 0.7396 | 0.7215 | 0.9293   |
| 0.0059        | 198.0 | 12870 | 0.5740          | 0.7015    | 0.7313 | 0.7161 | 0.9271   |
| 0.0059        | 199.0 | 12935 | 0.5589          | 0.7190    | 0.7311 | 0.7250 | 0.9297   |
| 0.0058        | 200.0 | 13000 | 0.5749          | 0.6847    | 0.7717 | 0.7256 | 0.9287   |
| 0.0058        | 201.0 | 13065 | 0.5486          | 0.7161    | 0.7663 | 0.7403 | 0.9313   |
| 0.0058        | 202.0 | 13130 | 0.5279          | 0.7108    | 0.7218 | 0.7162 | 0.9281   |
| 0.0058        | 203.0 | 13195 | 0.5850          | 0.7102    | 0.7252 | 0.7176 | 0.9273   |
| 0.0058        | 204.0 | 13260 | 0.6231          | 0.6969    | 0.7771 | 0.7348 | 0.9283   |
| 0.0058        | 205.0 | 13325 | 0.5637          | 0.6968    | 0.7740 | 0.7334 | 0.9277   |
| 0.0058        | 206.0 | 13390 | 0.5366          | 0.7017    | 0.7308 | 0.7159 | 0.9279   |
| 0.0058        | 207.0 | 13455 | 0.5978          | 0.7098    | 0.7250 | 0.7173 | 0.9267   |
| 0.0055        | 208.0 | 13520 | 0.5603          | 0.6980    | 0.7599 | 0.7276 | 0.9295   |
| 0.0055        | 209.0 | 13585 | 0.5780          | 0.6930    | 0.7407 | 0.7161 | 0.9275   |
| 0.0055        | 210.0 | 13650 | 0.5846          | 0.7038    | 0.7572 | 0.7295 | 0.9283   |
| 0.0055        | 211.0 | 13715 | 0.6297          | 0.7018    | 0.7250 | 0.7132 | 0.9241   |
| 0.0055        | 212.0 | 13780 | 0.5818          | 0.7143    | 0.7173 | 0.7158 | 0.9276   |
| 0.0055        | 213.0 | 13845 | 0.6260          | 0.6879    | 0.7454 | 0.7155 | 0.9252   |
| 0.0055        | 214.0 | 13910 | 0.6031          | 0.7072    | 0.7578 | 0.7316 | 0.9284   |
| 0.0055        | 215.0 | 13975 | 0.5846          | 0.6954    | 0.7684 | 0.7301 | 0.9279   |
| 0.0044        | 216.0 | 14040 | 0.5741          | 0.7067    | 0.7328 | 0.7195 | 0.9265   |
| 0.0044        | 217.0 | 14105 | 0.5848          | 0.7186    | 0.7389 | 0.7286 | 0.9291   |
| 0.0044        | 218.0 | 14170 | 0.5496          | 0.7163    | 0.7248 | 0.7206 | 0.9269   |
| 0.0044        | 219.0 | 14235 | 0.5700          | 0.7089    | 0.7520 | 0.7298 | 0.9288   |
| 0.0044        | 220.0 | 14300 | 0.5664          | 0.7063    | 0.7427 | 0.7240 | 0.9280   |
| 0.0044        | 221.0 | 14365 | 0.5573          | 0.7173    | 0.7618 | 0.7389 | 0.9324   |
| 0.0044        | 222.0 | 14430 | 0.5588          | 0.7151    | 0.7690 | 0.7411 | 0.9324   |
| 0.0044        | 223.0 | 14495 | 0.5809          | 0.7129    | 0.7455 | 0.7289 | 0.9294   |
| 0.0037        | 224.0 | 14560 | 0.6135          | 0.6921    | 0.7621 | 0.7254 | 0.9281   |
| 0.0037        | 225.0 | 14625 | 0.6160          | 0.6890    | 0.7383 | 0.7128 | 0.9251   |
| 0.0037        | 226.0 | 14690 | 0.5938          | 0.6887    | 0.7508 | 0.7184 | 0.9270   |
| 0.0037        | 227.0 | 14755 | 0.5687          | 0.7076    | 0.7473 | 0.7269 | 0.9296   |
| 0.0037        | 228.0 | 14820 | 0.5785          | 0.7097    | 0.7517 | 0.7301 | 0.9283   |
| 0.0037        | 229.0 | 14885 | 0.5675          | 0.6869    | 0.7470 | 0.7157 | 0.9270   |
| 0.0037        | 230.0 | 14950 | 0.5937          | 0.7077    | 0.7524 | 0.7293 | 0.9289   |
| 0.0046        | 231.0 | 15015 | 0.5650          | 0.7097    | 0.7414 | 0.7252 | 0.9294   |
| 0.0046        | 232.0 | 15080 | 0.5820          | 0.7038    | 0.7745 | 0.7375 | 0.9307   |
| 0.0046        | 233.0 | 15145 | 0.6118          | 0.7124    | 0.7432 | 0.7275 | 0.9284   |
| 0.0046        | 234.0 | 15210 | 0.6100          | 0.7055    | 0.7544 | 0.7291 | 0.9297   |
| 0.0046        | 235.0 | 15275 | 0.5869          | 0.7149    | 0.7592 | 0.7364 | 0.9302   |
| 0.0046        | 236.0 | 15340 | 0.5881          | 0.7169    | 0.7616 | 0.7386 | 0.9305   |
| 0.0046        | 237.0 | 15405 | 0.5616          | 0.7188    | 0.7380 | 0.7283 | 0.9315   |
| 0.0046        | 238.0 | 15470 | 0.5785          | 0.7176    | 0.7320 | 0.7247 | 0.9281   |
| 0.0047        | 239.0 | 15535 | 0.5979          | 0.7159    | 0.7466 | 0.7310 | 0.9279   |
| 0.0047        | 240.0 | 15600 | 0.5732          | 0.7075    | 0.7533 | 0.7297 | 0.9303   |
| 0.0047        | 241.0 | 15665 | 0.5732          | 0.7111    | 0.7421 | 0.7263 | 0.9294   |
| 0.0047        | 242.0 | 15730 | 0.5516          | 0.7198    | 0.7382 | 0.7288 | 0.9292   |
| 0.0047        | 243.0 | 15795 | 0.5505          | 0.7073    | 0.7697 | 0.7372 | 0.9310   |
| 0.0047        | 244.0 | 15860 | 0.5677          | 0.7163    | 0.7428 | 0.7293 | 0.9303   |
| 0.0047        | 245.0 | 15925 | 0.5815          | 0.7191    | 0.7302 | 0.7246 | 0.9286   |
| 0.0047        | 246.0 | 15990 | 0.6044          | 0.7099    | 0.7497 | 0.7293 | 0.9287   |
| 0.0042        | 247.0 | 16055 | 0.5540          | 0.7144    | 0.7558 | 0.7345 | 0.9302   |
| 0.0042        | 248.0 | 16120 | 0.5498          | 0.7219    | 0.7581 | 0.7396 | 0.9320   |
| 0.0042        | 249.0 | 16185 | 0.6078          | 0.7152    | 0.7428 | 0.7287 | 0.9303   |
| 0.0042        | 250.0 | 16250 | 0.6523          | 0.7152    | 0.7286 | 0.7219 | 0.9279   |
| 0.0042        | 251.0 | 16315 | 0.6075          | 0.7184    | 0.7621 | 0.7396 | 0.9319   |
| 0.0042        | 252.0 | 16380 | 0.6071          | 0.7108    | 0.7648 | 0.7368 | 0.9302   |
| 0.0042        | 253.0 | 16445 | 0.5849          | 0.7196    | 0.7367 | 0.7281 | 0.9308   |
| 0.0031        | 254.0 | 16510 | 0.5892          | 0.7141    | 0.7652 | 0.7388 | 0.9316   |
| 0.0031        | 255.0 | 16575 | 0.5991          | 0.7174    | 0.7310 | 0.7241 | 0.9273   |
| 0.0031        | 256.0 | 16640 | 0.6051          | 0.7240    | 0.7358 | 0.7298 | 0.9288   |
| 0.0031        | 257.0 | 16705 | 0.5621          | 0.7267    | 0.7560 | 0.7410 | 0.9320   |
| 0.0031        | 258.0 | 16770 | 0.5838          | 0.7165    | 0.7607 | 0.7379 | 0.9314   |
| 0.0031        | 259.0 | 16835 | 0.5713          | 0.7092    | 0.7709 | 0.7388 | 0.9318   |
| 0.0031        | 260.0 | 16900 | 0.5902          | 0.7243    | 0.7499 | 0.7369 | 0.9314   |
| 0.0031        | 261.0 | 16965 | 0.6098          | 0.716     | 0.7414 | 0.7285 | 0.9288   |
| 0.0029        | 262.0 | 17030 | 0.5979          | 0.7193    | 0.7502 | 0.7344 | 0.9308   |
| 0.0029        | 263.0 | 17095 | 0.6314          | 0.7077    | 0.7455 | 0.7261 | 0.9287   |
| 0.0029        | 264.0 | 17160 | 0.6227          | 0.6870    | 0.7360 | 0.7107 | 0.9261   |
| 0.0029        | 265.0 | 17225 | 0.5925          | 0.6997    | 0.7509 | 0.7244 | 0.9283   |
| 0.0029        | 266.0 | 17290 | 0.6090          | 0.7049    | 0.7428 | 0.7234 | 0.9274   |
| 0.0029        | 267.0 | 17355 | 0.5929          | 0.7082    | 0.7508 | 0.7288 | 0.9294   |
| 0.0029        | 268.0 | 17420 | 0.5661          | 0.7013    | 0.7560 | 0.7276 | 0.9293   |
| 0.0029        | 269.0 | 17485 | 0.6482          | 0.7223    | 0.7439 | 0.7330 | 0.9277   |
| 0.0036        | 270.0 | 17550 | 0.5838          | 0.7123    | 0.7479 | 0.7297 | 0.9300   |
| 0.0036        | 271.0 | 17615 | 0.5947          | 0.7220    | 0.7194 | 0.7207 | 0.9272   |
| 0.0036        | 272.0 | 17680 | 0.5878          | 0.7198    | 0.7416 | 0.7305 | 0.9292   |
| 0.0036        | 273.0 | 17745 | 0.5592          | 0.7120    | 0.7684 | 0.7391 | 0.9320   |
| 0.0036        | 274.0 | 17810 | 0.5885          | 0.7163    | 0.7513 | 0.7334 | 0.9297   |
| 0.0036        | 275.0 | 17875 | 0.5953          | 0.7091    | 0.7497 | 0.7288 | 0.9282   |
| 0.0036        | 276.0 | 17940 | 0.6116          | 0.7178    | 0.7457 | 0.7315 | 0.9294   |
| 0.0028        | 277.0 | 18005 | 0.6008          | 0.7201    | 0.7614 | 0.7402 | 0.9313   |
| 0.0028        | 278.0 | 18070 | 0.5998          | 0.7236    | 0.7452 | 0.7342 | 0.9311   |
| 0.0028        | 279.0 | 18135 | 0.6165          | 0.7018    | 0.7594 | 0.7295 | 0.9292   |
| 0.0028        | 280.0 | 18200 | 0.5834          | 0.7262    | 0.7452 | 0.7356 | 0.9312   |
| 0.0028        | 281.0 | 18265 | 0.6081          | 0.7072    | 0.7643 | 0.7346 | 0.9302   |
| 0.0028        | 282.0 | 18330 | 0.5909          | 0.6981    | 0.7580 | 0.7268 | 0.9301   |
| 0.0028        | 283.0 | 18395 | 0.6065          | 0.7155    | 0.7313 | 0.7233 | 0.9277   |
| 0.0028        | 284.0 | 18460 | 0.5695          | 0.7201    | 0.7454 | 0.7325 | 0.9306   |
| 0.0031        | 285.0 | 18525 | 0.6007          | 0.7173    | 0.7455 | 0.7311 | 0.9289   |
| 0.0031        | 286.0 | 18590 | 0.5894          | 0.7041    | 0.7488 | 0.7258 | 0.9284   |
| 0.0031        | 287.0 | 18655 | 0.6207          | 0.7082    | 0.7301 | 0.7190 | 0.9277   |
| 0.0031        | 288.0 | 18720 | 0.5907          | 0.7171    | 0.7488 | 0.7326 | 0.9303   |
| 0.0031        | 289.0 | 18785 | 0.6165          | 0.7199    | 0.7374 | 0.7286 | 0.9298   |
| 0.0031        | 290.0 | 18850 | 0.6304          | 0.7277    | 0.7419 | 0.7347 | 0.9297   |
| 0.0031        | 291.0 | 18915 | 0.6379          | 0.7132    | 0.7605 | 0.7361 | 0.9310   |
| 0.0031        | 292.0 | 18980 | 0.6186          | 0.7226    | 0.7553 | 0.7386 | 0.9307   |
| 0.0027        | 293.0 | 19045 | 0.6400          | 0.7125    | 0.7551 | 0.7332 | 0.9297   |
| 0.0027        | 294.0 | 19110 | 0.6244          | 0.7197    | 0.7527 | 0.7359 | 0.9305   |
| 0.0027        | 295.0 | 19175 | 0.6283          | 0.7200    | 0.7648 | 0.7417 | 0.9309   |
| 0.0027        | 296.0 | 19240 | 0.6233          | 0.7166    | 0.7563 | 0.7359 | 0.9304   |
| 0.0027        | 297.0 | 19305 | 0.6241          | 0.7288    | 0.7583 | 0.7433 | 0.9318   |
| 0.0027        | 298.0 | 19370 | 0.6316          | 0.7266    | 0.7450 | 0.7357 | 0.9299   |
| 0.0027        | 299.0 | 19435 | 0.6733          | 0.7185    | 0.7434 | 0.7307 | 0.9290   |
| 0.0018        | 300.0 | 19500 | 0.5783          | 0.7280    | 0.7506 | 0.7391 | 0.9323   |
| 0.0018        | 301.0 | 19565 | 0.6198          | 0.7086    | 0.7693 | 0.7377 | 0.9303   |
| 0.0018        | 302.0 | 19630 | 0.6555          | 0.7151    | 0.7508 | 0.7325 | 0.9273   |
| 0.0018        | 303.0 | 19695 | 0.6122          | 0.7132    | 0.7616 | 0.7366 | 0.9281   |
| 0.0018        | 304.0 | 19760 | 0.6051          | 0.7082    | 0.7542 | 0.7304 | 0.9294   |
| 0.0018        | 305.0 | 19825 | 0.6306          | 0.7282    | 0.7405 | 0.7343 | 0.9306   |
| 0.0018        | 306.0 | 19890 | 0.5903          | 0.7161    | 0.7650 | 0.7397 | 0.9313   |
| 0.0018        | 307.0 | 19955 | 0.6170          | 0.7169    | 0.7711 | 0.7430 | 0.9318   |
| 0.0023        | 308.0 | 20020 | 0.5948          | 0.7229    | 0.7596 | 0.7408 | 0.9314   |
| 0.0023        | 309.0 | 20085 | 0.6176          | 0.7187    | 0.7652 | 0.7412 | 0.9312   |
| 0.0023        | 310.0 | 20150 | 0.6166          | 0.7219    | 0.7576 | 0.7393 | 0.9305   |
| 0.0023        | 311.0 | 20215 | 0.6239          | 0.7230    | 0.7646 | 0.7432 | 0.9305   |
| 0.0023        | 312.0 | 20280 | 0.6458          | 0.7172    | 0.7641 | 0.7399 | 0.9311   |
| 0.0023        | 313.0 | 20345 | 0.6546          | 0.7112    | 0.7841 | 0.7459 | 0.9310   |
| 0.0023        | 314.0 | 20410 | 0.6326          | 0.7273    | 0.7627 | 0.7445 | 0.9312   |
| 0.0023        | 315.0 | 20475 | 0.6073          | 0.7248    | 0.7574 | 0.7408 | 0.9314   |
| 0.0016        | 316.0 | 20540 | 0.6442          | 0.7169    | 0.7673 | 0.7412 | 0.9303   |
| 0.0016        | 317.0 | 20605 | 0.6380          | 0.7215    | 0.7608 | 0.7406 | 0.9305   |
| 0.0016        | 318.0 | 20670 | 0.6590          | 0.7126    | 0.7461 | 0.7290 | 0.9280   |
| 0.0016        | 319.0 | 20735 | 0.6474          | 0.7178    | 0.7594 | 0.7380 | 0.9292   |
| 0.0016        | 320.0 | 20800 | 0.6006          | 0.7071    | 0.7729 | 0.7385 | 0.9302   |
| 0.0016        | 321.0 | 20865 | 0.6207          | 0.7274    | 0.7488 | 0.7380 | 0.9309   |
| 0.0016        | 322.0 | 20930 | 0.6735          | 0.7032    | 0.7679 | 0.7341 | 0.9277   |
| 0.0016        | 323.0 | 20995 | 0.6733          | 0.7056    | 0.7376 | 0.7213 | 0.9271   |
| 0.0018        | 324.0 | 21060 | 0.6851          | 0.6920    | 0.7288 | 0.7099 | 0.9245   |
| 0.0018        | 325.0 | 21125 | 0.6069          | 0.7245    | 0.7562 | 0.7400 | 0.9308   |
| 0.0018        | 326.0 | 21190 | 0.6677          | 0.7148    | 0.7562 | 0.7349 | 0.9299   |
| 0.0018        | 327.0 | 21255 | 0.6671          | 0.7057    | 0.7371 | 0.7210 | 0.9270   |
| 0.0018        | 328.0 | 21320 | 0.6393          | 0.7088    | 0.7506 | 0.7291 | 0.9285   |
| 0.0018        | 329.0 | 21385 | 0.6455          | 0.7186    | 0.7628 | 0.7400 | 0.9309   |
| 0.0018        | 330.0 | 21450 | 0.6320          | 0.7349    | 0.7358 | 0.7354 | 0.9301   |
| 0.0023        | 331.0 | 21515 | 0.6373          | 0.7281    | 0.7645 | 0.7458 | 0.9322   |
| 0.0023        | 332.0 | 21580 | 0.6545          | 0.7221    | 0.7504 | 0.7360 | 0.9305   |
| 0.0023        | 333.0 | 21645 | 0.6490          | 0.7188    | 0.7499 | 0.7340 | 0.9298   |
| 0.0023        | 334.0 | 21710 | 0.6504          | 0.7053    | 0.7623 | 0.7327 | 0.9305   |
| 0.0023        | 335.0 | 21775 | 0.6364          | 0.7196    | 0.7578 | 0.7382 | 0.9318   |
| 0.0023        | 336.0 | 21840 | 0.6697          | 0.7205    | 0.7389 | 0.7296 | 0.9293   |
| 0.0023        | 337.0 | 21905 | 0.6477          | 0.7156    | 0.7594 | 0.7369 | 0.9297   |
| 0.0023        | 338.0 | 21970 | 0.6673          | 0.6943    | 0.7634 | 0.7272 | 0.9280   |
| 0.0015        | 339.0 | 22035 | 0.6527          | 0.7253    | 0.7545 | 0.7396 | 0.9301   |
| 0.0015        | 340.0 | 22100 | 0.6479          | 0.7083    | 0.7310 | 0.7194 | 0.9262   |
| 0.0015        | 341.0 | 22165 | 0.6228          | 0.7179    | 0.7508 | 0.7340 | 0.9288   |
| 0.0015        | 342.0 | 22230 | 0.6324          | 0.6975    | 0.7706 | 0.7322 | 0.9280   |
| 0.0015        | 343.0 | 22295 | 0.6646          | 0.7212    | 0.7434 | 0.7321 | 0.9289   |
| 0.0015        | 344.0 | 22360 | 0.6601          | 0.7298    | 0.7329 | 0.7314 | 0.9281   |
| 0.0015        | 345.0 | 22425 | 0.6535          | 0.7191    | 0.7495 | 0.7340 | 0.9298   |
| 0.0015        | 346.0 | 22490 | 0.6840          | 0.7189    | 0.7437 | 0.7311 | 0.9284   |
| 0.0021        | 347.0 | 22555 | 0.6934          | 0.7214    | 0.7266 | 0.7240 | 0.9274   |
| 0.0021        | 348.0 | 22620 | 0.6449          | 0.7097    | 0.7326 | 0.7210 | 0.9282   |
| 0.0021        | 349.0 | 22685 | 0.6576          | 0.7119    | 0.7520 | 0.7314 | 0.9281   |
| 0.0021        | 350.0 | 22750 | 0.6672          | 0.7265    | 0.7473 | 0.7368 | 0.9301   |
| 0.0021        | 351.0 | 22815 | 0.6704          | 0.7193    | 0.7639 | 0.7410 | 0.9305   |
| 0.0021        | 352.0 | 22880 | 0.6893          | 0.7146    | 0.7648 | 0.7389 | 0.9299   |
| 0.0021        | 353.0 | 22945 | 0.6747          | 0.7299    | 0.7589 | 0.7441 | 0.9307   |
| 0.0013        | 354.0 | 23010 | 0.6942          | 0.7119    | 0.7650 | 0.7375 | 0.9285   |
| 0.0013        | 355.0 | 23075 | 0.7042          | 0.7223    | 0.7347 | 0.7284 | 0.9280   |
| 0.0013        | 356.0 | 23140 | 0.7009          | 0.7184    | 0.7666 | 0.7417 | 0.9313   |
| 0.0013        | 357.0 | 23205 | 0.6892          | 0.7262    | 0.7756 | 0.7501 | 0.9317   |
| 0.0013        | 358.0 | 23270 | 0.7022          | 0.7312    | 0.7607 | 0.7456 | 0.9311   |
| 0.0013        | 359.0 | 23335 | 0.7169          | 0.7067    | 0.7657 | 0.7350 | 0.9277   |
| 0.0013        | 360.0 | 23400 | 0.7329          | 0.7179    | 0.7551 | 0.7360 | 0.9273   |
| 0.0013        | 361.0 | 23465 | 0.7030          | 0.7242    | 0.7391 | 0.7316 | 0.9288   |
| 0.0007        | 362.0 | 23530 | 0.7063          | 0.7185    | 0.7529 | 0.7353 | 0.9290   |
| 0.0007        | 363.0 | 23595 | 0.7068          | 0.7239    | 0.7466 | 0.7351 | 0.9293   |
| 0.0007        | 364.0 | 23660 | 0.6959          | 0.7159    | 0.7722 | 0.7430 | 0.9303   |
| 0.0007        | 365.0 | 23725 | 0.7632          | 0.7015    | 0.7450 | 0.7226 | 0.9258   |
| 0.0007        | 366.0 | 23790 | 0.7022          | 0.7246    | 0.7301 | 0.7273 | 0.9268   |
| 0.0007        | 367.0 | 23855 | 0.6818          | 0.7161    | 0.7720 | 0.7430 | 0.9305   |
| 0.0007        | 368.0 | 23920 | 0.6895          | 0.7275    | 0.7578 | 0.7423 | 0.9311   |
| 0.0007        | 369.0 | 23985 | 0.6987          | 0.7124    | 0.7473 | 0.7295 | 0.9293   |
| 0.0016        | 370.0 | 24050 | 0.6857          | 0.7301    | 0.7531 | 0.7414 | 0.9310   |
| 0.0016        | 371.0 | 24115 | 0.7022          | 0.7271    | 0.7418 | 0.7344 | 0.9297   |
| 0.0016        | 372.0 | 24180 | 0.6936          | 0.7277    | 0.7672 | 0.7469 | 0.9313   |
| 0.0016        | 373.0 | 24245 | 0.6836          | 0.7240    | 0.7659 | 0.7444 | 0.9316   |
| 0.0016        | 374.0 | 24310 | 0.6868          | 0.7221    | 0.7576 | 0.7394 | 0.9311   |
| 0.0016        | 375.0 | 24375 | 0.6903          | 0.7315    | 0.7648 | 0.7478 | 0.9314   |
| 0.0016        | 376.0 | 24440 | 0.6973          | 0.7172    | 0.7700 | 0.7427 | 0.9315   |
| 0.0008        | 377.0 | 24505 | 0.6768          | 0.7233    | 0.7470 | 0.7349 | 0.9297   |
| 0.0008        | 378.0 | 24570 | 0.7004          | 0.7347    | 0.7171 | 0.7258 | 0.9273   |
| 0.0008        | 379.0 | 24635 | 0.6794          | 0.7267    | 0.7464 | 0.7364 | 0.9291   |
| 0.0008        | 380.0 | 24700 | 0.6835          | 0.7236    | 0.7599 | 0.7413 | 0.9298   |
| 0.0008        | 381.0 | 24765 | 0.6758          | 0.7188    | 0.7663 | 0.7417 | 0.9295   |
| 0.0008        | 382.0 | 24830 | 0.6731          | 0.7247    | 0.7542 | 0.7391 | 0.9304   |
| 0.0008        | 383.0 | 24895 | 0.6734          | 0.7232    | 0.7513 | 0.7370 | 0.9302   |
| 0.0008        | 384.0 | 24960 | 0.6849          | 0.7207    | 0.7673 | 0.7433 | 0.9305   |
| 0.001         | 385.0 | 25025 | 0.6711          | 0.7216    | 0.7533 | 0.7371 | 0.9297   |
| 0.001         | 386.0 | 25090 | 0.6792          | 0.7326    | 0.7508 | 0.7416 | 0.9298   |
| 0.001         | 387.0 | 25155 | 0.6708          | 0.7074    | 0.7603 | 0.7329 | 0.9284   |
| 0.001         | 388.0 | 25220 | 0.6708          | 0.7157    | 0.7468 | 0.7309 | 0.9282   |
| 0.001         | 389.0 | 25285 | 0.6720          | 0.7191    | 0.7639 | 0.7408 | 0.9292   |
| 0.001         | 390.0 | 25350 | 0.6690          | 0.7097    | 0.7738 | 0.7404 | 0.9291   |
| 0.001         | 391.0 | 25415 | 0.6585          | 0.7209    | 0.7599 | 0.7399 | 0.9304   |
| 0.001         | 392.0 | 25480 | 0.6568          | 0.7131    | 0.7717 | 0.7412 | 0.9313   |
| 0.0009        | 393.0 | 25545 | 0.6936          | 0.7104    | 0.7581 | 0.7335 | 0.9287   |
| 0.0009        | 394.0 | 25610 | 0.6739          | 0.7264    | 0.7639 | 0.7447 | 0.9316   |
| 0.0009        | 395.0 | 25675 | 0.7106          | 0.7215    | 0.7520 | 0.7364 | 0.9301   |
| 0.0009        | 396.0 | 25740 | 0.6742          | 0.7276    | 0.7490 | 0.7381 | 0.9309   |
| 0.0009        | 397.0 | 25805 | 0.6745          | 0.7238    | 0.7484 | 0.7359 | 0.9311   |
| 0.0009        | 398.0 | 25870 | 0.6849          | 0.7247    | 0.7614 | 0.7426 | 0.9297   |
| 0.0009        | 399.0 | 25935 | 0.6664          | 0.7242    | 0.7558 | 0.7397 | 0.9308   |
| 0.001         | 400.0 | 26000 | 0.7093          | 0.7172    | 0.7403 | 0.7286 | 0.9287   |
| 0.001         | 401.0 | 26065 | 0.6641          | 0.7202    | 0.7580 | 0.7386 | 0.9307   |
| 0.001         | 402.0 | 26130 | 0.6643          | 0.7137    | 0.7711 | 0.7413 | 0.9303   |
| 0.001         | 403.0 | 26195 | 0.6608          | 0.7263    | 0.7551 | 0.7404 | 0.9307   |
| 0.001         | 404.0 | 26260 | 0.6820          | 0.7251    | 0.7632 | 0.7436 | 0.9314   |
| 0.001         | 405.0 | 26325 | 0.6736          | 0.7293    | 0.7623 | 0.7454 | 0.9314   |
| 0.001         | 406.0 | 26390 | 0.6834          | 0.7274    | 0.7509 | 0.7390 | 0.9303   |
| 0.001         | 407.0 | 26455 | 0.6767          | 0.7218    | 0.7513 | 0.7363 | 0.9312   |
| 0.0006        | 408.0 | 26520 | 0.6918          | 0.7176    | 0.7738 | 0.7446 | 0.9315   |
| 0.0006        | 409.0 | 26585 | 0.6917          | 0.7276    | 0.7639 | 0.7453 | 0.9324   |
| 0.0006        | 410.0 | 26650 | 0.7120          | 0.7111    | 0.7603 | 0.7349 | 0.9297   |
| 0.0006        | 411.0 | 26715 | 0.6895          | 0.7251    | 0.7535 | 0.7390 | 0.9313   |
| 0.0006        | 412.0 | 26780 | 0.6915          | 0.7220    | 0.7627 | 0.7417 | 0.9316   |
| 0.0006        | 413.0 | 26845 | 0.7040          | 0.7071    | 0.7756 | 0.7398 | 0.9299   |
| 0.0006        | 414.0 | 26910 | 0.6899          | 0.7248    | 0.7526 | 0.7384 | 0.9308   |
| 0.0006        | 415.0 | 26975 | 0.6993          | 0.7229    | 0.7639 | 0.7428 | 0.9315   |
| 0.0005        | 416.0 | 27040 | 0.7063          | 0.7224    | 0.7672 | 0.7441 | 0.9316   |
| 0.0005        | 417.0 | 27105 | 0.6930          | 0.7241    | 0.7708 | 0.7467 | 0.9327   |
| 0.0005        | 418.0 | 27170 | 0.6957          | 0.7245    | 0.7610 | 0.7423 | 0.9320   |
| 0.0005        | 419.0 | 27235 | 0.6978          | 0.7256    | 0.7538 | 0.7394 | 0.9317   |
| 0.0005        | 420.0 | 27300 | 0.6905          | 0.7285    | 0.7562 | 0.7421 | 0.9327   |
| 0.0005        | 421.0 | 27365 | 0.7016          | 0.7140    | 0.7598 | 0.7362 | 0.9312   |
| 0.0005        | 422.0 | 27430 | 0.7007          | 0.7206    | 0.7590 | 0.7393 | 0.9323   |
| 0.0005        | 423.0 | 27495 | 0.7106          | 0.7175    | 0.7554 | 0.7360 | 0.9315   |
| 0.0006        | 424.0 | 27560 | 0.6984          | 0.7304    | 0.7778 | 0.7534 | 0.9331   |
| 0.0006        | 425.0 | 27625 | 0.6956          | 0.7310    | 0.7771 | 0.7533 | 0.9330   |
| 0.0006        | 426.0 | 27690 | 0.7069          | 0.7149    | 0.7583 | 0.7360 | 0.9303   |
| 0.0006        | 427.0 | 27755 | 0.7152          | 0.7233    | 0.7389 | 0.7310 | 0.9289   |
| 0.0006        | 428.0 | 27820 | 0.7047          | 0.7269    | 0.7639 | 0.7449 | 0.9319   |
| 0.0006        | 429.0 | 27885 | 0.7078          | 0.7295    | 0.7556 | 0.7423 | 0.9318   |
| 0.0006        | 430.0 | 27950 | 0.7091          | 0.7322    | 0.7610 | 0.7463 | 0.9321   |
| 0.0006        | 431.0 | 28015 | 0.7219          | 0.7340    | 0.7464 | 0.7402 | 0.9310   |
| 0.0006        | 432.0 | 28080 | 0.7183          | 0.7205    | 0.7571 | 0.7383 | 0.9303   |
| 0.0006        | 433.0 | 28145 | 0.7059          | 0.7262    | 0.7562 | 0.7409 | 0.9317   |
| 0.0006        | 434.0 | 28210 | 0.7006          | 0.7260    | 0.7654 | 0.7452 | 0.9316   |
| 0.0006        | 435.0 | 28275 | 0.7073          | 0.7209    | 0.7623 | 0.7410 | 0.9308   |
| 0.0006        | 436.0 | 28340 | 0.7080          | 0.7270    | 0.7720 | 0.7488 | 0.9324   |
| 0.0006        | 437.0 | 28405 | 0.7054          | 0.7218    | 0.7619 | 0.7413 | 0.9312   |
| 0.0006        | 438.0 | 28470 | 0.7128          | 0.7294    | 0.7529 | 0.7410 | 0.9314   |
| 0.0004        | 439.0 | 28535 | 0.7119          | 0.7234    | 0.7587 | 0.7406 | 0.9314   |
| 0.0004        | 440.0 | 28600 | 0.7244          | 0.7175    | 0.7632 | 0.7396 | 0.9313   |
| 0.0004        | 441.0 | 28665 | 0.7293          | 0.7297    | 0.7587 | 0.7439 | 0.9315   |
| 0.0004        | 442.0 | 28730 | 0.7422          | 0.7194    | 0.7587 | 0.7385 | 0.9310   |
| 0.0004        | 443.0 | 28795 | 0.7304          | 0.7264    | 0.7645 | 0.7449 | 0.9313   |
| 0.0004        | 444.0 | 28860 | 0.7224          | 0.7307    | 0.7551 | 0.7427 | 0.9315   |
| 0.0004        | 445.0 | 28925 | 0.7144          | 0.7317    | 0.7598 | 0.7455 | 0.9325   |
| 0.0004        | 446.0 | 28990 | 0.7153          | 0.7210    | 0.7627 | 0.7412 | 0.9325   |
| 0.0004        | 447.0 | 29055 | 0.7269          | 0.7273    | 0.7540 | 0.7404 | 0.9315   |
| 0.0004        | 448.0 | 29120 | 0.7487          | 0.7198    | 0.7608 | 0.7397 | 0.9304   |
| 0.0004        | 449.0 | 29185 | 0.7341          | 0.7238    | 0.7580 | 0.7405 | 0.9312   |
| 0.0004        | 450.0 | 29250 | 0.7212          | 0.7325    | 0.7697 | 0.7506 | 0.9327   |
| 0.0004        | 451.0 | 29315 | 0.7180          | 0.7302    | 0.7565 | 0.7431 | 0.9317   |
| 0.0004        | 452.0 | 29380 | 0.7197          | 0.7257    | 0.7724 | 0.7483 | 0.9324   |
| 0.0004        | 453.0 | 29445 | 0.7183          | 0.7194    | 0.7536 | 0.7361 | 0.9307   |
| 0.0003        | 454.0 | 29510 | 0.7264          | 0.7178    | 0.7679 | 0.7420 | 0.9308   |
| 0.0003        | 455.0 | 29575 | 0.7120          | 0.7283    | 0.7608 | 0.7442 | 0.9322   |
| 0.0003        | 456.0 | 29640 | 0.7410          | 0.7290    | 0.7513 | 0.7400 | 0.9305   |
| 0.0003        | 457.0 | 29705 | 0.7289          | 0.7338    | 0.7574 | 0.7454 | 0.9317   |
| 0.0003        | 458.0 | 29770 | 0.7051          | 0.7332    | 0.7576 | 0.7452 | 0.9321   |
| 0.0003        | 459.0 | 29835 | 0.7243          | 0.7292    | 0.7608 | 0.7447 | 0.9311   |
| 0.0003        | 460.0 | 29900 | 0.7140          | 0.7314    | 0.7562 | 0.7436 | 0.9318   |
| 0.0003        | 461.0 | 29965 | 0.7157          | 0.7257    | 0.7599 | 0.7424 | 0.9315   |
| 0.0003        | 462.0 | 30030 | 0.7115          | 0.7277    | 0.7646 | 0.7457 | 0.9324   |
| 0.0003        | 463.0 | 30095 | 0.7073          | 0.7296    | 0.7765 | 0.7523 | 0.9331   |
| 0.0003        | 464.0 | 30160 | 0.6973          | 0.7352    | 0.7594 | 0.7471 | 0.9336   |
| 0.0003        | 465.0 | 30225 | 0.6869          | 0.7332    | 0.7700 | 0.7512 | 0.9331   |
| 0.0003        | 466.0 | 30290 | 0.6951          | 0.7304    | 0.7704 | 0.7499 | 0.9327   |
| 0.0003        | 467.0 | 30355 | 0.7065          | 0.7250    | 0.7691 | 0.7464 | 0.9318   |
| 0.0003        | 468.0 | 30420 | 0.7112          | 0.7280    | 0.7679 | 0.7474 | 0.9319   |
| 0.0003        | 469.0 | 30485 | 0.7115          | 0.7303    | 0.7695 | 0.7494 | 0.9321   |
| 0.0004        | 470.0 | 30550 | 0.7132          | 0.7288    | 0.7681 | 0.7479 | 0.9324   |
| 0.0004        | 471.0 | 30615 | 0.7132          | 0.7278    | 0.7699 | 0.7482 | 0.9321   |
| 0.0004        | 472.0 | 30680 | 0.7200          | 0.7259    | 0.7630 | 0.7440 | 0.9313   |
| 0.0004        | 473.0 | 30745 | 0.7191          | 0.7233    | 0.7772 | 0.7493 | 0.9319   |
| 0.0004        | 474.0 | 30810 | 0.7178          | 0.7320    | 0.7679 | 0.7495 | 0.9327   |
| 0.0004        | 475.0 | 30875 | 0.7182          | 0.7331    | 0.7659 | 0.7492 | 0.9325   |
| 0.0004        | 476.0 | 30940 | 0.7216          | 0.7309    | 0.7654 | 0.7477 | 0.9322   |
| 0.0002        | 477.0 | 31005 | 0.7226          | 0.7309    | 0.7648 | 0.7474 | 0.9322   |
| 0.0002        | 478.0 | 31070 | 0.7241          | 0.7259    | 0.7697 | 0.7471 | 0.9319   |
| 0.0002        | 479.0 | 31135 | 0.7259          | 0.7280    | 0.7697 | 0.7482 | 0.9320   |
| 0.0002        | 480.0 | 31200 | 0.7258          | 0.7247    | 0.7738 | 0.7485 | 0.9319   |
| 0.0002        | 481.0 | 31265 | 0.7239          | 0.7274    | 0.7765 | 0.7512 | 0.9327   |
| 0.0002        | 482.0 | 31330 | 0.7243          | 0.7289    | 0.7763 | 0.7519 | 0.9327   |
| 0.0002        | 483.0 | 31395 | 0.7231          | 0.7267    | 0.7771 | 0.7510 | 0.9328   |
| 0.0002        | 484.0 | 31460 | 0.7221          | 0.7283    | 0.7744 | 0.7506 | 0.9328   |
| 0.0001        | 485.0 | 31525 | 0.7217          | 0.7309    | 0.7688 | 0.7493 | 0.9326   |
| 0.0001        | 486.0 | 31590 | 0.7211          | 0.7317    | 0.7616 | 0.7463 | 0.9323   |
| 0.0001        | 487.0 | 31655 | 0.7206          | 0.7330    | 0.7610 | 0.7468 | 0.9325   |
| 0.0001        | 488.0 | 31720 | 0.7198          | 0.7326    | 0.7580 | 0.7451 | 0.9323   |
| 0.0001        | 489.0 | 31785 | 0.7203          | 0.7311    | 0.7598 | 0.7451 | 0.9321   |
| 0.0001        | 490.0 | 31850 | 0.7205          | 0.7312    | 0.7614 | 0.7460 | 0.9323   |
| 0.0001        | 491.0 | 31915 | 0.7167          | 0.7294    | 0.7673 | 0.7479 | 0.9328   |
| 0.0001        | 492.0 | 31980 | 0.7164          | 0.7311    | 0.7646 | 0.7475 | 0.9328   |
| 0.0003        | 493.0 | 32045 | 0.7169          | 0.7312    | 0.7655 | 0.7480 | 0.9328   |
| 0.0003        | 494.0 | 32110 | 0.7184          | 0.7324    | 0.7675 | 0.7496 | 0.9330   |
| 0.0003        | 495.0 | 32175 | 0.7188          | 0.7320    | 0.7664 | 0.7488 | 0.9329   |
| 0.0003        | 496.0 | 32240 | 0.7187          | 0.7320    | 0.7655 | 0.7484 | 0.9328   |
| 0.0003        | 497.0 | 32305 | 0.7189          | 0.7321    | 0.7659 | 0.7486 | 0.9329   |
| 0.0003        | 498.0 | 32370 | 0.7192          | 0.7315    | 0.7659 | 0.7483 | 0.9328   |
| 0.0003        | 499.0 | 32435 | 0.7191          | 0.7313    | 0.7650 | 0.7478 | 0.9327   |
| 0.0001        | 500.0 | 32500 | 0.7191          | 0.7311    | 0.7648 | 0.7476 | 0.9327   |


### Framework versions

- Transformers 4.29.2
- Pytorch 2.0.1+cu117
- Datasets 2.12.0
- Tokenizers 0.13.3
