pytorch generated_from_trainer dataset:bionlp2004 license:apache-2.0 region:us
---
license: apache-2.0
tags:
- generated_from_trainer
datasets:
- bionlp2004
metrics:
- precision
- recall
- f1
- accuracy
model-index:
- name: bert-base-uncased_4_1039_token_headwise
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# bert-base-uncased_4_1039_token_headwise

This model is a fine-tuned version of [bert-base-uncased](https://huggingface.co/bert-base-uncased) on the bionlp2004 dataset.
It achieves the following results on the evaluation set:
- Loss: 0.7036
- Precision: 0.7424
- Recall: 0.7713
- F1: 0.7566
- Accuracy: 0.9330

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 0.001
- train_batch_size: 16
- eval_batch_size: 16
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 500

### Training results

| Training Loss | Epoch | Step  | Validation Loss | Precision | Recall | F1     | Accuracy |
|:-------------:|:-----:|:-----:|:---------------:|:---------:|:------:|:------:|:--------:|
| No log        | 1.0   | 65    | 0.3621          | 0.3676    | 0.4841 | 0.4178 | 0.8704   |
| No log        | 2.0   | 130   | 0.2679          | 0.5317    | 0.6341 | 0.5784 | 0.9048   |
| No log        | 3.0   | 195   | 0.2544          | 0.5950    | 0.6512 | 0.6218 | 0.9134   |
| No log        | 4.0   | 260   | 0.2279          | 0.6275    | 0.7048 | 0.6640 | 0.9256   |
| No log        | 5.0   | 325   | 0.2279          | 0.6544    | 0.7308 | 0.6905 | 0.9263   |
| No log        | 6.0   | 390   | 0.2459          | 0.6537    | 0.7497 | 0.6984 | 0.9253   |
| No log        | 7.0   | 455   | 0.2392          | 0.6777    | 0.7423 | 0.7086 | 0.9290   |
| 0.2297        | 8.0   | 520   | 0.2729          | 0.6762    | 0.6695 | 0.6729 | 0.9232   |
| 0.2297        | 9.0   | 585   | 0.2805          | 0.6490    | 0.7522 | 0.6968 | 0.9245   |
| 0.2297        | 10.0  | 650   | 0.3040          | 0.6514    | 0.7182 | 0.6832 | 0.9239   |
| 0.2297        | 11.0  | 715   | 0.2952          | 0.6745    | 0.7146 | 0.6939 | 0.9263   |
| 0.2297        | 12.0  | 780   | 0.2960          | 0.6708    | 0.7164 | 0.6929 | 0.9265   |
| 0.2297        | 13.0  | 845   | 0.3286          | 0.6830    | 0.7270 | 0.7043 | 0.9260   |
| 0.2297        | 14.0  | 910   | 0.3219          | 0.6595    | 0.7331 | 0.6944 | 0.9253   |
| 0.2297        | 15.0  | 975   | 0.3222          | 0.6858    | 0.7286 | 0.7065 | 0.9272   |
| 0.0631        | 16.0  | 1040  | 0.3338          | 0.6950    | 0.7500 | 0.7215 | 0.9295   |
| 0.0631        | 17.0  | 1105  | 0.3447          | 0.6643    | 0.7364 | 0.6985 | 0.9268   |
| 0.0631        | 18.0  | 1170  | 0.3583          | 0.6823    | 0.7279 | 0.7044 | 0.9264   |
| 0.0631        | 19.0  | 1235  | 0.3492          | 0.6939    | 0.7295 | 0.7113 | 0.9278   |
| 0.0631        | 20.0  | 1300  | 0.3729          | 0.6621    | 0.7684 | 0.7113 | 0.9259   |
| 0.0631        | 21.0  | 1365  | 0.3892          | 0.6548    | 0.6944 | 0.6740 | 0.9221   |
| 0.0631        | 22.0  | 1430  | 0.3885          | 0.6744    | 0.7086 | 0.6911 | 0.9241   |
| 0.0631        | 23.0  | 1495  | 0.3976          | 0.6511    | 0.7554 | 0.6994 | 0.9231   |
| 0.0367        | 24.0  | 1560  | 0.3550          | 0.6495    | 0.7491 | 0.6958 | 0.9262   |
| 0.0367        | 25.0  | 1625  | 0.3628          | 0.6689    | 0.7391 | 0.7023 | 0.9282   |
| 0.0367        | 26.0  | 1690  | 0.4010          | 0.6649    | 0.7526 | 0.7060 | 0.9260   |
| 0.0367        | 27.0  | 1755  | 0.4152          | 0.6683    | 0.7502 | 0.7069 | 0.9267   |
| 0.0367        | 28.0  | 1820  | 0.4081          | 0.6820    | 0.7322 | 0.7062 | 0.9267   |
| 0.0367        | 29.0  | 1885  | 0.4058          | 0.6834    | 0.7385 | 0.7099 | 0.9281   |
| 0.0367        | 30.0  | 1950  | 0.4027          | 0.6688    | 0.7194 | 0.6932 | 0.9253   |
| 0.0279        | 31.0  | 2015  | 0.3923          | 0.6847    | 0.7518 | 0.7167 | 0.9294   |
| 0.0279        | 32.0  | 2080  | 0.4188          | 0.6800    | 0.7542 | 0.7152 | 0.9285   |
| 0.0279        | 33.0  | 2145  | 0.4250          | 0.6815    | 0.7412 | 0.7101 | 0.9288   |
| 0.0279        | 34.0  | 2210  | 0.4161          | 0.6864    | 0.7628 | 0.7226 | 0.9299   |
| 0.0279        | 35.0  | 2275  | 0.4158          | 0.7025    | 0.7590 | 0.7297 | 0.9298   |
| 0.0279        | 36.0  | 2340  | 0.4208          | 0.6852    | 0.7648 | 0.7228 | 0.9285   |
| 0.0279        | 37.0  | 2405  | 0.4105          | 0.6930    | 0.7311 | 0.7115 | 0.9283   |
| 0.0279        | 38.0  | 2470  | 0.4363          | 0.6726    | 0.7794 | 0.7221 | 0.9287   |
| 0.019         | 39.0  | 2535  | 0.4223          | 0.6823    | 0.7482 | 0.7137 | 0.9269   |
| 0.019         | 40.0  | 2600  | 0.4363          | 0.6913    | 0.7227 | 0.7066 | 0.9267   |
| 0.019         | 41.0  | 2665  | 0.4231          | 0.6982    | 0.7610 | 0.7282 | 0.9302   |
| 0.019         | 42.0  | 2730  | 0.4709          | 0.6851    | 0.7193 | 0.7017 | 0.9250   |
| 0.019         | 43.0  | 2795  | 0.4535          | 0.7179    | 0.7272 | 0.7225 | 0.9293   |
| 0.019         | 44.0  | 2860  | 0.4276          | 0.6997    | 0.7601 | 0.7286 | 0.9299   |
| 0.019         | 45.0  | 2925  | 0.4856          | 0.6858    | 0.6840 | 0.6849 | 0.9242   |
| 0.019         | 46.0  | 2990  | 0.4392          | 0.6899    | 0.7319 | 0.7102 | 0.9256   |
| 0.0189        | 47.0  | 3055  | 0.4423          | 0.6921    | 0.7623 | 0.7255 | 0.9298   |
| 0.0189        | 48.0  | 3120  | 0.4592          | 0.6925    | 0.7560 | 0.7229 | 0.9292   |
| 0.0189        | 49.0  | 3185  | 0.4285          | 0.6818    | 0.7578 | 0.7178 | 0.9290   |
| 0.0189        | 50.0  | 3250  | 0.4413          | 0.6775    | 0.7407 | 0.7077 | 0.9264   |
| 0.0189        | 51.0  | 3315  | 0.4474          | 0.6901    | 0.7553 | 0.7212 | 0.9292   |
| 0.0189        | 52.0  | 3380  | 0.4558          | 0.6790    | 0.7608 | 0.7176 | 0.9278   |
| 0.0189        | 53.0  | 3445  | 0.4695          | 0.6894    | 0.7446 | 0.7160 | 0.9281   |
| 0.0157        | 54.0  | 3510  | 0.4737          | 0.6748    | 0.7333 | 0.7029 | 0.9266   |
| 0.0157        | 55.0  | 3575  | 0.5053          | 0.6838    | 0.7529 | 0.7167 | 0.9266   |
| 0.0157        | 56.0  | 3640  | 0.4746          | 0.6745    | 0.7315 | 0.7019 | 0.9254   |
| 0.0157        | 57.0  | 3705  | 0.4753          | 0.7202    | 0.7277 | 0.7239 | 0.9288   |
| 0.0157        | 58.0  | 3770  | 0.4465          | 0.6942    | 0.7558 | 0.7237 | 0.9296   |
| 0.0157        | 59.0  | 3835  | 0.4873          | 0.6992    | 0.7634 | 0.7299 | 0.9294   |
| 0.0157        | 60.0  | 3900  | 0.4738          | 0.6784    | 0.7457 | 0.7105 | 0.9267   |
| 0.0157        | 61.0  | 3965  | 0.5076          | 0.6827    | 0.7760 | 0.7263 | 0.9270   |
| 0.0153        | 62.0  | 4030  | 0.4785          | 0.6977    | 0.7524 | 0.7240 | 0.9302   |
| 0.0153        | 63.0  | 4095  | 0.5587          | 0.7030    | 0.6841 | 0.6934 | 0.9219   |
| 0.0153        | 64.0  | 4160  | 0.4740          | 0.6759    | 0.7392 | 0.7062 | 0.9266   |
| 0.0153        | 65.0  | 4225  | 0.4434          | 0.6807    | 0.7473 | 0.7124 | 0.9276   |
| 0.0153        | 66.0  | 4290  | 0.4587          | 0.6972    | 0.7455 | 0.7206 | 0.9291   |
| 0.0153        | 67.0  | 4355  | 0.4701          | 0.6967    | 0.7497 | 0.7222 | 0.9283   |
| 0.0153        | 68.0  | 4420  | 0.4957          | 0.6823    | 0.7414 | 0.7106 | 0.9267   |
| 0.0153        | 69.0  | 4485  | 0.4917          | 0.6851    | 0.7547 | 0.7183 | 0.9285   |
| 0.0147        | 70.0  | 4550  | 0.5401          | 0.6675    | 0.7430 | 0.7033 | 0.9249   |
| 0.0147        | 71.0  | 4615  | 0.4943          | 0.6700    | 0.7407 | 0.7036 | 0.9278   |
| 0.0147        | 72.0  | 4680  | 0.4488          | 0.6931    | 0.7457 | 0.7184 | 0.9284   |
| 0.0147        | 73.0  | 4745  | 0.4615          | 0.6986    | 0.7448 | 0.7210 | 0.9296   |
| 0.0147        | 74.0  | 4810  | 0.4820          | 0.7035    | 0.7416 | 0.7220 | 0.9294   |
| 0.0147        | 75.0  | 4875  | 0.5227          | 0.7040    | 0.7274 | 0.7155 | 0.9261   |
| 0.0147        | 76.0  | 4940  | 0.4992          | 0.6838    | 0.7288 | 0.7056 | 0.9261   |
| 0.0148        | 77.0  | 5005  | 0.5103          | 0.6476    | 0.7639 | 0.7010 | 0.9246   |
| 0.0148        | 78.0  | 5070  | 0.5046          | 0.6940    | 0.7266 | 0.7099 | 0.9258   |
| 0.0148        | 79.0  | 5135  | 0.4947          | 0.7072    | 0.7382 | 0.7224 | 0.9294   |
| 0.0148        | 80.0  | 5200  | 0.5373          | 0.7020    | 0.6881 | 0.6950 | 0.9211   |
| 0.0148        | 81.0  | 5265  | 0.5046          | 0.7016    | 0.7342 | 0.7175 | 0.9276   |
| 0.0148        | 82.0  | 5330  | 0.5293          | 0.6869    | 0.7679 | 0.7251 | 0.9285   |
| 0.0148        | 83.0  | 5395  | 0.4888          | 0.6945    | 0.7583 | 0.7250 | 0.9297   |
| 0.0148        | 84.0  | 5460  | 0.5260          | 0.7000    | 0.7590 | 0.7284 | 0.9289   |
| 0.0121        | 85.0  | 5525  | 0.4930          | 0.6701    | 0.7128 | 0.6908 | 0.9231   |
| 0.0121        | 86.0  | 5590  | 0.4973          | 0.7025    | 0.7137 | 0.7081 | 0.9268   |
| 0.0121        | 87.0  | 5655  | 0.4871          | 0.6855    | 0.7364 | 0.7100 | 0.9262   |
| 0.0121        | 88.0  | 5720  | 0.4794          | 0.7020    | 0.7468 | 0.7237 | 0.9296   |
| 0.0121        | 89.0  | 5785  | 0.5453          | 0.6603    | 0.7374 | 0.6967 | 0.9215   |
| 0.0121        | 90.0  | 5850  | 0.4842          | 0.6952    | 0.7641 | 0.7280 | 0.9300   |
| 0.0121        | 91.0  | 5915  | 0.4918          | 0.7056    | 0.7311 | 0.7181 | 0.9290   |
| 0.0121        | 92.0  | 5980  | 0.5144          | 0.6811    | 0.7405 | 0.7096 | 0.9258   |
| 0.0123        | 93.0  | 6045  | 0.5427          | 0.6905    | 0.7284 | 0.7090 | 0.9251   |
| 0.0123        | 94.0  | 6110  | 0.5272          | 0.7066    | 0.7529 | 0.7290 | 0.9287   |
| 0.0123        | 95.0  | 6175  | 0.5289          | 0.7087    | 0.7439 | 0.7259 | 0.9299   |
| 0.0123        | 96.0  | 6240  | 0.4713          | 0.7008    | 0.7454 | 0.7224 | 0.9288   |
| 0.0123        | 97.0  | 6305  | 0.4996          | 0.7040    | 0.7499 | 0.7262 | 0.9292   |
| 0.0123        | 98.0  | 6370  | 0.4996          | 0.7015    | 0.7428 | 0.7216 | 0.9298   |
| 0.0123        | 99.0  | 6435  | 0.5215          | 0.6938    | 0.7527 | 0.7221 | 0.9280   |
| 0.0091        | 100.0 | 6500  | 0.5168          | 0.7095    | 0.7392 | 0.7240 | 0.9299   |
| 0.0091        | 101.0 | 6565  | 0.4943          | 0.7013    | 0.7493 | 0.7245 | 0.9283   |
| 0.0091        | 102.0 | 6630  | 0.5093          | 0.7107    | 0.7459 | 0.7279 | 0.9290   |
| 0.0091        | 103.0 | 6695  | 0.5147          | 0.6897    | 0.7075 | 0.6985 | 0.9252   |
| 0.0091        | 104.0 | 6760  | 0.4826          | 0.7209    | 0.7025 | 0.7116 | 0.9273   |
| 0.0091        | 105.0 | 6825  | 0.5267          | 0.7136    | 0.7295 | 0.7215 | 0.9292   |
| 0.0091        | 106.0 | 6890  | 0.5081          | 0.6907    | 0.7547 | 0.7213 | 0.9284   |
| 0.0091        | 107.0 | 6955  | 0.4663          | 0.6927    | 0.7502 | 0.7203 | 0.9285   |
| 0.0112        | 108.0 | 7020  | 0.5241          | 0.7091    | 0.7198 | 0.7144 | 0.9272   |
| 0.0112        | 109.0 | 7085  | 0.4689          | 0.6904    | 0.7751 | 0.7303 | 0.9290   |
| 0.0112        | 110.0 | 7150  | 0.5325          | 0.7081    | 0.7670 | 0.7363 | 0.9291   |
| 0.0112        | 111.0 | 7215  | 0.5381          | 0.7037    | 0.7158 | 0.7097 | 0.9246   |
| 0.0112        | 112.0 | 7280  | 0.5423          | 0.7160    | 0.7184 | 0.7172 | 0.9280   |
| 0.0112        | 113.0 | 7345  | 0.5480          | 0.6945    | 0.7628 | 0.7271 | 0.9281   |
| 0.0112        | 114.0 | 7410  | 0.5324          | 0.7074    | 0.7340 | 0.7205 | 0.9270   |
| 0.0112        | 115.0 | 7475  | 0.5023          | 0.6825    | 0.7310 | 0.7059 | 0.9248   |
| 0.0105        | 116.0 | 7540  | 0.4980          | 0.7065    | 0.7681 | 0.7360 | 0.9311   |
| 0.0105        | 117.0 | 7605  | 0.5431          | 0.6901    | 0.7455 | 0.7168 | 0.9260   |
| 0.0105        | 118.0 | 7670  | 0.5262          | 0.6651    | 0.7630 | 0.7107 | 0.9233   |
| 0.0105        | 119.0 | 7735  | 0.4880          | 0.7021    | 0.7463 | 0.7235 | 0.9304   |
| 0.0105        | 120.0 | 7800  | 0.5234          | 0.7154    | 0.7108 | 0.7131 | 0.9259   |
| 0.0105        | 121.0 | 7865  | 0.5343          | 0.6967    | 0.7133 | 0.7049 | 0.9234   |
| 0.0105        | 122.0 | 7930  | 0.4882          | 0.6893    | 0.7560 | 0.7211 | 0.9275   |
| 0.0105        | 123.0 | 7995  | 0.5187          | 0.7107    | 0.7416 | 0.7258 | 0.9289   |
| 0.011         | 124.0 | 8060  | 0.5276          | 0.6932    | 0.7531 | 0.7219 | 0.9275   |
| 0.011         | 125.0 | 8125  | 0.5346          | 0.7019    | 0.7394 | 0.7202 | 0.9270   |
| 0.011         | 126.0 | 8190  | 0.5380          | 0.7099    | 0.7347 | 0.7221 | 0.9284   |
| 0.011         | 127.0 | 8255  | 0.4963          | 0.7102    | 0.7538 | 0.7314 | 0.9302   |
| 0.011         | 128.0 | 8320  | 0.5169          | 0.7036    | 0.7182 | 0.7108 | 0.9260   |
| 0.011         | 129.0 | 8385  | 0.5335          | 0.7208    | 0.7389 | 0.7297 | 0.9304   |
| 0.011         | 130.0 | 8450  | 0.5204          | 0.6989    | 0.7527 | 0.7248 | 0.9285   |
| 0.0088        | 131.0 | 8515  | 0.5203          | 0.6956    | 0.7385 | 0.7164 | 0.9268   |
| 0.0088        | 132.0 | 8580  | 0.5236          | 0.6822    | 0.7450 | 0.7122 | 0.9254   |
| 0.0088        | 133.0 | 8645  | 0.4771          | 0.6908    | 0.7738 | 0.7300 | 0.9304   |
| 0.0088        | 134.0 | 8710  | 0.5215          | 0.7137    | 0.7383 | 0.7258 | 0.9287   |
| 0.0088        | 135.0 | 8775  | 0.5171          | 0.7109    | 0.7441 | 0.7271 | 0.9298   |
| 0.0088        | 136.0 | 8840  | 0.5616          | 0.7222    | 0.7252 | 0.7237 | 0.9286   |
| 0.0088        | 137.0 | 8905  | 0.5248          | 0.7030    | 0.7601 | 0.7305 | 0.9283   |
| 0.0088        | 138.0 | 8970  | 0.5134          | 0.7080    | 0.7695 | 0.7375 | 0.9301   |
| 0.0083        | 139.0 | 9035  | 0.5323          | 0.7096    | 0.7346 | 0.7219 | 0.9280   |
| 0.0083        | 140.0 | 9100  | 0.5319          | 0.6881    | 0.7601 | 0.7223 | 0.9266   |
| 0.0083        | 141.0 | 9165  | 0.5579          | 0.7081    | 0.7434 | 0.7253 | 0.9273   |
| 0.0083        | 142.0 | 9230  | 0.5526          | 0.6931    | 0.7628 | 0.7263 | 0.9289   |
| 0.0083        | 143.0 | 9295  | 0.5019          | 0.7056    | 0.7650 | 0.7341 | 0.9302   |
| 0.0083        | 144.0 | 9360  | 0.5722          | 0.6983    | 0.7394 | 0.7183 | 0.9263   |
| 0.0083        | 145.0 | 9425  | 0.5329          | 0.6989    | 0.7625 | 0.7293 | 0.9285   |
| 0.0083        | 146.0 | 9490  | 0.5908          | 0.6953    | 0.7526 | 0.7228 | 0.9271   |
| 0.0072        | 147.0 | 9555  | 0.5361          | 0.7113    | 0.7488 | 0.7295 | 0.9269   |
| 0.0072        | 148.0 | 9620  | 0.5338          | 0.7161    | 0.7362 | 0.7260 | 0.9292   |
| 0.0072        | 149.0 | 9685  | 0.5415          | 0.6955    | 0.7380 | 0.7161 | 0.9278   |
| 0.0072        | 150.0 | 9750  | 0.6163          | 0.7042    | 0.6822 | 0.6930 | 0.9208   |
| 0.0072        | 151.0 | 9815  | 0.5642          | 0.7000    | 0.7560 | 0.7269 | 0.9285   |
| 0.0072        | 152.0 | 9880  | 0.5096          | 0.6997    | 0.7547 | 0.7262 | 0.9270   |
| 0.0072        | 153.0 | 9945  | 0.5272          | 0.7078    | 0.7504 | 0.7285 | 0.9287   |
| 0.0083        | 154.0 | 10010 | 0.5149          | 0.7013    | 0.7708 | 0.7344 | 0.9277   |
| 0.0083        | 155.0 | 10075 | 0.5412          | 0.7104    | 0.7661 | 0.7372 | 0.9286   |
| 0.0083        | 156.0 | 10140 | 0.5437          | 0.6905    | 0.7758 | 0.7307 | 0.9268   |
| 0.0083        | 157.0 | 10205 | 0.5201          | 0.7018    | 0.7785 | 0.7382 | 0.9293   |
| 0.0083        | 158.0 | 10270 | 0.5342          | 0.7146    | 0.7486 | 0.7312 | 0.9298   |
| 0.0083        | 159.0 | 10335 | 0.5250          | 0.6920    | 0.7059 | 0.6989 | 0.9230   |
| 0.0083        | 160.0 | 10400 | 0.5368          | 0.7079    | 0.7587 | 0.7324 | 0.9304   |
| 0.0083        | 161.0 | 10465 | 0.5146          | 0.6989    | 0.7567 | 0.7267 | 0.9294   |
| 0.008         | 162.0 | 10530 | 0.5450          | 0.7107    | 0.7486 | 0.7292 | 0.9294   |
| 0.008         | 163.0 | 10595 | 0.5746          | 0.6972    | 0.7306 | 0.7135 | 0.9238   |
| 0.008         | 164.0 | 10660 | 0.5169          | 0.7152    | 0.7349 | 0.7249 | 0.9283   |
| 0.008         | 165.0 | 10725 | 0.5512          | 0.7138    | 0.7299 | 0.7218 | 0.9266   |
| 0.008         | 166.0 | 10790 | 0.5472          | 0.7180    | 0.7029 | 0.7103 | 0.9244   |
| 0.008         | 167.0 | 10855 | 0.5727          | 0.6987    | 0.7567 | 0.7265 | 0.9266   |
| 0.008         | 168.0 | 10920 | 0.5660          | 0.6860    | 0.7610 | 0.7216 | 0.9256   |
| 0.008         | 169.0 | 10985 | 0.4885          | 0.7207    | 0.7587 | 0.7392 | 0.9304   |
| 0.0077        | 170.0 | 11050 | 0.5768          | 0.6752    | 0.7461 | 0.7089 | 0.9228   |
| 0.0077        | 171.0 | 11115 | 0.5170          | 0.7143    | 0.7313 | 0.7227 | 0.9279   |
| 0.0077        | 172.0 | 11180 | 0.5368          | 0.7016    | 0.7551 | 0.7274 | 0.9290   |
| 0.0077        | 173.0 | 11245 | 0.5343          | 0.7190    | 0.7652 | 0.7413 | 0.9317   |
| 0.0077        | 174.0 | 11310 | 0.5472          | 0.7231    | 0.7234 | 0.7233 | 0.9275   |
| 0.0077        | 175.0 | 11375 | 0.5275          | 0.7222    | 0.7601 | 0.7407 | 0.9307   |
| 0.0077        | 176.0 | 11440 | 0.5628          | 0.7044    | 0.7488 | 0.7259 | 0.9291   |
| 0.0064        | 177.0 | 11505 | 0.5391          | 0.7118    | 0.7122 | 0.7120 | 0.9256   |
| 0.0064        | 178.0 | 11570 | 0.5637          | 0.7121    | 0.7522 | 0.7316 | 0.9302   |
| 0.0064        | 179.0 | 11635 | 0.5401          | 0.7134    | 0.7513 | 0.7319 | 0.9280   |
| 0.0064        | 180.0 | 11700 | 0.6035          | 0.6963    | 0.7825 | 0.7369 | 0.9275   |
| 0.0064        | 181.0 | 11765 | 0.5969          | 0.6907    | 0.7592 | 0.7233 | 0.9276   |
| 0.0064        | 182.0 | 11830 | 0.5661          | 0.7196    | 0.7427 | 0.7309 | 0.9290   |
| 0.0064        | 183.0 | 11895 | 0.5654          | 0.7163    | 0.7401 | 0.7280 | 0.9291   |
| 0.0064        | 184.0 | 11960 | 0.5865          | 0.6989    | 0.7578 | 0.7271 | 0.9292   |
| 0.0047        | 185.0 | 12025 | 0.5389          | 0.6961    | 0.7473 | 0.7208 | 0.9271   |
| 0.0047        | 186.0 | 12090 | 0.5643          | 0.7093    | 0.7535 | 0.7307 | 0.9284   |
| 0.0047        | 187.0 | 12155 | 0.5704          | 0.7024    | 0.7531 | 0.7269 | 0.9282   |
| 0.0047        | 188.0 | 12220 | 0.5567          | 0.7035    | 0.7302 | 0.7166 | 0.9263   |
| 0.0047        | 189.0 | 12285 | 0.6077          | 0.7021    | 0.7311 | 0.7163 | 0.9241   |
| 0.0047        | 190.0 | 12350 | 0.5530          | 0.7082    | 0.7551 | 0.7309 | 0.9303   |
| 0.0047        | 191.0 | 12415 | 0.5351          | 0.7114    | 0.7630 | 0.7363 | 0.9296   |
| 0.0047        | 192.0 | 12480 | 0.5314          | 0.7247    | 0.7376 | 0.7311 | 0.9297   |
| 0.0065        | 193.0 | 12545 | 0.5895          | 0.7111    | 0.7409 | 0.7257 | 0.9263   |
| 0.0065        | 194.0 | 12610 | 0.5750          | 0.7112    | 0.7560 | 0.7329 | 0.9280   |
| 0.0065        | 195.0 | 12675 | 0.5497          | 0.7103    | 0.7569 | 0.7329 | 0.9295   |
| 0.0065        | 196.0 | 12740 | 0.5754          | 0.7124    | 0.7446 | 0.7282 | 0.9285   |
| 0.0065        | 197.0 | 12805 | 0.5606          | 0.7148    | 0.7634 | 0.7383 | 0.9302   |
| 0.0065        | 198.0 | 12870 | 0.5837          | 0.7187    | 0.7376 | 0.7280 | 0.9275   |
| 0.0065        | 199.0 | 12935 | 0.5944          | 0.7186    | 0.7371 | 0.7277 | 0.9277   |
| 0.0045        | 200.0 | 13000 | 0.5789          | 0.7166    | 0.7477 | 0.7318 | 0.9296   |
| 0.0045        | 201.0 | 13065 | 0.5776          | 0.6905    | 0.7373 | 0.7131 | 0.9240   |
| 0.0045        | 202.0 | 13130 | 0.6194          | 0.6920    | 0.7434 | 0.7168 | 0.9255   |
| 0.0045        | 203.0 | 13195 | 0.5758          | 0.7099    | 0.7365 | 0.7230 | 0.9280   |
| 0.0045        | 204.0 | 13260 | 0.5436          | 0.7151    | 0.7434 | 0.7289 | 0.9293   |
| 0.0045        | 205.0 | 13325 | 0.5624          | 0.7250    | 0.7481 | 0.7363 | 0.9300   |
| 0.0045        | 206.0 | 13390 | 0.5567          | 0.7097    | 0.7446 | 0.7268 | 0.9285   |
| 0.0045        | 207.0 | 13455 | 0.5513          | 0.7142    | 0.7138 | 0.7140 | 0.9249   |
| 0.0053        | 208.0 | 13520 | 0.5795          | 0.7057    | 0.7574 | 0.7307 | 0.9279   |
| 0.0053        | 209.0 | 13585 | 0.5445          | 0.7009    | 0.7526 | 0.7258 | 0.9275   |
| 0.0053        | 210.0 | 13650 | 0.5578          | 0.7246    | 0.7450 | 0.7347 | 0.9301   |
| 0.0053        | 211.0 | 13715 | 0.5437          | 0.7115    | 0.7688 | 0.7390 | 0.9312   |
| 0.0053        | 212.0 | 13780 | 0.4980          | 0.7292    | 0.7526 | 0.7407 | 0.9317   |
| 0.0053        | 213.0 | 13845 | 0.5782          | 0.7031    | 0.7594 | 0.7302 | 0.9292   |
| 0.0053        | 214.0 | 13910 | 0.5870          | 0.7130    | 0.7574 | 0.7345 | 0.9287   |
| 0.0053        | 215.0 | 13975 | 0.5367          | 0.7171    | 0.7490 | 0.7327 | 0.9283   |
| 0.006         | 216.0 | 14040 | 0.5845          | 0.7187    | 0.7583 | 0.7380 | 0.9278   |
| 0.006         | 217.0 | 14105 | 0.5766          | 0.7086    | 0.7646 | 0.7356 | 0.9272   |
| 0.006         | 218.0 | 14170 | 0.5593          | 0.7261    | 0.7614 | 0.7433 | 0.9306   |
| 0.006         | 219.0 | 14235 | 0.5373          | 0.7232    | 0.7598 | 0.7410 | 0.9313   |
| 0.006         | 220.0 | 14300 | 0.6219          | 0.7174    | 0.7450 | 0.7309 | 0.9275   |
| 0.006         | 221.0 | 14365 | 0.5916          | 0.7031    | 0.7634 | 0.7320 | 0.9286   |
| 0.006         | 222.0 | 14430 | 0.5404          | 0.7041    | 0.7756 | 0.7381 | 0.9290   |
| 0.006         | 223.0 | 14495 | 0.5963          | 0.7041    | 0.7490 | 0.7258 | 0.9267   |
| 0.0046        | 224.0 | 14560 | 0.5674          | 0.7109    | 0.7724 | 0.7404 | 0.9307   |
| 0.0046        | 225.0 | 14625 | 0.5854          | 0.7106    | 0.7769 | 0.7423 | 0.9288   |
| 0.0046        | 226.0 | 14690 | 0.5641          | 0.7053    | 0.7563 | 0.7299 | 0.9283   |
| 0.0046        | 227.0 | 14755 | 0.5753          | 0.7054    | 0.7616 | 0.7324 | 0.9285   |
| 0.0046        | 228.0 | 14820 | 0.5565          | 0.6980    | 0.7475 | 0.7219 | 0.9266   |
| 0.0046        | 229.0 | 14885 | 0.5419          | 0.6950    | 0.7816 | 0.7357 | 0.9286   |
| 0.0046        | 230.0 | 14950 | 0.5619          | 0.6926    | 0.7596 | 0.7246 | 0.9285   |
| 0.0053        | 231.0 | 15015 | 0.5680          | 0.7166    | 0.7400 | 0.7281 | 0.9280   |
| 0.0053        | 232.0 | 15080 | 0.5294          | 0.7106    | 0.7623 | 0.7355 | 0.9301   |
| 0.0053        | 233.0 | 15145 | 0.5938          | 0.7017    | 0.7493 | 0.7247 | 0.9259   |
| 0.0053        | 234.0 | 15210 | 0.5728          | 0.7157    | 0.7637 | 0.7389 | 0.9309   |
| 0.0053        | 235.0 | 15275 | 0.5562          | 0.7209    | 0.7526 | 0.7364 | 0.9298   |
| 0.0053        | 236.0 | 15340 | 0.5739          | 0.7295    | 0.7544 | 0.7417 | 0.9309   |
| 0.0053        | 237.0 | 15405 | 0.5848          | 0.7185    | 0.7760 | 0.7461 | 0.9320   |
| 0.0053        | 238.0 | 15470 | 0.5844          | 0.7015    | 0.7751 | 0.7365 | 0.9305   |
| 0.0037        | 239.0 | 15535 | 0.5699          | 0.7195    | 0.7499 | 0.7344 | 0.9307   |
| 0.0037        | 240.0 | 15600 | 0.5634          | 0.7266    | 0.7738 | 0.7495 | 0.9324   |
| 0.0037        | 241.0 | 15665 | 0.5915          | 0.7164    | 0.7655 | 0.7401 | 0.9291   |
| 0.0037        | 242.0 | 15730 | 0.5554          | 0.7061    | 0.7819 | 0.7421 | 0.9285   |
| 0.0037        | 243.0 | 15795 | 0.5476          | 0.7088    | 0.7677 | 0.7371 | 0.9299   |
| 0.0037        | 244.0 | 15860 | 0.6185          | 0.7380    | 0.7461 | 0.7420 | 0.9299   |
| 0.0037        | 245.0 | 15925 | 0.5879          | 0.7177    | 0.7645 | 0.7403 | 0.9313   |
| 0.0037        | 246.0 | 15990 | 0.6360          | 0.7104    | 0.7682 | 0.7382 | 0.9294   |
| 0.0033        | 247.0 | 16055 | 0.6197          | 0.7416    | 0.7380 | 0.7398 | 0.9291   |
| 0.0033        | 248.0 | 16120 | 0.5718          | 0.7145    | 0.7691 | 0.7408 | 0.9305   |
| 0.0033        | 249.0 | 16185 | 0.6096          | 0.7025    | 0.7398 | 0.7206 | 0.9266   |
| 0.0033        | 250.0 | 16250 | 0.5466          | 0.7110    | 0.7574 | 0.7335 | 0.9295   |
| 0.0033        | 251.0 | 16315 | 0.5995          | 0.7127    | 0.7670 | 0.7388 | 0.9293   |
| 0.0033        | 252.0 | 16380 | 0.5725          | 0.6981    | 0.7670 | 0.7309 | 0.9290   |
| 0.0033        | 253.0 | 16445 | 0.5625          | 0.7049    | 0.7668 | 0.7345 | 0.9297   |
| 0.0045        | 254.0 | 16510 | 0.5688          | 0.7178    | 0.7603 | 0.7384 | 0.9298   |
| 0.0045        | 255.0 | 16575 | 0.6108          | 0.7047    | 0.7333 | 0.7187 | 0.9256   |
| 0.0045        | 256.0 | 16640 | 0.5422          | 0.7093    | 0.7594 | 0.7335 | 0.9305   |
| 0.0045        | 257.0 | 16705 | 0.5737          | 0.7103    | 0.7439 | 0.7267 | 0.9289   |
| 0.0045        | 258.0 | 16770 | 0.5238          | 0.7058    | 0.7652 | 0.7343 | 0.9293   |
| 0.0045        | 259.0 | 16835 | 0.5794          | 0.7154    | 0.7677 | 0.7406 | 0.9302   |
| 0.0045        | 260.0 | 16900 | 0.6207          | 0.7135    | 0.7441 | 0.7285 | 0.9292   |
| 0.0045        | 261.0 | 16965 | 0.5672          | 0.7184    | 0.7490 | 0.7334 | 0.9287   |
| 0.0035        | 262.0 | 17030 | 0.5897          | 0.7187    | 0.7452 | 0.7317 | 0.9284   |
| 0.0035        | 263.0 | 17095 | 0.5981          | 0.7061    | 0.7744 | 0.7386 | 0.9299   |
| 0.0035        | 264.0 | 17160 | 0.6152          | 0.7214    | 0.7443 | 0.7327 | 0.9281   |
| 0.0035        | 265.0 | 17225 | 0.6185          | 0.7265    | 0.7527 | 0.7394 | 0.9305   |
| 0.0035        | 266.0 | 17290 | 0.6130          | 0.7165    | 0.7720 | 0.7432 | 0.9306   |
| 0.0035        | 267.0 | 17355 | 0.6058          | 0.7218    | 0.7751 | 0.7475 | 0.9305   |
| 0.0035        | 268.0 | 17420 | 0.6159          | 0.7136    | 0.7722 | 0.7417 | 0.9289   |
| 0.0035        | 269.0 | 17485 | 0.6156          | 0.7176    | 0.7738 | 0.7446 | 0.9301   |
| 0.0023        | 270.0 | 17550 | 0.5868          | 0.7090    | 0.7805 | 0.7430 | 0.9287   |
| 0.0023        | 271.0 | 17615 | 0.5651          | 0.7243    | 0.7713 | 0.7471 | 0.9319   |
| 0.0023        | 272.0 | 17680 | 0.5550          | 0.6917    | 0.7798 | 0.7331 | 0.9287   |
| 0.0023        | 273.0 | 17745 | 0.5620          | 0.7180    | 0.7468 | 0.7321 | 0.9293   |
| 0.0023        | 274.0 | 17810 | 0.5746          | 0.7198    | 0.7470 | 0.7331 | 0.9295   |
| 0.0023        | 275.0 | 17875 | 0.5724          | 0.7136    | 0.7414 | 0.7273 | 0.9265   |
| 0.0023        | 276.0 | 17940 | 0.5924          | 0.7097    | 0.7664 | 0.7370 | 0.9297   |
| 0.0032        | 277.0 | 18005 | 0.6020          | 0.6970    | 0.7607 | 0.7275 | 0.9279   |
| 0.0032        | 278.0 | 18070 | 0.6417          | 0.6984    | 0.7774 | 0.7358 | 0.9288   |
| 0.0032        | 279.0 | 18135 | 0.6101          | 0.7192    | 0.7641 | 0.7409 | 0.9300   |
| 0.0032        | 280.0 | 18200 | 0.6199          | 0.7134    | 0.7639 | 0.7378 | 0.9296   |
| 0.0032        | 281.0 | 18265 | 0.6048          | 0.7177    | 0.7567 | 0.7367 | 0.9300   |
| 0.0032        | 282.0 | 18330 | 0.6090          | 0.7221    | 0.7594 | 0.7403 | 0.9305   |
| 0.0032        | 283.0 | 18395 | 0.5958          | 0.7060    | 0.7830 | 0.7425 | 0.9300   |
| 0.0032        | 284.0 | 18460 | 0.5897          | 0.7127    | 0.7578 | 0.7346 | 0.9299   |
| 0.0022        | 285.0 | 18525 | 0.5743          | 0.7113    | 0.7664 | 0.7379 | 0.9307   |
| 0.0022        | 286.0 | 18590 | 0.5393          | 0.7063    | 0.7549 | 0.7298 | 0.9289   |
| 0.0022        | 287.0 | 18655 | 0.5873          | 0.6930    | 0.7690 | 0.7290 | 0.9280   |
| 0.0022        | 288.0 | 18720 | 0.5900          | 0.7151    | 0.7720 | 0.7425 | 0.9311   |
| 0.0022        | 289.0 | 18785 | 0.5481          | 0.7109    | 0.7780 | 0.7429 | 0.9306   |
| 0.0022        | 290.0 | 18850 | 0.6294          | 0.7236    | 0.7257 | 0.7247 | 0.9263   |
| 0.0022        | 291.0 | 18915 | 0.6257          | 0.7241    | 0.7358 | 0.7299 | 0.9265   |
| 0.0022        | 292.0 | 18980 | 0.5894          | 0.7289    | 0.7596 | 0.7439 | 0.9302   |
| 0.0032        | 293.0 | 19045 | 0.6101          | 0.6999    | 0.7805 | 0.7380 | 0.9290   |
| 0.0032        | 294.0 | 19110 | 0.6545          | 0.6996    | 0.7527 | 0.7252 | 0.9263   |
| 0.0032        | 295.0 | 19175 | 0.6525          | 0.7044    | 0.7636 | 0.7328 | 0.9296   |
| 0.0032        | 296.0 | 19240 | 0.6624          | 0.7158    | 0.7538 | 0.7343 | 0.9291   |
| 0.0032        | 297.0 | 19305 | 0.6560          | 0.7118    | 0.7744 | 0.7418 | 0.9299   |
| 0.0032        | 298.0 | 19370 | 0.6621          | 0.7071    | 0.7740 | 0.7391 | 0.9289   |
| 0.0032        | 299.0 | 19435 | 0.6707          | 0.7201    | 0.7578 | 0.7384 | 0.9286   |
| 0.0024        | 300.0 | 19500 | 0.6077          | 0.7131    | 0.7691 | 0.7401 | 0.9299   |
| 0.0024        | 301.0 | 19565 | 0.6373          | 0.7086    | 0.7554 | 0.7313 | 0.9270   |
| 0.0024        | 302.0 | 19630 | 0.6672          | 0.7077    | 0.7704 | 0.7377 | 0.9277   |
| 0.0024        | 303.0 | 19695 | 0.6336          | 0.7306    | 0.7614 | 0.7457 | 0.9315   |
| 0.0024        | 304.0 | 19760 | 0.6163          | 0.7316    | 0.7556 | 0.7434 | 0.9302   |
| 0.0024        | 305.0 | 19825 | 0.6155          | 0.7186    | 0.7648 | 0.7410 | 0.9294   |
| 0.0024        | 306.0 | 19890 | 0.6122          | 0.7176    | 0.7558 | 0.7362 | 0.9298   |
| 0.0024        | 307.0 | 19955 | 0.5746          | 0.7126    | 0.7781 | 0.7439 | 0.9312   |
| 0.0024        | 308.0 | 20020 | 0.5839          | 0.7239    | 0.7610 | 0.7420 | 0.9313   |
| 0.0024        | 309.0 | 20085 | 0.6299          | 0.7256    | 0.7490 | 0.7371 | 0.9291   |
| 0.0024        | 310.0 | 20150 | 0.6116          | 0.7097    | 0.7848 | 0.7453 | 0.9305   |
| 0.0024        | 311.0 | 20215 | 0.5846          | 0.7006    | 0.7785 | 0.7375 | 0.9275   |
| 0.0024        | 312.0 | 20280 | 0.5604          | 0.7086    | 0.7664 | 0.7364 | 0.9293   |
| 0.0024        | 313.0 | 20345 | 0.6063          | 0.7273    | 0.7717 | 0.7488 | 0.9308   |
| 0.0024        | 314.0 | 20410 | 0.6301          | 0.7303    | 0.7610 | 0.7453 | 0.9303   |
| 0.0024        | 315.0 | 20475 | 0.6441          | 0.7093    | 0.7675 | 0.7372 | 0.9274   |
| 0.0018        | 316.0 | 20540 | 0.6651          | 0.7270    | 0.7477 | 0.7372 | 0.9281   |
| 0.0018        | 317.0 | 20605 | 0.6420          | 0.7165    | 0.7684 | 0.7416 | 0.9293   |
| 0.0018        | 318.0 | 20670 | 0.6189          | 0.7231    | 0.7601 | 0.7412 | 0.9302   |
| 0.0018        | 319.0 | 20735 | 0.6246          | 0.7250    | 0.7596 | 0.7419 | 0.9298   |
| 0.0018        | 320.0 | 20800 | 0.6362          | 0.7130    | 0.7614 | 0.7364 | 0.9292   |
| 0.0018        | 321.0 | 20865 | 0.6363          | 0.7176    | 0.7569 | 0.7367 | 0.9291   |
| 0.0018        | 322.0 | 20930 | 0.6377          | 0.7166    | 0.7690 | 0.7418 | 0.9303   |
| 0.0018        | 323.0 | 20995 | 0.6287          | 0.7295    | 0.7762 | 0.7521 | 0.9319   |
| 0.0017        | 324.0 | 21060 | 0.6248          | 0.7242    | 0.7693 | 0.7461 | 0.9307   |
| 0.0017        | 325.0 | 21125 | 0.6228          | 0.7268    | 0.7738 | 0.7496 | 0.9314   |
| 0.0017        | 326.0 | 21190 | 0.6211          | 0.7249    | 0.7830 | 0.7528 | 0.9320   |
| 0.0017        | 327.0 | 21255 | 0.6104          | 0.7078    | 0.7708 | 0.7379 | 0.9293   |
| 0.0017        | 328.0 | 21320 | 0.6353          | 0.7255    | 0.7515 | 0.7383 | 0.9294   |
| 0.0017        | 329.0 | 21385 | 0.6598          | 0.7069    | 0.7623 | 0.7336 | 0.9277   |
| 0.0017        | 330.0 | 21450 | 0.6299          | 0.7171    | 0.7565 | 0.7363 | 0.9285   |
| 0.0018        | 331.0 | 21515 | 0.6222          | 0.7198    | 0.7754 | 0.7466 | 0.9307   |
| 0.0018        | 332.0 | 21580 | 0.6139          | 0.7176    | 0.7587 | 0.7376 | 0.9299   |
| 0.0018        | 333.0 | 21645 | 0.5928          | 0.7195    | 0.7663 | 0.7421 | 0.9310   |
| 0.0018        | 334.0 | 21710 | 0.5740          | 0.7251    | 0.7553 | 0.7399 | 0.9309   |
| 0.0018        | 335.0 | 21775 | 0.5864          | 0.7298    | 0.7677 | 0.7483 | 0.9324   |
| 0.0018        | 336.0 | 21840 | 0.6373          | 0.7301    | 0.7347 | 0.7324 | 0.9278   |
| 0.0018        | 337.0 | 21905 | 0.6215          | 0.7212    | 0.7760 | 0.7476 | 0.9314   |
| 0.0018        | 338.0 | 21970 | 0.6450          | 0.7131    | 0.7672 | 0.7391 | 0.9284   |
| 0.0026        | 339.0 | 22035 | 0.6126          | 0.7306    | 0.7517 | 0.7410 | 0.9295   |
| 0.0026        | 340.0 | 22100 | 0.6029          | 0.7169    | 0.7645 | 0.7399 | 0.9296   |
| 0.0026        | 341.0 | 22165 | 0.6201          | 0.7274    | 0.7681 | 0.7472 | 0.9313   |
| 0.0026        | 342.0 | 22230 | 0.6373          | 0.7316    | 0.7293 | 0.7305 | 0.9277   |
| 0.0026        | 343.0 | 22295 | 0.6083          | 0.7213    | 0.7443 | 0.7326 | 0.9286   |
| 0.0026        | 344.0 | 22360 | 0.6253          | 0.7275    | 0.7538 | 0.7404 | 0.9295   |
| 0.0026        | 345.0 | 22425 | 0.6554          | 0.7042    | 0.7808 | 0.7406 | 0.9277   |
| 0.0026        | 346.0 | 22490 | 0.6120          | 0.7288    | 0.7306 | 0.7297 | 0.9280   |
| 0.0015        | 347.0 | 22555 | 0.6236          | 0.7144    | 0.7576 | 0.7354 | 0.9296   |
| 0.0015        | 348.0 | 22620 | 0.6360          | 0.7166    | 0.7643 | 0.7397 | 0.9307   |
| 0.0015        | 349.0 | 22685 | 0.6313          | 0.7173    | 0.7616 | 0.7388 | 0.9302   |
| 0.0015        | 350.0 | 22750 | 0.6344          | 0.7301    | 0.7479 | 0.7389 | 0.9299   |
| 0.0015        | 351.0 | 22815 | 0.6111          | 0.7113    | 0.7870 | 0.7472 | 0.9300   |
| 0.0015        | 352.0 | 22880 | 0.6286          | 0.7349    | 0.7482 | 0.7415 | 0.9306   |
| 0.0015        | 353.0 | 22945 | 0.6342          | 0.7258    | 0.7727 | 0.7485 | 0.9313   |
| 0.0008        | 354.0 | 23010 | 0.6729          | 0.7148    | 0.7789 | 0.7454 | 0.9297   |
| 0.0008        | 355.0 | 23075 | 0.6213          | 0.7179    | 0.7639 | 0.7402 | 0.9296   |
| 0.0008        | 356.0 | 23140 | 0.6395          | 0.7273    | 0.7556 | 0.7412 | 0.9296   |
| 0.0008        | 357.0 | 23205 | 0.6439          | 0.7243    | 0.7560 | 0.7398 | 0.9299   |
| 0.0008        | 358.0 | 23270 | 0.7104          | 0.7329    | 0.7383 | 0.7356 | 0.9283   |
| 0.0008        | 359.0 | 23335 | 0.7150          | 0.7094    | 0.7558 | 0.7319 | 0.9279   |
| 0.0008        | 360.0 | 23400 | 0.6514          | 0.7302    | 0.7412 | 0.7357 | 0.9297   |
| 0.0008        | 361.0 | 23465 | 0.6533          | 0.7300    | 0.7574 | 0.7434 | 0.9308   |
| 0.0013        | 362.0 | 23530 | 0.6617          | 0.7399    | 0.7490 | 0.7444 | 0.9312   |
| 0.0013        | 363.0 | 23595 | 0.6771          | 0.7237    | 0.7722 | 0.7472 | 0.9312   |
| 0.0013        | 364.0 | 23660 | 0.6824          | 0.7228    | 0.7664 | 0.7440 | 0.9311   |
| 0.0013        | 365.0 | 23725 | 0.6868          | 0.7274    | 0.7580 | 0.7424 | 0.9307   |
| 0.0013        | 366.0 | 23790 | 0.6828          | 0.7336    | 0.7542 | 0.7437 | 0.9305   |
| 0.0013        | 367.0 | 23855 | 0.6669          | 0.7201    | 0.7655 | 0.7421 | 0.9307   |
| 0.0013        | 368.0 | 23920 | 0.6729          | 0.7293    | 0.7646 | 0.7465 | 0.9307   |
| 0.0013        | 369.0 | 23985 | 0.6766          | 0.7285    | 0.7553 | 0.7416 | 0.9300   |
| 0.0006        | 370.0 | 24050 | 0.6301          | 0.7180    | 0.7814 | 0.7484 | 0.9312   |
| 0.0006        | 371.0 | 24115 | 0.6610          | 0.7274    | 0.7688 | 0.7475 | 0.9311   |
| 0.0006        | 372.0 | 24180 | 0.6835          | 0.7226    | 0.7675 | 0.7444 | 0.9315   |
| 0.0006        | 373.0 | 24245 | 0.6778          | 0.7346    | 0.7491 | 0.7418 | 0.9303   |
| 0.0006        | 374.0 | 24310 | 0.6544          | 0.7406    | 0.7599 | 0.7502 | 0.9317   |
| 0.0006        | 375.0 | 24375 | 0.6549          | 0.7214    | 0.7756 | 0.7475 | 0.9314   |
| 0.0006        | 376.0 | 24440 | 0.6871          | 0.7214    | 0.7686 | 0.7443 | 0.9306   |
| 0.0009        | 377.0 | 24505 | 0.6714          | 0.7215    | 0.7744 | 0.7470 | 0.9316   |
| 0.0009        | 378.0 | 24570 | 0.6751          | 0.7340    | 0.7527 | 0.7432 | 0.9298   |
| 0.0009        | 379.0 | 24635 | 0.6599          | 0.7198    | 0.7722 | 0.7451 | 0.9315   |
| 0.0009        | 380.0 | 24700 | 0.6418          | 0.7363    | 0.7479 | 0.7421 | 0.9310   |
| 0.0009        | 381.0 | 24765 | 0.6480          | 0.7159    | 0.7765 | 0.7450 | 0.9324   |
| 0.0009        | 382.0 | 24830 | 0.6738          | 0.7266    | 0.7778 | 0.7513 | 0.9324   |
| 0.0009        | 383.0 | 24895 | 0.6758          | 0.7331    | 0.7655 | 0.7489 | 0.9325   |
| 0.0009        | 384.0 | 24960 | 0.7180          | 0.7092    | 0.7763 | 0.7412 | 0.9295   |
| 0.0009        | 385.0 | 25025 | 0.6652          | 0.7335    | 0.7553 | 0.7442 | 0.9315   |
| 0.0009        | 386.0 | 25090 | 0.6265          | 0.7314    | 0.7664 | 0.7485 | 0.9329   |
| 0.0009        | 387.0 | 25155 | 0.6247          | 0.7284    | 0.7715 | 0.7493 | 0.9314   |
| 0.0009        | 388.0 | 25220 | 0.6193          | 0.7275    | 0.7760 | 0.7510 | 0.9323   |
| 0.0009        | 389.0 | 25285 | 0.6515          | 0.7346    | 0.7556 | 0.7450 | 0.9305   |
| 0.0009        | 390.0 | 25350 | 0.6237          | 0.7179    | 0.7599 | 0.7383 | 0.9304   |
| 0.0009        | 391.0 | 25415 | 0.6286          | 0.7246    | 0.7731 | 0.7480 | 0.9314   |
| 0.0009        | 392.0 | 25480 | 0.6504          | 0.7295    | 0.7578 | 0.7434 | 0.9316   |
| 0.001         | 393.0 | 25545 | 0.6569          | 0.7342    | 0.7508 | 0.7424 | 0.9312   |
| 0.001         | 394.0 | 25610 | 0.6598          | 0.7361    | 0.7736 | 0.7544 | 0.9318   |
| 0.001         | 395.0 | 25675 | 0.6699          | 0.7317    | 0.7702 | 0.7505 | 0.9322   |
| 0.001         | 396.0 | 25740 | 0.6536          | 0.7315    | 0.7500 | 0.7406 | 0.9306   |
| 0.001         | 397.0 | 25805 | 0.6638          | 0.7293    | 0.7679 | 0.7481 | 0.9312   |
| 0.001         | 398.0 | 25870 | 0.6478          | 0.7264    | 0.7758 | 0.7503 | 0.9326   |
| 0.001         | 399.0 | 25935 | 0.6592          | 0.7234    | 0.7749 | 0.7483 | 0.9326   |
| 0.0005        | 400.0 | 26000 | 0.6534          | 0.7298    | 0.7610 | 0.7451 | 0.9317   |
| 0.0005        | 401.0 | 26065 | 0.6571          | 0.7356    | 0.7605 | 0.7478 | 0.9321   |
| 0.0005        | 402.0 | 26130 | 0.6599          | 0.7333    | 0.7803 | 0.7561 | 0.9328   |
| 0.0005        | 403.0 | 26195 | 0.6516          | 0.7210    | 0.7684 | 0.7440 | 0.9313   |
| 0.0005        | 404.0 | 26260 | 0.6303          | 0.7275    | 0.7538 | 0.7404 | 0.9307   |
| 0.0005        | 405.0 | 26325 | 0.6301          | 0.7407    | 0.7681 | 0.7541 | 0.9327   |
| 0.0005        | 406.0 | 26390 | 0.6513          | 0.7296    | 0.7713 | 0.7499 | 0.9325   |
| 0.0005        | 407.0 | 26455 | 0.6434          | 0.7428    | 0.7618 | 0.7521 | 0.9326   |
| 0.0006        | 408.0 | 26520 | 0.6576          | 0.7271    | 0.7812 | 0.7532 | 0.9329   |
| 0.0006        | 409.0 | 26585 | 0.6573          | 0.7356    | 0.7691 | 0.7520 | 0.9332   |
| 0.0006        | 410.0 | 26650 | 0.6646          | 0.7358    | 0.7718 | 0.7534 | 0.9319   |
| 0.0006        | 411.0 | 26715 | 0.6954          | 0.7327    | 0.7652 | 0.7486 | 0.9322   |
| 0.0006        | 412.0 | 26780 | 0.7009          | 0.7203    | 0.7742 | 0.7463 | 0.9313   |
| 0.0006        | 413.0 | 26845 | 0.6730          | 0.7385    | 0.7781 | 0.7578 | 0.9324   |
| 0.0006        | 414.0 | 26910 | 0.6644          | 0.7397    | 0.7733 | 0.7561 | 0.9330   |
| 0.0006        | 415.0 | 26975 | 0.6640          | 0.7343    | 0.7753 | 0.7542 | 0.9324   |
| 0.0005        | 416.0 | 27040 | 0.6604          | 0.7343    | 0.7731 | 0.7532 | 0.9328   |
| 0.0005        | 417.0 | 27105 | 0.6639          | 0.7406    | 0.7711 | 0.7555 | 0.9326   |
| 0.0005        | 418.0 | 27170 | 0.6614          | 0.7220    | 0.7848 | 0.7521 | 0.9319   |
| 0.0005        | 419.0 | 27235 | 0.6744          | 0.7340    | 0.7699 | 0.7515 | 0.9316   |
| 0.0005        | 420.0 | 27300 | 0.6854          | 0.7350    | 0.7648 | 0.7496 | 0.9316   |
| 0.0005        | 421.0 | 27365 | 0.6882          | 0.7395    | 0.7699 | 0.7544 | 0.9330   |
| 0.0005        | 422.0 | 27430 | 0.7170          | 0.7378    | 0.7567 | 0.7472 | 0.9312   |
| 0.0005        | 423.0 | 27495 | 0.7041          | 0.7355    | 0.7511 | 0.7432 | 0.9313   |
| 0.0003        | 424.0 | 27560 | 0.7173          | 0.7295    | 0.7562 | 0.7426 | 0.9300   |
| 0.0003        | 425.0 | 27625 | 0.7055          | 0.7289    | 0.7659 | 0.7469 | 0.9311   |
| 0.0003        | 426.0 | 27690 | 0.7082          | 0.7272    | 0.7670 | 0.7465 | 0.9310   |
| 0.0003        | 427.0 | 27755 | 0.7026          | 0.7323    | 0.7718 | 0.7515 | 0.9321   |
| 0.0003        | 428.0 | 27820 | 0.7085          | 0.7454    | 0.7517 | 0.7485 | 0.9314   |
| 0.0003        | 429.0 | 27885 | 0.7117          | 0.7335    | 0.7563 | 0.7447 | 0.9321   |
| 0.0003        | 430.0 | 27950 | 0.7928          | 0.7089    | 0.7661 | 0.7364 | 0.9268   |
| 0.0003        | 431.0 | 28015 | 0.6940          | 0.7363    | 0.7583 | 0.7472 | 0.9314   |
| 0.0003        | 432.0 | 28080 | 0.7003          | 0.7332    | 0.7729 | 0.7525 | 0.9324   |
| 0.0003        | 433.0 | 28145 | 0.6943          | 0.7286    | 0.7677 | 0.7476 | 0.9317   |
| 0.0003        | 434.0 | 28210 | 0.7012          | 0.7317    | 0.7587 | 0.7449 | 0.9312   |
| 0.0003        | 435.0 | 28275 | 0.7172          | 0.7241    | 0.7578 | 0.7406 | 0.9302   |
| 0.0003        | 436.0 | 28340 | 0.7066          | 0.7357    | 0.7594 | 0.7474 | 0.9314   |
| 0.0003        | 437.0 | 28405 | 0.7081          | 0.7315    | 0.7745 | 0.7524 | 0.9325   |
| 0.0003        | 438.0 | 28470 | 0.7408          | 0.7442    | 0.7418 | 0.7430 | 0.9306   |
| 0.0002        | 439.0 | 28535 | 0.7146          | 0.7412    | 0.7727 | 0.7567 | 0.9322   |
| 0.0002        | 440.0 | 28600 | 0.7072          | 0.7383    | 0.7641 | 0.7510 | 0.9325   |
| 0.0002        | 441.0 | 28665 | 0.7075          | 0.7384    | 0.7621 | 0.7501 | 0.9319   |
| 0.0002        | 442.0 | 28730 | 0.7106          | 0.7382    | 0.7632 | 0.7505 | 0.9319   |
| 0.0002        | 443.0 | 28795 | 0.7048          | 0.7427    | 0.7556 | 0.7491 | 0.9317   |
| 0.0002        | 444.0 | 28860 | 0.7119          | 0.7463    | 0.7536 | 0.7499 | 0.9315   |
| 0.0002        | 445.0 | 28925 | 0.7219          | 0.7422    | 0.7563 | 0.7492 | 0.9313   |
| 0.0002        | 446.0 | 28990 | 0.7071          | 0.7283    | 0.7756 | 0.7512 | 0.9320   |
| 0.0003        | 447.0 | 29055 | 0.7017          | 0.7378    | 0.7704 | 0.7538 | 0.9322   |
| 0.0003        | 448.0 | 29120 | 0.7036          | 0.7414    | 0.7713 | 0.7560 | 0.9322   |
| 0.0003        | 449.0 | 29185 | 0.7080          | 0.7408    | 0.7618 | 0.7511 | 0.9321   |
| 0.0003        | 450.0 | 29250 | 0.7037          | 0.7303    | 0.7679 | 0.7486 | 0.9318   |
| 0.0003        | 451.0 | 29315 | 0.7024          | 0.7412    | 0.7590 | 0.7500 | 0.9317   |
| 0.0003        | 452.0 | 29380 | 0.7050          | 0.7407    | 0.7641 | 0.7522 | 0.9320   |
| 0.0003        | 453.0 | 29445 | 0.7087          | 0.7396    | 0.7677 | 0.7534 | 0.9321   |
| 0.0002        | 454.0 | 29510 | 0.7013          | 0.7423    | 0.7738 | 0.7577 | 0.9326   |
| 0.0002        | 455.0 | 29575 | 0.7111          | 0.7375    | 0.7762 | 0.7563 | 0.9325   |
| 0.0002        | 456.0 | 29640 | 0.7102          | 0.7428    | 0.7661 | 0.7543 | 0.9320   |
| 0.0002        | 457.0 | 29705 | 0.6937          | 0.7400    | 0.7554 | 0.7476 | 0.9320   |
| 0.0002        | 458.0 | 29770 | 0.7076          | 0.7287    | 0.7526 | 0.7404 | 0.9313   |
| 0.0002        | 459.0 | 29835 | 0.6911          | 0.7433    | 0.7727 | 0.7577 | 0.9333   |
| 0.0002        | 460.0 | 29900 | 0.6945          | 0.7443    | 0.7769 | 0.7602 | 0.9331   |
| 0.0002        | 461.0 | 29965 | 0.7062          | 0.7398    | 0.7733 | 0.7562 | 0.9326   |
| 0.0003        | 462.0 | 30030 | 0.7095          | 0.7351    | 0.7727 | 0.7535 | 0.9317   |
| 0.0003        | 463.0 | 30095 | 0.7056          | 0.7340    | 0.7805 | 0.7565 | 0.9328   |
| 0.0003        | 464.0 | 30160 | 0.7244          | 0.7289    | 0.7718 | 0.7498 | 0.9321   |
| 0.0003        | 465.0 | 30225 | 0.7179          | 0.7260    | 0.7706 | 0.7476 | 0.9317   |
| 0.0003        | 466.0 | 30290 | 0.7046          | 0.7253    | 0.7771 | 0.7503 | 0.9319   |
| 0.0003        | 467.0 | 30355 | 0.6995          | 0.7333    | 0.7713 | 0.7518 | 0.9321   |
| 0.0003        | 468.0 | 30420 | 0.7040          | 0.7394    | 0.7681 | 0.7535 | 0.9322   |
| 0.0003        | 469.0 | 30485 | 0.7173          | 0.7322    | 0.7700 | 0.7506 | 0.9323   |
| 0.0003        | 470.0 | 30550 | 0.7105          | 0.7360    | 0.7726 | 0.7538 | 0.9328   |
| 0.0003        | 471.0 | 30615 | 0.7117          | 0.7377    | 0.7718 | 0.7544 | 0.9328   |
| 0.0003        | 472.0 | 30680 | 0.7099          | 0.7395    | 0.7726 | 0.7557 | 0.9328   |
| 0.0003        | 473.0 | 30745 | 0.7089          | 0.7383    | 0.7717 | 0.7546 | 0.9328   |
| 0.0003        | 474.0 | 30810 | 0.7080          | 0.7427    | 0.7729 | 0.7575 | 0.9328   |
| 0.0003        | 475.0 | 30875 | 0.7092          | 0.7473    | 0.7646 | 0.7559 | 0.9329   |
| 0.0003        | 476.0 | 30940 | 0.7094          | 0.7398    | 0.7574 | 0.7485 | 0.9317   |
| 0.0002        | 477.0 | 31005 | 0.7067          | 0.7396    | 0.7648 | 0.7520 | 0.9323   |
| 0.0002        | 478.0 | 31070 | 0.7070          | 0.7405    | 0.7699 | 0.7549 | 0.9324   |
| 0.0002        | 479.0 | 31135 | 0.7070          | 0.7403    | 0.7715 | 0.7556 | 0.9325   |
| 0.0002        | 480.0 | 31200 | 0.7010          | 0.7356    | 0.7776 | 0.7560 | 0.9326   |
| 0.0002        | 481.0 | 31265 | 0.6975          | 0.7375    | 0.7810 | 0.7586 | 0.9327   |
| 0.0002        | 482.0 | 31330 | 0.7017          | 0.7412    | 0.7763 | 0.7584 | 0.9331   |
| 0.0002        | 483.0 | 31395 | 0.6996          | 0.7412    | 0.7740 | 0.7572 | 0.9330   |
| 0.0002        | 484.0 | 31460 | 0.7002          | 0.7405    | 0.7733 | 0.7565 | 0.9329   |
| 0.0001        | 485.0 | 31525 | 0.7009          | 0.7406    | 0.7736 | 0.7567 | 0.9329   |
| 0.0001        | 486.0 | 31590 | 0.7004          | 0.7404    | 0.7751 | 0.7573 | 0.9328   |
| 0.0001        | 487.0 | 31655 | 0.6998          | 0.7422    | 0.7747 | 0.7581 | 0.9328   |
| 0.0001        | 488.0 | 31720 | 0.7025          | 0.7416    | 0.7727 | 0.7569 | 0.9328   |
| 0.0001        | 489.0 | 31785 | 0.7040          | 0.7425    | 0.7720 | 0.7570 | 0.9328   |
| 0.0001        | 490.0 | 31850 | 0.7047          | 0.7415    | 0.7718 | 0.7564 | 0.9329   |
| 0.0001        | 491.0 | 31915 | 0.7044          | 0.7436    | 0.7690 | 0.7561 | 0.9330   |
| 0.0001        | 492.0 | 31980 | 0.7060          | 0.7412    | 0.7673 | 0.7540 | 0.9326   |
| 0.0001        | 493.0 | 32045 | 0.7053          | 0.7403    | 0.7681 | 0.7539 | 0.9325   |
| 0.0001        | 494.0 | 32110 | 0.7039          | 0.7419    | 0.7717 | 0.7565 | 0.9328   |
| 0.0001        | 495.0 | 32175 | 0.7031          | 0.7414    | 0.7727 | 0.7567 | 0.9329   |
| 0.0001        | 496.0 | 32240 | 0.7029          | 0.7408    | 0.7724 | 0.7562 | 0.9330   |
| 0.0001        | 497.0 | 32305 | 0.7032          | 0.7406    | 0.7722 | 0.7561 | 0.9330   |
| 0.0001        | 498.0 | 32370 | 0.7033          | 0.7422    | 0.7713 | 0.7564 | 0.9330   |
| 0.0001        | 499.0 | 32435 | 0.7034          | 0.7418    | 0.7708 | 0.7560 | 0.9329   |
| 0.0001        | 500.0 | 32500 | 0.7036          | 0.7424    | 0.7713 | 0.7566 | 0.9330   |


### Framework versions

- Transformers 4.29.2
- Pytorch 2.0.1+cu117
- Datasets 2.12.0
- Tokenizers 0.13.3
