bert-base-multilingual-cased-iob2-20241224175951

This model is a fine-tuned version of bert-base-multilingual-cased on an unknown dataset. It achieves the following results on the evaluation set:

• Loss: 0.3526
• Overall Strict Precision: 0.6310
• Overall Strict Recall: 0.5456
• Overall Strict F1: 0.5852
• Overall Ent Type Precision: 0.7567
• Overall Ent Type Recall: 0.6543
• Overall Ent Type F1: 0.7018
• Overall Partial Precision: 0.7304
• Overall Partial Recall: 0.6316
• Overall Partial F1: 0.6774
• Overall Exact Precision: 0.6551
• Overall Exact Recall: 0.5664
• Overall Exact F1: 0.6075
• Companycountry Strict Precision: 0.0559
• Companycountry Strict Recall: 0.7698
• Companycountry Strict F1: 0.1042
• Companycountry Ent Type Precision: 0.0571
• Companycountry Ent Type Recall: 0.7866
• Companycountry Ent Type F1: 0.1065
• Companycountry Partial Precision: 0.0605
• Companycountry Partial Recall: 0.8339
• Companycountry Partial F1: 0.1129
• Companycountry Exact Precision: 0.0597
• Companycountry Exact Recall: 0.8226
• Companycountry Exact F1: 0.1114
• Documenttype Strict Precision: 0.0950
• Documenttype Strict Recall: 0.6164
• Documenttype Strict F1: 0.1646
• Documenttype Ent Type Precision: 0.1149
• Documenttype Ent Type Recall: 0.7454
• Documenttype Ent Type F1: 0.1990
• Documenttype Partial Precision: 0.1055
• Documenttype Partial Recall: 0.6844
• Documenttype Partial F1: 0.1827
• Documenttype Exact Precision: 0.0951
• Documenttype Exact Recall: 0.6172
• Documenttype Exact F1: 0.1648
• Hotelvatnumber Strict Precision: 0.0612
• Hotelvatnumber Strict Recall: 0.3947
• Hotelvatnumber Strict F1: 0.1060
• Hotelvatnumber Ent Type Precision: 0.0810
• Hotelvatnumber Ent Type Recall: 0.5219
• Hotelvatnumber Ent Type F1: 0.1402
• Hotelvatnumber Partial Precision: 0.0812
• Hotelvatnumber Partial Recall: 0.5231
• Hotelvatnumber Partial F1: 0.1406
• Hotelvatnumber Exact Precision: 0.0682
• Hotelvatnumber Exact Recall: 0.4394
• Hotelvatnumber Exact F1: 0.1181
• Companyzipcode Strict Precision: 0.1424
• Companyzipcode Strict Recall: 0.7826
• Companyzipcode Strict F1: 0.2409
• Companyzipcode Ent Type Precision: 0.1510
• Companyzipcode Ent Type Recall: 0.8298
• Companyzipcode Ent Type F1: 0.2555
• Companyzipcode Partial Precision: 0.1543
• Companyzipcode Partial Recall: 0.8483
• Companyzipcode Partial F1: 0.2611
• Companyzipcode Exact Precision: 0.1488
• Companyzipcode Exact Recall: 0.8180
• Companyzipcode Exact F1: 0.2518
• Companyvatnumber Strict Precision: 0.0013
• Companyvatnumber Strict Recall: 0.0296
• Companyvatnumber Strict F1: 0.0026
• Companyvatnumber Ent Type Precision: 0.0269
• Companyvatnumber Ent Type Recall: 0.5979
• Companyvatnumber Ent Type F1: 0.0515
• Companyvatnumber Partial Precision: 0.0172
• Companyvatnumber Partial Recall: 0.3813
• Companyvatnumber Partial F1: 0.0329
• Companyvatnumber Exact Precision: 0.0015
• Companyvatnumber Exact Recall: 0.0335
• Companyvatnumber Exact F1: 0.0029
• Travellername Strict Precision: 0.0864
• Travellername Strict Recall: 0.3905
• Travellername Strict F1: 0.1415
• Travellername Ent Type Precision: 0.1406
• Travellername Ent Type Recall: 0.6355
• Travellername Ent Type F1: 0.2303
• Travellername Partial Precision: 0.1165
• Travellername Partial Recall: 0.5267
• Travellername Partial F1: 0.1908
• Travellername Exact Precision: 0.0876
• Travellername Exact Recall: 0.3960
• Travellername Exact F1: 0.1435
• Hotelemail Strict Precision: 0.1069
• Hotelemail Strict Recall: 0.7826
• Hotelemail Strict F1: 0.1881
• Hotelemail Ent Type Precision: 0.1164
• Hotelemail Ent Type Recall: 0.8521
• Hotelemail Ent Type F1: 0.2048
• Hotelemail Partial Precision: 0.1117
• Hotelemail Partial Recall: 0.8180
• Hotelemail Partial F1: 0.1966
• Hotelemail Exact Precision: 0.1070
• Hotelemail Exact Recall: 0.7832
• Hotelemail Exact F1: 0.1882
• Cardnumber Strict Precision: 0.0018
• Cardnumber Strict Recall: 0.1731
• Cardnumber Strict F1: 0.0035
• Cardnumber Ent Type Precision: 0.0056
• Cardnumber Ent Type Recall: 0.5445
• Cardnumber Ent Type F1: 0.0110
• Cardnumber Partial Precision: 0.0037
• Cardnumber Partial Recall: 0.3645
• Cardnumber Partial F1: 0.0074
• Cardnumber Exact Precision: 0.0018
• Cardnumber Exact Recall: 0.1744
• Cardnumber Exact F1: 0.0035
• Checkin Strict Precision: 0.1615
• Checkin Strict Recall: 0.7891
• Checkin Strict F1: 0.2681
• Checkin Ent Type Precision: 0.1719
• Checkin Ent Type Recall: 0.8399
• Checkin Ent Type F1: 0.2854
• Checkin Partial Precision: 0.1710
• Checkin Partial Recall: 0.8354
• Checkin Partial F1: 0.2838
• Checkin Exact Precision: 0.1645
• Checkin Exact Recall: 0.8037
• Checkin Exact F1: 0.2731
• Externalreservationnumber Strict Precision: 0.0
• Externalreservationnumber Strict Recall: 0
• Externalreservationnumber Strict F1: 0
• Externalreservationnumber Ent Type Precision: 0.0
• Externalreservationnumber Ent Type Recall: 0
• Externalreservationnumber Ent Type F1: 0
• Externalreservationnumber Partial Precision: 0.0
• Externalreservationnumber Partial Recall: 0
• Externalreservationnumber Partial F1: 0
• Externalreservationnumber Exact Precision: 0.0
• Externalreservationnumber Exact Recall: 0
• Externalreservationnumber Exact F1: 0
• Pagenumber Strict Precision: 0.0683
• Pagenumber Strict Recall: 0.7712
• Pagenumber Strict F1: 0.1256
• Pagenumber Ent Type Precision: 0.0709
• Pagenumber Ent Type Recall: 0.7999
• Pagenumber Ent Type F1: 0.1303
• Pagenumber Partial Precision: 0.0697
• Pagenumber Partial Recall: 0.7866
• Pagenumber Partial F1: 0.1281
• Pagenumber Exact Precision: 0.0684
• Pagenumber Exact Recall: 0.7717
• Pagenumber Exact F1: 0.1257
• Netamount Strict Precision: 0.0
• Netamount Strict Recall: 0.0
• Netamount Strict F1: 0
• Netamount Ent Type Precision: 0.0162
• Netamount Ent Type Recall: 0.2042
• Netamount Ent Type F1: 0.0300
• Netamount Partial Precision: 0.0177
• Netamount Partial Recall: 0.2227
• Netamount Partial F1: 0.0328
• Netamount Exact Precision: 0.0000
• Netamount Exact Recall: 0.0006
• Netamount Exact F1: 0.0001
• Hotelcountry Strict Precision: 0.0
• Hotelcountry Strict Recall: 0
• Hotelcountry Strict F1: 0
• Hotelcountry Ent Type Precision: 0.0
• Hotelcountry Ent Type Recall: 0
• Hotelcountry Ent Type F1: 0
• Hotelcountry Partial Precision: 0.0
• Hotelcountry Partial Recall: 0
• Hotelcountry Partial F1: 0
• Hotelcountry Exact Precision: 0.0
• Hotelcountry Exact Recall: 0
• Hotelcountry Exact F1: 0
• Roomno Strict Precision: 0.1159
• Roomno Strict Recall: 0.7254
• Roomno Strict F1: 0.1999
• Roomno Ent Type Precision: 0.1159
• Roomno Ent Type Recall: 0.7254
• Roomno Ent Type F1: 0.1999
• Roomno Partial Precision: 0.1201
• Roomno Partial Recall: 0.7518
• Roomno Partial F1: 0.2072
• Roomno Exact Precision: 0.1201
• Roomno Exact Recall: 0.7518
• Roomno Exact F1: 0.2072
• Invoicedate Strict Precision: 0.1415
• Invoicedate Strict Recall: 0.7966
• Invoicedate Strict F1: 0.2404
• Invoicedate Ent Type Precision: 0.1488
• Invoicedate Ent Type Recall: 0.8372
• Invoicedate Ent Type F1: 0.2526
• Invoicedate Partial Precision: 0.1487
• Invoicedate Partial Recall: 0.8367
• Invoicedate Partial F1: 0.2525
• Invoicedate Exact Precision: 0.1442
• Invoicedate Exact Recall: 0.8116
• Invoicedate Exact F1: 0.2449
• Bookingnumber Strict Precision: 0.0
• Bookingnumber Strict Recall: 0.0
• Bookingnumber Strict F1: 0
• Bookingnumber Ent Type Precision: 0.0
• Bookingnumber Ent Type Recall: 0.0
• Bookingnumber Ent Type F1: 0
• Bookingnumber Partial Precision: 0.0
• Bookingnumber Partial Recall: 0.0
• Bookingnumber Partial F1: 0
• Bookingnumber Exact Precision: 0.0
• Bookingnumber Exact Recall: 0.0
• Bookingnumber Exact F1: 0
• Reservationnumber Strict Precision: 0.0
• Reservationnumber Strict Recall: 0.0
• Reservationnumber Strict F1: 0
• Reservationnumber Ent Type Precision: 0.0012
• Reservationnumber Ent Type Recall: 0.5054
• Reservationnumber Ent Type F1: 0.0024
• Reservationnumber Partial Precision: 0.0006
• Reservationnumber Partial Recall: 0.2554
• Reservationnumber Partial F1: 0.0012
• Reservationnumber Exact Precision: 0.0
• Reservationnumber Exact Recall: 0.0
• Reservationnumber Exact F1: 0
• Hotelname Strict Precision: 0.0178
• Hotelname Strict Recall: 0.1005
• Hotelname Strict F1: 0.0303
• Hotelname Ent Type Precision: 0.0727
• Hotelname Ent Type Recall: 0.4100
• Hotelname Ent Type F1: 0.1235
• Hotelname Partial Precision: 0.0469
• Hotelname Partial Recall: 0.2646
• Hotelname Partial F1: 0.0797
• Hotelname Exact Precision: 0.0180
• Hotelname Exact Recall: 0.1016
• Hotelname Exact F1: 0.0306
• Hotelbankaccount Strict Precision: 0.0
• Hotelbankaccount Strict Recall: 0
• Hotelbankaccount Strict F1: 0
• Hotelbankaccount Ent Type Precision: 0.0
• Hotelbankaccount Ent Type Recall: 0
• Hotelbankaccount Ent Type F1: 0
• Hotelbankaccount Partial Precision: 0.0
• Hotelbankaccount Partial Recall: 0
• Hotelbankaccount Partial F1: 0
• Hotelbankaccount Exact Precision: 0.0
• Hotelbankaccount Exact Recall: 0
• Hotelbankaccount Exact F1: 0
• Hotelzipcode Strict Precision: 0.0844
• Hotelzipcode Strict Recall: 0.4903
• Hotelzipcode Strict F1: 0.1439
• Hotelzipcode Ent Type Precision: 0.1023
• Hotelzipcode Ent Type Recall: 0.5946
• Hotelzipcode Ent Type F1: 0.1746
• Hotelzipcode Partial Precision: 0.0951
• Hotelzipcode Partial Recall: 0.5530
• Hotelzipcode Partial F1: 0.1624
• Hotelzipcode Exact Precision: 0.0856
• Hotelzipcode Exact Recall: 0.4975
• Hotelzipcode Exact F1: 0.1461
• Companycity Strict Precision: 0.1155
• Companycity Strict Recall: 0.5781
• Companycity Strict F1: 0.1926
• Companycity Ent Type Precision: 0.1407
• Companycity Ent Type Recall: 0.7038
• Companycity Ent Type F1: 0.2345
• Companycity Partial Precision: 0.1514
• Companycity Partial Recall: 0.7576
• Companycity Partial F1: 0.2524
• Companycity Exact Precision: 0.1333
• Companycity Exact Recall: 0.6670
• Companycity Exact F1: 0.2222
• Hoteladdress Strict Precision: 0.0478
• Hoteladdress Strict Recall: 0.2300
• Hoteladdress Strict F1: 0.0792
• Hoteladdress Ent Type Precision: 0.1153
• Hoteladdress Ent Type Recall: 0.5544
• Hoteladdress Ent Type F1: 0.1909
• Hoteladdress Partial Precision: 0.0853
• Hoteladdress Partial Recall: 0.4103
• Hoteladdress Partial F1: 0.1413
• Hoteladdress Exact Precision: 0.0488
• Hoteladdress Exact Recall: 0.2349
• Hoteladdress Exact F1: 0.0809
• Invoicenumber Strict Precision: 0.1187
• Invoicenumber Strict Recall: 0.5159
• Invoicenumber Strict F1: 0.1930
• Invoicenumber Ent Type Precision: 0.1403
• Invoicenumber Ent Type Recall: 0.6099
• Invoicenumber Ent Type F1: 0.2282
• Invoicenumber Partial Precision: 0.1474
• Invoicenumber Partial Recall: 0.6406
• Invoicenumber Partial F1: 0.2396
• Invoicenumber Exact Precision: 0.1340
• Invoicenumber Exact Recall: 0.5822
• Invoicenumber Exact F1: 0.2178
• Taxamount Strict Precision: 0.0001
• Taxamount Strict Recall: 0.0022
• Taxamount Strict F1: 0.0001
• Taxamount Ent Type Precision: 0.0034
• Taxamount Ent Type Recall: 0.1150
• Taxamount Ent Type F1: 0.0066
• Taxamount Partial Precision: 0.0042
• Taxamount Partial Recall: 0.1409
• Taxamount Partial F1: 0.0081
• Taxamount Exact Precision: 0.0001
• Taxamount Exact Recall: 0.0034
• Taxamount Exact F1: 0.0002
• Hotelphonenumber Strict Precision: 0.0984
• Hotelphonenumber Strict Recall: 0.6349
• Hotelphonenumber Strict F1: 0.1704
• Hotelphonenumber Ent Type Precision: 0.1266
• Hotelphonenumber Ent Type Recall: 0.8163
• Hotelphonenumber Ent Type F1: 0.2191
• Hotelphonenumber Partial Precision: 0.1140
• Hotelphonenumber Partial Recall: 0.7356
• Hotelphonenumber Partial F1: 0.1975
• Hotelphonenumber Exact Precision: 0.0998
• Hotelphonenumber Exact Recall: 0.6435
• Hotelphonenumber Exact F1: 0.1728
• Companyaddress Strict Precision: 0.1210
• Companyaddress Strict Recall: 0.6014
• Companyaddress Strict F1: 0.2015
• Companyaddress Ent Type Precision: 0.1506
• Companyaddress Ent Type Recall: 0.7488
• Companyaddress Ent Type F1: 0.2508
• Companyaddress Partial Precision: 0.1449
• Companyaddress Partial Recall: 0.7200
• Companyaddress Partial F1: 0.2412
• Companyaddress Exact Precision: 0.1259
• Companyaddress Exact Recall: 0.6259
• Companyaddress Exact F1: 0.2097
• Hotelfaxnumber Strict Precision: 0.0727
• Hotelfaxnumber Strict Recall: 0.7339
• Hotelfaxnumber Strict F1: 0.1324
• Hotelfaxnumber Ent Type Precision: 0.0855
• Hotelfaxnumber Ent Type Recall: 0.8624
• Hotelfaxnumber Ent Type F1: 0.1555
• Hotelfaxnumber Partial Precision: 0.0797
• Hotelfaxnumber Partial Recall: 0.8046
• Hotelfaxnumber Partial F1: 0.1451
• Hotelfaxnumber Exact Precision: 0.0732
• Hotelfaxnumber Exact Recall: 0.7387
• Hotelfaxnumber Exact F1: 0.1332
• Checkout Strict Precision: 0.1615
• Checkout Strict Recall: 0.7770
• Checkout Strict F1: 0.2674
• Checkout Ent Type Precision: 0.1707
• Checkout Ent Type Recall: 0.8212
• Checkout Ent Type F1: 0.2826
• Checkout Partial Precision: 0.1699
• Checkout Partial Recall: 0.8174
• Checkout Partial F1: 0.2813
• Checkout Exact Precision: 0.1647
• Checkout Exact Recall: 0.7924
• Checkout Exact F1: 0.2727
• Companyname Strict Precision: 0.0966
• Companyname Strict Recall: 0.5067
• Companyname Strict F1: 0.1623
• Companyname Ent Type Precision: 0.1454
• Companyname Ent Type Recall: 0.7625
• Companyname Ent Type F1: 0.2442
• Companyname Partial Precision: 0.1252
• Companyname Partial Recall: 0.6567
• Companyname Partial F1: 0.2104
• Companyname Exact Precision: 0.0980
• Companyname Exact Recall: 0.5137
• Companyname Exact F1: 0.1646
• Hoteltaxcode Strict Precision: 0.0023
• Hoteltaxcode Strict Recall: 0.0675
• Hoteltaxcode Strict F1: 0.0045
• Hoteltaxcode Ent Type Precision: 0.0239
• Hoteltaxcode Ent Type Recall: 0.7015
• Hoteltaxcode Ent Type F1: 0.0462
• Hoteltaxcode Partial Precision: 0.0137
• Hoteltaxcode Partial Recall: 0.4018
• Hoteltaxcode Partial F1: 0.0265
• Hoteltaxcode Exact Precision: 0.0023
• Hoteltaxcode Exact Recall: 0.0679
• Hoteltaxcode Exact F1: 0.0045
• Cardtype Strict Precision: 0.0030
• Cardtype Strict Recall: 0.3
• Cardtype Strict F1: 0.0060
• Cardtype Ent Type Precision: 0.0092
• Cardtype Ent Type Recall: 0.9114
• Cardtype Ent Type F1: 0.0182
• Cardtype Partial Precision: 0.0061
• Cardtype Partial Recall: 0.6057
• Cardtype Partial F1: 0.0121
• Cardtype Exact Precision: 0.0030
• Cardtype Exact Recall: 0.3
• Cardtype Exact F1: 0.0060
• Currencycode Strict Precision: 0.4396
• Currencycode Strict Recall: 0.6355
• Currencycode Strict F1: 0.5197
• Currencycode Ent Type Precision: 0.4410
• Currencycode Ent Type Recall: 0.6375
• Currencycode Ent Type F1: 0.5214
• Currencycode Partial Precision: 0.4413
• Currencycode Partial Recall: 0.6380
• Currencycode Partial F1: 0.5217
• Currencycode Exact Precision: 0.4398
• Currencycode Exact Recall: 0.6358
• Currencycode Exact F1: 0.5200
• Grossamount Strict Precision: 0.0597
• Grossamount Strict Recall: 0.1903
• Grossamount Strict F1: 0.0909
• Grossamount Ent Type Precision: 0.0813
• Grossamount Ent Type Recall: 0.2591
• Grossamount Ent Type F1: 0.1238
• Grossamount Partial Precision: 0.1010
• Grossamount Partial Recall: 0.3218
• Grossamount Partial F1: 0.1538
• Grossamount Exact Precision: 0.0827
• Grossamount Exact Recall: 0.2633
• Grossamount Exact F1: 0.1258
• Hotelcity Strict Precision: 0.0818
• Hotelcity Strict Recall: 0.4385
• Hotelcity Strict F1: 0.1379
• Hotelcity Ent Type Precision: 0.1026
• Hotelcity Ent Type Recall: 0.5500
• Hotelcity Ent Type F1: 0.1729
• Hotelcity Partial Precision: 0.1031
• Hotelcity Partial Recall: 0.5526
• Hotelcity Partial F1: 0.1737
• Hotelcity Exact Precision: 0.0896
• Hotelcity Exact Recall: 0.4805
• Hotelcity Exact F1: 0.1511

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• gradient_accumulation_steps: 16
• total_train_batch_size: 128
• optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
• lr_scheduler_type: linear
• lr_scheduler_warmup_ratio: 0.5
• num_epochs: 8

Training results

Training Loss	Epoch	Step	Validation Loss	Overall Strict Precision	Overall Strict Recall	Overall Strict F1	Overall Ent Type Precision	Overall Ent Type Recall	Overall Ent Type F1	Overall Partial Precision	Overall Partial Recall	Overall Partial F1	Overall Exact Precision	Overall Exact Recall	Overall Exact F1	Bookingnumber Strict Precision	Bookingnumber Strict Recall	Bookingnumber Strict F1	Bookingnumber Ent Type Precision	Bookingnumber Ent Type Recall	Bookingnumber Ent Type F1	Bookingnumber Partial Precision	Bookingnumber Partial Recall	Bookingnumber Partial F1	Bookingnumber Exact Precision	Bookingnumber Exact Recall	Bookingnumber Exact F1	Reservationnumber Strict Precision	Reservationnumber Strict Recall	Reservationnumber Strict F1	Reservationnumber Ent Type Precision	Reservationnumber Ent Type Recall	Reservationnumber Ent Type F1	Reservationnumber Partial Precision	Reservationnumber Partial Recall	Reservationnumber Partial F1	Reservationnumber Exact Precision	Reservationnumber Exact Recall	Reservationnumber Exact F1	Hotelname Strict Precision	Hotelname Strict Recall	Hotelname Strict F1	Hotelname Ent Type Precision	Hotelname Ent Type Recall	Hotelname Ent Type F1	Hotelname Partial Precision	Hotelname Partial Recall	Hotelname Partial F1	Hotelname Exact Precision	Hotelname Exact Recall	Hotelname Exact F1	Companycountry Strict Precision	Companycountry Strict Recall	Companycountry Strict F1	Companycountry Ent Type Precision	Companycountry Ent Type Recall	Companycountry Ent Type F1	Companycountry Partial Precision	Companycountry Partial Recall	Companycountry Partial F1	Companycountry Exact Precision	Companycountry Exact Recall	Companycountry Exact F1	Documenttype Strict Precision	Documenttype Strict Recall	Documenttype Strict F1	Documenttype Ent Type Precision	Documenttype Ent Type Recall	Documenttype Ent Type F1	Documenttype Partial Precision	Documenttype Partial Recall	Documenttype Partial F1	Documenttype Exact Precision	Documenttype Exact Recall	Documenttype Exact F1	Hotelbankaccount Strict Precision	Hotelbankaccount Strict Recall	Hotelbankaccount Strict F1	Hotelbankaccount Ent Type Precision	Hotelbankaccount Ent Type Recall	Hotelbankaccount Ent Type F1	Hotelbankaccount Partial Precision	Hotelbankaccount Partial Recall	Hotelbankaccount Partial F1	Hotelbankaccount Exact Precision	Hotelbankaccount Exact Recall	Hotelbankaccount Exact F1	Hotelvatnumber Strict Precision	Hotelvatnumber Strict Recall	Hotelvatnumber Strict F1	Hotelvatnumber Ent Type Precision	Hotelvatnumber Ent Type Recall	Hotelvatnumber Ent Type F1	Hotelvatnumber Partial Precision	Hotelvatnumber Partial Recall	Hotelvatnumber Partial F1	Hotelvatnumber Exact Precision	Hotelvatnumber Exact Recall	Hotelvatnumber Exact F1	Companyzipcode Strict Precision	Companyzipcode Strict Recall	Companyzipcode Strict F1	Companyzipcode Ent Type Precision	Companyzipcode Ent Type Recall	Companyzipcode Ent Type F1	Companyzipcode Partial Precision	Companyzipcode Partial Recall	Companyzipcode Partial F1	Companyzipcode Exact Precision	Companyzipcode Exact Recall	Companyzipcode Exact F1	Hotelzipcode Strict Precision	Hotelzipcode Strict Recall	Hotelzipcode Strict F1	Hotelzipcode Ent Type Precision	Hotelzipcode Ent Type Recall	Hotelzipcode Ent Type F1	Hotelzipcode Partial Precision	Hotelzipcode Partial Recall	Hotelzipcode Partial F1	Hotelzipcode Exact Precision	Hotelzipcode Exact Recall	Hotelzipcode Exact F1	Companycity Strict Precision	Companycity Strict Recall	Companycity Strict F1	Companycity Ent Type Precision	Companycity Ent Type Recall	Companycity Ent Type F1	Companycity Partial Precision	Companycity Partial Recall	Companycity Partial F1	Companycity Exact Precision	Companycity Exact Recall	Companycity Exact F1	Hoteladdress Strict Precision	Hoteladdress Strict Recall	Hoteladdress Strict F1	Hoteladdress Ent Type Precision	Hoteladdress Ent Type Recall	Hoteladdress Ent Type F1	Hoteladdress Partial Precision	Hoteladdress Partial Recall	Hoteladdress Partial F1	Hoteladdress Exact Precision	Hoteladdress Exact Recall	Hoteladdress Exact F1	Companyvatnumber Strict Precision	Companyvatnumber Strict Recall	Companyvatnumber Strict F1	Companyvatnumber Ent Type Precision	Companyvatnumber Ent Type Recall	Companyvatnumber Ent Type F1	Companyvatnumber Partial Precision	Companyvatnumber Partial Recall	Companyvatnumber Partial F1	Companyvatnumber Exact Precision	Companyvatnumber Exact Recall	Companyvatnumber Exact F1	Travellername Strict Precision	Travellername Strict Recall	Travellername Strict F1	Travellername Ent Type Precision	Travellername Ent Type Recall	Travellername Ent Type F1	Travellername Partial Precision	Travellername Partial Recall	Travellername Partial F1	Travellername Exact Precision	Travellername Exact Recall	Travellername Exact F1	Hotelemail Strict Precision	Hotelemail Strict Recall	Hotelemail Strict F1	Hotelemail Ent Type Precision	Hotelemail Ent Type Recall	Hotelemail Ent Type F1	Hotelemail Partial Precision	Hotelemail Partial Recall	Hotelemail Partial F1	Hotelemail Exact Precision	Hotelemail Exact Recall	Hotelemail Exact F1	Cardnumber Strict Precision	Cardnumber Strict Recall	Cardnumber Strict F1	Cardnumber Ent Type Precision	Cardnumber Ent Type Recall	Cardnumber Ent Type F1	Cardnumber Partial Precision	Cardnumber Partial Recall	Cardnumber Partial F1	Cardnumber Exact Precision	Cardnumber Exact Recall	Cardnumber Exact F1	Checkin Strict Precision	Checkin Strict Recall	Checkin Strict F1	Checkin Ent Type Precision	Checkin Ent Type Recall	Checkin Ent Type F1	Checkin Partial Precision	Checkin Partial Recall	Checkin Partial F1	Checkin Exact Precision	Checkin Exact Recall	Checkin Exact F1	Invoicenumber Strict Precision	Invoicenumber Strict Recall	Invoicenumber Strict F1	Invoicenumber Ent Type Precision	Invoicenumber Ent Type Recall	Invoicenumber Ent Type F1	Invoicenumber Partial Precision	Invoicenumber Partial Recall	Invoicenumber Partial F1	Invoicenumber Exact Precision	Invoicenumber Exact Recall	Invoicenumber Exact F1	Taxamount Strict Precision	Taxamount Strict Recall	Taxamount Strict F1	Taxamount Ent Type Precision	Taxamount Ent Type Recall	Taxamount Ent Type F1	Taxamount Partial Precision	Taxamount Partial Recall	Taxamount Partial F1	Taxamount Exact Precision	Taxamount Exact Recall	Taxamount Exact F1	Hotelphonenumber Strict Precision	Hotelphonenumber Strict Recall	Hotelphonenumber Strict F1	Hotelphonenumber Ent Type Precision	Hotelphonenumber Ent Type Recall	Hotelphonenumber Ent Type F1	Hotelphonenumber Partial Precision	Hotelphonenumber Partial Recall	Hotelphonenumber Partial F1	Hotelphonenumber Exact Precision	Hotelphonenumber Exact Recall	Hotelphonenumber Exact F1	Companyaddress Strict Precision	Companyaddress Strict Recall	Companyaddress Strict F1	Companyaddress Ent Type Precision	Companyaddress Ent Type Recall	Companyaddress Ent Type F1	Companyaddress Partial Precision	Companyaddress Partial Recall	Companyaddress Partial F1	Companyaddress Exact Precision	Companyaddress Exact Recall	Companyaddress Exact F1	Externalreservationnumber Strict Precision	Externalreservationnumber Strict Recall	Externalreservationnumber Strict F1	Externalreservationnumber Ent Type Precision	Externalreservationnumber Ent Type Recall	Externalreservationnumber Ent Type F1	Externalreservationnumber Partial Precision	Externalreservationnumber Partial Recall	Externalreservationnumber Partial F1	Externalreservationnumber Exact Precision	Externalreservationnumber Exact Recall	Externalreservationnumber Exact F1	Pagenumber Strict Precision	Pagenumber Strict Recall	Pagenumber Strict F1	Pagenumber Ent Type Precision	Pagenumber Ent Type Recall	Pagenumber Ent Type F1	Pagenumber Partial Precision	Pagenumber Partial Recall	Pagenumber Partial F1	Pagenumber Exact Precision	Pagenumber Exact Recall	Pagenumber Exact F1	Hotelfaxnumber Strict Precision	Hotelfaxnumber Strict Recall	Hotelfaxnumber Strict F1	Hotelfaxnumber Ent Type Precision	Hotelfaxnumber Ent Type Recall	Hotelfaxnumber Ent Type F1	Hotelfaxnumber Partial Precision	Hotelfaxnumber Partial Recall	Hotelfaxnumber Partial F1	Hotelfaxnumber Exact Precision	Hotelfaxnumber Exact Recall	Hotelfaxnumber Exact F1	Netamount Strict Precision	Netamount Strict Recall	Netamount Strict F1	Netamount Ent Type Precision	Netamount Ent Type Recall	Netamount Ent Type F1	Netamount Partial Precision	Netamount Partial Recall	Netamount Partial F1	Netamount Exact Precision	Netamount Exact Recall	Netamount Exact F1	Hotelcountry Strict Precision	Hotelcountry Strict Recall	Hotelcountry Strict F1	Hotelcountry Ent Type Precision	Hotelcountry Ent Type Recall	Hotelcountry Ent Type F1	Hotelcountry Partial Precision	Hotelcountry Partial Recall	Hotelcountry Partial F1	Hotelcountry Exact Precision	Hotelcountry Exact Recall	Hotelcountry Exact F1	Checkout Strict Precision	Checkout Strict Recall	Checkout Strict F1	Checkout Ent Type Precision	Checkout Ent Type Recall	Checkout Ent Type F1	Checkout Partial Precision	Checkout Partial Recall	Checkout Partial F1	Checkout Exact Precision	Checkout Exact Recall	Checkout Exact F1	Companyname Strict Precision	Companyname Strict Recall	Companyname Strict F1	Companyname Ent Type Precision	Companyname Ent Type Recall	Companyname Ent Type F1	Companyname Partial Precision	Companyname Partial Recall	Companyname Partial F1	Companyname Exact Precision	Companyname Exact Recall	Companyname Exact F1	Hoteltaxcode Strict Precision	Hoteltaxcode Strict Recall	Hoteltaxcode Strict F1	Hoteltaxcode Ent Type Precision	Hoteltaxcode Ent Type Recall	Hoteltaxcode Ent Type F1	Hoteltaxcode Partial Precision	Hoteltaxcode Partial Recall	Hoteltaxcode Partial F1	Hoteltaxcode Exact Precision	Hoteltaxcode Exact Recall	Hoteltaxcode Exact F1	Roomno Strict Precision	Roomno Strict Recall	Roomno Strict F1	Roomno Ent Type Precision	Roomno Ent Type Recall	Roomno Ent Type F1	Roomno Partial Precision	Roomno Partial Recall	Roomno Partial F1	Roomno Exact Precision	Roomno Exact Recall	Roomno Exact F1	Cardtype Strict Precision	Cardtype Strict Recall	Cardtype Strict F1	Cardtype Ent Type Precision	Cardtype Ent Type Recall	Cardtype Ent Type F1	Cardtype Partial Precision	Cardtype Partial Recall	Cardtype Partial F1	Cardtype Exact Precision	Cardtype Exact Recall	Cardtype Exact F1	Currencycode Strict Precision	Currencycode Strict Recall	Currencycode Strict F1	Currencycode Ent Type Precision	Currencycode Ent Type Recall	Currencycode Ent Type F1	Currencycode Partial Precision	Currencycode Partial Recall	Currencycode Partial F1	Currencycode Exact Precision	Currencycode Exact Recall	Currencycode Exact F1	Grossamount Strict Precision	Grossamount Strict Recall	Grossamount Strict F1	Grossamount Ent Type Precision	Grossamount Ent Type Recall	Grossamount Ent Type F1	Grossamount Partial Precision	Grossamount Partial Recall	Grossamount Partial F1	Grossamount Exact Precision	Grossamount Exact Recall	Grossamount Exact F1	Hotelcity Strict Precision	Hotelcity Strict Recall	Hotelcity Strict F1	Hotelcity Ent Type Precision	Hotelcity Ent Type Recall	Hotelcity Ent Type F1	Hotelcity Partial Precision	Hotelcity Partial Recall	Hotelcity Partial F1	Hotelcity Exact Precision	Hotelcity Exact Recall	Hotelcity Exact F1	Invoicedate Strict Precision	Invoicedate Strict Recall	Invoicedate Strict F1	Invoicedate Ent Type Precision	Invoicedate Ent Type Recall	Invoicedate Ent Type F1	Invoicedate Partial Precision	Invoicedate Partial Recall	Invoicedate Partial F1	Invoicedate Exact Precision	Invoicedate Exact Recall	Invoicedate Exact F1
66.2367	1.0	574	1.4115	0.0	0.0	0	0.0	0.0	0	0.0000	0.0159	0.0000	0.0000	0.0159	0.0000	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0.0	0	0.0	0.0	0	0.0	0.0	0	0.0	0.0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0.0	0	0.0	0.0	0	0.0	0.0	0	0.0	0.0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0.0	0	0.0	0.0	0	0.0	0.0	0	0.0	0.0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0.0	0	0.0	0.0	0	0.0	0.0	0	0.0	0.0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0.0	0	0.0	0.0	0	0.0	0.0	0	0.0	0.0	0	0.0	0.0	0	0.0	0.0	0	0.0	0.0	0	0.0	0.0	0	0.0	0.0	0	0.0	0.0	0	0.0	0.0	0	0.0	0.0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0.0	0	0.0	0.0	0	0.0	0.0	0	0.0	0.0	0	0.0	0.0	0	0.0	0.0	0	0.0	0.0	0	0.0	0.0	0	0.0	0.0	0	0.0	0.0	0	0.0000	0.0556	0.0000	0.0000	0.0556	0.0000	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0.0	0	0.0	0.0	0	0.0	0.0	0	0.0	0.0	0	0.0	0.0	0	0.0	0.0	0	0.0	0.0	0	0.0	0.0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0.0	0	0.0	0.0	0	0.0	0.0	0	0.0	0.0	0	0.0	0.0	0	0.0	0.0	0	0.0	0.0	0	0.0	0.0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0
18.8576	2.0	1148	0.7434	0.1714	0.2511	0.2037	0.2870	0.4205	0.3411	0.3224	0.4724	0.3832	0.2135	0.3129	0.2538	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0.0	0	0.0001	0.1918	0.0002	0.0001	0.1233	0.0002	0.0	0.0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0050	0.2211	0.0098	0.0120	0.5268	0.0235	0.0104	0.4545	0.0202	0.0057	0.2504	0.0112	0.0023	0.1106	0.0044	0.0064	0.3148	0.0126	0.0055	0.2700	0.0108	0.0029	0.1423	0.0057	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0019	0.0446	0.0037	0.0135	0.3140	0.0259	0.0121	0.2817	0.0233	0.0030	0.0698	0.0058	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0151	0.3066	0.0288	0.0258	0.5232	0.0492	0.0231	0.4696	0.0441	0.0158	0.3206	0.0301	0.0308	0.5727	0.0584	0.0433	0.8057	0.0821	0.0373	0.6951	0.0709	0.0310	0.5767	0.0588	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0194	0.1516	0.0344	0.0351	0.2745	0.0622	0.0462	0.3614	0.0819	0.0310	0.2422	0.0549	0.0125	0.2742	0.0240	0.0176	0.3844	0.0336	0.0252	0.5511	0.0482	0.0206	0.4494	0.0393	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0235	0.2523	0.0430	0.0421	0.4518	0.0770	0.0534	0.5728	0.0977	0.0367	0.3937	0.0671	0.0038	0.0243	0.0066	0.0471	0.2995	0.0814	0.0718	0.4569	0.1241	0.0131	0.0834	0.0227	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0006	0.0292	0.0013	0.0034	0.1526	0.0066	0.0021	0.0959	0.0042	0.0006	0.0292	0.0013	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0202	0.1516	0.0357	0.0429	0.3217	0.0757	0.0495	0.3718	0.0874	0.0286	0.2146	0.0505	0.0203	0.2317	0.0374	0.0468	0.5334	0.0860	0.0442	0.5043	0.0813	0.0249	0.2840	0.0458	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.1021	0.5707	0.1732	0.1021	0.5707	0.1732	0.1022	0.5710	0.1733	0.1022	0.5710	0.1733	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0219	0.2840	0.0407	0.0303	0.3922	0.0563	0.0414	0.5356	0.0768	0.0327	0.4226	0.0606
11.8223	3.0	1722	0.5320	0.4455	0.4810	0.4626	0.5695	0.6150	0.5914	0.5673	0.6126	0.5891	0.4847	0.5234	0.5033	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0048	0.1029	0.0092	0.0189	0.4044	0.0361	0.0130	0.2779	0.0248	0.0051	0.1087	0.0097	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0073	0.4569	0.0144	0.0076	0.4733	0.0149	0.0075	0.4680	0.0147	0.0073	0.4569	0.0144	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0276	0.3591	0.0512	0.0372	0.4851	0.0691	0.0431	0.5615	0.0800	0.0348	0.4533	0.0646	0.0694	0.6002	0.1244	0.0814	0.7038	0.1459	0.0856	0.7404	0.1535	0.0780	0.6748	0.1399	0.0079	0.2723	0.0154	0.0122	0.4211	0.0237	0.0102	0.3506	0.0198	0.0080	0.2747	0.0155	0.0374	0.3152	0.0668	0.0650	0.5483	0.1162	0.0763	0.6434	0.1364	0.0571	0.4816	0.1021	0.0206	0.1853	0.0371	0.0546	0.4911	0.0983	0.0414	0.3721	0.0745	0.0214	0.1929	0.0386	0.0026	0.2228	0.0051	0.0064	0.5549	0.0126	0.0052	0.4485	0.0102	0.0028	0.2451	0.0056	0.0442	0.3601	0.0788	0.0720	0.5866	0.1283	0.0637	0.5190	0.1135	0.0473	0.3852	0.0842	0.0569	0.7077	0.1052	0.0683	0.8496	0.1264	0.0627	0.7799	0.1160	0.0569	0.7083	0.1053	0.0	0.0	0	0.0000	0.5	0.0000	0.0000	0.25	0.0000	0.0	0.0	0	0.0646	0.4566	0.1132	0.0916	0.6475	0.1605	0.0878	0.6204	0.1538	0.0703	0.4967	0.1231	0.0520	0.3973	0.0919	0.0652	0.4981	0.1152	0.0901	0.6884	0.1593	0.0810	0.6192	0.1433	0.0	0.0	0	0.0	0.0	0	0.0	0.0	0	0.0	0.0	0	0.0474	0.5082	0.0867	0.0719	0.7715	0.1316	0.0630	0.6758	0.1153	0.0491	0.5271	0.0899	0.0594	0.4600	0.1052	0.0863	0.6683	0.1529	0.0850	0.6584	0.1506	0.0635	0.4920	0.1125	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0142	0.5925	0.0278	0.0149	0.6192	0.0290	0.0145	0.6058	0.0284	0.0142	0.5925	0.0278	0.0369	0.5879	0.0694	0.0467	0.7441	0.0878	0.0426	0.6785	0.0801	0.0373	0.5946	0.0702	0.0	0.0	0	0.0002	0.0430	0.0004	0.0008	0.1758	0.0017	0.0	0.0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0849	0.6235	0.1494	0.0976	0.7168	0.1717	0.0975	0.7161	0.1716	0.0888	0.6525	0.1563	0.0478	0.4366	0.0862	0.0814	0.7433	0.1467	0.0691	0.6310	0.1245	0.0490	0.4476	0.0883	0.0001	0.0199	0.0002	0.0008	0.1610	0.0015	0.0005	0.1058	0.0010	0.0001	0.0199	0.0002	0.0125	0.9485	0.0247	0.0125	0.9485	0.0247	0.0128	0.9689	0.0252	0.0128	0.9689	0.0252	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.2939	0.6119	0.3971	0.2944	0.6129	0.3977	0.2950	0.6141	0.3985	0.2940	0.6121	0.3972	0.0075	0.0895	0.0139	0.0211	0.2514	0.0390	0.0351	0.4171	0.0647	0.0186	0.2207	0.0343	0.0112	0.2949	0.0216	0.0194	0.5094	0.0374	0.0168	0.4415	0.0324	0.0121	0.3165	0.0232	0.0675	0.6223	0.1218	0.0776	0.7147	0.1399	0.0789	0.7272	0.1424	0.0712	0.6563	0.1285
9.0513	4.0	2296	0.4121	0.5691	0.5307	0.5492	0.6979	0.6508	0.6736	0.6767	0.6310	0.6530	0.5968	0.5565	0.5759	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0152	0.1255	0.0271	0.0505	0.4170	0.0901	0.0345	0.2851	0.0616	0.0157	0.1294	0.0280	0.0081	0.8051	0.0161	0.0084	0.8364	0.0167	0.0089	0.8823	0.0176	0.0087	0.8596	0.0172	0.0641	0.6547	0.1167	0.0740	0.7561	0.1348	0.0696	0.7106	0.1267	0.0642	0.6562	0.1170	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0437	0.3994	0.0789	0.0612	0.5589	0.1103	0.0609	0.5564	0.1099	0.0486	0.4438	0.0876	0.1114	0.7573	0.1942	0.1211	0.8237	0.2112	0.1238	0.8415	0.2158	0.1177	0.8	0.2051	0.0498	0.4412	0.0895	0.0663	0.5875	0.1191	0.0591	0.5241	0.1063	0.0505	0.4476	0.0908	0.0734	0.4110	0.1245	0.1089	0.6101	0.1848	0.1298	0.7274	0.2203	0.1047	0.5864	0.1776	0.0365	0.2307	0.0630	0.0867	0.5489	0.1498	0.0651	0.4117	0.1123	0.0372	0.2355	0.0643	0.0067	0.1926	0.0130	0.0185	0.5310	0.0358	0.0156	0.4477	0.0302	0.0077	0.2199	0.0148	0.0670	0.3744	0.1136	0.1115	0.6228	0.1891	0.0932	0.5205	0.1580	0.0686	0.3831	0.1163	0.0841	0.7532	0.1513	0.0953	0.8533	0.1714	0.0898	0.8040	0.1615	0.0842	0.7538	0.1514	0.0003	0.0572	0.0005	0.0027	0.5927	0.0053	0.0015	0.3284	0.0029	0.0003	0.0572	0.0005	0.1227	0.6712	0.2075	0.1403	0.7674	0.2372	0.1372	0.7507	0.2320	0.1265	0.6922	0.2139	0.0872	0.4869	0.1479	0.1088	0.6073	0.1845	0.1155	0.6447	0.1958	0.1014	0.5659	0.1719	0.0002	0.0266	0.0004	0.0010	0.1343	0.0020	0.0011	0.1497	0.0022	0.0002	0.0308	0.0004	0.0788	0.6142	0.1397	0.1033	0.8048	0.1830	0.0931	0.7256	0.1650	0.0805	0.6275	0.1427	0.0946	0.5997	0.1634	0.1222	0.7744	0.2110	0.1166	0.7393	0.2015	0.0979	0.6207	0.1692	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0483	0.7469	0.0908	0.0511	0.7892	0.0959	0.0497	0.7686	0.0934	0.0483	0.7472	0.0908	0.0575	0.7119	0.1065	0.0691	0.8550	0.1279	0.0638	0.7893	0.1180	0.0577	0.7136	0.1067	0.0001	0.0015	0.0001	0.0023	0.0567	0.0045	0.0040	0.0973	0.0077	0.0004	0.0106	0.0008	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.1303	0.7370	0.2214	0.1403	0.7936	0.2384	0.1401	0.7925	0.2381	0.1341	0.7586	0.2279	0.0739	0.5000	0.1287	0.1174	0.7945	0.2045	0.0991	0.6709	0.1727	0.0745	0.5041	0.1297	0.0103	0.4135	0.0201	0.0170	0.6832	0.0332	0.0143	0.5739	0.0279	0.0107	0.4297	0.0209	0.0791	0.7370	0.1428	0.0791	0.7370	0.1428	0.0824	0.7683	0.1489	0.0824	0.7683	0.1489	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.3831	0.6252	0.4751	0.3838	0.6265	0.4760	0.3843	0.6272	0.4766	0.3832	0.6255	0.4753	0.0288	0.1291	0.0471	0.0600	0.2688	0.0981	0.0711	0.3187	0.1163	0.0426	0.1911	0.0697	0.0397	0.3569	0.0714	0.0604	0.5431	0.1087	0.0558	0.5017	0.1004	0.0428	0.3851	0.0771	0.1110	0.7487	0.1933	0.1189	0.8019	0.2071	0.1188	0.8015	0.2069	0.1138	0.7675	0.1982
7.2492	5.0	2870	0.3630	0.6222	0.5403	0.5783	0.7489	0.6504	0.6962	0.7237	0.6285	0.6727	0.6475	0.5622	0.6018	0.0504	0.7882	0.0948	0.0514	0.8026	0.0965	0.0542	0.8466	0.1018	0.0536	0.8370	0.1007	0.0899	0.6203	0.1570	0.1091	0.7527	0.1905	0.1000	0.6901	0.1747	0.0900	0.6213	0.1573	0.0587	0.3806	0.1017	0.0787	0.5102	0.1364	0.0793	0.5138	0.1373	0.0657	0.4257	0.1138	0.1381	0.7736	0.2343	0.1469	0.8229	0.2493	0.1507	0.8441	0.2557	0.1450	0.8126	0.2461	0.0014	0.0310	0.0026	0.0257	0.5755	0.0491	0.0168	0.3760	0.0321	0.0016	0.0367	0.0031	0.0815	0.3819	0.1343	0.1352	0.6337	0.2229	0.1112	0.5214	0.1834	0.0826	0.3871	0.1361	0.1034	0.7756	0.1825	0.1135	0.8512	0.2003	0.1085	0.8141	0.1915	0.1035	0.7762	0.1826	0.0018	0.1686	0.0035	0.0055	0.5189	0.0108	0.0037	0.3502	0.0073	0.0018	0.1698	0.0035	0.1551	0.7655	0.2579	0.1674	0.8266	0.2785	0.1655	0.8172	0.2753	0.1580	0.7802	0.2628	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0647	0.7650	0.1194	0.0676	0.7993	0.1247	0.0663	0.7831	0.1222	0.0648	0.7656	0.1195	0.0	0.0	0	0.0131	0.1800	0.0245	0.0146	0.1999	0.0272	0.0001	0.0012	0.0002	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.1087	0.7298	0.1893	0.1087	0.7298	0.1893	0.1128	0.7572	0.1964	0.1128	0.7572	0.1964	0.1375	0.7878	0.2342	0.1447	0.8290	0.2465	0.1449	0.8300	0.2467	0.1403	0.8035	0.2389	0.0	0.0	0	0.0	0.0	0	0.0	0.0	0	0.0	0.0	0	0.0	0.0	0	0.0008	0.4037	0.0016	0.0004	0.2050	0.0008	0.0	0.0	0	0.0160	0.1002	0.0276	0.0643	0.4029	0.1108	0.0416	0.2611	0.0718	0.0161	0.1012	0.0278	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0799	0.4839	0.1372	0.0981	0.5936	0.1683	0.0907	0.5490	0.1557	0.0811	0.4910	0.1392	0.1103	0.5584	0.1842	0.1365	0.6907	0.2279	0.1486	0.7522	0.2482	0.1298	0.6568	0.2167	0.0444	0.2237	0.0741	0.1102	0.5550	0.1838	0.0808	0.4070	0.1348	0.0451	0.2274	0.0753	0.1139	0.4946	0.1852	0.1355	0.5885	0.2203	0.1443	0.6265	0.2345	0.1307	0.5673	0.2124	0.0000	0.0005	0.0000	0.0028	0.1166	0.0055	0.0033	0.1378	0.0065	0.0000	0.0016	0.0001	0.0957	0.6213	0.1659	0.1234	0.8009	0.2139	0.1114	0.7228	0.1930	0.0972	0.6308	0.1685	0.1176	0.5940	0.1964	0.1467	0.7406	0.2449	0.1420	0.7169	0.2370	0.1230	0.6210	0.2053	0.0704	0.7267	0.1283	0.0832	0.8589	0.1517	0.0774	0.7993	0.1411	0.0709	0.7316	0.1292	0.1569	0.7727	0.2608	0.1664	0.8194	0.2766	0.1657	0.8162	0.2755	0.1603	0.7896	0.2665	0.0924	0.5013	0.1561	0.1418	0.7693	0.2395	0.1213	0.6578	0.2048	0.0934	0.5068	0.1578	0.0034	0.1019	0.0066	0.0233	0.7006	0.0451	0.0139	0.4189	0.0269	0.0034	0.1030	0.0066	0.0010	0.1092	0.0020	0.0085	0.9068	0.0168	0.0047	0.5080	0.0094	0.0010	0.1092	0.0020	0.4327	0.6310	0.5134	0.4342	0.6331	0.5151	0.4345	0.6336	0.5155	0.4330	0.6314	0.5137	0.0564	0.1836	0.0862	0.0794	0.2586	0.1215	0.0986	0.3214	0.1510	0.0791	0.2576	0.1210	0.0783	0.4336	0.1327	0.0987	0.5464	0.1672	0.0987	0.5466	0.1673	0.0856	0.4738	0.1450
6.337	6.0	3444	0.3537	0.6292	0.5458	0.5845	0.7551	0.6550	0.7015	0.7288	0.6322	0.6770	0.6534	0.5668	0.6070	0.0551	0.7723	0.1029	0.0563	0.7888	0.1051	0.0597	0.8364	0.1114	0.0589	0.8257	0.1100	0.0938	0.6161	0.1629	0.1136	0.7458	0.1972	0.1043	0.6845	0.1810	0.0940	0.6169	0.1631	0.0604	0.3967	0.1049	0.0799	0.5246	0.1387	0.0800	0.5256	0.1389	0.0673	0.4416	0.1167	0.1412	0.7807	0.2391	0.1498	0.8287	0.2538	0.1534	0.8483	0.2598	0.1478	0.8176	0.2504	0.0013	0.0292	0.0025	0.0267	0.5949	0.0511	0.0171	0.3807	0.0327	0.0015	0.0334	0.0029	0.0856	0.3874	0.1403	0.1398	0.6324	0.2289	0.1158	0.5238	0.1896	0.0869	0.3931	0.1423	0.1060	0.7815	0.1867	0.1155	0.8519	0.2035	0.1108	0.8174	0.1952	0.1061	0.7821	0.1868	0.0017	0.1686	0.0033	0.0054	0.5508	0.0108	0.0036	0.3655	0.0072	0.0017	0.1699	0.0033	0.1598	0.7871	0.2657	0.1705	0.8396	0.2835	0.1694	0.8344	0.2817	0.1628	0.8018	0.2707	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0674	0.7689	0.1240	0.0700	0.7981	0.1287	0.0688	0.7845	0.1265	0.0675	0.7695	0.1241	0.0	0.0	0	0.0155	0.2018	0.0288	0.0167	0.2173	0.0310	0.0000	0.0006	0.0001	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.1143	0.7259	0.1975	0.1143	0.7259	0.1975	0.1185	0.7526	0.2048	0.1185	0.7526	0.2048	0.1404	0.7957	0.2386	0.1476	0.8368	0.2509	0.1475	0.8364	0.2508	0.1430	0.8108	0.2431	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0.0	0	0.0011	0.4863	0.0023	0.0006	0.2459	0.0011	0.0	0.0	0	0.0176	0.1016	0.0301	0.0716	0.4120	0.1220	0.0462	0.2661	0.0788	0.0178	0.1026	0.0304	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0834	0.4918	0.1425	0.1010	0.5962	0.1728	0.0939	0.5543	0.1606	0.0846	0.4989	0.1446	0.1144	0.5778	0.1910	0.1395	0.7049	0.2329	0.1502	0.7586	0.2507	0.1321	0.6672	0.2205	0.0467	0.2285	0.0776	0.1139	0.5570	0.1892	0.0839	0.4104	0.1394	0.0477	0.2330	0.0791	0.1174	0.5144	0.1912	0.1391	0.6093	0.2265	0.1463	0.6407	0.2382	0.1328	0.5818	0.2163	0.0001	0.0018	0.0001	0.0035	0.1213	0.0068	0.0042	0.1461	0.0082	0.0001	0.0031	0.0002	0.0977	0.6355	0.1694	0.1256	0.8164	0.2176	0.1132	0.7360	0.1962	0.0991	0.6441	0.1717	0.1200	0.6005	0.2000	0.1495	0.7484	0.2493	0.1440	0.7206	0.2400	0.1251	0.6261	0.2085	0.0721	0.7346	0.1313	0.0848	0.8637	0.1544	0.0790	0.8051	0.1440	0.0725	0.7384	0.1320	0.1599	0.7763	0.2652	0.1693	0.8216	0.2807	0.1683	0.8170	0.2792	0.1630	0.7913	0.2704	0.0958	0.5058	0.1611	0.1443	0.7618	0.2426	0.1242	0.6560	0.2089	0.0970	0.5123	0.1631	0.0024	0.0712	0.0047	0.0236	0.6972	0.0456	0.0136	0.4015	0.0263	0.0024	0.0716	0.0047	0.0027	0.2710	0.0053	0.0091	0.9109	0.0180	0.0059	0.5910	0.0117	0.0027	0.2710	0.0053	0.4374	0.6355	0.5182	0.4389	0.6375	0.5199	0.4392	0.6380	0.5202	0.4377	0.6358	0.5185	0.0589	0.1898	0.0899	0.0807	0.2601	0.1232	0.1006	0.3240	0.1535	0.0821	0.2643	0.1252	0.0808	0.4417	0.1366	0.1011	0.5528	0.1710	0.1014	0.5541	0.1714	0.0882	0.4823	0.1492
6.0684	7.0	4018	0.3529	0.6315	0.5450	0.5851	0.7574	0.6537	0.7017	0.7312	0.6311	0.6775	0.6558	0.5660	0.6076	0.0560	0.7686	0.1045	0.0573	0.7864	0.1069	0.0608	0.8335	0.1133	0.0599	0.8219	0.1117	0.0955	0.6159	0.1653	0.1155	0.7449	0.2000	0.1060	0.6839	0.1836	0.0956	0.6167	0.1655	0.0616	0.3937	0.1065	0.0813	0.5201	0.1407	0.0816	0.5219	0.1411	0.0686	0.4384	0.1186	0.1428	0.7814	0.2415	0.1515	0.8291	0.2563	0.1548	0.8471	0.2618	0.1493	0.8167	0.2524	0.0014	0.0300	0.0026	0.0271	0.5965	0.0519	0.0173	0.3810	0.0332	0.0015	0.0339	0.0029	0.0869	0.3904	0.1422	0.1413	0.6348	0.2311	0.1172	0.5264	0.1917	0.0882	0.3961	0.1442	0.1074	0.7830	0.1889	0.1169	0.8522	0.2056	0.1122	0.8183	0.1974	0.1075	0.7836	0.1890	0.0018	0.1715	0.0035	0.0056	0.5419	0.0110	0.0037	0.3623	0.0074	0.0018	0.1727	0.0035	0.1623	0.7892	0.2692	0.1727	0.8396	0.2864	0.1718	0.8354	0.2850	0.1653	0.8039	0.2742	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0686	0.7711	0.1260	0.0713	0.8006	0.1309	0.0700	0.7869	0.1286	0.0687	0.7717	0.1261	0.0	0.0	0	0.0164	0.2065	0.0305	0.0178	0.2229	0.0329	0.0000	0.0006	0.0001	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.1165	0.7232	0.2006	0.1165	0.7232	0.2006	0.1207	0.7496	0.2079	0.1207	0.7496	0.2079	0.1422	0.7961	0.2414	0.1494	0.8363	0.2535	0.1494	0.8362	0.2535	0.1449	0.8112	0.2459	0.0	0.0	0	0.0	0.0	0	0.0	0.0	0	0.0	0.0	0	0.0	0.0	0	0.0012	0.5082	0.0024	0.0006	0.2568	0.0012	0.0	0.0	0	0.0181	0.1006	0.0306	0.0736	0.4097	0.1248	0.0476	0.2647	0.0806	0.0183	0.1018	0.0310	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0850	0.4900	0.1448	0.1030	0.5944	0.1756	0.0958	0.5528	0.1633	0.0862	0.4971	0.1469	0.1159	0.5778	0.1931	0.1412	0.7040	0.2352	0.1520	0.7580	0.2533	0.1338	0.6671	0.2229	0.0481	0.2297	0.0796	0.1160	0.5540	0.1919	0.0859	0.4100	0.1420	0.0491	0.2346	0.0813	0.1193	0.5139	0.1936	0.1410	0.6075	0.2289	0.1484	0.6393	0.2408	0.1348	0.5808	0.2188	0.0001	0.0022	0.0001	0.0034	0.1162	0.0067	0.0042	0.1430	0.0082	0.0001	0.0039	0.0002	0.0989	0.6341	0.1711	0.1271	0.8149	0.2199	0.1146	0.7347	0.1982	0.1003	0.6429	0.1735	0.1215	0.6014	0.2021	0.1512	0.7485	0.2516	0.1454	0.7200	0.2420	0.1265	0.6263	0.2105	0.0731	0.7338	0.1329	0.0859	0.8625	0.1562	0.0801	0.8046	0.1457	0.0735	0.7386	0.1337	0.1623	0.7777	0.2685	0.1715	0.8220	0.2838	0.1707	0.8182	0.2825	0.1655	0.7932	0.2739	0.0971	0.5072	0.1630	0.1460	0.7625	0.2451	0.1258	0.6569	0.2111	0.0984	0.5141	0.1652	0.0023	0.0680	0.0045	0.0241	0.7010	0.0465	0.0138	0.4022	0.0267	0.0024	0.0691	0.0046	0.0030	0.3	0.0060	0.0092	0.9101	0.0183	0.0061	0.6051	0.0121	0.0030	0.3	0.0060	0.4408	0.6351	0.5204	0.4422	0.6372	0.5221	0.4425	0.6376	0.5224	0.4410	0.6354	0.5207	0.0602	0.1903	0.0914	0.0820	0.2595	0.1247	0.1019	0.3223	0.1549	0.0834	0.2637	0.1267	0.0824	0.4382	0.1387	0.1032	0.5492	0.1738	0.1037	0.5519	0.1746	0.0903	0.4802	0.1519
6.0625	8.0	4592	0.3526	0.6310	0.5456	0.5852	0.7567	0.6543	0.7018	0.7304	0.6316	0.6774	0.6551	0.5664	0.6075	0.0559	0.7698	0.1042	0.0571	0.7866	0.1065	0.0605	0.8339	0.1129	0.0597	0.8226	0.1114	0.0950	0.6164	0.1646	0.1149	0.7454	0.1990	0.1055	0.6844	0.1827	0.0951	0.6172	0.1648	0.0612	0.3947	0.1060	0.0810	0.5219	0.1402	0.0812	0.5231	0.1406	0.0682	0.4394	0.1181	0.1424	0.7826	0.2409	0.1510	0.8298	0.2555	0.1543	0.8483	0.2611	0.1488	0.8180	0.2518	0.0013	0.0296	0.0026	0.0269	0.5979	0.0515	0.0172	0.3813	0.0329	0.0015	0.0335	0.0029	0.0864	0.3905	0.1415	0.1406	0.6355	0.2303	0.1165	0.5267	0.1908	0.0876	0.3960	0.1435	0.1069	0.7826	0.1881	0.1164	0.8521	0.2048	0.1117	0.8180	0.1966	0.1070	0.7832	0.1882	0.0018	0.1731	0.0035	0.0056	0.5445	0.0110	0.0037	0.3645	0.0074	0.0018	0.1744	0.0035	0.1615	0.7891	0.2681	0.1719	0.8399	0.2854	0.1710	0.8354	0.2838	0.1645	0.8037	0.2731	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0683	0.7712	0.1256	0.0709	0.7999	0.1303	0.0697	0.7866	0.1281	0.0684	0.7717	0.1257	0.0	0.0	0	0.0162	0.2042	0.0300	0.0177	0.2227	0.0328	0.0000	0.0006	0.0001	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.1159	0.7254	0.1999	0.1159	0.7254	0.1999	0.1201	0.7518	0.2072	0.1201	0.7518	0.2072	0.1415	0.7966	0.2404	0.1488	0.8372	0.2526	0.1487	0.8367	0.2525	0.1442	0.8116	0.2449	0.0	0.0	0	0.0	0.0	0	0.0	0.0	0	0.0	0.0	0	0.0	0.0	0	0.0012	0.5054	0.0024	0.0006	0.2554	0.0012	0.0	0.0	0	0.0178	0.1005	0.0303	0.0727	0.4100	0.1235	0.0469	0.2646	0.0797	0.0180	0.1016	0.0306	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0844	0.4903	0.1439	0.1023	0.5946	0.1746	0.0951	0.5530	0.1624	0.0856	0.4975	0.1461	0.1155	0.5781	0.1926	0.1407	0.7038	0.2345	0.1514	0.7576	0.2524	0.1333	0.6670	0.2222	0.0478	0.2300	0.0792	0.1153	0.5544	0.1909	0.0853	0.4103	0.1413	0.0488	0.2349	0.0809	0.1187	0.5159	0.1930	0.1403	0.6099	0.2282	0.1474	0.6406	0.2396	0.1340	0.5822	0.2178	0.0001	0.0022	0.0001	0.0034	0.1150	0.0066	0.0042	0.1409	0.0081	0.0001	0.0034	0.0002	0.0984	0.6349	0.1704	0.1266	0.8163	0.2191	0.1140	0.7356	0.1975	0.0998	0.6435	0.1728	0.1210	0.6014	0.2015	0.1506	0.7488	0.2508	0.1449	0.7200	0.2412	0.1259	0.6259	0.2097	0.0727	0.7339	0.1324	0.0855	0.8624	0.1555	0.0797	0.8046	0.1451	0.0732	0.7387	0.1332	0.1615	0.7770	0.2674	0.1707	0.8212	0.2826	0.1699	0.8174	0.2813	0.1647	0.7924	0.2727	0.0966	0.5067	0.1623	0.1454	0.7625	0.2442	0.1252	0.6567	0.2104	0.0980	0.5137	0.1646	0.0023	0.0675	0.0045	0.0239	0.7015	0.0462	0.0137	0.4018	0.0265	0.0023	0.0679	0.0045	0.0030	0.3	0.0060	0.0092	0.9114	0.0182	0.0061	0.6057	0.0121	0.0030	0.3	0.0060	0.4396	0.6355	0.5197	0.4410	0.6375	0.5214	0.4413	0.6380	0.5217	0.4398	0.6358	0.5200	0.0597	0.1903	0.0909	0.0813	0.2591	0.1238	0.1010	0.3218	0.1538	0.0827	0.2633	0.1258	0.0818	0.4385	0.1379	0.1026	0.5500	0.1729	0.1031	0.5526	0.1737	0.0896	0.4805	0.1511

Framework versions

• Transformers 4.46.1
• Pytorch 2.3.1
• Datasets 2.20.0
• Tokenizers 0.20.1