Sarah Tariq commited on
Commit
970b2d5
·
verified ·
1 Parent(s): 8065892

End of training

Browse files
README.md CHANGED
@@ -15,33 +15,34 @@ should probably proofread and complete it, then remove this comment. -->
15
 
16
  This model is a fine-tuned version of [google/flan-t5-small](https://huggingface.co/google/flan-t5-small) on an unknown dataset.
17
  It achieves the following results on the evaluation set:
18
- - Loss: 0.4724
19
  - Classification Report: precision recall f1-score support
20
 
21
- ALLERGY 1.0000 0.5000 0.6667 4
22
  ASSESSMENT 0.0000 0.0000 0.0000 4
23
- CC 0.5000 0.7500 0.6000 4
 
24
  DIAGNOSIS 0.0000 0.0000 0.0000 1
25
- DISPOSITION 1.0000 0.5000 0.6667 2
26
  EDCOURSE 0.0000 0.0000 0.0000 3
27
- EXAM 0.3333 1.0000 0.5000 1
28
- FAM/SOCHX 0.8400 0.9545 0.8936 22
29
- GENHX 0.8095 0.8500 0.8293 20
30
  GYNHX 0.0000 0.0000 0.0000 1
31
  IMAGING 0.0000 0.0000 0.0000 1
32
- IMMUNIZATIONS 1.0000 1.0000 1.0000 1
33
  LABS 0.0000 0.0000 0.0000 1
34
- MEDICATIONS 0.7143 0.7143 0.7143 7
35
  OTHER_HISTORY 0.0000 0.0000 0.0000 1
36
- PASTMEDICALHX 0.3636 1.0000 0.5333 4
37
- PASTSURGICAL 0.8889 1.0000 0.9412 8
38
- PLAN 0.6667 0.6667 0.6667 3
39
  PROCEDURES 0.0000 0.0000 0.0000 1
40
- ROS 0.8750 0.6364 0.7368 11
41
 
42
- accuracy 0.7200 100
43
- macro avg 0.4496 0.4786 0.4374 100
44
- weighted avg 0.6919 0.7200 0.6891 100
45
 
46
 
47
  ## Model description
@@ -71,11 +72,11 @@ The following hyperparameters were used during training:
71
 
72
  ### Training results
73
 
74
- | Training Loss | Epoch | Step | Validation Loss | Classification Report |
75
- |:-------------:|:-----:|:----:|:---------------:|:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------:|
76
- | No log | 1.0 | 172 | 0.5916 | precision recall f1-score support
77
 
78
- ALLERGY 0.6667 0.5000 0.5714 4
79
  ASSESSMENT 0.0000 0.0000 0.0000 4
80
  Afib 0.0000 0.0000 0.0000 0
81
  CC 0.0000 0.0000 0.0000 4
@@ -83,538 +84,554 @@ The following hyperparameters were used during training:
83
  DISPOSITION 0.0000 0.0000 0.0000 2
84
  EDCOURSE 0.0000 0.0000 0.0000 3
85
  EXAM 0.0000 0.0000 0.0000 1
86
- FAM/SOCHX 0.7308 0.8636 0.7917 22
87
- GENHX 0.4000 1.0000 0.5714 20
88
  GYNHX 0.0000 0.0000 0.0000 1
 
 
89
  IMAGING 0.0000 0.0000 0.0000 1
90
  IMMUNIZATIONS 0.0000 0.0000 0.0000 1
91
  LABS 0.0000 0.0000 0.0000 1
92
- MEDICATIONS 1.0000 0.1429 0.2500 7
93
  OTHER_HISTORY 0.0000 0.0000 0.0000 1
94
- PASTMEDICALHX 0.0000 0.0000 0.0000 4
95
- PASTSURGICAL 0.4286 0.7500 0.5455 8
96
  PLAN 0.0000 0.0000 0.0000 3
97
  PROCEDURES 0.0000 0.0000 0.0000 1
 
98
  ROS 0.0000 0.0000 0.0000 11
 
99
 
100
- accuracy 0.4800 100
101
- macro avg 0.1536 0.1551 0.1300 100
102
- weighted avg 0.3717 0.4800 0.3724 100
103
- |
104
- | No log | 2.0 | 344 | 0.3963 | precision recall f1-score support
105
-
106
- ALLERGY 1.0000 0.2500 0.4000 4
107
- ASSESSMENT 1.0000 0.2500 0.4000 4
108
- CC 0.1667 0.5000 0.2500 4
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
109
  DIAGNOSIS 0.0000 0.0000 0.0000 1
110
  DISPOSITION 0.0000 0.0000 0.0000 2
111
  EDCOURSE 0.0000 0.0000 0.0000 3
112
  EXAM 0.0000 0.0000 0.0000 1
113
- FAM/SOCHX 0.8077 0.9545 0.8750 22
114
- GENHX 0.7200 0.9000 0.8000 20
115
  GYNHX 0.0000 0.0000 0.0000 1
116
  IMAGING 0.0000 0.0000 0.0000 1
117
  IMMUNIZATIONS 0.0000 0.0000 0.0000 1
118
  LABS 0.0000 0.0000 0.0000 1
119
- MEDICATIONS 0.5556 0.7143 0.6250 7
120
  OTHER_HISTORY 0.0000 0.0000 0.0000 1
121
- PASTMEDICALHX 0.2000 0.7500 0.3158 4
122
- PASTSURGICAL 1.0000 1.0000 1.0000 8
123
  PLAN 0.0000 0.0000 0.0000 3
124
  PROCEDURES 0.0000 0.0000 0.0000 1
125
- ROS 0.6667 0.1818 0.2857 11
126
-
127
- accuracy 0.6100 100
128
- macro avg 0.3058 0.2750 0.2476 100
129
- weighted avg 0.6086 0.6100 0.5623 100
130
- |
131
- | 0.6305 | 3.0 | 516 | 0.3808 | precision recall f1-score support
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
132
 
133
- ALLERGY 1.0000 0.2500 0.4000 4
134
  ASSESSMENT 0.0000 0.0000 0.0000 4
135
- CC 0.3333 0.7500 0.4615 4
136
  DIAGNOSIS 0.0000 0.0000 0.0000 1
137
  DISPOSITION 0.0000 0.0000 0.0000 2
138
  EDCOURSE 0.0000 0.0000 0.0000 3
139
- EXAM 1.0000 1.0000 1.0000 1
140
- FAM/SOCHX 0.7857 1.0000 0.8800 22
141
- GENHX 0.7826 0.9000 0.8372 20
142
  GYNHX 0.0000 0.0000 0.0000 1
143
  IMAGING 0.0000 0.0000 0.0000 1
144
  IMMUNIZATIONS 0.0000 0.0000 0.0000 1
145
  LABS 0.0000 0.0000 0.0000 1
146
- MEDICATIONS 0.5556 0.7143 0.6250 7
147
  OTHER_HISTORY 0.0000 0.0000 0.0000 1
148
- PASTMEDICALHX 0.4000 1.0000 0.5714 4
149
- PASTSURGICAL 0.8889 1.0000 0.9412 8
150
  PLAN 0.0000 0.0000 0.0000 3
151
  PROCEDURES 0.0000 0.0000 0.0000 1
152
- ROS 0.8000 0.3636 0.5000 11
153
 
154
- accuracy 0.6600 100
155
- macro avg 0.3273 0.3489 0.3108 100
156
- weighted avg 0.6067 0.6600 0.6024 100
157
- |
158
- | 0.6305 | 4.0 | 688 | 0.3441 | precision recall f1-score support
159
 
160
  ALLERGY 1.0000 0.2500 0.4000 4
161
  ASSESSMENT 0.0000 0.0000 0.0000 4
162
- CC 0.2727 0.7500 0.4000 4
163
  DIAGNOSIS 0.0000 0.0000 0.0000 1
164
  DISPOSITION 0.0000 0.0000 0.0000 2
165
  EDCOURSE 0.0000 0.0000 0.0000 3
166
  EXAM 0.5000 1.0000 0.6667 1
167
- FAM/SOCHX 0.8400 0.9545 0.8936 22
168
- GENHX 0.8182 0.9000 0.8571 20
169
  GYNHX 0.0000 0.0000 0.0000 1
170
  IMAGING 0.0000 0.0000 0.0000 1
171
  IMMUNIZATIONS 0.0000 0.0000 0.0000 1
172
  LABS 0.0000 0.0000 0.0000 1
173
- MEDICATIONS 0.6250 0.7143 0.6667 7
174
  OTHER_HISTORY 0.0000 0.0000 0.0000 1
175
- PASTMEDICALHX 0.3333 1.0000 0.5000 4
176
- PASTSURGICAL 0.8000 1.0000 0.8889 8
177
  PLAN 0.0000 0.0000 0.0000 3
178
  PROCEDURES 0.0000 0.0000 0.0000 1
179
- ROS 0.8750 0.6364 0.7368 11
180
 
181
- accuracy 0.6800 100
182
- macro avg 0.3032 0.3603 0.3005 100
183
- weighted avg 0.6217 0.6800 0.6255 100
184
- |
185
- | 0.6305 | 5.0 | 860 | 0.3423 | precision recall f1-score support
186
 
187
- ALLERGY 1.0000 0.5000 0.6667 4
188
  ASSESSMENT 0.0000 0.0000 0.0000 4
189
- CC 0.7500 0.7500 0.7500 4
 
190
  DIAGNOSIS 0.0000 0.0000 0.0000 1
191
- DISPOSITION 0.1667 0.5000 0.2500 2
192
  EDCOURSE 0.0000 0.0000 0.0000 3
193
  EXAM 0.5000 1.0000 0.6667 1
194
- FAM/SOCHX 0.8462 1.0000 0.9167 22
195
- GENHX 0.8095 0.8500 0.8293 20
196
  GYNHX 0.0000 0.0000 0.0000 1
197
  IMAGING 0.0000 0.0000 0.0000 1
198
  IMMUNIZATIONS 0.0000 0.0000 0.0000 1
199
  LABS 0.0000 0.0000 0.0000 1
200
- MEDICATIONS 0.6250 0.7143 0.6667 7
201
  OTHER_HISTORY 0.0000 0.0000 0.0000 1
202
- PASTMEDICALHX 0.3077 1.0000 0.4706 4
203
- PASTSURGICAL 1.0000 1.0000 1.0000 8
204
  PLAN 0.0000 0.0000 0.0000 3
205
  PROCEDURES 0.0000 0.0000 0.0000 1
206
- ROS 0.8750 0.6364 0.7368 11
207
 
208
- accuracy 0.7000 100
209
- macro avg 0.3440 0.3975 0.3477 100
210
- weighted avg 0.6587 0.7000 0.6624 100
211
- |
212
- | 0.1584 | 6.0 | 1032 | 0.3373 | precision recall f1-score support
213
 
214
  ALLERGY 1.0000 0.2500 0.4000 4
215
  ASSESSMENT 0.0000 0.0000 0.0000 4
216
- CC 0.5000 0.7500 0.6000 4
 
217
  DIAGNOSIS 0.0000 0.0000 0.0000 1
218
  DISPOSITION 0.0000 0.0000 0.0000 2
219
  EDCOURSE 0.0000 0.0000 0.0000 3
220
- EXAM 0.3333 1.0000 0.5000 1
221
- FAM/SOCHX 0.8400 0.9545 0.8936 22
222
- GENHX 0.8889 0.8000 0.8421 20
223
  GYNHX 0.0000 0.0000 0.0000 1
224
  IMAGING 0.0000 0.0000 0.0000 1
225
- IMMUNIZATIONS 1.0000 1.0000 1.0000 1
226
  LABS 0.0000 0.0000 0.0000 1
227
- MEDICATIONS 0.6250 0.7143 0.6667 7
228
  OTHER_HISTORY 0.0000 0.0000 0.0000 1
229
- PASTMEDICALHX 0.3333 1.0000 0.5000 4
230
  PASTSURGICAL 0.8000 1.0000 0.8889 8
231
  PLAN 0.0000 0.0000 0.0000 3
232
  PROCEDURES 0.0000 0.0000 0.0000 1
233
- ROS 0.8889 0.7273 0.8000 11
234
 
235
- accuracy 0.6800 100
236
- macro avg 0.3605 0.4098 0.3546 100
237
- weighted avg 0.6548 0.6800 0.6458 100
238
- |
239
- | 0.1584 | 7.0 | 1204 | 0.3611 | precision recall f1-score support
240
 
241
- ALLERGY 1.0000 0.5000 0.6667 4
242
  ASSESSMENT 0.0000 0.0000 0.0000 4
243
- CC 0.3750 0.7500 0.5000 4
244
- DIAGNOSIS 0.0000 0.0000 0.0000 1
245
- DISPOSITION 0.0000 0.0000 0.0000 2
246
- EDCOURSE 0.0000 0.0000 0.0000 3
247
- EXAM 0.2500 1.0000 0.4000 1
248
- FAM/SOCHX 0.8400 0.9545 0.8936 22
249
- GENHX 0.8889 0.8000 0.8421 20
250
- GYNHX 0.0000 0.0000 0.0000 1
251
- IMAGING 0.0000 0.0000 0.0000 1
252
- IMMUNIZATIONS 1.0000 1.0000 1.0000 1
253
- LABS 0.0000 0.0000 0.0000 1
254
- MEDICATIONS 0.6250 0.7143 0.6667 7
255
- OTHER_HISTORY 0.0000 0.0000 0.0000 1
256
- PASTMEDICALHX 0.3333 1.0000 0.5000 4
257
- PASTSURGICAL 0.8889 1.0000 0.9412 8
258
- PLAN 1.0000 0.3333 0.5000 3
259
- PROCEDURES 0.0000 0.0000 0.0000 1
260
- ROS 0.8889 0.7273 0.8000 11
261
-
262
- accuracy 0.7000 100
263
- macro avg 0.4045 0.4390 0.3855 100
264
- weighted avg 0.6860 0.7000 0.6706 100
265
- |
266
- | 0.1584 | 8.0 | 1376 | 0.3677 | precision recall f1-score support
267
-
268
- ALLERGY 1.0000 0.5000 0.6667 4
269
- ASSESSMENT 1.0000 0.2500 0.4000 4
270
- CC 0.5000 0.7500 0.6000 4
271
  DIAGNOSIS 0.0000 0.0000 0.0000 1
272
  DISPOSITION 0.0000 0.0000 0.0000 2
273
  EDCOURSE 0.0000 0.0000 0.0000 3
274
- EXAM 0.2000 1.0000 0.3333 1
275
- FAM/SOCHX 0.9130 0.9545 0.9333 22
276
- GENHX 0.7391 0.8500 0.7907 20
277
  GYNHX 0.0000 0.0000 0.0000 1
278
  IMAGING 0.0000 0.0000 0.0000 1
279
- IMMUNIZATIONS 1.0000 1.0000 1.0000 1
280
  LABS 0.0000 0.0000 0.0000 1
281
- MEDICATIONS 0.8333 0.7143 0.7692 7
282
  OTHER_HISTORY 0.0000 0.0000 0.0000 1
283
- PASTMEDICALHX 0.4000 1.0000 0.5714 4
284
  PASTSURGICAL 0.7273 1.0000 0.8421 8
285
- PLAN 0.5000 0.3333 0.4000 3
286
  PROCEDURES 0.0000 0.0000 0.0000 1
287
- ROS 0.8571 0.5455 0.6667 11
288
 
289
- accuracy 0.7000 100
290
- macro avg 0.4335 0.4449 0.3987 100
291
- weighted avg 0.7025 0.7000 0.6729 100
292
- |
293
- | 0.098 | 9.0 | 1548 | 0.3759 | precision recall f1-score support
294
 
295
- ALLERGY 1.0000 0.5000 0.6667 4
296
  ASSESSMENT 0.0000 0.0000 0.0000 4
297
- CC 0.4286 0.7500 0.5455 4
298
  DIAGNOSIS 0.0000 0.0000 0.0000 1
299
  DISPOSITION 0.0000 0.0000 0.0000 2
300
- EDCOURSE 0.3333 0.3333 0.3333 3
301
- EXAM 0.3333 1.0000 0.5000 1
302
- FAM/SOCHX 0.9130 0.9545 0.9333 22
303
- GENHX 0.8421 0.8000 0.8205 20
304
- GYNHX 0.0000 0.0000 0.0000 1
305
- IMAGING 0.0000 0.0000 0.0000 1
306
- IMMUNIZATIONS 1.0000 1.0000 1.0000 1
307
- LABS 0.0000 0.0000 0.0000 1
308
- MEDICATIONS 0.6667 0.8571 0.7500 7
309
- OTHER_HISTORY 0.0000 0.0000 0.0000 1
310
- PASTMEDICALHX 0.5000 1.0000 0.6667 4
311
- PASTSURGICAL 0.8000 1.0000 0.8889 8
312
- PLAN 0.5000 0.3333 0.4000 3
313
- PROCEDURES 0.0000 0.0000 0.0000 1
314
- ROS 0.8889 0.7273 0.8000 11
315
-
316
- accuracy 0.7200 100
317
- macro avg 0.4103 0.4628 0.4152 100
318
- weighted avg 0.6932 0.7200 0.6932 100
319
- |
320
- | 0.098 | 10.0 | 1720 | 0.3918 | precision recall f1-score support
321
-
322
- ALLERGY 1.0000 0.5000 0.6667 4
323
- ASSESSMENT 0.0000 0.0000 0.0000 4
324
- CC 0.5000 0.7500 0.6000 4
325
- DIAGNOSIS 0.0000 0.0000 0.0000 1
326
- DISPOSITION 0.2500 0.5000 0.3333 2
327
  EDCOURSE 0.0000 0.0000 0.0000 3
328
- EXAM 0.3333 1.0000 0.5000 1
329
- FAM/SOCHX 0.8400 0.9545 0.8936 22
330
- GENHX 0.8947 0.8500 0.8718 20
331
  GYNHX 0.0000 0.0000 0.0000 1
332
  IMAGING 0.0000 0.0000 0.0000 1
333
- IMMUNIZATIONS 1.0000 1.0000 1.0000 1
334
  LABS 0.0000 0.0000 0.0000 1
335
  MEDICATIONS 0.5714 0.5714 0.5714 7
336
  OTHER_HISTORY 0.0000 0.0000 0.0000 1
337
- PASTMEDICALHX 0.4000 1.0000 0.5714 4
338
- PASTSURGICAL 1.0000 1.0000 1.0000 8
339
- PLAN 0.5000 0.3333 0.4000 3
340
  PROCEDURES 0.0000 0.0000 0.0000 1
341
- ROS 0.8889 0.7273 0.8000 11
342
 
343
- accuracy 0.7100 100
344
- macro avg 0.4089 0.4593 0.4104 100
345
- weighted avg 0.6909 0.7100 0.6861 100
346
- |
347
- | 0.098 | 11.0 | 1892 | 0.3808 | precision recall f1-score support
348
 
349
- ALLERGY 1.0000 0.5000 0.6667 4
350
  ASSESSMENT 0.0000 0.0000 0.0000 4
351
- CC 0.7500 0.7500 0.7500 4
352
  DIAGNOSIS 0.0000 0.0000 0.0000 1
353
- DISPOSITION 0.2000 0.5000 0.2857 2
354
- EDCOURSE 0.5000 0.3333 0.4000 3
355
  EXAM 0.5000 1.0000 0.6667 1
356
  FAM/SOCHX 0.8800 1.0000 0.9362 22
357
- GENHX 0.8095 0.8500 0.8293 20
358
  GYNHX 0.0000 0.0000 0.0000 1
359
  IMAGING 0.0000 0.0000 0.0000 1
360
- IMMUNIZATIONS 1.0000 1.0000 1.0000 1
361
  LABS 0.0000 0.0000 0.0000 1
362
- MEDICATIONS 0.7500 0.8571 0.8000 7
363
  OTHER_HISTORY 0.0000 0.0000 0.0000 1
364
- PASTMEDICALHX 0.4000 1.0000 0.5714 4
365
- PASTSURGICAL 1.0000 1.0000 1.0000 8
366
- PLAN 0.5000 0.3333 0.4000 3
367
  PROCEDURES 0.0000 0.0000 0.0000 1
368
- ROS 0.8000 0.7273 0.7619 11
369
 
370
- accuracy 0.7500 100
371
- macro avg 0.4545 0.4926 0.4534 100
372
- weighted avg 0.7110 0.7500 0.7175 100
373
- |
374
- | 0.0648 | 12.0 | 2064 | 0.3998 | precision recall f1-score support
375
 
376
  ALLERGY 1.0000 0.5000 0.6667 4
377
  ASSESSMENT 0.0000 0.0000 0.0000 4
378
- CC 0.4286 0.7500 0.5455 4
 
379
  DIAGNOSIS 0.0000 0.0000 0.0000 1
380
- DISPOSITION 0.3333 0.5000 0.4000 2
381
- EDCOURSE 0.5000 0.3333 0.4000 3
382
- EDITION 0.0000 0.0000 0.0000 0
383
  EXAM 0.5000 1.0000 0.6667 1
384
- FAM/SOCHX 0.9130 0.9545 0.9333 22
385
- GENHX 0.8947 0.8500 0.8718 20
386
  GYNHX 0.0000 0.0000 0.0000 1
387
  IMAGING 0.0000 0.0000 0.0000 1
388
- IMMUNIZATIONS 1.0000 1.0000 1.0000 1
389
  LABS 0.0000 0.0000 0.0000 1
390
- MEDICATIONS 0.7143 0.7143 0.7143 7
391
  OTHER_HISTORY 0.0000 0.0000 0.0000 1
392
- PASTMEDICALHX 0.3636 1.0000 0.5333 4
393
- PASTSURGICAL 1.0000 1.0000 1.0000 8
394
- PLAN 0.6667 0.6667 0.6667 3
395
  PROCEDURES 0.0000 0.0000 0.0000 1
396
- ROS 0.8000 0.7273 0.7619 11
397
 
398
- accuracy 0.7400 100
399
- macro avg 0.4340 0.4760 0.4362 100
400
- weighted avg 0.7262 0.7400 0.7200 100
401
- |
402
- | 0.0648 | 13.0 | 2236 | 0.4352 | precision recall f1-score support
403
 
404
- ALLERGY 1.0000 0.5000 0.6667 4
405
  ASSESSMENT 0.0000 0.0000 0.0000 4
406
- CC 0.6000 0.7500 0.6667 4
407
  DIAGNOSIS 0.0000 0.0000 0.0000 1
408
- DISPOSITION 1.0000 0.5000 0.6667 2
409
  EDCOURSE 0.0000 0.0000 0.0000 3
410
  EXAM 0.5000 1.0000 0.6667 1
411
- FAM/SOCHX 0.8750 0.9545 0.9130 22
412
- GENHX 0.7391 0.8500 0.7907 20
413
  GYNHX 0.0000 0.0000 0.0000 1
414
  IMAGING 0.0000 0.0000 0.0000 1
415
- IMMUNIZATIONS 1.0000 1.0000 1.0000 1
416
  LABS 0.0000 0.0000 0.0000 1
417
  MEDICATIONS 0.7143 0.7143 0.7143 7
418
  OTHER_HISTORY 0.0000 0.0000 0.0000 1
419
- PASTMEDICALHX 0.3636 1.0000 0.5333 4
420
- PASTSURGICAL 0.8889 1.0000 0.9412 8
421
  PLAN 0.5000 0.3333 0.4000 3
422
  PROCEDURES 0.0000 0.0000 0.0000 1
423
- ROS 0.8750 0.6364 0.7368 11
424
 
425
- accuracy 0.7100 100
426
- macro avg 0.4528 0.4619 0.4348 100
427
- weighted avg 0.6862 0.7100 0.6820 100
428
- |
429
- | 0.0648 | 14.0 | 2408 | 0.4611 | precision recall f1-score support
430
 
431
- ALLERGY 1.0000 0.5000 0.6667 4
432
  ASSESSMENT 0.0000 0.0000 0.0000 4
433
- CC 0.4286 0.7500 0.5455 4
434
  DIAGNOSIS 0.0000 0.0000 0.0000 1
435
- DISPOSITION 0.5000 0.5000 0.5000 2
436
  EDCOURSE 0.0000 0.0000 0.0000 3
437
  EXAM 0.5000 1.0000 0.6667 1
438
- FAM/SOCHX 0.8400 0.9545 0.8936 22
439
- GENHX 0.8947 0.8500 0.8718 20
440
  GYNHX 0.0000 0.0000 0.0000 1
441
  IMAGING 0.0000 0.0000 0.0000 1
442
- IMMUNIZATIONS 1.0000 1.0000 1.0000 1
443
  LABS 0.0000 0.0000 0.0000 1
444
  MEDICATIONS 0.7143 0.7143 0.7143 7
445
  OTHER_HISTORY 0.0000 0.0000 0.0000 1
446
- PASTMEDICALHX 0.3636 1.0000 0.5333 4
447
- PASTSURGICAL 0.8889 1.0000 0.9412 8
448
- PLAN 0.6667 0.6667 0.6667 3
449
  PROCEDURES 0.0000 0.0000 0.0000 1
450
- ROS 0.8750 0.6364 0.7368 11
451
 
452
- accuracy 0.7200 100
453
- macro avg 0.4336 0.4786 0.4368 100
454
- weighted avg 0.6978 0.7200 0.6938 100
455
- |
456
- | 0.0475 | 15.0 | 2580 | 0.4470 | precision recall f1-score support
457
 
458
- ALLERGY 1.0000 0.5000 0.6667 4
459
  ASSESSMENT 0.0000 0.0000 0.0000 4
460
- CC 0.5000 0.7500 0.6000 4
461
  DIAGNOSIS 0.0000 0.0000 0.0000 1
462
- DISPOSITION 1.0000 0.5000 0.6667 2
463
  EDCOURSE 0.0000 0.0000 0.0000 3
464
- EXAM 0.3333 1.0000 0.5000 1
465
- FAM/SOCHX 0.8750 0.9545 0.9130 22
466
- GENHX 0.7727 0.8500 0.8095 20
467
  GYNHX 0.0000 0.0000 0.0000 1
468
  IMAGING 0.0000 0.0000 0.0000 1
469
- IMMUNIZATIONS 1.0000 1.0000 1.0000 1
470
  LABS 0.0000 0.0000 0.0000 1
471
- MEDICATIONS 0.7143 0.7143 0.7143 7
472
  OTHER_HISTORY 0.0000 0.0000 0.0000 1
473
- PASTMEDICALHX 0.4444 1.0000 0.6154 4
474
- PASTSURGICAL 0.8889 1.0000 0.9412 8
475
- PLAN 0.5000 0.6667 0.5714 3
476
  PROCEDURES 0.0000 0.0000 0.0000 1
477
- ROS 0.8750 0.6364 0.7368 11
478
 
479
- accuracy 0.7200 100
480
- macro avg 0.4452 0.4786 0.4368 100
481
- weighted avg 0.6905 0.7200 0.6899 100
482
- |
483
- | 0.0475 | 16.0 | 2752 | 0.4607 | precision recall f1-score support
484
 
485
- ALLERGY 1.0000 0.5000 0.6667 4
486
  ASSESSMENT 0.0000 0.0000 0.0000 4
487
- CC 0.4286 0.7500 0.5455 4
 
488
  DIAGNOSIS 0.0000 0.0000 0.0000 1
489
- DISPOSITION 1.0000 0.5000 0.6667 2
490
  EDCOURSE 0.0000 0.0000 0.0000 3
491
- EXAM 0.3333 1.0000 0.5000 1
492
  FAM/SOCHX 0.8462 1.0000 0.9167 22
493
- GENHX 0.8500 0.8500 0.8500 20
494
  GYNHX 0.0000 0.0000 0.0000 1
495
  IMAGING 0.0000 0.0000 0.0000 1
496
- IMMUNIZATIONS 1.0000 1.0000 1.0000 1
497
  LABS 0.0000 0.0000 0.0000 1
498
- MEDICATIONS 0.7143 0.7143 0.7143 7
499
  OTHER_HISTORY 0.0000 0.0000 0.0000 1
500
- PASTMEDICALHX 0.4000 1.0000 0.5714 4
501
- PASTSURGICAL 0.8889 1.0000 0.9412 8
502
- PLAN 0.6667 0.6667 0.6667 3
503
  PROCEDURES 0.0000 0.0000 0.0000 1
504
- ROS 0.8750 0.6364 0.7368 11
505
 
506
- accuracy 0.7300 100
507
- macro avg 0.4501 0.4809 0.4388 100
508
- weighted avg 0.7000 0.7300 0.6977 100
509
- |
510
- | 0.0475 | 17.0 | 2924 | 0.4592 | precision recall f1-score support
511
 
512
- ALLERGY 1.0000 0.5000 0.6667 4
513
  ASSESSMENT 0.0000 0.0000 0.0000 4
514
- CC 0.3750 0.7500 0.5000 4
 
515
  DIAGNOSIS 0.0000 0.0000 0.0000 1
516
- DISPOSITION 0.5000 0.5000 0.5000 2
517
  EDCOURSE 0.0000 0.0000 0.0000 3
518
  EXAM 0.5000 1.0000 0.6667 1
519
- FAM/SOCHX 0.8400 0.9545 0.8936 22
520
- GENHX 0.9444 0.8500 0.8947 20
521
  GYNHX 0.0000 0.0000 0.0000 1
522
  IMAGING 0.0000 0.0000 0.0000 1
523
- IMMUNIZATIONS 1.0000 1.0000 1.0000 1
524
  LABS 0.0000 0.0000 0.0000 1
525
- MEDICATIONS 0.7143 0.7143 0.7143 7
526
  OTHER_HISTORY 0.0000 0.0000 0.0000 1
527
  PASTMEDICALHX 0.4444 1.0000 0.6154 4
528
- PASTSURGICAL 0.8889 1.0000 0.9412 8
529
- PLAN 0.7500 1.0000 0.8571 3
530
- PROCEDURES 0.0000 0.0000 0.0000 1
531
- ROS 0.8750 0.6364 0.7368 11
532
-
533
- accuracy 0.7300 100
534
- macro avg 0.4416 0.4953 0.4493 100
535
- weighted avg 0.7113 0.7300 0.7056 100
536
- |
537
- | 0.0323 | 18.0 | 3096 | 0.4671 | precision recall f1-score support
538
-
539
- ALLERGY 1.0000 0.5000 0.6667 4
540
- ASSESSMENT 0.0000 0.0000 0.0000 4
541
- CC 0.4286 0.7500 0.5455 4
542
- DIAGNOSIS 0.0000 0.0000 0.0000 1
543
- DISPOSITION 0.5000 0.5000 0.5000 2
544
- EDCOURSE 0.0000 0.0000 0.0000 3
545
- EXAM 0.3333 1.0000 0.5000 1
546
- FAM/SOCHX 0.8400 0.9545 0.8936 22
547
- GENHX 0.8947 0.8500 0.8718 20
548
- GYNHX 0.0000 0.0000 0.0000 1
549
- IMAGING 0.0000 0.0000 0.0000 1
550
- IMMUNIZATIONS 1.0000 1.0000 1.0000 1
551
- LABS 0.0000 0.0000 0.0000 1
552
- MEDICATIONS 0.7143 0.7143 0.7143 7
553
- OTHER_HISTORY 0.0000 0.0000 0.0000 1
554
- PASTMEDICALHX 0.4000 1.0000 0.5714 4
555
- PASTSURGICAL 0.8889 1.0000 0.9412 8
556
- PLAN 0.7500 1.0000 0.8571 3
557
- PROCEDURES 0.0000 0.0000 0.0000 1
558
- ROS 0.8750 0.6364 0.7368 11
559
-
560
- accuracy 0.7300 100
561
- macro avg 0.4312 0.4953 0.4399 100
562
- weighted avg 0.7001 0.7300 0.6994 100
563
- |
564
- | 0.0323 | 19.0 | 3268 | 0.4689 | precision recall f1-score support
565
-
566
- ALLERGY 1.0000 0.5000 0.6667 4
567
- ASSESSMENT 0.0000 0.0000 0.0000 4
568
- CC 0.5000 0.7500 0.6000 4
569
- DIAGNOSIS 0.0000 0.0000 0.0000 1
570
- DISPOSITION 1.0000 0.5000 0.6667 2
571
- EDCOURSE 0.0000 0.0000 0.0000 3
572
- EXAM 0.3333 1.0000 0.5000 1
573
- FAM/SOCHX 0.8400 0.9545 0.8936 22
574
- GENHX 0.8095 0.8500 0.8293 20
575
- GYNHX 0.0000 0.0000 0.0000 1
576
- IMAGING 0.0000 0.0000 0.0000 1
577
- IMMUNIZATIONS 1.0000 1.0000 1.0000 1
578
- LABS 0.0000 0.0000 0.0000 1
579
- MEDICATIONS 0.6250 0.7143 0.6667 7
580
- OTHER_HISTORY 0.0000 0.0000 0.0000 1
581
- PASTMEDICALHX 0.4000 1.0000 0.5714 4
582
- PASTSURGICAL 0.8889 1.0000 0.9412 8
583
- PLAN 0.6667 0.6667 0.6667 3
584
  PROCEDURES 0.0000 0.0000 0.0000 1
585
- ROS 0.8750 0.6364 0.7368 11
586
 
587
- accuracy 0.7200 100
588
- macro avg 0.4469 0.4786 0.4369 100
589
- weighted avg 0.6871 0.7200 0.6873 100
590
- |
591
- | 0.0323 | 20.0 | 3440 | 0.4724 | precision recall f1-score support
592
 
593
- ALLERGY 1.0000 0.5000 0.6667 4
594
  ASSESSMENT 0.0000 0.0000 0.0000 4
595
- CC 0.5000 0.7500 0.6000 4
 
596
  DIAGNOSIS 0.0000 0.0000 0.0000 1
597
- DISPOSITION 1.0000 0.5000 0.6667 2
598
  EDCOURSE 0.0000 0.0000 0.0000 3
599
- EXAM 0.3333 1.0000 0.5000 1
600
- FAM/SOCHX 0.8400 0.9545 0.8936 22
601
- GENHX 0.8095 0.8500 0.8293 20
602
  GYNHX 0.0000 0.0000 0.0000 1
603
  IMAGING 0.0000 0.0000 0.0000 1
604
- IMMUNIZATIONS 1.0000 1.0000 1.0000 1
605
  LABS 0.0000 0.0000 0.0000 1
606
- MEDICATIONS 0.7143 0.7143 0.7143 7
607
  OTHER_HISTORY 0.0000 0.0000 0.0000 1
608
- PASTMEDICALHX 0.3636 1.0000 0.5333 4
609
- PASTSURGICAL 0.8889 1.0000 0.9412 8
610
- PLAN 0.6667 0.6667 0.6667 3
611
  PROCEDURES 0.0000 0.0000 0.0000 1
612
- ROS 0.8750 0.6364 0.7368 11
613
 
614
- accuracy 0.7200 100
615
- macro avg 0.4496 0.4786 0.4374 100
616
- weighted avg 0.6919 0.7200 0.6891 100
617
- |
618
 
619
 
620
  ### Framework versions
 
15
 
16
  This model is a fine-tuned version of [google/flan-t5-small](https://huggingface.co/google/flan-t5-small) on an unknown dataset.
17
  It achieves the following results on the evaluation set:
18
+ - Loss: 0.5317
19
  - Classification Report: precision recall f1-score support
20
 
21
+ ALLERGY 0.6667 0.5000 0.5714 4
22
  ASSESSMENT 0.0000 0.0000 0.0000 4
23
+ Afib 0.0000 0.0000 0.0000 0
24
+ CC 0.0000 0.0000 0.0000 4
25
  DIAGNOSIS 0.0000 0.0000 0.0000 1
26
+ DISPOSITION 0.0000 0.0000 0.0000 2
27
  EDCOURSE 0.0000 0.0000 0.0000 3
28
+ EXAM 0.5000 1.0000 0.6667 1
29
+ FAM/SOCHX 0.8462 1.0000 0.9167 22
30
+ GENHX 0.7917 0.9500 0.8636 20
31
  GYNHX 0.0000 0.0000 0.0000 1
32
  IMAGING 0.0000 0.0000 0.0000 1
33
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
34
  LABS 0.0000 0.0000 0.0000 1
35
+ MEDICATIONS 0.8333 0.7143 0.7692 7
36
  OTHER_HISTORY 0.0000 0.0000 0.0000 1
37
+ PASTMEDICALHX 0.4444 1.0000 0.6154 4
38
+ PASTSURGICAL 0.7273 1.0000 0.8421 8
39
+ PLAN 0.0000 0.0000 0.0000 3
40
  PROCEDURES 0.0000 0.0000 0.0000 1
41
+ ROS 0.7500 0.2727 0.4000 11
42
 
43
+ accuracy 0.6400 100
44
+ macro avg 0.2647 0.3065 0.2688 100
45
+ weighted avg 0.5929 0.6400 0.5937 100
46
 
47
 
48
  ## Model description
 
72
 
73
  ### Training results
74
 
75
+ | Training Loss | Epoch | Step | Validation Loss | Classification Report |
76
+ |:-------------:|:-----:|:----:|:---------------:|:--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------:|
77
+ | No log | 1.0 | 172 | 0.7096 | precision recall f1-score support
78
 
79
+ ALLERGY 0.3333 0.2500 0.2857 4
80
  ASSESSMENT 0.0000 0.0000 0.0000 4
81
  Afib 0.0000 0.0000 0.0000 0
82
  CC 0.0000 0.0000 0.0000 4
 
84
  DISPOSITION 0.0000 0.0000 0.0000 2
85
  EDCOURSE 0.0000 0.0000 0.0000 3
86
  EXAM 0.0000 0.0000 0.0000 1
87
+ FAM/SOCHX 0.7222 0.5909 0.6500 22
88
+ GENHX 0.3846 1.0000 0.5556 20
89
  GYNHX 0.0000 0.0000 0.0000 1
90
+ I T 0.0000 0.0000 0.0000 0
91
+ I V 0.0000 0.0000 0.0000 0
92
  IMAGING 0.0000 0.0000 0.0000 1
93
  IMMUNIZATIONS 0.0000 0.0000 0.0000 1
94
  LABS 0.0000 0.0000 0.0000 1
95
+ MEDICATIONS 0.4444 0.5714 0.5000 7
96
  OTHER_HISTORY 0.0000 0.0000 0.0000 1
97
+ PASTMEDICALHX 0.2000 0.2500 0.2222 4
98
+ PASTSURGICAL 0.8000 0.5000 0.6154 8
99
  PLAN 0.0000 0.0000 0.0000 3
100
  PROCEDURES 0.0000 0.0000 0.0000 1
101
+ Psychiatric 0.0000 0.0000 0.0000 0
102
  ROS 0.0000 0.0000 0.0000 11
103
+ SPECIALHX 0.0000 0.0000 0.0000 0
104
 
105
+ accuracy 0.4300 100
106
+ macro avg 0.1154 0.1265 0.1132 100
107
+ weighted avg 0.3523 0.4300 0.3587 100
108
+ |
109
+ | No log | 2.0 | 344 | 0.5308 | precision recall f1-score support
110
+
111
+ ALLERGY 0.5000 0.2500 0.3333 4
112
+ ASSESSMENT 0.0000 0.0000 0.0000 4
113
+ Afib 0.0000 0.0000 0.0000 0
114
+ CC 0.0000 0.0000 0.0000 4
115
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
116
+ DISPOSITION 0.0909 0.5000 0.1538 2
117
+ EDCOURSE 0.0000 0.0000 0.0000 3
118
+ EXAM 0.0000 0.0000 0.0000 1
119
+ FAM/SOCHX 0.8750 0.9545 0.9130 22
120
+ GENHX 0.6129 0.9500 0.7451 20
121
+ GYNHX 0.0000 0.0000 0.0000 1
122
+ How are you feeling? 0.0000 0.0000 0.0000 0
123
+ IMAGING 0.0000 0.0000 0.0000 1
124
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
125
+ LABS 0.0000 0.0000 0.0000 1
126
+ MEDICATIONS 0.6250 0.7143 0.6667 7
127
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
128
+ PASTMEDICALHX 0.2727 0.7500 0.4000 4
129
+ PASTSURGICAL 0.7273 1.0000 0.8421 8
130
+ PLAN 0.0000 0.0000 0.0000 3
131
+ PROCEDURES 0.0000 0.0000 0.0000 1
132
+ ROS 0.0000 0.0000 0.0000 11
133
+
134
+ accuracy 0.5800 100
135
+ macro avg 0.1684 0.2327 0.1843 100
136
+ weighted avg 0.4497 0.5800 0.4963 100
137
+ |
138
+ | 0.6083 | 3.0 | 516 | 0.5336 | precision recall f1-score support
139
+
140
+ ALLERGY 0.5000 0.2500 0.3333 4
141
+ ASSESSMENT 0.0000 0.0000 0.0000 4
142
+ CC 0.0000 0.0000 0.0000 4
143
  DIAGNOSIS 0.0000 0.0000 0.0000 1
144
  DISPOSITION 0.0000 0.0000 0.0000 2
145
  EDCOURSE 0.0000 0.0000 0.0000 3
146
  EXAM 0.0000 0.0000 0.0000 1
147
+ FAM/SOCHX 0.8462 1.0000 0.9167 22
148
+ GENHX 0.7600 0.9500 0.8444 20
149
  GYNHX 0.0000 0.0000 0.0000 1
150
  IMAGING 0.0000 0.0000 0.0000 1
151
  IMMUNIZATIONS 0.0000 0.0000 0.0000 1
152
  LABS 0.0000 0.0000 0.0000 1
153
+ MEDICATIONS 0.5714 0.5714 0.5714 7
154
  OTHER_HISTORY 0.0000 0.0000 0.0000 1
155
+ PASTMEDICALHX 0.3636 1.0000 0.5333 4
156
+ PASTSURGICAL 0.8000 1.0000 0.8889 8
157
  PLAN 0.0000 0.0000 0.0000 3
158
  PROCEDURES 0.0000 0.0000 0.0000 1
159
+ ROS 1.0000 0.0909 0.1667 11
160
+
161
+ accuracy 0.5900 100
162
+ macro avg 0.2421 0.2431 0.2127 100
163
+ weighted avg 0.5867 0.5900 0.5347 100
164
+ |
165
+ | 0.6083 | 4.0 | 688 | 0.5260 | precision recall f1-score support
166
+
167
+ ALLERGY 1.0000 0.2500 0.4000 4
168
+ ASSESSMENT 0.0000 0.0000 0.0000 4
169
+ CC 0.0000 0.0000 0.0000 4
170
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
171
+ DISPOSITION 0.0000 0.0000 0.0000 2
172
+ EDCOURSE 0.0000 0.0000 0.0000 3
173
+ EXAM 0.0000 0.0000 0.0000 1
174
+ FAM/SOCHX 0.8148 1.0000 0.8980 22
175
+ GENHX 0.6552 0.9500 0.7755 20
176
+ GYNHX 0.0000 0.0000 0.0000 1
177
+ IMAGING 0.0000 0.0000 0.0000 1
178
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
179
+ LABS 0.0000 0.0000 0.0000 1
180
+ MEDICATIONS 0.5714 0.5714 0.5714 7
181
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
182
+ PASTMEDICALHX 0.3636 1.0000 0.5333 4
183
+ PASTSURGICAL 0.7273 1.0000 0.8421 8
184
+ PLAN 0.0000 0.0000 0.0000 3
185
+ PROCEDURES 0.0000 0.0000 0.0000 1
186
+ ROS 1.0000 0.1818 0.3077 11
187
+ What is the DISPOSITION? 0.0000 0.0000 0.0000 0
188
+
189
+ accuracy 0.6000 100
190
+ macro avg 0.2444 0.2359 0.2061 100
191
+ weighted avg 0.5730 0.6000 0.5312 100
192
+ |
193
+ | 0.6083 | 5.0 | 860 | 0.4168 | precision recall f1-score support
194
+
195
+ ALLERGY 0.6667 0.5000 0.5714 4
196
+ ASSESSMENT 0.0000 0.0000 0.0000 4
197
+ CC 0.0000 0.0000 0.0000 4
198
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
199
+ DISPOSITION 0.0000 0.0000 0.0000 2
200
+ EDCOURSE 0.0000 0.0000 0.0000 3
201
+ EXAM 0.5000 1.0000 0.6667 1
202
+ FAM/SOCHX 0.8800 1.0000 0.9362 22
203
+ GENHX 0.7600 0.9500 0.8444 20
204
+ GYNHX 0.0000 0.0000 0.0000 1
205
+ How are you feeling? 0.0000 0.0000 0.0000 0
206
+ IMAGING 0.0000 0.0000 0.0000 1
207
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
208
+ LABS 0.0000 0.0000 0.0000 1
209
+ MEDICATIONS 0.7143 0.7143 0.7143 7
210
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
211
+ PASTMEDICALHX 0.3000 0.7500 0.4286 4
212
+ PASTSURGICAL 1.0000 1.0000 1.0000 8
213
+ PLAN 0.0000 0.0000 0.0000 3
214
+ PROCEDURES 0.0000 0.0000 0.0000 1
215
+ ROS 0.7500 0.2727 0.4000 11
216
+
217
+ accuracy 0.6300 100
218
+ macro avg 0.2653 0.2946 0.2648 100
219
+ weighted avg 0.6018 0.6300 0.5955 100
220
+ |
221
+ | 0.163 | 6.0 | 1032 | 0.4511 | precision recall f1-score support
222
+
223
+ ALLERGY 1.0000 0.5000 0.6667 4
224
+ ASSESSMENT 0.0000 0.0000 0.0000 4
225
+ Afib 0.0000 0.0000 0.0000 0
226
+ CC 0.0000 0.0000 0.0000 4
227
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
228
+ DISPOSITION 0.0000 0.0000 0.0000 2
229
+ EDCOURSE 0.0000 0.0000 0.0000 3
230
+ EXAM 0.5000 1.0000 0.6667 1
231
+ FAM/SOCHX 0.8800 1.0000 0.9362 22
232
+ GENHX 0.7500 0.9000 0.8182 20
233
+ GYNHX 0.0000 0.0000 0.0000 1
234
+ How are you feeling? 0.0000 0.0000 0.0000 0
235
+ IMAGING 0.0000 0.0000 0.0000 1
236
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
237
+ LABS 0.0000 0.0000 0.0000 1
238
+ MEDICATIONS 0.8000 0.5714 0.6667 7
239
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
240
+ PASTMEDICALHX 0.3333 1.0000 0.5000 4
241
+ PASTSURGICAL 0.6667 1.0000 0.8000 8
242
+ PLAN 0.0000 0.0000 0.0000 3
243
+ PROCEDURES 0.0000 0.0000 0.0000 1
244
+ ROS 1.0000 0.2727 0.4286 11
245
+
246
+ accuracy 0.6200 100
247
+ macro avg 0.2695 0.2838 0.2492 100
248
+ weighted avg 0.6213 0.6200 0.5807 100
249
+ |
250
+ | 0.163 | 7.0 | 1204 | 0.3896 | precision recall f1-score support
251
 
252
+ ALLERGY 0.6667 0.5000 0.5714 4
253
  ASSESSMENT 0.0000 0.0000 0.0000 4
254
+ CC 0.3333 0.2500 0.2857 4
255
  DIAGNOSIS 0.0000 0.0000 0.0000 1
256
  DISPOSITION 0.0000 0.0000 0.0000 2
257
  EDCOURSE 0.0000 0.0000 0.0000 3
258
+ EXAM 0.5000 1.0000 0.6667 1
259
+ FAM/SOCHX 0.8800 1.0000 0.9362 22
260
+ GENHX 0.7200 0.9000 0.8000 20
261
  GYNHX 0.0000 0.0000 0.0000 1
262
  IMAGING 0.0000 0.0000 0.0000 1
263
  IMMUNIZATIONS 0.0000 0.0000 0.0000 1
264
  LABS 0.0000 0.0000 0.0000 1
265
+ MEDICATIONS 0.6667 0.5714 0.6154 7
266
  OTHER_HISTORY 0.0000 0.0000 0.0000 1
267
+ PASTMEDICALHX 0.2857 1.0000 0.4444 4
268
+ PASTSURGICAL 1.0000 1.0000 1.0000 8
269
  PLAN 0.0000 0.0000 0.0000 3
270
  PROCEDURES 0.0000 0.0000 0.0000 1
271
+ ROS 0.7500 0.2727 0.4000 11
272
 
273
+ accuracy 0.6300 100
274
+ macro avg 0.2901 0.3247 0.2860 100
275
+ weighted avg 0.6032 0.6300 0.5918 100
276
+ |
277
+ | 0.163 | 8.0 | 1376 | 0.4200 | precision recall f1-score support
278
 
279
  ALLERGY 1.0000 0.2500 0.4000 4
280
  ASSESSMENT 0.0000 0.0000 0.0000 4
281
+ CC 0.4286 0.7500 0.5455 4
282
  DIAGNOSIS 0.0000 0.0000 0.0000 1
283
  DISPOSITION 0.0000 0.0000 0.0000 2
284
  EDCOURSE 0.0000 0.0000 0.0000 3
285
  EXAM 0.5000 1.0000 0.6667 1
286
+ FAM/SOCHX 0.9167 1.0000 0.9565 22
287
+ GENHX 0.6667 0.9000 0.7660 20
288
  GYNHX 0.0000 0.0000 0.0000 1
289
  IMAGING 0.0000 0.0000 0.0000 1
290
  IMMUNIZATIONS 0.0000 0.0000 0.0000 1
291
  LABS 0.0000 0.0000 0.0000 1
292
+ MEDICATIONS 0.5556 0.7143 0.6250 7
293
  OTHER_HISTORY 0.0000 0.0000 0.0000 1
294
+ PASTMEDICALHX 0.4286 0.7500 0.5455 4
295
+ PASTSURGICAL 1.0000 1.0000 1.0000 8
296
  PLAN 0.0000 0.0000 0.0000 3
297
  PROCEDURES 0.0000 0.0000 0.0000 1
298
+ ROS 0.7500 0.2727 0.4000 11
299
 
300
+ accuracy 0.6400 100
301
+ macro avg 0.3123 0.3319 0.2953 100
302
+ weighted avg 0.6157 0.6400 0.5977 100
303
+ |
304
+ | 0.1057 | 9.0 | 1548 | 0.4642 | precision recall f1-score support
305
 
306
+ ALLERGY 0.6667 0.5000 0.5714 4
307
  ASSESSMENT 0.0000 0.0000 0.0000 4
308
+ Afib 0.0000 0.0000 0.0000 0
309
+ CC 0.2500 0.2500 0.2500 4
310
  DIAGNOSIS 0.0000 0.0000 0.0000 1
311
+ DISPOSITION 0.0000 0.0000 0.0000 2
312
  EDCOURSE 0.0000 0.0000 0.0000 3
313
  EXAM 0.5000 1.0000 0.6667 1
314
+ FAM/SOCHX 0.8800 1.0000 0.9362 22
315
+ GENHX 0.7826 0.9000 0.8372 20
316
  GYNHX 0.0000 0.0000 0.0000 1
317
  IMAGING 0.0000 0.0000 0.0000 1
318
  IMMUNIZATIONS 0.0000 0.0000 0.0000 1
319
  LABS 0.0000 0.0000 0.0000 1
320
+ MEDICATIONS 0.8000 0.5714 0.6667 7
321
  OTHER_HISTORY 0.0000 0.0000 0.0000 1
322
+ PASTMEDICALHX 0.3636 1.0000 0.5333 4
323
+ PASTSURGICAL 0.8000 1.0000 0.8889 8
324
  PLAN 0.0000 0.0000 0.0000 3
325
  PROCEDURES 0.0000 0.0000 0.0000 1
326
+ ROS 0.7500 0.2727 0.4000 11
327
 
328
+ accuracy 0.6300 100
329
+ macro avg 0.2759 0.3092 0.2738 100
330
+ weighted avg 0.6088 0.6300 0.5960 100
331
+ |
332
+ | 0.1057 | 10.0 | 1720 | 0.4837 | precision recall f1-score support
333
 
334
  ALLERGY 1.0000 0.2500 0.4000 4
335
  ASSESSMENT 0.0000 0.0000 0.0000 4
336
+ Afib 0.0000 0.0000 0.0000 0
337
+ CC 0.0000 0.0000 0.0000 4
338
  DIAGNOSIS 0.0000 0.0000 0.0000 1
339
  DISPOSITION 0.0000 0.0000 0.0000 2
340
  EDCOURSE 0.0000 0.0000 0.0000 3
341
+ EXAM 0.5000 1.0000 0.6667 1
342
+ FAM/SOCHX 0.8462 1.0000 0.9167 22
343
+ GENHX 0.6429 0.9000 0.7500 20
344
  GYNHX 0.0000 0.0000 0.0000 1
345
  IMAGING 0.0000 0.0000 0.0000 1
346
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
347
  LABS 0.0000 0.0000 0.0000 1
348
+ MEDICATIONS 0.6667 0.5714 0.6154 7
349
  OTHER_HISTORY 0.0000 0.0000 0.0000 1
350
+ PASTMEDICALHX 0.4000 1.0000 0.5714 4
351
  PASTSURGICAL 0.8000 1.0000 0.8889 8
352
  PLAN 0.0000 0.0000 0.0000 3
353
  PROCEDURES 0.0000 0.0000 0.0000 1
354
+ ROS 0.7500 0.2727 0.4000 11
355
 
356
+ accuracy 0.6100 100
357
+ macro avg 0.2669 0.2854 0.2480 100
358
+ weighted avg 0.5689 0.6100 0.5554 100
359
+ |
360
+ | 0.1057 | 11.0 | 1892 | 0.4834 | precision recall f1-score support
361
 
362
+ ALLERGY 0.5000 0.2500 0.3333 4
363
  ASSESSMENT 0.0000 0.0000 0.0000 4
364
+ Afib 0.0000 0.0000 0.0000 0
365
+ CC 0.3333 0.5000 0.4000 4
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
366
  DIAGNOSIS 0.0000 0.0000 0.0000 1
367
  DISPOSITION 0.0000 0.0000 0.0000 2
368
  EDCOURSE 0.0000 0.0000 0.0000 3
369
+ EXAM 0.5000 1.0000 0.6667 1
370
+ FAM/SOCHX 0.9167 1.0000 0.9565 22
371
+ GENHX 0.7826 0.9000 0.8372 20
372
  GYNHX 0.0000 0.0000 0.0000 1
373
  IMAGING 0.0000 0.0000 0.0000 1
374
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
375
  LABS 0.0000 0.0000 0.0000 1
376
+ MEDICATIONS 0.6667 0.5714 0.6154 7
377
  OTHER_HISTORY 0.0000 0.0000 0.0000 1
378
+ PASTMEDICALHX 0.3000 0.7500 0.4286 4
379
  PASTSURGICAL 0.7273 1.0000 0.8421 8
380
+ PLAN 0.0000 0.0000 0.0000 3
381
  PROCEDURES 0.0000 0.0000 0.0000 1
382
+ ROS 0.7500 0.2727 0.4000 11
383
 
384
+ accuracy 0.6200 100
385
+ macro avg 0.2608 0.2973 0.2609 100
386
+ weighted avg 0.5959 0.6200 0.5855 100
387
+ |
388
+ | 0.0688 | 12.0 | 2064 | 0.5085 | precision recall f1-score support
389
 
390
+ ALLERGY 1.0000 0.2500 0.4000 4
391
  ASSESSMENT 0.0000 0.0000 0.0000 4
392
+ CC 0.4000 0.5000 0.4444 4
393
  DIAGNOSIS 0.0000 0.0000 0.0000 1
394
  DISPOSITION 0.0000 0.0000 0.0000 2
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
395
  EDCOURSE 0.0000 0.0000 0.0000 3
396
+ EXAM 1.0000 1.0000 1.0000 1
397
+ FAM/SOCHX 0.8800 1.0000 0.9362 22
398
+ GENHX 0.7391 0.8500 0.7907 20
399
  GYNHX 0.0000 0.0000 0.0000 1
400
  IMAGING 0.0000 0.0000 0.0000 1
401
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
402
  LABS 0.0000 0.0000 0.0000 1
403
  MEDICATIONS 0.5714 0.5714 0.5714 7
404
  OTHER_HISTORY 0.0000 0.0000 0.0000 1
405
+ PASTMEDICALHX 0.2857 1.0000 0.4444 4
406
+ PASTSURGICAL 0.8000 1.0000 0.8889 8
407
+ PLAN 0.0000 0.0000 0.0000 3
408
  PROCEDURES 0.0000 0.0000 0.0000 1
409
+ ROS 0.7500 0.2727 0.4000 11
410
 
411
+ accuracy 0.6200 100
412
+ macro avg 0.3213 0.3222 0.2938 100
413
+ weighted avg 0.6054 0.6200 0.5808 100
414
+ |
415
+ | 0.0688 | 13.0 | 2236 | 0.5189 | precision recall f1-score support
416
 
417
+ ALLERGY 1.0000 0.2500 0.4000 4
418
  ASSESSMENT 0.0000 0.0000 0.0000 4
419
+ CC 0.4000 0.5000 0.4444 4
420
  DIAGNOSIS 0.0000 0.0000 0.0000 1
421
+ DISPOSITION 0.0000 0.0000 0.0000 2
422
+ EDCOURSE 0.0000 0.0000 0.0000 3
423
  EXAM 0.5000 1.0000 0.6667 1
424
  FAM/SOCHX 0.8800 1.0000 0.9362 22
425
+ GENHX 0.7083 0.8500 0.7727 20
426
  GYNHX 0.0000 0.0000 0.0000 1
427
  IMAGING 0.0000 0.0000 0.0000 1
428
+ IMMUNIZATIONS 0.3333 1.0000 0.5000 1
429
  LABS 0.0000 0.0000 0.0000 1
430
+ MEDICATIONS 0.5714 0.5714 0.5714 7
431
  OTHER_HISTORY 0.0000 0.0000 0.0000 1
432
+ PASTMEDICALHX 0.3636 1.0000 0.5333 4
433
+ PASTSURGICAL 0.6154 1.0000 0.7619 8
434
+ PLAN 1.0000 0.3333 0.5000 3
435
  PROCEDURES 0.0000 0.0000 0.0000 1
436
+ ROS 0.7500 0.2727 0.4000 11
437
 
438
+ accuracy 0.6400 100
439
+ macro avg 0.3561 0.3889 0.3243 100
440
+ weighted avg 0.6159 0.6400 0.5872 100
441
+ |
442
+ | 0.0688 | 14.0 | 2408 | 0.5504 | precision recall f1-score support
443
 
444
  ALLERGY 1.0000 0.5000 0.6667 4
445
  ASSESSMENT 0.0000 0.0000 0.0000 4
446
+ Afib 0.0000 0.0000 0.0000 0
447
+ CC 0.6667 0.5000 0.5714 4
448
  DIAGNOSIS 0.0000 0.0000 0.0000 1
449
+ DISPOSITION 0.0000 0.0000 0.0000 2
450
+ EDCOURSE 0.0000 0.0000 0.0000 3
 
451
  EXAM 0.5000 1.0000 0.6667 1
452
+ FAM/SOCHX 0.8800 1.0000 0.9362 22
453
+ GENHX 0.6897 1.0000 0.8163 20
454
  GYNHX 0.0000 0.0000 0.0000 1
455
  IMAGING 0.0000 0.0000 0.0000 1
456
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
457
  LABS 0.0000 0.0000 0.0000 1
458
+ MEDICATIONS 0.8000 0.5714 0.6667 7
459
  OTHER_HISTORY 0.0000 0.0000 0.0000 1
460
+ PASTMEDICALHX 0.3000 0.7500 0.4286 4
461
+ PASTSURGICAL 0.7273 1.0000 0.8421 8
462
+ PLAN 0.0000 0.0000 0.0000 3
463
  PROCEDURES 0.0000 0.0000 0.0000 1
464
+ ROS 0.6667 0.1818 0.2857 11
465
 
466
+ accuracy 0.6400 100
467
+ macro avg 0.2967 0.3097 0.2800 100
468
+ weighted avg 0.6027 0.6400 0.5880 100
469
+ |
470
+ | 0.0493 | 15.0 | 2580 | 0.5524 | precision recall f1-score support
471
 
472
+ ALLERGY 0.6667 0.5000 0.5714 4
473
  ASSESSMENT 0.0000 0.0000 0.0000 4
474
+ CC 0.0000 0.0000 0.0000 4
475
  DIAGNOSIS 0.0000 0.0000 0.0000 1
476
+ DISPOSITION 0.0000 0.0000 0.0000 2
477
  EDCOURSE 0.0000 0.0000 0.0000 3
478
  EXAM 0.5000 1.0000 0.6667 1
479
+ FAM/SOCHX 0.8800 1.0000 0.9362 22
480
+ GENHX 0.7600 0.9500 0.8444 20
481
  GYNHX 0.0000 0.0000 0.0000 1
482
  IMAGING 0.0000 0.0000 0.0000 1
483
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
484
  LABS 0.0000 0.0000 0.0000 1
485
  MEDICATIONS 0.7143 0.7143 0.7143 7
486
  OTHER_HISTORY 0.0000 0.0000 0.0000 1
487
+ PASTMEDICALHX 0.3750 0.7500 0.5000 4
488
+ PASTSURGICAL 0.7273 1.0000 0.8421 8
489
  PLAN 0.5000 0.3333 0.4000 3
490
  PROCEDURES 0.0000 0.0000 0.0000 1
491
+ ROS 0.6667 0.1818 0.2857 11
492
 
493
+ accuracy 0.6300 100
494
+ macro avg 0.2895 0.3215 0.2880 100
495
+ weighted avg 0.5888 0.6300 0.5852 100
496
+ |
497
+ | 0.0493 | 16.0 | 2752 | 0.5291 | precision recall f1-score support
498
 
499
+ ALLERGY 0.6667 0.5000 0.5714 4
500
  ASSESSMENT 0.0000 0.0000 0.0000 4
501
+ CC 0.2500 0.2500 0.2500 4
502
  DIAGNOSIS 0.0000 0.0000 0.0000 1
503
+ DISPOSITION 0.0000 0.0000 0.0000 2
504
  EDCOURSE 0.0000 0.0000 0.0000 3
505
  EXAM 0.5000 1.0000 0.6667 1
506
+ FAM/SOCHX 0.8800 1.0000 0.9362 22
507
+ GENHX 0.7500 0.9000 0.8182 20
508
  GYNHX 0.0000 0.0000 0.0000 1
509
  IMAGING 0.0000 0.0000 0.0000 1
510
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
511
  LABS 0.0000 0.0000 0.0000 1
512
  MEDICATIONS 0.7143 0.7143 0.7143 7
513
  OTHER_HISTORY 0.0000 0.0000 0.0000 1
514
+ PASTMEDICALHX 0.5000 1.0000 0.6667 4
515
+ PASTSURGICAL 0.6154 1.0000 0.7619 8
516
+ PLAN 0.0000 0.0000 0.0000 3
517
  PROCEDURES 0.0000 0.0000 0.0000 1
518
+ ROS 0.6667 0.1818 0.2857 11
519
 
520
+ accuracy 0.6300 100
521
+ macro avg 0.2772 0.3273 0.2836 100
522
+ weighted avg 0.5778 0.6300 0.5782 100
523
+ |
524
+ | 0.0493 | 17.0 | 2924 | 0.5434 | precision recall f1-score support
525
 
526
+ ALLERGY 0.5000 0.2500 0.3333 4
527
  ASSESSMENT 0.0000 0.0000 0.0000 4
528
+ CC 0.0000 0.0000 0.0000 4
529
  DIAGNOSIS 0.0000 0.0000 0.0000 1
530
+ DISPOSITION 0.0000 0.0000 0.0000 2
531
  EDCOURSE 0.0000 0.0000 0.0000 3
532
+ EXAM 0.5000 1.0000 0.6667 1
533
+ FAM/SOCHX 0.8800 1.0000 0.9362 22
534
+ GENHX 0.7500 0.9000 0.8182 20
535
  GYNHX 0.0000 0.0000 0.0000 1
536
  IMAGING 0.0000 0.0000 0.0000 1
537
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
538
  LABS 0.0000 0.0000 0.0000 1
539
+ MEDICATIONS 0.6250 0.7143 0.6667 7
540
  OTHER_HISTORY 0.0000 0.0000 0.0000 1
541
+ PASTMEDICALHX 0.4000 1.0000 0.5714 4
542
+ PASTSURGICAL 0.7273 1.0000 0.8421 8
543
+ PLAN 0.0000 0.0000 0.0000 3
544
  PROCEDURES 0.0000 0.0000 0.0000 1
545
+ ROS 0.6667 0.1818 0.2857 11
546
 
547
+ accuracy 0.6100 100
548
+ macro avg 0.2524 0.3023 0.2560 100
549
+ weighted avg 0.5599 0.6100 0.5579 100
550
+ |
551
+ | 0.0353 | 18.0 | 3096 | 0.5396 | precision recall f1-score support
552
 
553
+ ALLERGY 0.6667 0.5000 0.5714 4
554
  ASSESSMENT 0.0000 0.0000 0.0000 4
555
+ Afib 0.0000 0.0000 0.0000 0
556
+ CC 0.0000 0.0000 0.0000 4
557
  DIAGNOSIS 0.0000 0.0000 0.0000 1
558
+ DISPOSITION 0.0000 0.0000 0.0000 2
559
  EDCOURSE 0.0000 0.0000 0.0000 3
560
+ EXAM 0.5000 1.0000 0.6667 1
561
  FAM/SOCHX 0.8462 1.0000 0.9167 22
562
+ GENHX 0.7600 0.9500 0.8444 20
563
  GYNHX 0.0000 0.0000 0.0000 1
564
  IMAGING 0.0000 0.0000 0.0000 1
565
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
566
  LABS 0.0000 0.0000 0.0000 1
567
+ MEDICATIONS 0.8333 0.7143 0.7692 7
568
  OTHER_HISTORY 0.0000 0.0000 0.0000 1
569
+ PASTMEDICALHX 0.5000 1.0000 0.6667 4
570
+ PASTSURGICAL 0.6667 1.0000 0.8000 8
571
+ PLAN 0.0000 0.0000 0.0000 3
572
  PROCEDURES 0.0000 0.0000 0.0000 1
573
+ ROS 0.6667 0.1818 0.2857 11
574
 
575
+ accuracy 0.6300 100
576
+ macro avg 0.2590 0.3022 0.2629 100
577
+ weighted avg 0.5748 0.6300 0.5760 100
578
+ |
579
+ | 0.0353 | 19.0 | 3268 | 0.5345 | precision recall f1-score support
580
 
581
+ ALLERGY 0.6667 0.5000 0.5714 4
582
  ASSESSMENT 0.0000 0.0000 0.0000 4
583
+ Afib 0.0000 0.0000 0.0000 0
584
+ CC 0.0000 0.0000 0.0000 4
585
  DIAGNOSIS 0.0000 0.0000 0.0000 1
586
+ DISPOSITION 0.0000 0.0000 0.0000 2
587
  EDCOURSE 0.0000 0.0000 0.0000 3
588
  EXAM 0.5000 1.0000 0.6667 1
589
+ FAM/SOCHX 0.8462 1.0000 0.9167 22
590
+ GENHX 0.7917 0.9500 0.8636 20
591
  GYNHX 0.0000 0.0000 0.0000 1
592
  IMAGING 0.0000 0.0000 0.0000 1
593
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
594
  LABS 0.0000 0.0000 0.0000 1
595
+ MEDICATIONS 0.8333 0.7143 0.7692 7
596
  OTHER_HISTORY 0.0000 0.0000 0.0000 1
597
  PASTMEDICALHX 0.4444 1.0000 0.6154 4
598
+ PASTSURGICAL 0.7273 1.0000 0.8421 8
599
+ PLAN 0.0000 0.0000 0.0000 3
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
600
  PROCEDURES 0.0000 0.0000 0.0000 1
601
+ ROS 0.7500 0.2727 0.4000 11
602
 
603
+ accuracy 0.6400 100
604
+ macro avg 0.2647 0.3065 0.2688 100
605
+ weighted avg 0.5929 0.6400 0.5937 100
606
+ |
607
+ | 0.0353 | 20.0 | 3440 | 0.5317 | precision recall f1-score support
608
 
609
+ ALLERGY 0.6667 0.5000 0.5714 4
610
  ASSESSMENT 0.0000 0.0000 0.0000 4
611
+ Afib 0.0000 0.0000 0.0000 0
612
+ CC 0.0000 0.0000 0.0000 4
613
  DIAGNOSIS 0.0000 0.0000 0.0000 1
614
+ DISPOSITION 0.0000 0.0000 0.0000 2
615
  EDCOURSE 0.0000 0.0000 0.0000 3
616
+ EXAM 0.5000 1.0000 0.6667 1
617
+ FAM/SOCHX 0.8462 1.0000 0.9167 22
618
+ GENHX 0.7917 0.9500 0.8636 20
619
  GYNHX 0.0000 0.0000 0.0000 1
620
  IMAGING 0.0000 0.0000 0.0000 1
621
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
622
  LABS 0.0000 0.0000 0.0000 1
623
+ MEDICATIONS 0.8333 0.7143 0.7692 7
624
  OTHER_HISTORY 0.0000 0.0000 0.0000 1
625
+ PASTMEDICALHX 0.4444 1.0000 0.6154 4
626
+ PASTSURGICAL 0.7273 1.0000 0.8421 8
627
+ PLAN 0.0000 0.0000 0.0000 3
628
  PROCEDURES 0.0000 0.0000 0.0000 1
629
+ ROS 0.7500 0.2727 0.4000 11
630
 
631
+ accuracy 0.6400 100
632
+ macro avg 0.2647 0.3065 0.2688 100
633
+ weighted avg 0.5929 0.6400 0.5937 100
634
+ |
635
 
636
 
637
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7f24d96f48ef3eccdacda4918eb7ea93d7e24fbd9ab5599bde7eb54a469b3753
3
  size 307867048
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3fa0f9e74dbbf45c459d63b846b4957729d839424e5f3718b6dffd3458fe5989
3
  size 307867048
runs/Jan14_22-04-35_dcd1aa35f795/events.out.tfevents.1705269879.dcd1aa35f795.9262.2 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e2eb270ea3325dab839dd713a79616dedf543f3860643dc997133b0a52fe4a7a
3
- size 10831
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:57403014a2dc2cff8e077fae3f771927fa23f2ea08b4d87b0c3b1015c4f4989d
3
+ size 11998