File size: 30,759 Bytes
84f3ace
 
 
 
 
 
32261f1
84f3ace
 
 
 
 
 
32261f1
84f3ace
 
 
32261f1
 
 
 
84f3ace
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
32261f1
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
84f3ace
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
---
library_name: transformers
base_model: aubmindlab/bert-base-arabertv02
tags:
- generated_from_trainer
model-index:
- name: ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k20_task1_organization
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k20_task1_organization

This model is a fine-tuned version of [aubmindlab/bert-base-arabertv02](https://huggingface.co/aubmindlab/bert-base-arabertv02) on the None dataset.
It achieves the following results on the evaluation set:
- Loss: 1.8984
- Qwk: 0.2517
- Mse: 1.8984
- Rmse: 1.3778

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 2e-05
- train_batch_size: 8
- eval_batch_size: 8
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 100

### Training results

| Training Loss | Epoch  | Step | Validation Loss | Qwk    | Mse    | Rmse   |
|:-------------:|:------:|:----:|:---------------:|:------:|:------:|:------:|
| No log        | 0.0230 | 2    | 6.6396          | 0.0    | 6.6396 | 2.5768 |
| No log        | 0.0460 | 4    | 4.3286          | 0.0684 | 4.3286 | 2.0805 |
| No log        | 0.0690 | 6    | 3.4395          | 0.0113 | 3.4395 | 1.8546 |
| No log        | 0.0920 | 8    | 2.7750          | 0.0654 | 2.7750 | 1.6658 |
| No log        | 0.1149 | 10   | 2.1940          | 0.0945 | 2.1940 | 1.4812 |
| No log        | 0.1379 | 12   | 1.8165          | 0.2017 | 1.8165 | 1.3478 |
| No log        | 0.1609 | 14   | 2.0792          | 0.2590 | 2.0792 | 1.4419 |
| No log        | 0.1839 | 16   | 2.2314          | 0.2821 | 2.2314 | 1.4938 |
| No log        | 0.2069 | 18   | 2.2926          | 0.2822 | 2.2926 | 1.5141 |
| No log        | 0.2299 | 20   | 1.5379          | 0.2927 | 1.5379 | 1.2401 |
| No log        | 0.2529 | 22   | 1.4927          | 0.2564 | 1.4927 | 1.2218 |
| No log        | 0.2759 | 24   | 1.7676          | 0.2162 | 1.7676 | 1.3295 |
| No log        | 0.2989 | 26   | 2.0794          | 0.0721 | 2.0794 | 1.4420 |
| No log        | 0.3218 | 28   | 1.9527          | 0.1429 | 1.9527 | 1.3974 |
| No log        | 0.3448 | 30   | 1.8721          | 0.1356 | 1.8721 | 1.3683 |
| No log        | 0.3678 | 32   | 1.6050          | 0.2645 | 1.6050 | 1.2669 |
| No log        | 0.3908 | 34   | 1.4963          | 0.3016 | 1.4963 | 1.2232 |
| No log        | 0.4138 | 36   | 1.4959          | 0.3548 | 1.4959 | 1.2231 |
| No log        | 0.4368 | 38   | 1.5768          | 0.3220 | 1.5768 | 1.2557 |
| No log        | 0.4598 | 40   | 2.2270          | 0.0678 | 2.2270 | 1.4923 |
| No log        | 0.4828 | 42   | 2.4280          | 0.0    | 2.4280 | 1.5582 |
| No log        | 0.5057 | 44   | 1.6804          | 0.3193 | 1.6804 | 1.2963 |
| No log        | 0.5287 | 46   | 1.1931          | 0.4538 | 1.1931 | 1.0923 |
| No log        | 0.5517 | 48   | 1.1980          | 0.4426 | 1.1980 | 1.0945 |
| No log        | 0.5747 | 50   | 1.1796          | 0.4640 | 1.1796 | 1.0861 |
| No log        | 0.5977 | 52   | 1.0833          | 0.4918 | 1.0833 | 1.0408 |
| No log        | 0.6207 | 54   | 1.0498          | 0.5440 | 1.0498 | 1.0246 |
| No log        | 0.6437 | 56   | 0.9887          | 0.6154 | 0.9887 | 0.9943 |
| No log        | 0.6667 | 58   | 0.9723          | 0.5625 | 0.9723 | 0.9861 |
| No log        | 0.6897 | 60   | 1.1282          | 0.496  | 1.1282 | 1.0621 |
| No log        | 0.7126 | 62   | 1.5062          | 0.3590 | 1.5062 | 1.2273 |
| No log        | 0.7356 | 64   | 1.8798          | 0.1391 | 1.8798 | 1.3711 |
| No log        | 0.7586 | 66   | 1.5885          | 0.3276 | 1.5885 | 1.2603 |
| No log        | 0.7816 | 68   | 1.0975          | 0.5760 | 1.0975 | 1.0476 |
| No log        | 0.8046 | 70   | 1.0344          | 0.6029 | 1.0344 | 1.0171 |
| No log        | 0.8276 | 72   | 1.0121          | 0.5758 | 1.0121 | 1.0060 |
| No log        | 0.8506 | 74   | 1.0209          | 0.6047 | 1.0209 | 1.0104 |
| No log        | 0.8736 | 76   | 1.1943          | 0.5606 | 1.1943 | 1.0928 |
| No log        | 0.8966 | 78   | 1.0836          | 0.5669 | 1.0836 | 1.0410 |
| No log        | 0.9195 | 80   | 1.0904          | 0.5    | 1.0904 | 1.0442 |
| No log        | 0.9425 | 82   | 1.5082          | 0.4122 | 1.5082 | 1.2281 |
| No log        | 0.9655 | 84   | 1.5763          | 0.4    | 1.5763 | 1.2555 |
| No log        | 0.9885 | 86   | 1.1756          | 0.4640 | 1.1756 | 1.0842 |
| No log        | 1.0115 | 88   | 1.0360          | 0.5806 | 1.0360 | 1.0178 |
| No log        | 1.0345 | 90   | 1.4010          | 0.5185 | 1.4010 | 1.1836 |
| No log        | 1.0575 | 92   | 1.5854          | 0.4088 | 1.5854 | 1.2591 |
| No log        | 1.0805 | 94   | 1.4811          | 0.3939 | 1.4811 | 1.2170 |
| No log        | 1.1034 | 96   | 1.2524          | 0.4677 | 1.2524 | 1.1191 |
| No log        | 1.1264 | 98   | 1.3287          | 0.4628 | 1.3287 | 1.1527 |
| No log        | 1.1494 | 100  | 1.2594          | 0.3966 | 1.2594 | 1.1222 |
| No log        | 1.1724 | 102  | 1.2842          | 0.2778 | 1.2842 | 1.1332 |
| No log        | 1.1954 | 104  | 1.3294          | 0.2778 | 1.3294 | 1.1530 |
| No log        | 1.2184 | 106  | 1.3482          | 0.2617 | 1.3482 | 1.1611 |
| No log        | 1.2414 | 108  | 1.3784          | 0.3363 | 1.3784 | 1.1740 |
| No log        | 1.2644 | 110  | 1.3333          | 0.3833 | 1.3333 | 1.1547 |
| No log        | 1.2874 | 112  | 1.2499          | 0.4590 | 1.2499 | 1.1180 |
| No log        | 1.3103 | 114  | 1.1115          | 0.5246 | 1.1115 | 1.0543 |
| No log        | 1.3333 | 116  | 1.0839          | 0.5714 | 1.0839 | 1.0411 |
| No log        | 1.3563 | 118  | 1.1164          | 0.5781 | 1.1164 | 1.0566 |
| No log        | 1.3793 | 120  | 1.2813          | 0.5414 | 1.2813 | 1.1320 |
| No log        | 1.4023 | 122  | 1.7999          | 0.3497 | 1.7999 | 1.3416 |
| No log        | 1.4253 | 124  | 2.0460          | 0.1944 | 2.0460 | 1.4304 |
| No log        | 1.4483 | 126  | 1.8702          | 0.2837 | 1.8702 | 1.3676 |
| No log        | 1.4713 | 128  | 1.4243          | 0.5385 | 1.4243 | 1.1934 |
| No log        | 1.4943 | 130  | 1.2884          | 0.2407 | 1.2884 | 1.1351 |
| No log        | 1.5172 | 132  | 1.3952          | 0.2883 | 1.3952 | 1.1812 |
| No log        | 1.5402 | 134  | 1.3172          | 0.2883 | 1.3172 | 1.1477 |
| No log        | 1.5632 | 136  | 1.1772          | 0.3273 | 1.1772 | 1.0850 |
| No log        | 1.5862 | 138  | 1.1143          | 0.4655 | 1.1143 | 1.0556 |
| No log        | 1.6092 | 140  | 1.3532          | 0.5197 | 1.3532 | 1.1633 |
| No log        | 1.6322 | 142  | 1.5880          | 0.4219 | 1.5880 | 1.2601 |
| No log        | 1.6552 | 144  | 1.6034          | 0.4252 | 1.6034 | 1.2663 |
| No log        | 1.6782 | 146  | 1.4578          | 0.4390 | 1.4578 | 1.2074 |
| No log        | 1.7011 | 148  | 1.2886          | 0.4918 | 1.2886 | 1.1352 |
| No log        | 1.7241 | 150  | 1.2625          | 0.5410 | 1.2625 | 1.1236 |
| No log        | 1.7471 | 152  | 1.4193          | 0.4687 | 1.4193 | 1.1913 |
| No log        | 1.7701 | 154  | 1.5623          | 0.4375 | 1.5623 | 1.2499 |
| No log        | 1.7931 | 156  | 1.5403          | 0.4496 | 1.5403 | 1.2411 |
| No log        | 1.8161 | 158  | 1.4334          | 0.4806 | 1.4334 | 1.1973 |
| No log        | 1.8391 | 160  | 1.4433          | 0.4776 | 1.4433 | 1.2014 |
| No log        | 1.8621 | 162  | 1.5804          | 0.4203 | 1.5804 | 1.2572 |
| No log        | 1.8851 | 164  | 1.5432          | 0.4526 | 1.5432 | 1.2423 |
| No log        | 1.9080 | 166  | 1.4105          | 0.4812 | 1.4105 | 1.1876 |
| No log        | 1.9310 | 168  | 1.2996          | 0.528  | 1.2996 | 1.1400 |
| No log        | 1.9540 | 170  | 1.3288          | 0.5312 | 1.3288 | 1.1528 |
| No log        | 1.9770 | 172  | 1.3701          | 0.5    | 1.3701 | 1.1705 |
| No log        | 2.0    | 174  | 1.2990          | 0.5441 | 1.2990 | 1.1397 |
| No log        | 2.0230 | 176  | 1.2281          | 0.5564 | 1.2281 | 1.1082 |
| No log        | 2.0460 | 178  | 1.1811          | 0.5865 | 1.1811 | 1.0868 |
| No log        | 2.0690 | 180  | 1.1898          | 0.5606 | 1.1898 | 1.0908 |
| No log        | 2.0920 | 182  | 1.1627          | 0.5606 | 1.1627 | 1.0783 |
| No log        | 2.1149 | 184  | 1.1530          | 0.5649 | 1.1530 | 1.0738 |
| No log        | 2.1379 | 186  | 1.1665          | 0.5649 | 1.1665 | 1.0800 |
| No log        | 2.1609 | 188  | 1.1981          | 0.5496 | 1.1981 | 1.0946 |
| No log        | 2.1839 | 190  | 1.2022          | 0.5312 | 1.2022 | 1.0965 |
| No log        | 2.2069 | 192  | 1.2374          | 0.5116 | 1.2374 | 1.1124 |
| No log        | 2.2299 | 194  | 1.3089          | 0.4923 | 1.3089 | 1.1441 |
| No log        | 2.2529 | 196  | 1.4924          | 0.4265 | 1.4924 | 1.2217 |
| No log        | 2.2759 | 198  | 1.4630          | 0.4265 | 1.4630 | 1.2095 |
| No log        | 2.2989 | 200  | 1.2680          | 0.4961 | 1.2680 | 1.1260 |
| No log        | 2.3218 | 202  | 1.1860          | 0.5354 | 1.1860 | 1.0891 |
| No log        | 2.3448 | 204  | 1.2265          | 0.5231 | 1.2265 | 1.1075 |
| No log        | 2.3678 | 206  | 1.2553          | 0.5344 | 1.2553 | 1.1204 |
| No log        | 2.3908 | 208  | 1.2083          | 0.5426 | 1.2083 | 1.0992 |
| No log        | 2.4138 | 210  | 1.1640          | 0.5781 | 1.1640 | 1.0789 |
| No log        | 2.4368 | 212  | 1.0898          | 0.5827 | 1.0898 | 1.0439 |
| No log        | 2.4598 | 214  | 1.1020          | 0.5323 | 1.1020 | 1.0498 |
| No log        | 2.4828 | 216  | 1.1504          | 0.5714 | 1.1504 | 1.0726 |
| No log        | 2.5057 | 218  | 1.1112          | 0.56   | 1.1112 | 1.0542 |
| No log        | 2.5287 | 220  | 1.0967          | 0.5669 | 1.0967 | 1.0472 |
| No log        | 2.5517 | 222  | 1.1012          | 0.5410 | 1.1012 | 1.0494 |
| No log        | 2.5747 | 224  | 1.1181          | 0.4706 | 1.1181 | 1.0574 |
| No log        | 2.5977 | 226  | 1.1496          | 0.4786 | 1.1496 | 1.0722 |
| No log        | 2.6207 | 228  | 1.1519          | 0.5691 | 1.1519 | 1.0733 |
| No log        | 2.6437 | 230  | 1.1306          | 0.5760 | 1.1306 | 1.0633 |
| No log        | 2.6667 | 232  | 1.2015          | 0.5692 | 1.2015 | 1.0961 |
| No log        | 2.6897 | 234  | 1.3104          | 0.4380 | 1.3104 | 1.1447 |
| No log        | 2.7126 | 236  | 1.3136          | 0.4672 | 1.3136 | 1.1461 |
| No log        | 2.7356 | 238  | 1.1960          | 0.5496 | 1.1960 | 1.0936 |
| No log        | 2.7586 | 240  | 1.2786          | 0.5303 | 1.2786 | 1.1308 |
| No log        | 2.7816 | 242  | 1.4279          | 0.4203 | 1.4279 | 1.1949 |
| No log        | 2.8046 | 244  | 1.4671          | 0.4029 | 1.4671 | 1.2112 |
| No log        | 2.8276 | 246  | 1.3665          | 0.4460 | 1.3665 | 1.1690 |
| No log        | 2.8506 | 248  | 1.0579          | 0.6423 | 1.0579 | 1.0285 |
| No log        | 2.8736 | 250  | 0.9342          | 0.6861 | 0.9342 | 0.9665 |
| No log        | 2.8966 | 252  | 0.9813          | 0.6423 | 0.9813 | 0.9906 |
| No log        | 2.9195 | 254  | 1.1367          | 0.5899 | 1.1367 | 1.0661 |
| No log        | 2.9425 | 256  | 1.1817          | 0.5758 | 1.1817 | 1.0870 |
| No log        | 2.9655 | 258  | 1.1011          | 0.5846 | 1.1011 | 1.0494 |
| No log        | 2.9885 | 260  | 1.0400          | 0.5669 | 1.0400 | 1.0198 |
| No log        | 3.0115 | 262  | 0.9944          | 0.6299 | 0.9944 | 0.9972 |
| No log        | 3.0345 | 264  | 0.9963          | 0.6032 | 0.9963 | 0.9981 |
| No log        | 3.0575 | 266  | 1.1173          | 0.5625 | 1.1173 | 1.0570 |
| No log        | 3.0805 | 268  | 1.1982          | 0.5271 | 1.1982 | 1.0946 |
| No log        | 3.1034 | 270  | 1.2233          | 0.5426 | 1.2233 | 1.1060 |
| No log        | 3.1264 | 272  | 1.3227          | 0.4962 | 1.3227 | 1.1501 |
| No log        | 3.1494 | 274  | 1.2208          | 0.5426 | 1.2208 | 1.1049 |
| No log        | 3.1724 | 276  | 1.0372          | 0.5645 | 1.0372 | 1.0185 |
| No log        | 3.1954 | 278  | 0.9725          | 0.5873 | 0.9725 | 0.9862 |
| No log        | 3.2184 | 280  | 1.0086          | 0.5873 | 1.0086 | 1.0043 |
| No log        | 3.2414 | 282  | 1.1523          | 0.5827 | 1.1523 | 1.0735 |
| No log        | 3.2644 | 284  | 1.3368          | 0.5116 | 1.3368 | 1.1562 |
| No log        | 3.2874 | 286  | 1.4434          | 0.4962 | 1.4434 | 1.2014 |
| No log        | 3.3103 | 288  | 1.4567          | 0.4925 | 1.4567 | 1.2069 |
| No log        | 3.3333 | 290  | 1.3767          | 0.4769 | 1.3767 | 1.1733 |
| No log        | 3.3563 | 292  | 1.3411          | 0.4961 | 1.3411 | 1.1581 |
| No log        | 3.3793 | 294  | 1.3676          | 0.4733 | 1.3676 | 1.1694 |
| No log        | 3.4023 | 296  | 1.2750          | 0.5039 | 1.2750 | 1.1291 |
| No log        | 3.4253 | 298  | 1.2325          | 0.5039 | 1.2325 | 1.1102 |
| No log        | 3.4483 | 300  | 1.2712          | 0.5039 | 1.2712 | 1.1275 |
| No log        | 3.4713 | 302  | 1.3184          | 0.4961 | 1.3184 | 1.1482 |
| No log        | 3.4943 | 304  | 1.4368          | 0.4148 | 1.4368 | 1.1987 |
| No log        | 3.5172 | 306  | 1.4269          | 0.4328 | 1.4269 | 1.1945 |
| No log        | 3.5402 | 308  | 1.3510          | 0.4593 | 1.3510 | 1.1623 |
| No log        | 3.5632 | 310  | 1.3076          | 0.4593 | 1.3076 | 1.1435 |
| No log        | 3.5862 | 312  | 1.3697          | 0.4526 | 1.3697 | 1.1703 |
| No log        | 3.6092 | 314  | 1.5421          | 0.4088 | 1.5421 | 1.2418 |
| No log        | 3.6322 | 316  | 1.5764          | 0.4058 | 1.5764 | 1.2555 |
| No log        | 3.6552 | 318  | 1.5224          | 0.4058 | 1.5224 | 1.2339 |
| No log        | 3.6782 | 320  | 1.5893          | 0.3714 | 1.5893 | 1.2607 |
| No log        | 3.7011 | 322  | 1.4869          | 0.3714 | 1.4869 | 1.2194 |
| No log        | 3.7241 | 324  | 1.2243          | 0.5564 | 1.2243 | 1.1065 |
| No log        | 3.7471 | 326  | 1.1279          | 0.5692 | 1.1279 | 1.0620 |
| No log        | 3.7701 | 328  | 1.1739          | 0.5344 | 1.1739 | 1.0835 |
| No log        | 3.7931 | 330  | 1.4700          | 0.3741 | 1.4700 | 1.2125 |
| No log        | 3.8161 | 332  | 1.6624          | 0.3714 | 1.6624 | 1.2894 |
| No log        | 3.8391 | 334  | 1.4960          | 0.3714 | 1.4960 | 1.2231 |
| No log        | 3.8621 | 336  | 1.3010          | 0.5606 | 1.3010 | 1.1406 |
| No log        | 3.8851 | 338  | 1.3107          | 0.5606 | 1.3107 | 1.1449 |
| No log        | 3.9080 | 340  | 1.3728          | 0.5414 | 1.3728 | 1.1716 |
| No log        | 3.9310 | 342  | 1.4491          | 0.4593 | 1.4491 | 1.2038 |
| No log        | 3.9540 | 344  | 1.5773          | 0.3623 | 1.5773 | 1.2559 |
| No log        | 3.9770 | 346  | 1.7291          | 0.3262 | 1.7291 | 1.3149 |
| No log        | 4.0    | 348  | 1.7387          | 0.3429 | 1.7387 | 1.3186 |
| No log        | 4.0230 | 350  | 1.6559          | 0.3623 | 1.6559 | 1.2868 |
| No log        | 4.0460 | 352  | 1.4741          | 0.5344 | 1.4741 | 1.2141 |
| No log        | 4.0690 | 354  | 1.3706          | 0.5    | 1.3706 | 1.1707 |
| No log        | 4.0920 | 356  | 1.3625          | 0.5354 | 1.3625 | 1.1673 |
| No log        | 4.1149 | 358  | 1.4286          | 0.5113 | 1.4286 | 1.1952 |
| No log        | 4.1379 | 360  | 1.6639          | 0.3404 | 1.6639 | 1.2899 |
| No log        | 4.1609 | 362  | 1.9604          | 0.2759 | 1.9604 | 1.4002 |
| No log        | 4.1839 | 364  | 2.1547          | 0.1644 | 2.1547 | 1.4679 |
| No log        | 4.2069 | 366  | 2.0803          | 0.2345 | 2.0803 | 1.4423 |
| No log        | 4.2299 | 368  | 1.7800          | 0.3194 | 1.7800 | 1.3342 |
| No log        | 4.2529 | 370  | 1.4957          | 0.4380 | 1.4957 | 1.2230 |
| No log        | 4.2759 | 372  | 1.4564          | 0.4559 | 1.4564 | 1.2068 |
| No log        | 4.2989 | 374  | 1.5045          | 0.4296 | 1.5045 | 1.2266 |
| No log        | 4.3218 | 376  | 1.5944          | 0.3852 | 1.5944 | 1.2627 |
| No log        | 4.3448 | 378  | 1.5763          | 0.3852 | 1.5763 | 1.2555 |
| No log        | 4.3678 | 380  | 1.5089          | 0.4242 | 1.5089 | 1.2284 |
| No log        | 4.3908 | 382  | 1.5180          | 0.4296 | 1.5180 | 1.2321 |
| No log        | 4.4138 | 384  | 1.6072          | 0.3768 | 1.6072 | 1.2677 |
| No log        | 4.4368 | 386  | 1.6286          | 0.3404 | 1.6286 | 1.2762 |
| No log        | 4.4598 | 388  | 1.5246          | 0.3885 | 1.5246 | 1.2347 |
| No log        | 4.4828 | 390  | 1.2945          | 0.5263 | 1.2945 | 1.1378 |
| No log        | 4.5057 | 392  | 1.2349          | 0.5385 | 1.2349 | 1.1113 |
| No log        | 4.5287 | 394  | 1.2889          | 0.4961 | 1.2889 | 1.1353 |
| No log        | 4.5517 | 396  | 1.4070          | 0.5    | 1.4070 | 1.1862 |
| No log        | 4.5747 | 398  | 1.3769          | 0.5191 | 1.3769 | 1.1734 |
| No log        | 4.5977 | 400  | 1.3234          | 0.4961 | 1.3234 | 1.1504 |
| No log        | 4.6207 | 402  | 1.1981          | 0.5581 | 1.1981 | 1.0946 |
| No log        | 4.6437 | 404  | 1.1565          | 0.5692 | 1.1565 | 1.0754 |
| No log        | 4.6667 | 406  | 1.3229          | 0.5185 | 1.3229 | 1.1502 |
| No log        | 4.6897 | 408  | 1.6437          | 0.3099 | 1.6437 | 1.2821 |
| No log        | 4.7126 | 410  | 1.8009          | 0.2937 | 1.8009 | 1.3420 |
| No log        | 4.7356 | 412  | 1.8364          | 0.2937 | 1.8364 | 1.3551 |
| No log        | 4.7586 | 414  | 1.8491          | 0.2937 | 1.8491 | 1.3598 |
| No log        | 4.7816 | 416  | 1.8671          | 0.2937 | 1.8671 | 1.3664 |
| No log        | 4.8046 | 418  | 1.6429          | 0.3429 | 1.6429 | 1.2817 |
| No log        | 4.8276 | 420  | 1.3856          | 0.4885 | 1.3856 | 1.1771 |
| No log        | 4.8506 | 422  | 1.1711          | 0.5760 | 1.1711 | 1.0822 |
| No log        | 4.8736 | 424  | 1.1531          | 0.5333 | 1.1531 | 1.0738 |
| No log        | 4.8966 | 426  | 1.2058          | 0.5333 | 1.2058 | 1.0981 |
| No log        | 4.9195 | 428  | 1.3206          | 0.4960 | 1.3206 | 1.1492 |
| No log        | 4.9425 | 430  | 1.5334          | 0.4662 | 1.5334 | 1.2383 |
| No log        | 4.9655 | 432  | 1.6032          | 0.3910 | 1.6032 | 1.2662 |
| No log        | 4.9885 | 434  | 1.5111          | 0.4662 | 1.5111 | 1.2293 |
| No log        | 5.0115 | 436  | 1.3103          | 0.4882 | 1.3103 | 1.1447 |
| No log        | 5.0345 | 438  | 1.1810          | 0.5161 | 1.1810 | 1.0868 |
| No log        | 5.0575 | 440  | 1.1516          | 0.5323 | 1.1516 | 1.0731 |
| No log        | 5.0805 | 442  | 1.1639          | 0.512  | 1.1639 | 1.0788 |
| No log        | 5.1034 | 444  | 1.3012          | 0.4688 | 1.3012 | 1.1407 |
| No log        | 5.1264 | 446  | 1.5285          | 0.4412 | 1.5285 | 1.2363 |
| No log        | 5.1494 | 448  | 1.8003          | 0.2411 | 1.8003 | 1.3418 |
| No log        | 5.1724 | 450  | 1.9070          | 0.2254 | 1.9070 | 1.3809 |
| No log        | 5.1954 | 452  | 1.8954          | 0.1986 | 1.8954 | 1.3767 |
| No log        | 5.2184 | 454  | 1.7546          | 0.2794 | 1.7546 | 1.3246 |
| No log        | 5.2414 | 456  | 1.5689          | 0.4962 | 1.5689 | 1.2526 |
| No log        | 5.2644 | 458  | 1.4135          | 0.4961 | 1.4135 | 1.1889 |
| No log        | 5.2874 | 460  | 1.3102          | 0.5197 | 1.3102 | 1.1447 |
| No log        | 5.3103 | 462  | 1.3136          | 0.5197 | 1.3136 | 1.1461 |
| No log        | 5.3333 | 464  | 1.4122          | 0.4848 | 1.4122 | 1.1884 |
| No log        | 5.3563 | 466  | 1.6434          | 0.3429 | 1.6434 | 1.2819 |
| No log        | 5.3793 | 468  | 1.7797          | 0.2500 | 1.7797 | 1.3341 |
| No log        | 5.4023 | 470  | 1.6938          | 0.2937 | 1.6938 | 1.3015 |
| No log        | 5.4253 | 472  | 1.4997          | 0.4627 | 1.4997 | 1.2246 |
| No log        | 5.4483 | 474  | 1.3020          | 0.4961 | 1.3020 | 1.1410 |
| No log        | 5.4713 | 476  | 1.2321          | 0.56   | 1.2321 | 1.1100 |
| No log        | 5.4943 | 478  | 1.2385          | 0.56   | 1.2385 | 1.1129 |
| No log        | 5.5172 | 480  | 1.3110          | 0.4921 | 1.3110 | 1.1450 |
| No log        | 5.5402 | 482  | 1.4441          | 0.4733 | 1.4441 | 1.2017 |
| No log        | 5.5632 | 484  | 1.5051          | 0.4580 | 1.5051 | 1.2268 |
| No log        | 5.5862 | 486  | 1.4491          | 0.4375 | 1.4491 | 1.2038 |
| No log        | 5.6092 | 488  | 1.3803          | 0.4921 | 1.3803 | 1.1749 |
| No log        | 5.6322 | 490  | 1.3547          | 0.4688 | 1.3547 | 1.1639 |
| No log        | 5.6552 | 492  | 1.3347          | 0.5077 | 1.3347 | 1.1553 |
| No log        | 5.6782 | 494  | 1.4334          | 0.4662 | 1.4334 | 1.1972 |
| No log        | 5.7011 | 496  | 1.5450          | 0.4593 | 1.5450 | 1.2430 |
| No log        | 5.7241 | 498  | 1.5718          | 0.4593 | 1.5718 | 1.2537 |
| 0.4347        | 5.7471 | 500  | 1.5015          | 0.4394 | 1.5015 | 1.2254 |
| 0.4347        | 5.7701 | 502  | 1.3400          | 0.5039 | 1.3400 | 1.1576 |
| 0.4347        | 5.7931 | 504  | 1.2568          | 0.4915 | 1.2568 | 1.1211 |
| 0.4347        | 5.8161 | 506  | 1.2432          | 0.4915 | 1.2432 | 1.1150 |
| 0.4347        | 5.8391 | 508  | 1.2658          | 0.5161 | 1.2658 | 1.1251 |
| 0.4347        | 5.8621 | 510  | 1.4334          | 0.4848 | 1.4334 | 1.1972 |
| 0.4347        | 5.8851 | 512  | 1.5819          | 0.3676 | 1.5819 | 1.2577 |
| 0.4347        | 5.9080 | 514  | 1.5649          | 0.3852 | 1.5649 | 1.2509 |
| 0.4347        | 5.9310 | 516  | 1.3894          | 0.4889 | 1.3894 | 1.1787 |
| 0.4347        | 5.9540 | 518  | 1.1733          | 0.5564 | 1.1733 | 1.0832 |
| 0.4347        | 5.9770 | 520  | 1.0960          | 0.5581 | 1.0960 | 1.0469 |
| 0.4347        | 6.0    | 522  | 1.1116          | 0.5649 | 1.1116 | 1.0543 |
| 0.4347        | 6.0230 | 524  | 1.1948          | 0.5455 | 1.1948 | 1.0931 |
| 0.4347        | 6.0460 | 526  | 1.3285          | 0.5113 | 1.3285 | 1.1526 |
| 0.4347        | 6.0690 | 528  | 1.3922          | 0.4697 | 1.3922 | 1.1799 |
| 0.4347        | 6.0920 | 530  | 1.3815          | 0.4580 | 1.3815 | 1.1754 |
| 0.4347        | 6.1149 | 532  | 1.2919          | 0.5312 | 1.2919 | 1.1366 |
| 0.4347        | 6.1379 | 534  | 1.2262          | 0.5397 | 1.2262 | 1.1073 |
| 0.4347        | 6.1609 | 536  | 1.2131          | 0.512  | 1.2131 | 1.1014 |
| 0.4347        | 6.1839 | 538  | 1.2450          | 0.512  | 1.2450 | 1.1158 |
| 0.4347        | 6.2069 | 540  | 1.3866          | 0.4615 | 1.3866 | 1.1776 |
| 0.4347        | 6.2299 | 542  | 1.6000          | 0.4    | 1.6000 | 1.2649 |
| 0.4347        | 6.2529 | 544  | 1.7320          | 0.3333 | 1.7320 | 1.3161 |
| 0.4347        | 6.2759 | 546  | 1.7131          | 0.3165 | 1.7131 | 1.3088 |
| 0.4347        | 6.2989 | 548  | 1.5479          | 0.4265 | 1.5479 | 1.2441 |
| 0.4347        | 6.3218 | 550  | 1.3998          | 0.4511 | 1.3998 | 1.1831 |
| 0.4347        | 6.3448 | 552  | 1.3579          | 0.4923 | 1.3579 | 1.1653 |
| 0.4347        | 6.3678 | 554  | 1.3935          | 0.4885 | 1.3935 | 1.1805 |
| 0.4347        | 6.3908 | 556  | 1.4059          | 0.5312 | 1.4059 | 1.1857 |
| 0.4347        | 6.4138 | 558  | 1.4852          | 0.4769 | 1.4852 | 1.2187 |
| 0.4347        | 6.4368 | 560  | 1.5676          | 0.4154 | 1.5676 | 1.2521 |
| 0.4347        | 6.4598 | 562  | 1.5989          | 0.4154 | 1.5989 | 1.2645 |
| 0.4347        | 6.4828 | 564  | 1.5775          | 0.4242 | 1.5775 | 1.2560 |
| 0.4347        | 6.5057 | 566  | 1.5556          | 0.4328 | 1.5556 | 1.2473 |
| 0.4347        | 6.5287 | 568  | 1.4635          | 0.4511 | 1.4635 | 1.2097 |
| 0.4347        | 6.5517 | 570  | 1.4034          | 0.4812 | 1.4034 | 1.1846 |
| 0.4347        | 6.5747 | 572  | 1.4276          | 0.4776 | 1.4276 | 1.1948 |
| 0.4347        | 6.5977 | 574  | 1.5342          | 0.4348 | 1.5342 | 1.2386 |
| 0.4347        | 6.6207 | 576  | 1.6155          | 0.3913 | 1.6155 | 1.2710 |
| 0.4347        | 6.6437 | 578  | 1.6526          | 0.3741 | 1.6526 | 1.2855 |
| 0.4347        | 6.6667 | 580  | 1.4867          | 0.4444 | 1.4867 | 1.2193 |
| 0.4347        | 6.6897 | 582  | 1.3511          | 0.5077 | 1.3511 | 1.1623 |
| 0.4347        | 6.7126 | 584  | 1.2709          | 0.512  | 1.2709 | 1.1273 |
| 0.4347        | 6.7356 | 586  | 1.2833          | 0.4754 | 1.2833 | 1.1328 |
| 0.4347        | 6.7586 | 588  | 1.3130          | 0.5    | 1.3130 | 1.1458 |
| 0.4347        | 6.7816 | 590  | 1.3059          | 0.512  | 1.3059 | 1.1427 |
| 0.4347        | 6.8046 | 592  | 1.3349          | 0.5312 | 1.3349 | 1.1554 |
| 0.4347        | 6.8276 | 594  | 1.3663          | 0.4885 | 1.3663 | 1.1689 |
| 0.4347        | 6.8506 | 596  | 1.4730          | 0.4627 | 1.4730 | 1.2137 |
| 0.4347        | 6.8736 | 598  | 1.5839          | 0.3913 | 1.5839 | 1.2585 |
| 0.4347        | 6.8966 | 600  | 1.5044          | 0.4265 | 1.5044 | 1.2265 |
| 0.4347        | 6.9195 | 602  | 1.3039          | 0.5263 | 1.3039 | 1.1419 |
| 0.4347        | 6.9425 | 604  | 1.1330          | 0.5736 | 1.1330 | 1.0644 |
| 0.4347        | 6.9655 | 606  | 1.0688          | 0.5556 | 1.0688 | 1.0338 |
| 0.4347        | 6.9885 | 608  | 1.0872          | 0.5669 | 1.0872 | 1.0427 |
| 0.4347        | 7.0115 | 610  | 1.1955          | 0.5606 | 1.1955 | 1.0934 |
| 0.4347        | 7.0345 | 612  | 1.3510          | 0.5    | 1.3510 | 1.1623 |
| 0.4347        | 7.0575 | 614  | 1.4167          | 0.4962 | 1.4167 | 1.1902 |
| 0.4347        | 7.0805 | 616  | 1.3512          | 0.5    | 1.3512 | 1.1624 |
| 0.4347        | 7.1034 | 618  | 1.2124          | 0.5469 | 1.2124 | 1.1011 |
| 0.4347        | 7.1264 | 620  | 1.1339          | 0.56   | 1.1339 | 1.0649 |
| 0.4347        | 7.1494 | 622  | 1.1438          | 0.56   | 1.1438 | 1.0695 |
| 0.4347        | 7.1724 | 624  | 1.1986          | 0.5323 | 1.1986 | 1.0948 |
| 0.4347        | 7.1954 | 626  | 1.2715          | 0.528  | 1.2715 | 1.1276 |
| 0.4347        | 7.2184 | 628  | 1.3823          | 0.4885 | 1.3823 | 1.1757 |
| 0.4347        | 7.2414 | 630  | 1.4553          | 0.5    | 1.4553 | 1.2064 |
| 0.4347        | 7.2644 | 632  | 1.4225          | 0.4769 | 1.4225 | 1.1927 |
| 0.4347        | 7.2874 | 634  | 1.3294          | 0.5197 | 1.3294 | 1.1530 |
| 0.4347        | 7.3103 | 636  | 1.2544          | 0.5625 | 1.2544 | 1.1200 |
| 0.4347        | 7.3333 | 638  | 1.2116          | 0.5469 | 1.2116 | 1.1007 |
| 0.4347        | 7.3563 | 640  | 1.2316          | 0.5736 | 1.2316 | 1.1098 |
| 0.4347        | 7.3793 | 642  | 1.3420          | 0.5538 | 1.3420 | 1.1584 |
| 0.4347        | 7.4023 | 644  | 1.4724          | 0.4427 | 1.4724 | 1.2134 |
| 0.4347        | 7.4253 | 646  | 1.6138          | 0.3529 | 1.6138 | 1.2704 |
| 0.4347        | 7.4483 | 648  | 1.6128          | 0.3407 | 1.6128 | 1.2699 |
| 0.4347        | 7.4713 | 650  | 1.5286          | 0.3969 | 1.5286 | 1.2364 |
| 0.4347        | 7.4943 | 652  | 1.4003          | 0.5197 | 1.4003 | 1.1833 |
| 0.4347        | 7.5172 | 654  | 1.2823          | 0.5556 | 1.2823 | 1.1324 |
| 0.4347        | 7.5402 | 656  | 1.2540          | 0.56   | 1.2540 | 1.1198 |
| 0.4347        | 7.5632 | 658  | 1.2793          | 0.5556 | 1.2793 | 1.1311 |
| 0.4347        | 7.5862 | 660  | 1.3627          | 0.5469 | 1.3627 | 1.1673 |
| 0.4347        | 7.6092 | 662  | 1.4674          | 0.4697 | 1.4674 | 1.2113 |
| 0.4347        | 7.6322 | 664  | 1.5248          | 0.3407 | 1.5248 | 1.2348 |
| 0.4347        | 7.6552 | 666  | 1.4965          | 0.3676 | 1.4965 | 1.2233 |
| 0.4347        | 7.6782 | 668  | 1.4107          | 0.5152 | 1.4107 | 1.1877 |
| 0.4347        | 7.7011 | 670  | 1.3486          | 0.5414 | 1.3486 | 1.1613 |
| 0.4347        | 7.7241 | 672  | 1.3490          | 0.5152 | 1.3490 | 1.1615 |
| 0.4347        | 7.7471 | 674  | 1.3717          | 0.5152 | 1.3717 | 1.1712 |
| 0.4347        | 7.7701 | 676  | 1.3971          | 0.5152 | 1.3971 | 1.1820 |
| 0.4347        | 7.7931 | 678  | 1.4638          | 0.4848 | 1.4638 | 1.2099 |
| 0.4347        | 7.8161 | 680  | 1.4675          | 0.4885 | 1.4675 | 1.2114 |
| 0.4347        | 7.8391 | 682  | 1.5349          | 0.3910 | 1.5349 | 1.2389 |
| 0.4347        | 7.8621 | 684  | 1.5463          | 0.3910 | 1.5463 | 1.2435 |
| 0.4347        | 7.8851 | 686  | 1.5596          | 0.3910 | 1.5596 | 1.2488 |
| 0.4347        | 7.9080 | 688  | 1.4831          | 0.4806 | 1.4831 | 1.2178 |
| 0.4347        | 7.9310 | 690  | 1.4093          | 0.4806 | 1.4093 | 1.1871 |
| 0.4347        | 7.9540 | 692  | 1.3967          | 0.5197 | 1.3967 | 1.1818 |
| 0.4347        | 7.9770 | 694  | 1.4094          | 0.5197 | 1.4094 | 1.1872 |
| 0.4347        | 8.0    | 696  | 1.4270          | 0.4806 | 1.4270 | 1.1946 |
| 0.4347        | 8.0230 | 698  | 1.3780          | 0.4806 | 1.3780 | 1.1739 |
| 0.4347        | 8.0460 | 700  | 1.3167          | 0.5077 | 1.3167 | 1.1475 |
| 0.4347        | 8.0690 | 702  | 1.2951          | 0.4806 | 1.2951 | 1.1380 |
| 0.4347        | 8.0920 | 704  | 1.3042          | 0.4806 | 1.3042 | 1.1420 |
| 0.4347        | 8.1149 | 706  | 1.3067          | 0.4806 | 1.3067 | 1.1431 |
| 0.4347        | 8.1379 | 708  | 1.2937          | 0.4921 | 1.2937 | 1.1374 |
| 0.4347        | 8.1609 | 710  | 1.2888          | 0.4921 | 1.2888 | 1.1353 |
| 0.4347        | 8.1839 | 712  | 1.3342          | 0.4800 | 1.3342 | 1.1551 |
| 0.4347        | 8.2069 | 714  | 1.4315          | 0.4531 | 1.4315 | 1.1964 |
| 0.4347        | 8.2299 | 716  | 1.5187          | 0.4615 | 1.5187 | 1.2324 |
| 0.4347        | 8.2529 | 718  | 1.6451          | 0.3556 | 1.6451 | 1.2826 |
| 0.4347        | 8.2759 | 720  | 1.6716          | 0.3504 | 1.6716 | 1.2929 |
| 0.4347        | 8.2989 | 722  | 1.5875          | 0.3824 | 1.5875 | 1.2600 |
| 0.4347        | 8.3218 | 724  | 1.4811          | 0.4662 | 1.4811 | 1.2170 |
| 0.4347        | 8.3448 | 726  | 1.4022          | 0.4545 | 1.4022 | 1.1842 |
| 0.4347        | 8.3678 | 728  | 1.4026          | 0.4885 | 1.4026 | 1.1843 |
| 0.4347        | 8.3908 | 730  | 1.4609          | 0.4545 | 1.4609 | 1.2087 |
| 0.4347        | 8.4138 | 732  | 1.6069          | 0.3910 | 1.6069 | 1.2676 |
| 0.4347        | 8.4368 | 734  | 1.8499          | 0.2817 | 1.8499 | 1.3601 |
| 0.4347        | 8.4598 | 736  | 1.9723          | 0.2517 | 1.9723 | 1.4044 |
| 0.4347        | 8.4828 | 738  | 1.9968          | 0.2517 | 1.9968 | 1.4131 |
| 0.4347        | 8.5057 | 740  | 1.8984          | 0.2517 | 1.8984 | 1.3778 |


### Framework versions

- Transformers 4.44.2
- Pytorch 2.4.0+cu118
- Datasets 2.21.0
- Tokenizers 0.19.1