File size: 28,811 Bytes
117dd32
 
 
 
 
 
36df57a
117dd32
 
 
 
 
 
36df57a
117dd32
 
 
36df57a
 
 
 
117dd32
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
36df57a
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
117dd32
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
---
library_name: transformers
base_model: aubmindlab/bert-base-arabertv02
tags:
- generated_from_trainer
model-index:
- name: ArabicNewSplits8_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k13_task2_organization
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# ArabicNewSplits8_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k13_task2_organization

This model is a fine-tuned version of [aubmindlab/bert-base-arabertv02](https://huggingface.co/aubmindlab/bert-base-arabertv02) on the None dataset.
It achieves the following results on the evaluation set:
- Loss: 0.6240
- Qwk: 0.4051
- Mse: 0.6240
- Rmse: 0.7900

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 2e-05
- train_batch_size: 8
- eval_batch_size: 8
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 100

### Training results

| Training Loss | Epoch  | Step | Validation Loss | Qwk     | Mse    | Rmse   |
|:-------------:|:------:|:----:|:---------------:|:-------:|:------:|:------:|
| No log        | 0.0290 | 2    | 4.3096          | -0.0253 | 4.3096 | 2.0759 |
| No log        | 0.0580 | 4    | 2.2467          | 0.0656  | 2.2467 | 1.4989 |
| No log        | 0.0870 | 6    | 1.2781          | 0.0205  | 1.2781 | 1.1305 |
| No log        | 0.1159 | 8    | 1.0565          | -0.0965 | 1.0565 | 1.0279 |
| No log        | 0.1449 | 10   | 1.2314          | -0.1047 | 1.2314 | 1.1097 |
| No log        | 0.1739 | 12   | 1.0535          | -0.1321 | 1.0535 | 1.0264 |
| No log        | 0.2029 | 14   | 0.9517          | -0.0334 | 0.9517 | 0.9755 |
| No log        | 0.2319 | 16   | 0.8628          | 0.1240  | 0.8628 | 0.9289 |
| No log        | 0.2609 | 18   | 0.8946          | 0.1163  | 0.8946 | 0.9458 |
| No log        | 0.2899 | 20   | 0.9093          | 0.1217  | 0.9093 | 0.9536 |
| No log        | 0.3188 | 22   | 1.3347          | 0.0363  | 1.3347 | 1.1553 |
| No log        | 0.3478 | 24   | 1.4202          | 0.0262  | 1.4202 | 1.1917 |
| No log        | 0.3768 | 26   | 1.0640          | 0.0031  | 1.0640 | 1.0315 |
| No log        | 0.4058 | 28   | 1.0029          | 0.0684  | 1.0029 | 1.0015 |
| No log        | 0.4348 | 30   | 0.9527          | 0.1349  | 0.9527 | 0.9761 |
| No log        | 0.4638 | 32   | 0.9489          | 0.1186  | 0.9489 | 0.9741 |
| No log        | 0.4928 | 34   | 0.8822          | 0.1804  | 0.8822 | 0.9393 |
| No log        | 0.5217 | 36   | 0.8514          | 0.1669  | 0.8514 | 0.9227 |
| No log        | 0.5507 | 38   | 0.9190          | 0.1295  | 0.9190 | 0.9587 |
| No log        | 0.5797 | 40   | 0.9465          | 0.0434  | 0.9465 | 0.9729 |
| No log        | 0.6087 | 42   | 1.0997          | -0.0915 | 1.0997 | 1.0486 |
| No log        | 0.6377 | 44   | 0.9871          | 0.0450  | 0.9871 | 0.9936 |
| No log        | 0.6667 | 46   | 0.8452          | 0.1878  | 0.8452 | 0.9193 |
| No log        | 0.6957 | 48   | 0.8660          | 0.1716  | 0.8660 | 0.9306 |
| No log        | 0.7246 | 50   | 0.9563          | 0.0401  | 0.9563 | 0.9779 |
| No log        | 0.7536 | 52   | 0.9327          | 0.0851  | 0.9327 | 0.9658 |
| No log        | 0.7826 | 54   | 0.8801          | 0.1898  | 0.8801 | 0.9381 |
| No log        | 0.8116 | 56   | 0.8076          | 0.2862  | 0.8076 | 0.8987 |
| No log        | 0.8406 | 58   | 0.7729          | 0.2916  | 0.7729 | 0.8791 |
| No log        | 0.8696 | 60   | 0.7717          | 0.3025  | 0.7717 | 0.8785 |
| No log        | 0.8986 | 62   | 0.8727          | 0.1898  | 0.8727 | 0.9342 |
| No log        | 0.9275 | 64   | 0.8200          | 0.2551  | 0.8200 | 0.9055 |
| No log        | 0.9565 | 66   | 0.7584          | 0.2690  | 0.7584 | 0.8709 |
| No log        | 0.9855 | 68   | 0.8916          | 0.1568  | 0.8916 | 0.9443 |
| No log        | 1.0145 | 70   | 1.1315          | 0.1919  | 1.1315 | 1.0637 |
| No log        | 1.0435 | 72   | 1.1715          | 0.2064  | 1.1715 | 1.0824 |
| No log        | 1.0725 | 74   | 0.9765          | 0.1988  | 0.9765 | 0.9882 |
| No log        | 1.1014 | 76   | 0.7724          | 0.1408  | 0.7724 | 0.8788 |
| No log        | 1.1304 | 78   | 0.7778          | 0.2834  | 0.7778 | 0.8819 |
| No log        | 1.1594 | 80   | 1.0548          | 0.0296  | 1.0548 | 1.0270 |
| No log        | 1.1884 | 82   | 1.5160          | 0.1439  | 1.5160 | 1.2313 |
| No log        | 1.2174 | 84   | 1.7781          | 0.1872  | 1.7781 | 1.3335 |
| No log        | 1.2464 | 86   | 1.5600          | 0.1495  | 1.5600 | 1.2490 |
| No log        | 1.2754 | 88   | 1.2210          | 0.0614  | 1.2210 | 1.1050 |
| No log        | 1.3043 | 90   | 0.8493          | 0.2624  | 0.8493 | 0.9216 |
| No log        | 1.3333 | 92   | 0.6823          | 0.3121  | 0.6823 | 0.8260 |
| No log        | 1.3623 | 94   | 0.6876          | 0.2114  | 0.6876 | 0.8292 |
| No log        | 1.3913 | 96   | 0.7469          | 0.2828  | 0.7469 | 0.8642 |
| No log        | 1.4203 | 98   | 0.8684          | 0.3307  | 0.8684 | 0.9319 |
| No log        | 1.4493 | 100  | 0.8885          | 0.3188  | 0.8885 | 0.9426 |
| No log        | 1.4783 | 102  | 0.8145          | 0.3419  | 0.8145 | 0.9025 |
| No log        | 1.5072 | 104  | 0.7435          | 0.4110  | 0.7435 | 0.8623 |
| No log        | 1.5362 | 106  | 0.7107          | 0.4462  | 0.7107 | 0.8430 |
| No log        | 1.5652 | 108  | 0.6923          | 0.4350  | 0.6923 | 0.8320 |
| No log        | 1.5942 | 110  | 0.6792          | 0.4174  | 0.6792 | 0.8241 |
| No log        | 1.6232 | 112  | 0.6712          | 0.4074  | 0.6712 | 0.8193 |
| No log        | 1.6522 | 114  | 0.6985          | 0.4192  | 0.6985 | 0.8358 |
| No log        | 1.6812 | 116  | 0.7159          | 0.3922  | 0.7159 | 0.8461 |
| No log        | 1.7101 | 118  | 0.7282          | 0.3865  | 0.7282 | 0.8534 |
| No log        | 1.7391 | 120  | 0.7205          | 0.3590  | 0.7205 | 0.8488 |
| No log        | 1.7681 | 122  | 0.7034          | 0.3443  | 0.7034 | 0.8387 |
| No log        | 1.7971 | 124  | 0.6939          | 0.4181  | 0.6939 | 0.8330 |
| No log        | 1.8261 | 126  | 0.7101          | 0.4155  | 0.7101 | 0.8427 |
| No log        | 1.8551 | 128  | 0.7519          | 0.3186  | 0.7519 | 0.8671 |
| No log        | 1.8841 | 130  | 0.8191          | 0.2586  | 0.8191 | 0.9050 |
| No log        | 1.9130 | 132  | 0.7256          | 0.3637  | 0.7256 | 0.8518 |
| No log        | 1.9420 | 134  | 0.6884          | 0.4020  | 0.6884 | 0.8297 |
| No log        | 1.9710 | 136  | 0.6825          | 0.4072  | 0.6825 | 0.8261 |
| No log        | 2.0    | 138  | 0.7070          | 0.4138  | 0.7070 | 0.8408 |
| No log        | 2.0290 | 140  | 0.6807          | 0.4389  | 0.6807 | 0.8251 |
| No log        | 2.0580 | 142  | 0.6671          | 0.3958  | 0.6671 | 0.8168 |
| No log        | 2.0870 | 144  | 0.7849          | 0.3715  | 0.7849 | 0.8860 |
| No log        | 2.1159 | 146  | 0.7525          | 0.3796  | 0.7525 | 0.8675 |
| No log        | 2.1449 | 148  | 0.6342          | 0.4607  | 0.6342 | 0.7964 |
| No log        | 2.1739 | 150  | 0.7398          | 0.4357  | 0.7398 | 0.8601 |
| No log        | 2.2029 | 152  | 0.7879          | 0.4450  | 0.7879 | 0.8877 |
| No log        | 2.2319 | 154  | 0.7249          | 0.4478  | 0.7249 | 0.8514 |
| No log        | 2.2609 | 156  | 0.6904          | 0.4409  | 0.6904 | 0.8309 |
| No log        | 2.2899 | 158  | 0.7311          | 0.4790  | 0.7311 | 0.8550 |
| No log        | 2.3188 | 160  | 0.7217          | 0.4596  | 0.7217 | 0.8496 |
| No log        | 2.3478 | 162  | 0.7634          | 0.4233  | 0.7634 | 0.8737 |
| No log        | 2.3768 | 164  | 0.9333          | 0.4057  | 0.9333 | 0.9661 |
| No log        | 2.4058 | 166  | 0.8518          | 0.4100  | 0.8518 | 0.9230 |
| No log        | 2.4348 | 168  | 0.6835          | 0.4562  | 0.6835 | 0.8267 |
| No log        | 2.4638 | 170  | 0.8059          | 0.4021  | 0.8059 | 0.8977 |
| No log        | 2.4928 | 172  | 0.8174          | 0.4003  | 0.8174 | 0.9041 |
| No log        | 2.5217 | 174  | 0.6609          | 0.3868  | 0.6609 | 0.8130 |
| No log        | 2.5507 | 176  | 0.6272          | 0.4730  | 0.6272 | 0.7920 |
| No log        | 2.5797 | 178  | 0.6195          | 0.5005  | 0.6195 | 0.7871 |
| No log        | 2.6087 | 180  | 0.7028          | 0.3978  | 0.7028 | 0.8383 |
| No log        | 2.6377 | 182  | 0.9908          | 0.4140  | 0.9908 | 0.9954 |
| No log        | 2.6667 | 184  | 1.0567          | 0.3876  | 1.0567 | 1.0279 |
| No log        | 2.6957 | 186  | 0.8498          | 0.4219  | 0.8498 | 0.9219 |
| No log        | 2.7246 | 188  | 0.6758          | 0.4035  | 0.6758 | 0.8220 |
| No log        | 2.7536 | 190  | 0.6326          | 0.5012  | 0.6326 | 0.7953 |
| No log        | 2.7826 | 192  | 0.6379          | 0.4594  | 0.6379 | 0.7987 |
| No log        | 2.8116 | 194  | 0.6656          | 0.4625  | 0.6656 | 0.8158 |
| No log        | 2.8406 | 196  | 0.6383          | 0.4789  | 0.6383 | 0.7989 |
| No log        | 2.8696 | 198  | 0.6398          | 0.4926  | 0.6398 | 0.7999 |
| No log        | 2.8986 | 200  | 0.6765          | 0.4416  | 0.6765 | 0.8225 |
| No log        | 2.9275 | 202  | 0.6527          | 0.4537  | 0.6527 | 0.8079 |
| No log        | 2.9565 | 204  | 0.6393          | 0.4998  | 0.6393 | 0.7996 |
| No log        | 2.9855 | 206  | 0.6882          | 0.4028  | 0.6882 | 0.8296 |
| No log        | 3.0145 | 208  | 0.6853          | 0.4323  | 0.6853 | 0.8278 |
| No log        | 3.0435 | 210  | 0.6617          | 0.4418  | 0.6617 | 0.8135 |
| No log        | 3.0725 | 212  | 0.6135          | 0.4857  | 0.6135 | 0.7833 |
| No log        | 3.1014 | 214  | 0.6021          | 0.4956  | 0.6021 | 0.7760 |
| No log        | 3.1304 | 216  | 0.6119          | 0.5042  | 0.6119 | 0.7822 |
| No log        | 3.1594 | 218  | 0.6222          | 0.4662  | 0.6222 | 0.7888 |
| No log        | 3.1884 | 220  | 0.6293          | 0.4507  | 0.6293 | 0.7933 |
| No log        | 3.2174 | 222  | 0.6410          | 0.4639  | 0.6410 | 0.8006 |
| No log        | 3.2464 | 224  | 0.6366          | 0.4553  | 0.6366 | 0.7979 |
| No log        | 3.2754 | 226  | 0.6347          | 0.5134  | 0.6347 | 0.7967 |
| No log        | 3.3043 | 228  | 0.6511          | 0.4544  | 0.6511 | 0.8069 |
| No log        | 3.3333 | 230  | 0.7082          | 0.4282  | 0.7082 | 0.8415 |
| No log        | 3.3623 | 232  | 0.6828          | 0.4267  | 0.6828 | 0.8263 |
| No log        | 3.3913 | 234  | 0.6468          | 0.5312  | 0.6468 | 0.8042 |
| No log        | 3.4203 | 236  | 0.7436          | 0.4182  | 0.7436 | 0.8623 |
| No log        | 3.4493 | 238  | 0.7480          | 0.4157  | 0.7480 | 0.8649 |
| No log        | 3.4783 | 240  | 0.6797          | 0.4295  | 0.6797 | 0.8244 |
| No log        | 3.5072 | 242  | 0.6239          | 0.3961  | 0.6239 | 0.7898 |
| No log        | 3.5362 | 244  | 0.6407          | 0.4544  | 0.6407 | 0.8004 |
| No log        | 3.5652 | 246  | 0.6808          | 0.4456  | 0.6808 | 0.8251 |
| No log        | 3.5942 | 248  | 0.6213          | 0.4721  | 0.6213 | 0.7882 |
| No log        | 3.6232 | 250  | 0.5950          | 0.4064  | 0.5950 | 0.7714 |
| No log        | 3.6522 | 252  | 0.6190          | 0.4474  | 0.6190 | 0.7868 |
| No log        | 3.6812 | 254  | 0.5913          | 0.4473  | 0.5913 | 0.7690 |
| No log        | 3.7101 | 256  | 0.5953          | 0.4783  | 0.5953 | 0.7715 |
| No log        | 3.7391 | 258  | 0.5919          | 0.4783  | 0.5919 | 0.7693 |
| No log        | 3.7681 | 260  | 0.5911          | 0.4473  | 0.5911 | 0.7688 |
| No log        | 3.7971 | 262  | 0.5936          | 0.4760  | 0.5936 | 0.7704 |
| No log        | 3.8261 | 264  | 0.6009          | 0.4686  | 0.6009 | 0.7752 |
| No log        | 3.8551 | 266  | 0.6517          | 0.4741  | 0.6517 | 0.8073 |
| No log        | 3.8841 | 268  | 0.6544          | 0.4826  | 0.6544 | 0.8090 |
| No log        | 3.9130 | 270  | 0.6371          | 0.4645  | 0.6371 | 0.7982 |
| No log        | 3.9420 | 272  | 0.6428          | 0.4225  | 0.6428 | 0.8018 |
| No log        | 3.9710 | 274  | 0.6486          | 0.4018  | 0.6486 | 0.8054 |
| No log        | 4.0    | 276  | 0.6450          | 0.3691  | 0.6450 | 0.8031 |
| No log        | 4.0290 | 278  | 0.6516          | 0.3405  | 0.6516 | 0.8072 |
| No log        | 4.0580 | 280  | 0.6310          | 0.3631  | 0.6310 | 0.7943 |
| No log        | 4.0870 | 282  | 0.6242          | 0.4042  | 0.6242 | 0.7900 |
| No log        | 4.1159 | 284  | 0.6184          | 0.4790  | 0.6184 | 0.7864 |
| No log        | 4.1449 | 286  | 0.6100          | 0.4737  | 0.6100 | 0.7810 |
| No log        | 4.1739 | 288  | 0.5999          | 0.4737  | 0.5999 | 0.7746 |
| No log        | 4.2029 | 290  | 0.6003          | 0.4767  | 0.6003 | 0.7748 |
| No log        | 4.2319 | 292  | 0.6064          | 0.4600  | 0.6064 | 0.7787 |
| No log        | 4.2609 | 294  | 0.6140          | 0.5088  | 0.6140 | 0.7836 |
| No log        | 4.2899 | 296  | 0.6313          | 0.4420  | 0.6313 | 0.7946 |
| No log        | 4.3188 | 298  | 0.6842          | 0.4428  | 0.6842 | 0.8272 |
| No log        | 4.3478 | 300  | 0.6569          | 0.3965  | 0.6569 | 0.8105 |
| No log        | 4.3768 | 302  | 0.6262          | 0.4909  | 0.6262 | 0.7913 |
| No log        | 4.4058 | 304  | 0.6431          | 0.5327  | 0.6431 | 0.8020 |
| No log        | 4.4348 | 306  | 0.6711          | 0.5438  | 0.6711 | 0.8192 |
| No log        | 4.4638 | 308  | 0.6953          | 0.5327  | 0.6953 | 0.8339 |
| No log        | 4.4928 | 310  | 0.7171          | 0.5394  | 0.7171 | 0.8468 |
| No log        | 4.5217 | 312  | 0.6977          | 0.5267  | 0.6977 | 0.8353 |
| No log        | 4.5507 | 314  | 0.7458          | 0.4976  | 0.7458 | 0.8636 |
| No log        | 4.5797 | 316  | 0.7675          | 0.4698  | 0.7675 | 0.8760 |
| No log        | 4.6087 | 318  | 0.6975          | 0.5143  | 0.6975 | 0.8352 |
| No log        | 4.6377 | 320  | 0.6243          | 0.5526  | 0.6243 | 0.7901 |
| No log        | 4.6667 | 322  | 0.6406          | 0.53    | 0.6406 | 0.8004 |
| No log        | 4.6957 | 324  | 0.6753          | 0.5046  | 0.6753 | 0.8218 |
| No log        | 4.7246 | 326  | 0.6372          | 0.5026  | 0.6372 | 0.7982 |
| No log        | 4.7536 | 328  | 0.6637          | 0.4960  | 0.6637 | 0.8147 |
| No log        | 4.7826 | 330  | 0.6529          | 0.5075  | 0.6529 | 0.8080 |
| No log        | 4.8116 | 332  | 0.6002          | 0.5384  | 0.6002 | 0.7747 |
| No log        | 4.8406 | 334  | 0.5975          | 0.5321  | 0.5975 | 0.7730 |
| No log        | 4.8696 | 336  | 0.6436          | 0.5054  | 0.6436 | 0.8022 |
| No log        | 4.8986 | 338  | 0.6695          | 0.4706  | 0.6695 | 0.8182 |
| No log        | 4.9275 | 340  | 0.6415          | 0.4702  | 0.6415 | 0.8009 |
| No log        | 4.9565 | 342  | 0.6335          | 0.4102  | 0.6335 | 0.7959 |
| No log        | 4.9855 | 344  | 0.6519          | 0.4175  | 0.6519 | 0.8074 |
| No log        | 5.0145 | 346  | 0.6423          | 0.4177  | 0.6423 | 0.8014 |
| No log        | 5.0435 | 348  | 0.6793          | 0.4438  | 0.6793 | 0.8242 |
| No log        | 5.0725 | 350  | 0.7265          | 0.4242  | 0.7265 | 0.8524 |
| No log        | 5.1014 | 352  | 0.6739          | 0.4137  | 0.6739 | 0.8209 |
| No log        | 5.1304 | 354  | 0.6432          | 0.4146  | 0.6432 | 0.8020 |
| No log        | 5.1594 | 356  | 0.6359          | 0.4514  | 0.6359 | 0.7974 |
| No log        | 5.1884 | 358  | 0.6351          | 0.4546  | 0.6351 | 0.7969 |
| No log        | 5.2174 | 360  | 0.6335          | 0.4447  | 0.6335 | 0.7959 |
| No log        | 5.2464 | 362  | 0.6318          | 0.4642  | 0.6318 | 0.7949 |
| No log        | 5.2754 | 364  | 0.6457          | 0.4151  | 0.6457 | 0.8036 |
| No log        | 5.3043 | 366  | 0.6362          | 0.4529  | 0.6362 | 0.7976 |
| No log        | 5.3333 | 368  | 0.6345          | 0.4621  | 0.6345 | 0.7966 |
| No log        | 5.3623 | 370  | 0.6358          | 0.4539  | 0.6358 | 0.7974 |
| No log        | 5.3913 | 372  | 0.6246          | 0.4442  | 0.6246 | 0.7903 |
| No log        | 5.4203 | 374  | 0.6109          | 0.4539  | 0.6109 | 0.7816 |
| No log        | 5.4493 | 376  | 0.6238          | 0.4337  | 0.6238 | 0.7898 |
| No log        | 5.4783 | 378  | 0.5954          | 0.4556  | 0.5954 | 0.7716 |
| No log        | 5.5072 | 380  | 0.6131          | 0.4698  | 0.6131 | 0.7830 |
| No log        | 5.5362 | 382  | 0.6281          | 0.48    | 0.6281 | 0.7925 |
| No log        | 5.5652 | 384  | 0.6075          | 0.4426  | 0.6075 | 0.7794 |
| No log        | 5.5942 | 386  | 0.6192          | 0.4391  | 0.6192 | 0.7869 |
| No log        | 5.6232 | 388  | 0.6466          | 0.4080  | 0.6466 | 0.8041 |
| No log        | 5.6522 | 390  | 0.6418          | 0.4080  | 0.6418 | 0.8011 |
| No log        | 5.6812 | 392  | 0.6191          | 0.4391  | 0.6191 | 0.7868 |
| No log        | 5.7101 | 394  | 0.6164          | 0.4359  | 0.6164 | 0.7851 |
| No log        | 5.7391 | 396  | 0.6217          | 0.4506  | 0.6217 | 0.7885 |
| No log        | 5.7681 | 398  | 0.6621          | 0.4656  | 0.6621 | 0.8137 |
| No log        | 5.7971 | 400  | 0.6880          | 0.4928  | 0.6880 | 0.8295 |
| No log        | 5.8261 | 402  | 0.6443          | 0.4913  | 0.6443 | 0.8027 |
| No log        | 5.8551 | 404  | 0.6514          | 0.4503  | 0.6514 | 0.8071 |
| No log        | 5.8841 | 406  | 0.7056          | 0.4502  | 0.7056 | 0.8400 |
| No log        | 5.9130 | 408  | 0.6544          | 0.4404  | 0.6544 | 0.8089 |
| No log        | 5.9420 | 410  | 0.6025          | 0.5226  | 0.6025 | 0.7762 |
| No log        | 5.9710 | 412  | 0.6304          | 0.4293  | 0.6304 | 0.7940 |
| No log        | 6.0    | 414  | 0.6315          | 0.3944  | 0.6315 | 0.7947 |
| No log        | 6.0290 | 416  | 0.6094          | 0.3810  | 0.6094 | 0.7806 |
| No log        | 6.0580 | 418  | 0.5910          | 0.4073  | 0.5910 | 0.7688 |
| No log        | 6.0870 | 420  | 0.5911          | 0.4602  | 0.5911 | 0.7689 |
| No log        | 6.1159 | 422  | 0.6048          | 0.4598  | 0.6048 | 0.7777 |
| No log        | 6.1449 | 424  | 0.6090          | 0.4349  | 0.6090 | 0.7804 |
| No log        | 6.1739 | 426  | 0.6079          | 0.4880  | 0.6079 | 0.7797 |
| No log        | 6.2029 | 428  | 0.6324          | 0.3828  | 0.6324 | 0.7952 |
| No log        | 6.2319 | 430  | 0.6173          | 0.4625  | 0.6173 | 0.7857 |
| No log        | 6.2609 | 432  | 0.6096          | 0.4690  | 0.6096 | 0.7808 |
| No log        | 6.2899 | 434  | 0.6282          | 0.4840  | 0.6282 | 0.7926 |
| No log        | 6.3188 | 436  | 0.6200          | 0.4857  | 0.6200 | 0.7874 |
| No log        | 6.3478 | 438  | 0.5969          | 0.5440  | 0.5969 | 0.7726 |
| No log        | 6.3768 | 440  | 0.5939          | 0.5235  | 0.5939 | 0.7707 |
| No log        | 6.4058 | 442  | 0.5868          | 0.5259  | 0.5868 | 0.7660 |
| No log        | 6.4348 | 444  | 0.6142          | 0.4887  | 0.6142 | 0.7837 |
| No log        | 6.4638 | 446  | 0.6875          | 0.5090  | 0.6875 | 0.8292 |
| No log        | 6.4928 | 448  | 0.6772          | 0.5103  | 0.6772 | 0.8229 |
| No log        | 6.5217 | 450  | 0.6096          | 0.4581  | 0.6096 | 0.7808 |
| No log        | 6.5507 | 452  | 0.6099          | 0.4943  | 0.6099 | 0.7809 |
| No log        | 6.5797 | 454  | 0.6376          | 0.4672  | 0.6376 | 0.7985 |
| No log        | 6.6087 | 456  | 0.6285          | 0.4211  | 0.6285 | 0.7928 |
| No log        | 6.6377 | 458  | 0.6281          | 0.4180  | 0.6281 | 0.7925 |
| No log        | 6.6667 | 460  | 0.6737          | 0.4592  | 0.6737 | 0.8208 |
| No log        | 6.6957 | 462  | 0.6729          | 0.4530  | 0.6729 | 0.8203 |
| No log        | 6.7246 | 464  | 0.6427          | 0.4474  | 0.6427 | 0.8017 |
| No log        | 6.7536 | 466  | 0.6411          | 0.4522  | 0.6411 | 0.8007 |
| No log        | 6.7826 | 468  | 0.6407          | 0.4642  | 0.6407 | 0.8004 |
| No log        | 6.8116 | 470  | 0.6486          | 0.4442  | 0.6486 | 0.8054 |
| No log        | 6.8406 | 472  | 0.6836          | 0.4247  | 0.6836 | 0.8268 |
| No log        | 6.8696 | 474  | 0.7167          | 0.4086  | 0.7167 | 0.8466 |
| No log        | 6.8986 | 476  | 0.6865          | 0.4605  | 0.6865 | 0.8286 |
| No log        | 6.9275 | 478  | 0.6448          | 0.4781  | 0.6448 | 0.8030 |
| No log        | 6.9565 | 480  | 0.7210          | 0.4253  | 0.7210 | 0.8491 |
| No log        | 6.9855 | 482  | 0.7582          | 0.4341  | 0.7582 | 0.8707 |
| No log        | 7.0145 | 484  | 0.7221          | 0.4313  | 0.7221 | 0.8498 |
| No log        | 7.0435 | 486  | 0.6341          | 0.4882  | 0.6341 | 0.7963 |
| No log        | 7.0725 | 488  | 0.6303          | 0.5107  | 0.6303 | 0.7939 |
| No log        | 7.1014 | 490  | 0.6812          | 0.4901  | 0.6812 | 0.8253 |
| No log        | 7.1304 | 492  | 0.6738          | 0.4901  | 0.6738 | 0.8209 |
| No log        | 7.1594 | 494  | 0.6222          | 0.4787  | 0.6222 | 0.7888 |
| No log        | 7.1884 | 496  | 0.5921          | 0.4302  | 0.5921 | 0.7695 |
| No log        | 7.2174 | 498  | 0.6374          | 0.4128  | 0.6374 | 0.7984 |
| 0.4508        | 7.2464 | 500  | 0.6729          | 0.4539  | 0.6729 | 0.8203 |
| 0.4508        | 7.2754 | 502  | 0.6392          | 0.4445  | 0.6392 | 0.7995 |
| 0.4508        | 7.3043 | 504  | 0.5931          | 0.4858  | 0.5931 | 0.7701 |
| 0.4508        | 7.3333 | 506  | 0.6235          | 0.5127  | 0.6235 | 0.7896 |
| 0.4508        | 7.3623 | 508  | 0.6471          | 0.5376  | 0.6471 | 0.8044 |
| 0.4508        | 7.3913 | 510  | 0.6087          | 0.5569  | 0.6087 | 0.7802 |
| 0.4508        | 7.4203 | 512  | 0.6086          | 0.4945  | 0.6086 | 0.7801 |
| 0.4508        | 7.4493 | 514  | 0.6325          | 0.4790  | 0.6325 | 0.7953 |
| 0.4508        | 7.4783 | 516  | 0.6147          | 0.4822  | 0.6147 | 0.7840 |
| 0.4508        | 7.5072 | 518  | 0.5999          | 0.4848  | 0.5999 | 0.7745 |
| 0.4508        | 7.5362 | 520  | 0.6002          | 0.4676  | 0.6002 | 0.7747 |
| 0.4508        | 7.5652 | 522  | 0.5913          | 0.4386  | 0.5913 | 0.7690 |
| 0.4508        | 7.5942 | 524  | 0.6062          | 0.5033  | 0.6062 | 0.7786 |
| 0.4508        | 7.6232 | 526  | 0.6408          | 0.4908  | 0.6408 | 0.8005 |
| 0.4508        | 7.6522 | 528  | 0.6148          | 0.4840  | 0.6148 | 0.7841 |
| 0.4508        | 7.6812 | 530  | 0.5904          | 0.4514  | 0.5904 | 0.7684 |
| 0.4508        | 7.7101 | 532  | 0.5991          | 0.4149  | 0.5991 | 0.7740 |
| 0.4508        | 7.7391 | 534  | 0.6095          | 0.5185  | 0.6095 | 0.7807 |
| 0.4508        | 7.7681 | 536  | 0.6108          | 0.5185  | 0.6108 | 0.7816 |
| 0.4508        | 7.7971 | 538  | 0.6069          | 0.5040  | 0.6069 | 0.7791 |
| 0.4508        | 7.8261 | 540  | 0.6030          | 0.4262  | 0.6030 | 0.7765 |
| 0.4508        | 7.8551 | 542  | 0.6177          | 0.4049  | 0.6177 | 0.7860 |
| 0.4508        | 7.8841 | 544  | 0.6140          | 0.4007  | 0.6140 | 0.7836 |
| 0.4508        | 7.9130 | 546  | 0.6586          | 0.4584  | 0.6586 | 0.8115 |
| 0.4508        | 7.9420 | 548  | 0.7119          | 0.4699  | 0.7119 | 0.8438 |
| 0.4508        | 7.9710 | 550  | 0.6821          | 0.5046  | 0.6821 | 0.8259 |
| 0.4508        | 8.0    | 552  | 0.6194          | 0.4498  | 0.6194 | 0.7870 |
| 0.4508        | 8.0290 | 554  | 0.6313          | 0.4257  | 0.6313 | 0.7946 |
| 0.4508        | 8.0580 | 556  | 0.6396          | 0.4607  | 0.6396 | 0.7997 |
| 0.4508        | 8.0870 | 558  | 0.6137          | 0.5050  | 0.6137 | 0.7834 |
| 0.4508        | 8.1159 | 560  | 0.6378          | 0.5037  | 0.6378 | 0.7986 |
| 0.4508        | 8.1449 | 562  | 0.7104          | 0.5038  | 0.7104 | 0.8429 |
| 0.4508        | 8.1739 | 564  | 0.6821          | 0.5051  | 0.6821 | 0.8259 |
| 0.4508        | 8.2029 | 566  | 0.6136          | 0.4940  | 0.6136 | 0.7833 |
| 0.4508        | 8.2319 | 568  | 0.5743          | 0.4761  | 0.5743 | 0.7579 |
| 0.4508        | 8.2609 | 570  | 0.5650          | 0.4887  | 0.5650 | 0.7517 |
| 0.4508        | 8.2899 | 572  | 0.5602          | 0.5109  | 0.5602 | 0.7485 |
| 0.4508        | 8.3188 | 574  | 0.5718          | 0.4698  | 0.5718 | 0.7562 |
| 0.4508        | 8.3478 | 576  | 0.5888          | 0.4862  | 0.5888 | 0.7673 |
| 0.4508        | 8.3768 | 578  | 0.5759          | 0.4422  | 0.5759 | 0.7589 |
| 0.4508        | 8.4058 | 580  | 0.5673          | 0.4878  | 0.5673 | 0.7532 |
| 0.4508        | 8.4348 | 582  | 0.5738          | 0.4381  | 0.5738 | 0.7575 |
| 0.4508        | 8.4638 | 584  | 0.5916          | 0.4684  | 0.5916 | 0.7691 |
| 0.4508        | 8.4928 | 586  | 0.5794          | 0.4666  | 0.5794 | 0.7612 |
| 0.4508        | 8.5217 | 588  | 0.5801          | 0.4284  | 0.5801 | 0.7616 |
| 0.4508        | 8.5507 | 590  | 0.6492          | 0.4755  | 0.6492 | 0.8057 |
| 0.4508        | 8.5797 | 592  | 0.7257          | 0.5026  | 0.7257 | 0.8519 |
| 0.4508        | 8.6087 | 594  | 0.7043          | 0.5206  | 0.7043 | 0.8392 |
| 0.4508        | 8.6377 | 596  | 0.6325          | 0.4455  | 0.6325 | 0.7953 |
| 0.4508        | 8.6667 | 598  | 0.6177          | 0.4657  | 0.6177 | 0.7859 |
| 0.4508        | 8.6957 | 600  | 0.6554          | 0.4710  | 0.6554 | 0.8096 |
| 0.4508        | 8.7246 | 602  | 0.6487          | 0.4535  | 0.6487 | 0.8054 |
| 0.4508        | 8.7536 | 604  | 0.6140          | 0.4598  | 0.6140 | 0.7836 |
| 0.4508        | 8.7826 | 606  | 0.6044          | 0.4579  | 0.6044 | 0.7775 |
| 0.4508        | 8.8116 | 608  | 0.6049          | 0.4728  | 0.6049 | 0.7777 |
| 0.4508        | 8.8406 | 610  | 0.5918          | 0.4721  | 0.5918 | 0.7693 |
| 0.4508        | 8.8696 | 612  | 0.5777          | 0.4672  | 0.5777 | 0.7601 |
| 0.4508        | 8.8986 | 614  | 0.5743          | 0.4704  | 0.5743 | 0.7578 |
| 0.4508        | 8.9275 | 616  | 0.5717          | 0.4615  | 0.5717 | 0.7561 |
| 0.4508        | 8.9565 | 618  | 0.5700          | 0.4790  | 0.5700 | 0.7550 |
| 0.4508        | 8.9855 | 620  | 0.5844          | 0.4856  | 0.5844 | 0.7645 |
| 0.4508        | 9.0145 | 622  | 0.5911          | 0.5091  | 0.5911 | 0.7688 |
| 0.4508        | 9.0435 | 624  | 0.5989          | 0.5391  | 0.5989 | 0.7739 |
| 0.4508        | 9.0725 | 626  | 0.6055          | 0.5238  | 0.6055 | 0.7781 |
| 0.4508        | 9.1014 | 628  | 0.6037          | 0.5061  | 0.6037 | 0.7770 |
| 0.4508        | 9.1304 | 630  | 0.5968          | 0.4814  | 0.5968 | 0.7726 |
| 0.4508        | 9.1594 | 632  | 0.5937          | 0.4825  | 0.5937 | 0.7705 |
| 0.4508        | 9.1884 | 634  | 0.5925          | 0.5111  | 0.5925 | 0.7697 |
| 0.4508        | 9.2174 | 636  | 0.5969          | 0.5119  | 0.5969 | 0.7726 |
| 0.4508        | 9.2464 | 638  | 0.6378          | 0.4907  | 0.6378 | 0.7986 |
| 0.4508        | 9.2754 | 640  | 0.6413          | 0.4949  | 0.6413 | 0.8008 |
| 0.4508        | 9.3043 | 642  | 0.6073          | 0.5517  | 0.6073 | 0.7793 |
| 0.4508        | 9.3333 | 644  | 0.6065          | 0.5366  | 0.6065 | 0.7788 |
| 0.4508        | 9.3623 | 646  | 0.6436          | 0.4789  | 0.6436 | 0.8022 |
| 0.4508        | 9.3913 | 648  | 0.6326          | 0.5033  | 0.6326 | 0.7953 |
| 0.4508        | 9.4203 | 650  | 0.6020          | 0.5331  | 0.6020 | 0.7759 |
| 0.4508        | 9.4493 | 652  | 0.5877          | 0.5103  | 0.5877 | 0.7666 |
| 0.4508        | 9.4783 | 654  | 0.5863          | 0.5005  | 0.5863 | 0.7657 |
| 0.4508        | 9.5072 | 656  | 0.5990          | 0.4377  | 0.5990 | 0.7740 |
| 0.4508        | 9.5362 | 658  | 0.6309          | 0.4722  | 0.6309 | 0.7943 |
| 0.4508        | 9.5652 | 660  | 0.6171          | 0.4504  | 0.6171 | 0.7856 |
| 0.4508        | 9.5942 | 662  | 0.6177          | 0.4565  | 0.6177 | 0.7860 |
| 0.4508        | 9.6232 | 664  | 0.6115          | 0.4630  | 0.6115 | 0.7820 |
| 0.4508        | 9.6522 | 666  | 0.6143          | 0.4711  | 0.6143 | 0.7838 |
| 0.4508        | 9.6812 | 668  | 0.6398          | 0.5220  | 0.6398 | 0.7998 |
| 0.4508        | 9.7101 | 670  | 0.6493          | 0.5119  | 0.6493 | 0.8058 |
| 0.4508        | 9.7391 | 672  | 0.6203          | 0.5108  | 0.6203 | 0.7876 |
| 0.4508        | 9.7681 | 674  | 0.6092          | 0.4436  | 0.6092 | 0.7805 |
| 0.4508        | 9.7971 | 676  | 0.6280          | 0.4355  | 0.6280 | 0.7924 |
| 0.4508        | 9.8261 | 678  | 0.6342          | 0.4355  | 0.6342 | 0.7964 |
| 0.4508        | 9.8551 | 680  | 0.6120          | 0.4075  | 0.6120 | 0.7823 |
| 0.4508        | 9.8841 | 682  | 0.6240          | 0.4051  | 0.6240 | 0.7900 |


### Framework versions

- Transformers 4.44.2
- Pytorch 2.4.0+cu118
- Datasets 2.21.0
- Tokenizers 0.19.1