File size: 26,951 Bytes
463ac76
 
 
 
 
 
3707443
463ac76
 
 
 
 
 
3707443
463ac76
 
 
3707443
 
 
 
463ac76
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
3707443
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
463ac76
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
---
library_name: transformers
base_model: aubmindlab/bert-base-arabertv02
tags:
- generated_from_trainer
model-index:
- name: ArabicNewSplits8_usingALLEssays_FineTuningAraBERT_run1_AugV5_k11_task2_organization
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# ArabicNewSplits8_usingALLEssays_FineTuningAraBERT_run1_AugV5_k11_task2_organization

This model is a fine-tuned version of [aubmindlab/bert-base-arabertv02](https://huggingface.co/aubmindlab/bert-base-arabertv02) on the None dataset.
It achieves the following results on the evaluation set:
- Loss: 0.5621
- Qwk: 0.4691
- Mse: 0.5621
- Rmse: 0.7497

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 2e-05
- train_batch_size: 8
- eval_batch_size: 8
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 100

### Training results

| Training Loss | Epoch   | Step | Validation Loss | Qwk     | Mse    | Rmse   |
|:-------------:|:-------:|:----:|:---------------:|:-------:|:------:|:------:|
| No log        | 0.0351  | 2    | 4.4200          | -0.0244 | 4.4200 | 2.1024 |
| No log        | 0.0702  | 4    | 2.5215          | 0.0485  | 2.5215 | 1.5879 |
| No log        | 0.1053  | 6    | 1.4456          | 0.0383  | 1.4456 | 1.2023 |
| No log        | 0.1404  | 8    | 1.1443          | -0.0490 | 1.1443 | 1.0697 |
| No log        | 0.1754  | 10   | 0.9800          | -0.0408 | 0.9800 | 0.9899 |
| No log        | 0.2105  | 12   | 0.9020          | 0.0512  | 0.9020 | 0.9497 |
| No log        | 0.2456  | 14   | 0.8492          | 0.2676  | 0.8492 | 0.9215 |
| No log        | 0.2807  | 16   | 1.5027          | 0.1211  | 1.5027 | 1.2259 |
| No log        | 0.3158  | 18   | 1.5323          | 0.1155  | 1.5323 | 1.2379 |
| No log        | 0.3509  | 20   | 0.8796          | 0.2564  | 0.8796 | 0.9379 |
| No log        | 0.3860  | 22   | 0.6798          | 0.3074  | 0.6798 | 0.8245 |
| No log        | 0.4211  | 24   | 0.6636          | 0.3967  | 0.6636 | 0.8146 |
| No log        | 0.4561  | 26   | 0.7656          | 0.2830  | 0.7656 | 0.8750 |
| No log        | 0.4912  | 28   | 1.1124          | 0.1708  | 1.1124 | 1.0547 |
| No log        | 0.5263  | 30   | 0.9898          | 0.2224  | 0.9898 | 0.9949 |
| No log        | 0.5614  | 32   | 0.9910          | 0.2224  | 0.9910 | 0.9955 |
| No log        | 0.5965  | 34   | 0.8933          | 0.2191  | 0.8933 | 0.9451 |
| No log        | 0.6316  | 36   | 0.9160          | 0.2191  | 0.9160 | 0.9571 |
| No log        | 0.6667  | 38   | 1.0336          | 0.2622  | 1.0336 | 1.0167 |
| No log        | 0.7018  | 40   | 0.9107          | 0.3279  | 0.9107 | 0.9543 |
| No log        | 0.7368  | 42   | 0.6430          | 0.4285  | 0.6430 | 0.8018 |
| No log        | 0.7719  | 44   | 0.7071          | 0.3596  | 0.7071 | 0.8409 |
| No log        | 0.8070  | 46   | 0.7477          | 0.3873  | 0.7477 | 0.8647 |
| No log        | 0.8421  | 48   | 0.6924          | 0.3774  | 0.6924 | 0.8321 |
| No log        | 0.8772  | 50   | 0.6838          | 0.3935  | 0.6838 | 0.8269 |
| No log        | 0.9123  | 52   | 0.8099          | 0.4007  | 0.8099 | 0.9000 |
| No log        | 0.9474  | 54   | 0.7370          | 0.3941  | 0.7370 | 0.8585 |
| No log        | 0.9825  | 56   | 0.7982          | 0.4033  | 0.7982 | 0.8934 |
| No log        | 1.0175  | 58   | 0.7783          | 0.4033  | 0.7783 | 0.8822 |
| No log        | 1.0526  | 60   | 0.6508          | 0.4716  | 0.6508 | 0.8067 |
| No log        | 1.0877  | 62   | 0.6065          | 0.4974  | 0.6065 | 0.7788 |
| No log        | 1.1228  | 64   | 0.6528          | 0.4791  | 0.6528 | 0.8080 |
| No log        | 1.1579  | 66   | 0.7195          | 0.4408  | 0.7195 | 0.8483 |
| No log        | 1.1930  | 68   | 0.8678          | 0.3754  | 0.8678 | 0.9316 |
| No log        | 1.2281  | 70   | 0.7659          | 0.4184  | 0.7659 | 0.8751 |
| No log        | 1.2632  | 72   | 0.6102          | 0.5172  | 0.6102 | 0.7812 |
| No log        | 1.2982  | 74   | 0.5555          | 0.6053  | 0.5555 | 0.7453 |
| No log        | 1.3333  | 76   | 0.5376          | 0.6186  | 0.5376 | 0.7332 |
| No log        | 1.3684  | 78   | 0.7040          | 0.4806  | 0.7041 | 0.8391 |
| No log        | 1.4035  | 80   | 0.9842          | 0.4319  | 0.9842 | 0.9921 |
| No log        | 1.4386  | 82   | 1.0666          | 0.4093  | 1.0666 | 1.0327 |
| No log        | 1.4737  | 84   | 0.7975          | 0.4314  | 0.7975 | 0.8930 |
| No log        | 1.5088  | 86   | 0.5379          | 0.5368  | 0.5379 | 0.7334 |
| No log        | 1.5439  | 88   | 0.5579          | 0.5361  | 0.5579 | 0.7469 |
| No log        | 1.5789  | 90   | 0.5789          | 0.5227  | 0.5789 | 0.7609 |
| No log        | 1.6140  | 92   | 0.5432          | 0.5492  | 0.5432 | 0.7371 |
| No log        | 1.6491  | 94   | 0.7044          | 0.4918  | 0.7044 | 0.8393 |
| No log        | 1.6842  | 96   | 0.8144          | 0.4688  | 0.8144 | 0.9024 |
| No log        | 1.7193  | 98   | 0.7234          | 0.5464  | 0.7234 | 0.8505 |
| No log        | 1.7544  | 100  | 0.8323          | 0.5349  | 0.8323 | 0.9123 |
| No log        | 1.7895  | 102  | 1.0668          | 0.4505  | 1.0668 | 1.0329 |
| No log        | 1.8246  | 104  | 1.0303          | 0.4786  | 1.0303 | 1.0150 |
| No log        | 1.8596  | 106  | 0.9724          | 0.5279  | 0.9724 | 0.9861 |
| No log        | 1.8947  | 108  | 0.8267          | 0.5602  | 0.8267 | 0.9092 |
| No log        | 1.9298  | 110  | 0.7692          | 0.5869  | 0.7692 | 0.8771 |
| No log        | 1.9649  | 112  | 0.7170          | 0.5614  | 0.7170 | 0.8468 |
| No log        | 2.0     | 114  | 0.7642          | 0.5582  | 0.7642 | 0.8742 |
| No log        | 2.0351  | 116  | 0.8182          | 0.5329  | 0.8182 | 0.9045 |
| No log        | 2.0702  | 118  | 0.8717          | 0.4738  | 0.8717 | 0.9336 |
| No log        | 2.1053  | 120  | 0.7082          | 0.4737  | 0.7082 | 0.8416 |
| No log        | 2.1404  | 122  | 0.6336          | 0.5199  | 0.6336 | 0.7960 |
| No log        | 2.1754  | 124  | 0.6287          | 0.5080  | 0.6287 | 0.7929 |
| No log        | 2.2105  | 126  | 0.6005          | 0.4949  | 0.6005 | 0.7749 |
| No log        | 2.2456  | 128  | 0.5940          | 0.4875  | 0.5940 | 0.7707 |
| No log        | 2.2807  | 130  | 0.6019          | 0.4834  | 0.6019 | 0.7758 |
| No log        | 2.3158  | 132  | 0.5799          | 0.5514  | 0.5799 | 0.7615 |
| No log        | 2.3509  | 134  | 0.6264          | 0.5500  | 0.6264 | 0.7915 |
| No log        | 2.3860  | 136  | 0.5986          | 0.5593  | 0.5986 | 0.7737 |
| No log        | 2.4211  | 138  | 0.6129          | 0.5709  | 0.6129 | 0.7829 |
| No log        | 2.4561  | 140  | 0.6691          | 0.5391  | 0.6691 | 0.8180 |
| No log        | 2.4912  | 142  | 0.6760          | 0.5417  | 0.6760 | 0.8222 |
| No log        | 2.5263  | 144  | 0.6174          | 0.5697  | 0.6174 | 0.7857 |
| No log        | 2.5614  | 146  | 0.5978          | 0.5495  | 0.5978 | 0.7732 |
| No log        | 2.5965  | 148  | 0.5874          | 0.5521  | 0.5874 | 0.7664 |
| No log        | 2.6316  | 150  | 0.5975          | 0.5398  | 0.5975 | 0.7730 |
| No log        | 2.6667  | 152  | 0.5653          | 0.5567  | 0.5653 | 0.7519 |
| No log        | 2.7018  | 154  | 0.5644          | 0.4522  | 0.5644 | 0.7513 |
| No log        | 2.7368  | 156  | 0.5877          | 0.4337  | 0.5877 | 0.7666 |
| No log        | 2.7719  | 158  | 0.5592          | 0.5060  | 0.5592 | 0.7478 |
| No log        | 2.8070  | 160  | 0.5769          | 0.5179  | 0.5769 | 0.7595 |
| No log        | 2.8421  | 162  | 0.5915          | 0.5579  | 0.5915 | 0.7691 |
| No log        | 2.8772  | 164  | 0.5628          | 0.5660  | 0.5628 | 0.7502 |
| No log        | 2.9123  | 166  | 0.5587          | 0.5445  | 0.5587 | 0.7475 |
| No log        | 2.9474  | 168  | 0.6018          | 0.5370  | 0.6018 | 0.7757 |
| No log        | 2.9825  | 170  | 1.1185          | 0.2977  | 1.1185 | 1.0576 |
| No log        | 3.0175  | 172  | 1.5856          | 0.3024  | 1.5856 | 1.2592 |
| No log        | 3.0526  | 174  | 1.3929          | 0.3315  | 1.3929 | 1.1802 |
| No log        | 3.0877  | 176  | 0.8295          | 0.4551  | 0.8295 | 0.9108 |
| No log        | 3.1228  | 178  | 0.6394          | 0.5191  | 0.6394 | 0.7996 |
| No log        | 3.1579  | 180  | 0.5464          | 0.5565  | 0.5464 | 0.7392 |
| No log        | 3.1930  | 182  | 0.5890          | 0.5053  | 0.5890 | 0.7675 |
| No log        | 3.2281  | 184  | 0.5669          | 0.5342  | 0.5669 | 0.7529 |
| No log        | 3.2632  | 186  | 0.5556          | 0.6091  | 0.5556 | 0.7454 |
| No log        | 3.2982  | 188  | 0.6250          | 0.5504  | 0.6250 | 0.7906 |
| No log        | 3.3333  | 190  | 0.6007          | 0.5751  | 0.6007 | 0.7751 |
| No log        | 3.3684  | 192  | 0.5782          | 0.5867  | 0.5782 | 0.7604 |
| No log        | 3.4035  | 194  | 0.6393          | 0.4988  | 0.6393 | 0.7996 |
| No log        | 3.4386  | 196  | 0.6734          | 0.4863  | 0.6734 | 0.8206 |
| No log        | 3.4737  | 198  | 0.6358          | 0.4840  | 0.6358 | 0.7974 |
| No log        | 3.5088  | 200  | 0.5793          | 0.5422  | 0.5793 | 0.7611 |
| No log        | 3.5439  | 202  | 0.5611          | 0.4506  | 0.5611 | 0.7491 |
| No log        | 3.5789  | 204  | 0.5658          | 0.4079  | 0.5658 | 0.7522 |
| No log        | 3.6140  | 206  | 0.5685          | 0.4042  | 0.5685 | 0.7540 |
| No log        | 3.6491  | 208  | 0.5801          | 0.4855  | 0.5801 | 0.7617 |
| No log        | 3.6842  | 210  | 0.5960          | 0.5164  | 0.5960 | 0.7720 |
| No log        | 3.7193  | 212  | 0.5987          | 0.4921  | 0.5987 | 0.7738 |
| No log        | 3.7544  | 214  | 0.6403          | 0.5095  | 0.6403 | 0.8002 |
| No log        | 3.7895  | 216  | 0.6176          | 0.5172  | 0.6176 | 0.7859 |
| No log        | 3.8246  | 218  | 0.6512          | 0.4971  | 0.6512 | 0.8070 |
| No log        | 3.8596  | 220  | 0.6619          | 0.4867  | 0.6619 | 0.8136 |
| No log        | 3.8947  | 222  | 0.6091          | 0.4174  | 0.6091 | 0.7805 |
| No log        | 3.9298  | 224  | 0.6686          | 0.4033  | 0.6686 | 0.8177 |
| No log        | 3.9649  | 226  | 0.6089          | 0.3691  | 0.6089 | 0.7803 |
| No log        | 4.0     | 228  | 0.5770          | 0.4273  | 0.5770 | 0.7596 |
| No log        | 4.0351  | 230  | 0.5849          | 0.4846  | 0.5849 | 0.7648 |
| No log        | 4.0702  | 232  | 0.8004          | 0.4983  | 0.8004 | 0.8947 |
| No log        | 4.1053  | 234  | 0.9954          | 0.3766  | 0.9954 | 0.9977 |
| No log        | 4.1404  | 236  | 0.8244          | 0.4879  | 0.8244 | 0.9080 |
| No log        | 4.1754  | 238  | 0.6231          | 0.5437  | 0.6231 | 0.7894 |
| No log        | 4.2105  | 240  | 0.6703          | 0.5379  | 0.6703 | 0.8187 |
| No log        | 4.2456  | 242  | 0.6327          | 0.5863  | 0.6327 | 0.7954 |
| No log        | 4.2807  | 244  | 0.5538          | 0.4970  | 0.5538 | 0.7442 |
| No log        | 4.3158  | 246  | 0.5551          | 0.5973  | 0.5551 | 0.7450 |
| No log        | 4.3509  | 248  | 0.5475          | 0.5345  | 0.5475 | 0.7400 |
| No log        | 4.3860  | 250  | 0.5437          | 0.4529  | 0.5437 | 0.7374 |
| No log        | 4.4211  | 252  | 0.5395          | 0.4185  | 0.5395 | 0.7345 |
| No log        | 4.4561  | 254  | 0.5466          | 0.5338  | 0.5466 | 0.7393 |
| No log        | 4.4912  | 256  | 0.5354          | 0.4393  | 0.5354 | 0.7317 |
| No log        | 4.5263  | 258  | 0.5623          | 0.4869  | 0.5623 | 0.7498 |
| No log        | 4.5614  | 260  | 0.5772          | 0.5051  | 0.5772 | 0.7597 |
| No log        | 4.5965  | 262  | 0.5447          | 0.5209  | 0.5447 | 0.7380 |
| No log        | 4.6316  | 264  | 0.5436          | 0.5153  | 0.5436 | 0.7373 |
| No log        | 4.6667  | 266  | 0.5426          | 0.5355  | 0.5426 | 0.7366 |
| No log        | 4.7018  | 268  | 0.5438          | 0.5741  | 0.5438 | 0.7374 |
| No log        | 4.7368  | 270  | 0.5763          | 0.5594  | 0.5763 | 0.7592 |
| No log        | 4.7719  | 272  | 0.6543          | 0.5741  | 0.6543 | 0.8089 |
| No log        | 4.8070  | 274  | 0.6180          | 0.5833  | 0.6180 | 0.7861 |
| No log        | 4.8421  | 276  | 0.5450          | 0.6421  | 0.5450 | 0.7382 |
| No log        | 4.8772  | 278  | 0.6391          | 0.4862  | 0.6391 | 0.7994 |
| No log        | 4.9123  | 280  | 0.7290          | 0.5089  | 0.7290 | 0.8538 |
| No log        | 4.9474  | 282  | 0.6237          | 0.5145  | 0.6237 | 0.7898 |
| No log        | 4.9825  | 284  | 0.5278          | 0.4259  | 0.5278 | 0.7265 |
| No log        | 5.0175  | 286  | 0.7424          | 0.4832  | 0.7424 | 0.8616 |
| No log        | 5.0526  | 288  | 0.9817          | 0.4365  | 0.9817 | 0.9908 |
| No log        | 5.0877  | 290  | 0.9107          | 0.4506  | 0.9107 | 0.9543 |
| No log        | 5.1228  | 292  | 0.6477          | 0.5074  | 0.6477 | 0.8048 |
| No log        | 5.1579  | 294  | 0.5463          | 0.4616  | 0.5463 | 0.7391 |
| No log        | 5.1930  | 296  | 0.5384          | 0.4809  | 0.5384 | 0.7338 |
| No log        | 5.2281  | 298  | 0.5360          | 0.5345  | 0.5360 | 0.7321 |
| No log        | 5.2632  | 300  | 0.5440          | 0.4700  | 0.5440 | 0.7376 |
| No log        | 5.2982  | 302  | 0.5904          | 0.5562  | 0.5904 | 0.7684 |
| No log        | 5.3333  | 304  | 0.6440          | 0.5607  | 0.6440 | 0.8025 |
| No log        | 5.3684  | 306  | 0.5828          | 0.6152  | 0.5828 | 0.7634 |
| No log        | 5.4035  | 308  | 0.5810          | 0.5707  | 0.5810 | 0.7622 |
| No log        | 5.4386  | 310  | 0.6750          | 0.5189  | 0.6750 | 0.8216 |
| No log        | 5.4737  | 312  | 0.6521          | 0.5123  | 0.6521 | 0.8075 |
| No log        | 5.5088  | 314  | 0.5700          | 0.5289  | 0.5700 | 0.7550 |
| No log        | 5.5439  | 316  | 0.5513          | 0.5250  | 0.5513 | 0.7425 |
| No log        | 5.5789  | 318  | 0.6628          | 0.5324  | 0.6628 | 0.8141 |
| No log        | 5.6140  | 320  | 0.7076          | 0.5602  | 0.7076 | 0.8412 |
| No log        | 5.6491  | 322  | 0.6318          | 0.6046  | 0.6318 | 0.7948 |
| No log        | 5.6842  | 324  | 0.5912          | 0.6176  | 0.5912 | 0.7689 |
| No log        | 5.7193  | 326  | 0.5661          | 0.5926  | 0.5661 | 0.7524 |
| No log        | 5.7544  | 328  | 0.5383          | 0.5235  | 0.5383 | 0.7337 |
| No log        | 5.7895  | 330  | 0.5454          | 0.5647  | 0.5454 | 0.7385 |
| No log        | 5.8246  | 332  | 0.5520          | 0.5422  | 0.5520 | 0.7430 |
| No log        | 5.8596  | 334  | 0.5439          | 0.5063  | 0.5439 | 0.7375 |
| No log        | 5.8947  | 336  | 0.5592          | 0.5389  | 0.5592 | 0.7478 |
| No log        | 5.9298  | 338  | 0.5550          | 0.5662  | 0.5550 | 0.7450 |
| No log        | 5.9649  | 340  | 0.5715          | 0.5645  | 0.5715 | 0.7560 |
| No log        | 6.0     | 342  | 0.5854          | 0.5591  | 0.5854 | 0.7651 |
| No log        | 6.0351  | 344  | 0.5767          | 0.6363  | 0.5767 | 0.7594 |
| No log        | 6.0702  | 346  | 0.6031          | 0.5732  | 0.6031 | 0.7766 |
| No log        | 6.1053  | 348  | 0.7328          | 0.5677  | 0.7328 | 0.8561 |
| No log        | 6.1404  | 350  | 0.7609          | 0.5186  | 0.7609 | 0.8723 |
| No log        | 6.1754  | 352  | 0.6738          | 0.5381  | 0.6738 | 0.8209 |
| No log        | 6.2105  | 354  | 0.5588          | 0.5569  | 0.5588 | 0.7475 |
| No log        | 6.2456  | 356  | 0.5326          | 0.5596  | 0.5326 | 0.7298 |
| No log        | 6.2807  | 358  | 0.5377          | 0.5073  | 0.5377 | 0.7333 |
| No log        | 6.3158  | 360  | 0.5250          | 0.5259  | 0.5250 | 0.7246 |
| No log        | 6.3509  | 362  | 0.5366          | 0.4697  | 0.5366 | 0.7325 |
| No log        | 6.3860  | 364  | 0.6379          | 0.5442  | 0.6379 | 0.7987 |
| No log        | 6.4211  | 366  | 0.8264          | 0.4867  | 0.8264 | 0.9091 |
| No log        | 6.4561  | 368  | 0.8595          | 0.4788  | 0.8595 | 0.9271 |
| No log        | 6.4912  | 370  | 0.6845          | 0.5709  | 0.6845 | 0.8274 |
| No log        | 6.5263  | 372  | 0.5504          | 0.5772  | 0.5504 | 0.7419 |
| No log        | 6.5614  | 374  | 0.5284          | 0.5947  | 0.5284 | 0.7269 |
| No log        | 6.5965  | 376  | 0.5468          | 0.5678  | 0.5468 | 0.7394 |
| No log        | 6.6316  | 378  | 0.5273          | 0.5593  | 0.5273 | 0.7261 |
| No log        | 6.6667  | 380  | 0.5147          | 0.5562  | 0.5147 | 0.7174 |
| No log        | 6.7018  | 382  | 0.5545          | 0.4926  | 0.5545 | 0.7447 |
| No log        | 6.7368  | 384  | 0.6038          | 0.5023  | 0.6038 | 0.7771 |
| No log        | 6.7719  | 386  | 0.5706          | 0.5076  | 0.5706 | 0.7554 |
| No log        | 6.8070  | 388  | 0.5104          | 0.6306  | 0.5104 | 0.7144 |
| No log        | 6.8421  | 390  | 0.5049          | 0.5583  | 0.5049 | 0.7106 |
| No log        | 6.8772  | 392  | 0.5037          | 0.5428  | 0.5037 | 0.7097 |
| No log        | 6.9123  | 394  | 0.5171          | 0.5570  | 0.5171 | 0.7191 |
| No log        | 6.9474  | 396  | 0.5124          | 0.5732  | 0.5124 | 0.7158 |
| No log        | 6.9825  | 398  | 0.5313          | 0.5593  | 0.5313 | 0.7289 |
| No log        | 7.0175  | 400  | 0.5239          | 0.5435  | 0.5239 | 0.7238 |
| No log        | 7.0526  | 402  | 0.5079          | 0.5888  | 0.5079 | 0.7127 |
| No log        | 7.0877  | 404  | 0.5355          | 0.5124  | 0.5355 | 0.7318 |
| No log        | 7.1228  | 406  | 0.5611          | 0.5104  | 0.5611 | 0.7491 |
| No log        | 7.1579  | 408  | 0.5286          | 0.5452  | 0.5286 | 0.7270 |
| No log        | 7.1930  | 410  | 0.5103          | 0.5694  | 0.5103 | 0.7143 |
| No log        | 7.2281  | 412  | 0.5397          | 0.5565  | 0.5397 | 0.7346 |
| No log        | 7.2632  | 414  | 0.5430          | 0.5540  | 0.5430 | 0.7369 |
| No log        | 7.2982  | 416  | 0.5342          | 0.5495  | 0.5342 | 0.7309 |
| No log        | 7.3333  | 418  | 0.4991          | 0.5336  | 0.4991 | 0.7064 |
| No log        | 7.3684  | 420  | 0.5671          | 0.5380  | 0.5671 | 0.7531 |
| No log        | 7.4035  | 422  | 0.7180          | 0.4929  | 0.7180 | 0.8474 |
| No log        | 7.4386  | 424  | 0.8147          | 0.4307  | 0.8147 | 0.9026 |
| No log        | 7.4737  | 426  | 0.7456          | 0.4806  | 0.7456 | 0.8635 |
| No log        | 7.5088  | 428  | 0.5838          | 0.5197  | 0.5838 | 0.7641 |
| No log        | 7.5439  | 430  | 0.4991          | 0.6270  | 0.4991 | 0.7065 |
| No log        | 7.5789  | 432  | 0.4994          | 0.6424  | 0.4994 | 0.7067 |
| No log        | 7.6140  | 434  | 0.5010          | 0.6183  | 0.5010 | 0.7078 |
| No log        | 7.6491  | 436  | 0.5356          | 0.5971  | 0.5356 | 0.7318 |
| No log        | 7.6842  | 438  | 0.5676          | 0.5367  | 0.5676 | 0.7534 |
| No log        | 7.7193  | 440  | 0.5671          | 0.5626  | 0.5671 | 0.7530 |
| No log        | 7.7544  | 442  | 0.5497          | 0.5214  | 0.5497 | 0.7414 |
| No log        | 7.7895  | 444  | 0.5450          | 0.5414  | 0.5450 | 0.7382 |
| No log        | 7.8246  | 446  | 0.5075          | 0.6425  | 0.5075 | 0.7124 |
| No log        | 7.8596  | 448  | 0.5477          | 0.5997  | 0.5477 | 0.7401 |
| No log        | 7.8947  | 450  | 0.6083          | 0.5469  | 0.6083 | 0.7799 |
| No log        | 7.9298  | 452  | 0.5868          | 0.5865  | 0.5868 | 0.7661 |
| No log        | 7.9649  | 454  | 0.5489          | 0.6232  | 0.5489 | 0.7409 |
| No log        | 8.0     | 456  | 0.5350          | 0.6149  | 0.5350 | 0.7314 |
| No log        | 8.0351  | 458  | 0.5697          | 0.5194  | 0.5697 | 0.7548 |
| No log        | 8.0702  | 460  | 0.5706          | 0.5128  | 0.5706 | 0.7554 |
| No log        | 8.1053  | 462  | 0.5640          | 0.6139  | 0.5640 | 0.7510 |
| No log        | 8.1404  | 464  | 0.5557          | 0.6315  | 0.5557 | 0.7454 |
| No log        | 8.1754  | 466  | 0.5593          | 0.6100  | 0.5593 | 0.7479 |
| No log        | 8.2105  | 468  | 0.5432          | 0.6080  | 0.5432 | 0.7370 |
| No log        | 8.2456  | 470  | 0.5335          | 0.5972  | 0.5335 | 0.7304 |
| No log        | 8.2807  | 472  | 0.5327          | 0.5873  | 0.5327 | 0.7299 |
| No log        | 8.3158  | 474  | 0.5274          | 0.6145  | 0.5274 | 0.7262 |
| No log        | 8.3509  | 476  | 0.5379          | 0.5576  | 0.5379 | 0.7334 |
| No log        | 8.3860  | 478  | 0.5603          | 0.5616  | 0.5603 | 0.7485 |
| No log        | 8.4211  | 480  | 0.5466          | 0.5858  | 0.5466 | 0.7393 |
| No log        | 8.4561  | 482  | 0.5453          | 0.5633  | 0.5453 | 0.7384 |
| No log        | 8.4912  | 484  | 0.5365          | 0.5703  | 0.5365 | 0.7324 |
| No log        | 8.5263  | 486  | 0.5434          | 0.5159  | 0.5434 | 0.7371 |
| No log        | 8.5614  | 488  | 0.5399          | 0.5218  | 0.5399 | 0.7348 |
| No log        | 8.5965  | 490  | 0.5293          | 0.5919  | 0.5293 | 0.7275 |
| No log        | 8.6316  | 492  | 0.5873          | 0.5543  | 0.5873 | 0.7663 |
| No log        | 8.6667  | 494  | 0.6121          | 0.5162  | 0.6121 | 0.7823 |
| No log        | 8.7018  | 496  | 0.5640          | 0.6022  | 0.5640 | 0.7510 |
| No log        | 8.7368  | 498  | 0.5594          | 0.5476  | 0.5594 | 0.7479 |
| 0.3397        | 8.7719  | 500  | 0.6210          | 0.5075  | 0.6210 | 0.7880 |
| 0.3397        | 8.8070  | 502  | 0.6172          | 0.5249  | 0.6172 | 0.7856 |
| 0.3397        | 8.8421  | 504  | 0.5883          | 0.4990  | 0.5883 | 0.7670 |
| 0.3397        | 8.8772  | 506  | 0.5482          | 0.5590  | 0.5482 | 0.7404 |
| 0.3397        | 8.9123  | 508  | 0.5501          | 0.5831  | 0.5501 | 0.7417 |
| 0.3397        | 8.9474  | 510  | 0.5630          | 0.5699  | 0.5630 | 0.7503 |
| 0.3397        | 8.9825  | 512  | 0.5346          | 0.5790  | 0.5346 | 0.7312 |
| 0.3397        | 9.0175  | 514  | 0.5376          | 0.5626  | 0.5376 | 0.7332 |
| 0.3397        | 9.0526  | 516  | 0.5941          | 0.5263  | 0.5941 | 0.7708 |
| 0.3397        | 9.0877  | 518  | 0.6432          | 0.5109  | 0.6432 | 0.8020 |
| 0.3397        | 9.1228  | 520  | 0.5852          | 0.5281  | 0.5852 | 0.7650 |
| 0.3397        | 9.1579  | 522  | 0.5555          | 0.5396  | 0.5555 | 0.7453 |
| 0.3397        | 9.1930  | 524  | 0.5238          | 0.5415  | 0.5238 | 0.7237 |
| 0.3397        | 9.2281  | 526  | 0.5322          | 0.5487  | 0.5322 | 0.7296 |
| 0.3397        | 9.2632  | 528  | 0.5302          | 0.5396  | 0.5302 | 0.7281 |
| 0.3397        | 9.2982  | 530  | 0.5210          | 0.5311  | 0.5210 | 0.7218 |
| 0.3397        | 9.3333  | 532  | 0.5175          | 0.5205  | 0.5175 | 0.7194 |
| 0.3397        | 9.3684  | 534  | 0.5259          | 0.5250  | 0.5259 | 0.7252 |
| 0.3397        | 9.4035  | 536  | 0.5647          | 0.5053  | 0.5647 | 0.7515 |
| 0.3397        | 9.4386  | 538  | 0.6142          | 0.5448  | 0.6142 | 0.7837 |
| 0.3397        | 9.4737  | 540  | 0.6146          | 0.5351  | 0.6146 | 0.7840 |
| 0.3397        | 9.5088  | 542  | 0.6002          | 0.5351  | 0.6002 | 0.7747 |
| 0.3397        | 9.5439  | 544  | 0.5694          | 0.5176  | 0.5694 | 0.7546 |
| 0.3397        | 9.5789  | 546  | 0.5348          | 0.5030  | 0.5348 | 0.7313 |
| 0.3397        | 9.6140  | 548  | 0.5256          | 0.4923  | 0.5256 | 0.7250 |
| 0.3397        | 9.6491  | 550  | 0.5263          | 0.5155  | 0.5263 | 0.7255 |
| 0.3397        | 9.6842  | 552  | 0.5327          | 0.5756  | 0.5327 | 0.7298 |
| 0.3397        | 9.7193  | 554  | 0.5662          | 0.5200  | 0.5662 | 0.7524 |
| 0.3397        | 9.7544  | 556  | 0.5831          | 0.5474  | 0.5831 | 0.7636 |
| 0.3397        | 9.7895  | 558  | 0.5479          | 0.5637  | 0.5479 | 0.7402 |
| 0.3397        | 9.8246  | 560  | 0.5229          | 0.5088  | 0.5229 | 0.7231 |
| 0.3397        | 9.8596  | 562  | 0.5693          | 0.5195  | 0.5693 | 0.7545 |
| 0.3397        | 9.8947  | 564  | 0.5860          | 0.5357  | 0.5860 | 0.7655 |
| 0.3397        | 9.9298  | 566  | 0.5549          | 0.5442  | 0.5549 | 0.7449 |
| 0.3397        | 9.9649  | 568  | 0.5482          | 0.6003  | 0.5482 | 0.7404 |
| 0.3397        | 10.0    | 570  | 0.6294          | 0.5523  | 0.6294 | 0.7933 |
| 0.3397        | 10.0351 | 572  | 0.7071          | 0.5215  | 0.7071 | 0.8409 |
| 0.3397        | 10.0702 | 574  | 0.6636          | 0.5124  | 0.6636 | 0.8146 |
| 0.3397        | 10.1053 | 576  | 0.5781          | 0.5525  | 0.5781 | 0.7603 |
| 0.3397        | 10.1404 | 578  | 0.5612          | 0.5481  | 0.5612 | 0.7491 |
| 0.3397        | 10.1754 | 580  | 0.6054          | 0.5255  | 0.6054 | 0.7781 |
| 0.3397        | 10.2105 | 582  | 0.6069          | 0.5255  | 0.6069 | 0.7791 |
| 0.3397        | 10.2456 | 584  | 0.5714          | 0.4864  | 0.5714 | 0.7559 |
| 0.3397        | 10.2807 | 586  | 0.5403          | 0.5325  | 0.5403 | 0.7350 |
| 0.3397        | 10.3158 | 588  | 0.5763          | 0.5319  | 0.5763 | 0.7592 |
| 0.3397        | 10.3509 | 590  | 0.6368          | 0.5627  | 0.6368 | 0.7980 |
| 0.3397        | 10.3860 | 592  | 0.6454          | 0.5385  | 0.6454 | 0.8034 |
| 0.3397        | 10.4211 | 594  | 0.6133          | 0.5474  | 0.6133 | 0.7832 |
| 0.3397        | 10.4561 | 596  | 0.5742          | 0.5403  | 0.5742 | 0.7578 |
| 0.3397        | 10.4912 | 598  | 0.5713          | 0.5554  | 0.5713 | 0.7558 |
| 0.3397        | 10.5263 | 600  | 0.5695          | 0.5651  | 0.5695 | 0.7547 |
| 0.3397        | 10.5614 | 602  | 0.5768          | 0.5768  | 0.5768 | 0.7595 |
| 0.3397        | 10.5965 | 604  | 0.5729          | 0.5788  | 0.5729 | 0.7569 |
| 0.3397        | 10.6316 | 606  | 0.5627          | 0.5577  | 0.5627 | 0.7502 |
| 0.3397        | 10.6667 | 608  | 0.5486          | 0.5535  | 0.5486 | 0.7407 |
| 0.3397        | 10.7018 | 610  | 0.5429          | 0.4850  | 0.5429 | 0.7368 |
| 0.3397        | 10.7368 | 612  | 0.5484          | 0.4672  | 0.5484 | 0.7406 |
| 0.3397        | 10.7719 | 614  | 0.5505          | 0.4672  | 0.5505 | 0.7420 |
| 0.3397        | 10.8070 | 616  | 0.5516          | 0.5321  | 0.5516 | 0.7427 |
| 0.3397        | 10.8421 | 618  | 0.5583          | 0.5488  | 0.5583 | 0.7472 |
| 0.3397        | 10.8772 | 620  | 0.5680          | 0.5033  | 0.5680 | 0.7536 |
| 0.3397        | 10.9123 | 622  | 0.5885          | 0.4983  | 0.5885 | 0.7671 |
| 0.3397        | 10.9474 | 624  | 0.5953          | 0.4619  | 0.5953 | 0.7715 |
| 0.3397        | 10.9825 | 626  | 0.5785          | 0.4694  | 0.5785 | 0.7606 |
| 0.3397        | 11.0175 | 628  | 0.5621          | 0.4691  | 0.5621 | 0.7497 |


### Framework versions

- Transformers 4.44.2
- Pytorch 2.4.0+cu118
- Datasets 2.21.0
- Tokenizers 0.19.1