File size: 23,617 Bytes
90cc221
 
 
 
 
 
30100c7
90cc221
 
 
 
 
 
30100c7
90cc221
 
 
30100c7
 
 
 
90cc221
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
30100c7
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
90cc221
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
---
library_name: transformers
base_model: aubmindlab/bert-base-arabertv02
tags:
- generated_from_trainer
model-index:
- name: ArabicNewSplits7_OSS_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k3_task1_organization
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# ArabicNewSplits7_OSS_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k3_task1_organization

This model is a fine-tuned version of [aubmindlab/bert-base-arabertv02](https://huggingface.co/aubmindlab/bert-base-arabertv02) on the None dataset.
It achieves the following results on the evaluation set:
- Loss: 0.6083
- Qwk: 0.7613
- Mse: 0.6083
- Rmse: 0.7800

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 2e-05
- train_batch_size: 8
- eval_batch_size: 8
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 100

### Training results

| Training Loss | Epoch   | Step | Validation Loss | Qwk    | Mse    | Rmse   |
|:-------------:|:-------:|:----:|:---------------:|:------:|:------:|:------:|
| No log        | 0.0870  | 2    | 6.7965          | 0.0242 | 6.7965 | 2.6070 |
| No log        | 0.1739  | 4    | 5.2676          | 0.0366 | 5.2676 | 2.2951 |
| No log        | 0.2609  | 6    | 3.0917          | 0.0595 | 3.0917 | 1.7583 |
| No log        | 0.3478  | 8    | 2.5803          | 0.0132 | 2.5803 | 1.6063 |
| No log        | 0.4348  | 10   | 3.5005          | 0.0787 | 3.5005 | 1.8710 |
| No log        | 0.5217  | 12   | 2.6461          | 0.0141 | 2.6461 | 1.6267 |
| No log        | 0.6087  | 14   | 1.7385          | 0.2478 | 1.7385 | 1.3185 |
| No log        | 0.6957  | 16   | 1.6891          | 0.0583 | 1.6891 | 1.2996 |
| No log        | 0.7826  | 18   | 1.6908          | 0.1296 | 1.6908 | 1.3003 |
| No log        | 0.8696  | 20   | 1.6275          | 0.1308 | 1.6275 | 1.2757 |
| No log        | 0.9565  | 22   | 1.4872          | 0.1538 | 1.4872 | 1.2195 |
| No log        | 1.0435  | 24   | 1.5368          | 0.3158 | 1.5368 | 1.2397 |
| No log        | 1.1304  | 26   | 1.3818          | 0.3158 | 1.3818 | 1.1755 |
| No log        | 1.2174  | 28   | 1.2881          | 0.3932 | 1.2881 | 1.1349 |
| No log        | 1.3043  | 30   | 1.1907          | 0.3621 | 1.1907 | 1.0912 |
| No log        | 1.3913  | 32   | 1.1694          | 0.3652 | 1.1694 | 1.0814 |
| No log        | 1.4783  | 34   | 1.1661          | 0.3214 | 1.1661 | 1.0798 |
| No log        | 1.5652  | 36   | 1.0867          | 0.4138 | 1.0867 | 1.0425 |
| No log        | 1.6522  | 38   | 1.0225          | 0.4959 | 1.0225 | 1.0112 |
| No log        | 1.7391  | 40   | 0.9464          | 0.6970 | 0.9464 | 0.9728 |
| No log        | 1.8261  | 42   | 0.8481          | 0.7482 | 0.8481 | 0.9209 |
| No log        | 1.9130  | 44   | 0.7664          | 0.7260 | 0.7664 | 0.8754 |
| No log        | 2.0     | 46   | 0.7207          | 0.7651 | 0.7207 | 0.8489 |
| No log        | 2.0870  | 48   | 0.9562          | 0.5926 | 0.9562 | 0.9779 |
| No log        | 2.1739  | 50   | 1.2811          | 0.5224 | 1.2811 | 1.1319 |
| No log        | 2.2609  | 52   | 1.1457          | 0.5481 | 1.1457 | 1.0704 |
| No log        | 2.3478  | 54   | 1.0695          | 0.5630 | 1.0695 | 1.0342 |
| No log        | 2.4348  | 56   | 1.2533          | 0.5180 | 1.2533 | 1.1195 |
| No log        | 2.5217  | 58   | 1.4337          | 0.4714 | 1.4337 | 1.1974 |
| No log        | 2.6087  | 60   | 1.1399          | 0.5693 | 1.1399 | 1.0677 |
| No log        | 2.6957  | 62   | 0.8858          | 0.5926 | 0.8858 | 0.9412 |
| No log        | 2.7826  | 64   | 0.9129          | 0.6567 | 0.9129 | 0.9555 |
| No log        | 2.8696  | 66   | 1.2352          | 0.5    | 1.2352 | 1.1114 |
| No log        | 2.9565  | 68   | 1.1034          | 0.5606 | 1.1034 | 1.0504 |
| No log        | 3.0435  | 70   | 0.9522          | 0.5891 | 0.9522 | 0.9758 |
| No log        | 3.1304  | 72   | 0.9261          | 0.6142 | 0.9261 | 0.9624 |
| No log        | 3.2174  | 74   | 0.9060          | 0.6515 | 0.9060 | 0.9519 |
| No log        | 3.3043  | 76   | 0.8631          | 0.6667 | 0.8631 | 0.9290 |
| No log        | 3.3913  | 78   | 0.8798          | 0.6522 | 0.8798 | 0.9380 |
| No log        | 3.4783  | 80   | 0.8796          | 0.6324 | 0.8796 | 0.9379 |
| No log        | 3.5652  | 82   | 0.9746          | 0.6222 | 0.9746 | 0.9872 |
| No log        | 3.6522  | 84   | 1.0278          | 0.5899 | 1.0278 | 1.0138 |
| No log        | 3.7391  | 86   | 0.9362          | 0.6479 | 0.9362 | 0.9676 |
| No log        | 3.8261  | 88   | 0.9420          | 0.6383 | 0.9420 | 0.9706 |
| No log        | 3.9130  | 90   | 1.0282          | 0.6383 | 1.0282 | 1.0140 |
| No log        | 4.0     | 92   | 1.3175          | 0.5    | 1.3175 | 1.1478 |
| No log        | 4.0870  | 94   | 1.2619          | 0.5324 | 1.2619 | 1.1234 |
| No log        | 4.1739  | 96   | 0.9363          | 0.6716 | 0.9363 | 0.9676 |
| No log        | 4.2609  | 98   | 0.7244          | 0.7194 | 0.7244 | 0.8511 |
| No log        | 4.3478  | 100  | 0.7534          | 0.7586 | 0.7534 | 0.8680 |
| No log        | 4.4348  | 102  | 0.7001          | 0.7286 | 0.7001 | 0.8367 |
| No log        | 4.5217  | 104  | 0.7011          | 0.7324 | 0.7011 | 0.8373 |
| No log        | 4.6087  | 106  | 0.7827          | 0.6897 | 0.7827 | 0.8847 |
| No log        | 4.6957  | 108  | 0.7922          | 0.7034 | 0.7922 | 0.8900 |
| No log        | 4.7826  | 110  | 0.8235          | 0.6377 | 0.8235 | 0.9075 |
| No log        | 4.8696  | 112  | 0.8034          | 0.6331 | 0.8034 | 0.8963 |
| No log        | 4.9565  | 114  | 0.7506          | 0.6897 | 0.7506 | 0.8664 |
| No log        | 5.0435  | 116  | 0.8669          | 0.6525 | 0.8669 | 0.9311 |
| No log        | 5.1304  | 118  | 0.9777          | 0.6241 | 0.9777 | 0.9888 |
| No log        | 5.2174  | 120  | 0.8365          | 0.6525 | 0.8365 | 0.9146 |
| No log        | 5.3043  | 122  | 0.7675          | 0.7034 | 0.7675 | 0.8761 |
| No log        | 5.3913  | 124  | 0.8405          | 0.7222 | 0.8405 | 0.9168 |
| No log        | 5.4783  | 126  | 0.8176          | 0.7020 | 0.8176 | 0.9042 |
| No log        | 5.5652  | 128  | 0.7173          | 0.7027 | 0.7173 | 0.8469 |
| No log        | 5.6522  | 130  | 0.7593          | 0.6897 | 0.7593 | 0.8714 |
| No log        | 5.7391  | 132  | 0.7562          | 0.6806 | 0.7562 | 0.8696 |
| No log        | 5.8261  | 134  | 0.7676          | 0.6475 | 0.7676 | 0.8761 |
| No log        | 5.9130  | 136  | 0.7785          | 0.6812 | 0.7785 | 0.8823 |
| No log        | 6.0     | 138  | 0.8224          | 0.6667 | 0.8224 | 0.9069 |
| No log        | 6.0870  | 140  | 0.7774          | 0.6963 | 0.7774 | 0.8817 |
| No log        | 6.1739  | 142  | 0.7749          | 0.6906 | 0.7749 | 0.8803 |
| No log        | 6.2609  | 144  | 0.7668          | 0.6906 | 0.7668 | 0.8757 |
| No log        | 6.3478  | 146  | 0.7373          | 0.7273 | 0.7373 | 0.8587 |
| No log        | 6.4348  | 148  | 0.7192          | 0.7310 | 0.7192 | 0.8481 |
| No log        | 6.5217  | 150  | 0.7090          | 0.7333 | 0.7090 | 0.8420 |
| No log        | 6.6087  | 152  | 0.7434          | 0.7248 | 0.7434 | 0.8622 |
| No log        | 6.6957  | 154  | 0.9131          | 0.6957 | 0.9131 | 0.9555 |
| No log        | 6.7826  | 156  | 1.0124          | 0.6497 | 1.0124 | 1.0062 |
| No log        | 6.8696  | 158  | 1.0566          | 0.6364 | 1.0566 | 1.0279 |
| No log        | 6.9565  | 160  | 0.9694          | 0.6316 | 0.9694 | 0.9846 |
| No log        | 7.0435  | 162  | 0.8067          | 0.7042 | 0.8067 | 0.8982 |
| No log        | 7.1304  | 164  | 0.7349          | 0.6944 | 0.7349 | 0.8573 |
| No log        | 7.2174  | 166  | 0.6986          | 0.7310 | 0.6986 | 0.8358 |
| No log        | 7.3043  | 168  | 0.6657          | 0.7582 | 0.6657 | 0.8159 |
| No log        | 7.3913  | 170  | 0.6363          | 0.7516 | 0.6363 | 0.7977 |
| No log        | 7.4783  | 172  | 0.6082          | 0.7625 | 0.6082 | 0.7799 |
| No log        | 7.5652  | 174  | 0.7006          | 0.7248 | 0.7006 | 0.8370 |
| No log        | 7.6522  | 176  | 0.7965          | 0.6906 | 0.7965 | 0.8925 |
| No log        | 7.7391  | 178  | 0.8408          | 0.6715 | 0.8408 | 0.9169 |
| No log        | 7.8261  | 180  | 0.8113          | 0.6815 | 0.8113 | 0.9007 |
| No log        | 7.9130  | 182  | 0.7450          | 0.7101 | 0.7450 | 0.8631 |
| No log        | 8.0     | 184  | 0.7569          | 0.6765 | 0.7569 | 0.8700 |
| No log        | 8.0870  | 186  | 0.8218          | 0.6364 | 0.8218 | 0.9065 |
| No log        | 8.1739  | 188  | 0.8568          | 0.7353 | 0.8568 | 0.9256 |
| No log        | 8.2609  | 190  | 0.8843          | 0.7007 | 0.8843 | 0.9404 |
| No log        | 8.3478  | 192  | 0.8448          | 0.7092 | 0.8448 | 0.9191 |
| No log        | 8.4348  | 194  | 0.8084          | 0.7133 | 0.8084 | 0.8991 |
| No log        | 8.5217  | 196  | 0.8005          | 0.6901 | 0.8005 | 0.8947 |
| No log        | 8.6087  | 198  | 0.8825          | 0.6099 | 0.8825 | 0.9394 |
| No log        | 8.6957  | 200  | 0.9992          | 0.5899 | 0.9992 | 0.9996 |
| No log        | 8.7826  | 202  | 0.9517          | 0.6471 | 0.9517 | 0.9756 |
| No log        | 8.8696  | 204  | 0.7884          | 0.6619 | 0.7884 | 0.8879 |
| No log        | 8.9565  | 206  | 0.6833          | 0.7483 | 0.6833 | 0.8266 |
| No log        | 9.0435  | 208  | 0.6564          | 0.7534 | 0.6564 | 0.8102 |
| No log        | 9.1304  | 210  | 0.6524          | 0.7260 | 0.6524 | 0.8077 |
| No log        | 9.2174  | 212  | 0.7133          | 0.7114 | 0.7133 | 0.8446 |
| No log        | 9.3043  | 214  | 0.7107          | 0.7097 | 0.7107 | 0.8430 |
| No log        | 9.3913  | 216  | 0.6151          | 0.7248 | 0.6151 | 0.7843 |
| No log        | 9.4783  | 218  | 0.5884          | 0.7632 | 0.5884 | 0.7671 |
| No log        | 9.5652  | 220  | 0.6203          | 0.7453 | 0.6203 | 0.7876 |
| No log        | 9.6522  | 222  | 0.6408          | 0.7586 | 0.6408 | 0.8005 |
| No log        | 9.7391  | 224  | 0.5502          | 0.8136 | 0.5502 | 0.7417 |
| No log        | 9.8261  | 226  | 0.5383          | 0.8095 | 0.5383 | 0.7337 |
| No log        | 9.9130  | 228  | 0.5737          | 0.7738 | 0.5737 | 0.7575 |
| No log        | 10.0    | 230  | 0.7389          | 0.7317 | 0.7389 | 0.8596 |
| No log        | 10.0870 | 232  | 0.7915          | 0.6933 | 0.7915 | 0.8897 |
| No log        | 10.1739 | 234  | 0.7053          | 0.7042 | 0.7053 | 0.8398 |
| No log        | 10.2609 | 236  | 0.6509          | 0.7639 | 0.6509 | 0.8068 |
| No log        | 10.3478 | 238  | 0.6944          | 0.7448 | 0.6944 | 0.8333 |
| No log        | 10.4348 | 240  | 0.6575          | 0.7867 | 0.6575 | 0.8109 |
| No log        | 10.5217 | 242  | 0.6312          | 0.8077 | 0.6312 | 0.7945 |
| No log        | 10.6087 | 244  | 0.5962          | 0.7413 | 0.5962 | 0.7721 |
| No log        | 10.6957 | 246  | 0.7272          | 0.7117 | 0.7272 | 0.8528 |
| No log        | 10.7826 | 248  | 0.9181          | 0.7159 | 0.9181 | 0.9582 |
| No log        | 10.8696 | 250  | 0.9041          | 0.7273 | 0.9041 | 0.9509 |
| No log        | 10.9565 | 252  | 0.7246          | 0.7261 | 0.7246 | 0.8512 |
| No log        | 11.0435 | 254  | 0.6210          | 0.7123 | 0.6210 | 0.7880 |
| No log        | 11.1304 | 256  | 0.6441          | 0.7975 | 0.6441 | 0.8026 |
| No log        | 11.2174 | 258  | 0.6400          | 0.7722 | 0.6400 | 0.8000 |
| No log        | 11.3043 | 260  | 0.6608          | 0.7133 | 0.6608 | 0.8129 |
| No log        | 11.3913 | 262  | 0.6943          | 0.7050 | 0.6943 | 0.8333 |
| No log        | 11.4783 | 264  | 0.7331          | 0.7194 | 0.7331 | 0.8562 |
| No log        | 11.5652 | 266  | 0.8334          | 0.6619 | 0.8334 | 0.9129 |
| No log        | 11.6522 | 268  | 0.8575          | 0.6277 | 0.8575 | 0.9260 |
| No log        | 11.7391 | 270  | 0.7644          | 0.6765 | 0.7644 | 0.8743 |
| No log        | 11.8261 | 272  | 0.6426          | 0.7552 | 0.6426 | 0.8016 |
| No log        | 11.9130 | 274  | 0.6004          | 0.7792 | 0.6004 | 0.7749 |
| No log        | 12.0    | 276  | 0.5728          | 0.7871 | 0.5728 | 0.7569 |
| No log        | 12.0870 | 278  | 0.5652          | 0.7831 | 0.5652 | 0.7518 |
| No log        | 12.1739 | 280  | 0.6229          | 0.7727 | 0.6229 | 0.7893 |
| No log        | 12.2609 | 282  | 0.6352          | 0.7574 | 0.6352 | 0.7970 |
| No log        | 12.3478 | 284  | 0.6230          | 0.7712 | 0.6230 | 0.7893 |
| No log        | 12.4348 | 286  | 0.6832          | 0.7143 | 0.6832 | 0.8266 |
| No log        | 12.5217 | 288  | 0.7361          | 0.7429 | 0.7361 | 0.8580 |
| No log        | 12.6087 | 290  | 0.7906          | 0.7092 | 0.7906 | 0.8892 |
| No log        | 12.6957 | 292  | 0.7854          | 0.6901 | 0.7854 | 0.8863 |
| No log        | 12.7826 | 294  | 0.7310          | 0.7172 | 0.7310 | 0.8550 |
| No log        | 12.8696 | 296  | 0.6754          | 0.7432 | 0.6754 | 0.8219 |
| No log        | 12.9565 | 298  | 0.6937          | 0.7347 | 0.6937 | 0.8329 |
| No log        | 13.0435 | 300  | 0.7777          | 0.7172 | 0.7777 | 0.8819 |
| No log        | 13.1304 | 302  | 0.8698          | 0.6806 | 0.8698 | 0.9326 |
| No log        | 13.2174 | 304  | 0.8839          | 0.6806 | 0.8839 | 0.9402 |
| No log        | 13.3043 | 306  | 0.8234          | 0.6901 | 0.8234 | 0.9074 |
| No log        | 13.3913 | 308  | 0.7608          | 0.6950 | 0.7608 | 0.8722 |
| No log        | 13.4783 | 310  | 0.6967          | 0.7222 | 0.6967 | 0.8347 |
| No log        | 13.5652 | 312  | 0.6828          | 0.7083 | 0.6828 | 0.8263 |
| No log        | 13.6522 | 314  | 0.7175          | 0.7342 | 0.7175 | 0.8470 |
| No log        | 13.7391 | 316  | 0.7009          | 0.7545 | 0.7009 | 0.8372 |
| No log        | 13.8261 | 318  | 0.5856          | 0.7619 | 0.5856 | 0.7653 |
| No log        | 13.9130 | 320  | 0.5438          | 0.7516 | 0.5438 | 0.7374 |
| No log        | 14.0    | 322  | 0.5434          | 0.8075 | 0.5434 | 0.7371 |
| No log        | 14.0870 | 324  | 0.5506          | 0.7949 | 0.5506 | 0.7420 |
| No log        | 14.1739 | 326  | 0.5678          | 0.7722 | 0.5678 | 0.7535 |
| No log        | 14.2609 | 328  | 0.6371          | 0.6986 | 0.6371 | 0.7982 |
| No log        | 14.3478 | 330  | 0.7045          | 0.7034 | 0.7045 | 0.8394 |
| No log        | 14.4348 | 332  | 0.6817          | 0.6901 | 0.6817 | 0.8256 |
| No log        | 14.5217 | 334  | 0.6294          | 0.7222 | 0.6294 | 0.7933 |
| No log        | 14.6087 | 336  | 0.6336          | 0.7361 | 0.6336 | 0.7960 |
| No log        | 14.6957 | 338  | 0.6504          | 0.7222 | 0.6504 | 0.8065 |
| No log        | 14.7826 | 340  | 0.7387          | 0.7034 | 0.7387 | 0.8595 |
| No log        | 14.8696 | 342  | 0.7726          | 0.7485 | 0.7726 | 0.8790 |
| No log        | 14.9565 | 344  | 0.6830          | 0.7389 | 0.6830 | 0.8264 |
| No log        | 15.0435 | 346  | 0.5874          | 0.7582 | 0.5874 | 0.7664 |
| No log        | 15.1304 | 348  | 0.5782          | 0.7895 | 0.5782 | 0.7604 |
| No log        | 15.2174 | 350  | 0.5740          | 0.7895 | 0.5740 | 0.7576 |
| No log        | 15.3043 | 352  | 0.5592          | 0.7821 | 0.5592 | 0.7478 |
| No log        | 15.3913 | 354  | 0.5783          | 0.7643 | 0.5783 | 0.7605 |
| No log        | 15.4783 | 356  | 0.6894          | 0.7152 | 0.6894 | 0.8303 |
| No log        | 15.5652 | 358  | 0.8083          | 0.7152 | 0.8083 | 0.8991 |
| No log        | 15.6522 | 360  | 0.7990          | 0.7034 | 0.7990 | 0.8938 |
| No log        | 15.7391 | 362  | 0.7269          | 0.7391 | 0.7269 | 0.8526 |
| No log        | 15.8261 | 364  | 0.6937          | 0.7286 | 0.6937 | 0.8329 |
| No log        | 15.9130 | 366  | 0.6747          | 0.7413 | 0.6747 | 0.8214 |
| No log        | 16.0    | 368  | 0.7028          | 0.7391 | 0.7028 | 0.8384 |
| No log        | 16.0870 | 370  | 0.7329          | 0.7042 | 0.7329 | 0.8561 |
| No log        | 16.1739 | 372  | 0.7263          | 0.7042 | 0.7263 | 0.8522 |
| No log        | 16.2609 | 374  | 0.6680          | 0.7234 | 0.6680 | 0.8173 |
| No log        | 16.3478 | 376  | 0.6554          | 0.7324 | 0.6554 | 0.8096 |
| No log        | 16.4348 | 378  | 0.6463          | 0.7092 | 0.6463 | 0.8039 |
| No log        | 16.5217 | 380  | 0.6519          | 0.6993 | 0.6519 | 0.8074 |
| No log        | 16.6087 | 382  | 0.7800          | 0.7355 | 0.7800 | 0.8832 |
| No log        | 16.6957 | 384  | 0.8796          | 0.7135 | 0.8796 | 0.9379 |
| No log        | 16.7826 | 386  | 0.8313          | 0.7412 | 0.8313 | 0.9117 |
| No log        | 16.8696 | 388  | 0.7209          | 0.7403 | 0.7209 | 0.8491 |
| No log        | 16.9565 | 390  | 0.6469          | 0.6993 | 0.6469 | 0.8043 |
| No log        | 17.0435 | 392  | 0.6308          | 0.7429 | 0.6308 | 0.7942 |
| No log        | 17.1304 | 394  | 0.6557          | 0.7391 | 0.6557 | 0.8098 |
| No log        | 17.2174 | 396  | 0.6678          | 0.7206 | 0.6678 | 0.8172 |
| No log        | 17.3043 | 398  | 0.6687          | 0.7299 | 0.6687 | 0.8177 |
| No log        | 17.3913 | 400  | 0.6655          | 0.7299 | 0.6655 | 0.8158 |
| No log        | 17.4783 | 402  | 0.6923          | 0.7286 | 0.6923 | 0.8321 |
| No log        | 17.5652 | 404  | 0.6951          | 0.7092 | 0.6951 | 0.8337 |
| No log        | 17.6522 | 406  | 0.6981          | 0.7299 | 0.6981 | 0.8355 |
| No log        | 17.7391 | 408  | 0.6696          | 0.7259 | 0.6696 | 0.8183 |
| No log        | 17.8261 | 410  | 0.6481          | 0.7338 | 0.6481 | 0.8051 |
| No log        | 17.9130 | 412  | 0.6289          | 0.7465 | 0.6289 | 0.7930 |
| No log        | 18.0    | 414  | 0.6130          | 0.7448 | 0.6130 | 0.7829 |
| No log        | 18.0870 | 416  | 0.6391          | 0.7172 | 0.6391 | 0.7995 |
| No log        | 18.1739 | 418  | 0.6525          | 0.7285 | 0.6525 | 0.8078 |
| No log        | 18.2609 | 420  | 0.6984          | 0.6993 | 0.6984 | 0.8357 |
| No log        | 18.3478 | 422  | 0.7015          | 0.6993 | 0.7015 | 0.8376 |
| No log        | 18.4348 | 424  | 0.6479          | 0.7083 | 0.6479 | 0.8049 |
| No log        | 18.5217 | 426  | 0.6102          | 0.7568 | 0.6102 | 0.7812 |
| No log        | 18.6087 | 428  | 0.6221          | 0.7619 | 0.6221 | 0.7887 |
| No log        | 18.6957 | 430  | 0.6196          | 0.7682 | 0.6196 | 0.7871 |
| No log        | 18.7826 | 432  | 0.6425          | 0.7465 | 0.6425 | 0.8016 |
| No log        | 18.8696 | 434  | 0.7384          | 0.7564 | 0.7384 | 0.8593 |
| No log        | 18.9565 | 436  | 0.7683          | 0.7468 | 0.7683 | 0.8765 |
| No log        | 19.0435 | 438  | 0.7516          | 0.7355 | 0.7516 | 0.8670 |
| No log        | 19.1304 | 440  | 0.6607          | 0.76   | 0.6607 | 0.8129 |
| No log        | 19.2174 | 442  | 0.6014          | 0.7552 | 0.6014 | 0.7755 |
| No log        | 19.3043 | 444  | 0.5984          | 0.7552 | 0.5984 | 0.7736 |
| No log        | 19.3913 | 446  | 0.5899          | 0.7273 | 0.5899 | 0.7681 |
| No log        | 19.4783 | 448  | 0.6044          | 0.7632 | 0.6044 | 0.7774 |
| No log        | 19.5652 | 450  | 0.6503          | 0.7333 | 0.6503 | 0.8064 |
| No log        | 19.6522 | 452  | 0.6377          | 0.7333 | 0.6377 | 0.7985 |
| No log        | 19.7391 | 454  | 0.6340          | 0.7451 | 0.6340 | 0.7962 |
| No log        | 19.8261 | 456  | 0.6477          | 0.7451 | 0.6477 | 0.8048 |
| No log        | 19.9130 | 458  | 0.6841          | 0.7448 | 0.6841 | 0.8271 |
| No log        | 20.0    | 460  | 0.6696          | 0.7376 | 0.6696 | 0.8183 |
| No log        | 20.0870 | 462  | 0.6422          | 0.7586 | 0.6422 | 0.8014 |
| No log        | 20.1739 | 464  | 0.6321          | 0.7483 | 0.6321 | 0.7951 |
| No log        | 20.2609 | 466  | 0.6653          | 0.7586 | 0.6653 | 0.8157 |
| No log        | 20.3478 | 468  | 0.7282          | 0.7162 | 0.7282 | 0.8533 |
| No log        | 20.4348 | 470  | 0.8254          | 0.6939 | 0.8254 | 0.9085 |
| No log        | 20.5217 | 472  | 0.8982          | 0.675  | 0.8982 | 0.9478 |
| No log        | 20.6087 | 474  | 0.9288          | 0.6667 | 0.9288 | 0.9638 |
| No log        | 20.6957 | 476  | 0.8928          | 0.6757 | 0.8928 | 0.9449 |
| No log        | 20.7826 | 478  | 0.7766          | 0.6993 | 0.7766 | 0.8812 |
| No log        | 20.8696 | 480  | 0.7318          | 0.6861 | 0.7318 | 0.8554 |
| No log        | 20.9565 | 482  | 0.7215          | 0.7299 | 0.7215 | 0.8494 |
| No log        | 21.0435 | 484  | 0.7576          | 0.7050 | 0.7576 | 0.8704 |
| No log        | 21.1304 | 486  | 0.8378          | 0.6901 | 0.8378 | 0.9153 |
| No log        | 21.2174 | 488  | 0.8329          | 0.6713 | 0.8329 | 0.9126 |
| No log        | 21.3043 | 490  | 0.7573          | 0.6806 | 0.7573 | 0.8702 |
| No log        | 21.3913 | 492  | 0.6638          | 0.7534 | 0.6638 | 0.8147 |
| No log        | 21.4783 | 494  | 0.6208          | 0.7712 | 0.6208 | 0.7879 |
| No log        | 21.5652 | 496  | 0.5694          | 0.7771 | 0.5694 | 0.7546 |
| No log        | 21.6522 | 498  | 0.5471          | 0.7643 | 0.5471 | 0.7397 |
| 0.3686        | 21.7391 | 500  | 0.5431          | 0.7643 | 0.5431 | 0.7369 |
| 0.3686        | 21.8261 | 502  | 0.5557          | 0.7875 | 0.5557 | 0.7455 |
| 0.3686        | 21.9130 | 504  | 0.6282          | 0.7907 | 0.6282 | 0.7926 |
| 0.3686        | 22.0    | 506  | 0.6934          | 0.7746 | 0.6934 | 0.8327 |
| 0.3686        | 22.0870 | 508  | 0.7206          | 0.7283 | 0.7206 | 0.8489 |
| 0.3686        | 22.1739 | 510  | 0.6874          | 0.775  | 0.6874 | 0.8291 |
| 0.3686        | 22.2609 | 512  | 0.6474          | 0.7517 | 0.6474 | 0.8046 |
| 0.3686        | 22.3478 | 514  | 0.6205          | 0.7660 | 0.6205 | 0.7877 |
| 0.3686        | 22.4348 | 516  | 0.6134          | 0.7660 | 0.6134 | 0.7832 |
| 0.3686        | 22.5217 | 518  | 0.6145          | 0.7606 | 0.6145 | 0.7839 |
| 0.3686        | 22.6087 | 520  | 0.6451          | 0.7552 | 0.6451 | 0.8032 |
| 0.3686        | 22.6957 | 522  | 0.7010          | 0.7564 | 0.7010 | 0.8372 |
| 0.3686        | 22.7826 | 524  | 0.6915          | 0.7673 | 0.6915 | 0.8316 |
| 0.3686        | 22.8696 | 526  | 0.6316          | 0.775  | 0.6316 | 0.7947 |
| 0.3686        | 22.9565 | 528  | 0.5589          | 0.7925 | 0.5589 | 0.7476 |
| 0.3686        | 23.0435 | 530  | 0.5466          | 0.8101 | 0.5466 | 0.7393 |
| 0.3686        | 23.1304 | 532  | 0.5849          | 0.7922 | 0.5849 | 0.7648 |
| 0.3686        | 23.2174 | 534  | 0.6205          | 0.7397 | 0.6205 | 0.7877 |
| 0.3686        | 23.3043 | 536  | 0.6262          | 0.7586 | 0.6262 | 0.7913 |
| 0.3686        | 23.3913 | 538  | 0.6058          | 0.7778 | 0.6058 | 0.7783 |
| 0.3686        | 23.4783 | 540  | 0.5877          | 0.7862 | 0.5877 | 0.7666 |
| 0.3686        | 23.5652 | 542  | 0.5880          | 0.7838 | 0.5880 | 0.7668 |
| 0.3686        | 23.6522 | 544  | 0.6254          | 0.7534 | 0.6254 | 0.7908 |
| 0.3686        | 23.7391 | 546  | 0.6427          | 0.7417 | 0.6427 | 0.8017 |
| 0.3686        | 23.8261 | 548  | 0.6254          | 0.75   | 0.6254 | 0.7909 |
| 0.3686        | 23.9130 | 550  | 0.6155          | 0.7550 | 0.6155 | 0.7845 |
| 0.3686        | 24.0    | 552  | 0.6083          | 0.7613 | 0.6083 | 0.7800 |


### Framework versions

- Transformers 4.44.2
- Pytorch 2.4.0+cu118
- Datasets 2.21.0
- Tokenizers 0.19.1