File size: 23,401 Bytes
817d59d
 
 
 
 
 
29e5e08
817d59d
 
 
 
 
 
29e5e08
817d59d
 
 
29e5e08
 
 
 
817d59d
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
29e5e08
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
817d59d
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
---
library_name: transformers
base_model: aubmindlab/bert-base-arabertv02
tags:
- generated_from_trainer
model-index:
- name: ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k6_task1_organization
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k6_task1_organization

This model is a fine-tuned version of [aubmindlab/bert-base-arabertv02](https://huggingface.co/aubmindlab/bert-base-arabertv02) on the None dataset.
It achieves the following results on the evaluation set:
- Loss: 1.7207
- Qwk: 0.3165
- Mse: 1.7207
- Rmse: 1.3118

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 2e-05
- train_batch_size: 8
- eval_batch_size: 8
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 100

### Training results

| Training Loss | Epoch   | Step | Validation Loss | Qwk     | Mse    | Rmse   |
|:-------------:|:-------:|:----:|:---------------:|:-------:|:------:|:------:|
| No log        | 0.0769  | 2    | 6.7951          | -0.0057 | 6.7951 | 2.6067 |
| No log        | 0.1538  | 4    | 4.4769          | 0.0433  | 4.4769 | 2.1159 |
| No log        | 0.2308  | 6    | 3.7117          | -0.0426 | 3.7117 | 1.9266 |
| No log        | 0.3077  | 8    | 4.1086          | -0.0928 | 4.1086 | 2.0270 |
| No log        | 0.3846  | 10   | 4.4629          | -0.0531 | 4.4629 | 2.1126 |
| No log        | 0.4615  | 12   | 2.8130          | 0.0145  | 2.8130 | 1.6772 |
| No log        | 0.5385  | 14   | 1.8421          | 0.1538  | 1.8421 | 1.3572 |
| No log        | 0.6154  | 16   | 1.8548          | 0.0784  | 1.8548 | 1.3619 |
| No log        | 0.6923  | 18   | 1.9939          | 0.0962  | 1.9939 | 1.4121 |
| No log        | 0.7692  | 20   | 2.1927          | -0.0348 | 2.1927 | 1.4808 |
| No log        | 0.8462  | 22   | 2.4397          | -0.1168 | 2.4397 | 1.5620 |
| No log        | 0.9231  | 24   | 2.3850          | -0.0876 | 2.3850 | 1.5443 |
| No log        | 1.0     | 26   | 2.2329          | -0.0645 | 2.2329 | 1.4943 |
| No log        | 1.0769  | 28   | 2.2449          | -0.0159 | 2.2449 | 1.4983 |
| No log        | 1.1538  | 30   | 2.2631          | 0.0     | 2.2631 | 1.5044 |
| No log        | 1.2308  | 32   | 2.1780          | 0.1345  | 2.1780 | 1.4758 |
| No log        | 1.3077  | 34   | 2.0550          | 0.2124  | 2.0550 | 1.4335 |
| No log        | 1.3846  | 36   | 1.9927          | 0.1835  | 1.9927 | 1.4116 |
| No log        | 1.4615  | 38   | 1.9631          | 0.1835  | 1.9631 | 1.4011 |
| No log        | 1.5385  | 40   | 1.8847          | 0.2182  | 1.8847 | 1.3728 |
| No log        | 1.6154  | 42   | 1.8011          | 0.2679  | 1.8011 | 1.3421 |
| No log        | 1.6923  | 44   | 1.7112          | 0.2385  | 1.7112 | 1.3081 |
| No log        | 1.7692  | 46   | 1.6358          | 0.2037  | 1.6358 | 1.2790 |
| No log        | 1.8462  | 48   | 1.5937          | 0.1667  | 1.5937 | 1.2624 |
| No log        | 1.9231  | 50   | 1.5798          | 0.1667  | 1.5798 | 1.2569 |
| No log        | 2.0     | 52   | 1.4956          | 0.2202  | 1.4956 | 1.2229 |
| No log        | 2.0769  | 54   | 1.4556          | 0.3063  | 1.4556 | 1.2065 |
| No log        | 2.1538  | 56   | 1.4596          | 0.2655  | 1.4596 | 1.2081 |
| No log        | 2.2308  | 58   | 1.4205          | 0.2759  | 1.4205 | 1.1919 |
| No log        | 2.3077  | 60   | 1.3573          | 0.3025  | 1.3573 | 1.1650 |
| No log        | 2.3846  | 62   | 1.3763          | 0.3248  | 1.3763 | 1.1732 |
| No log        | 2.4615  | 64   | 1.8621          | 0.1636  | 1.8621 | 1.3646 |
| No log        | 2.5385  | 66   | 1.9653          | 0.1468  | 1.9653 | 1.4019 |
| No log        | 2.6154  | 68   | 1.7682          | 0.1468  | 1.7682 | 1.3298 |
| No log        | 2.6923  | 70   | 1.4049          | 0.2609  | 1.4049 | 1.1853 |
| No log        | 2.7692  | 72   | 1.4162          | 0.3740  | 1.4162 | 1.1900 |
| No log        | 2.8462  | 74   | 1.4159          | 0.3740  | 1.4159 | 1.1899 |
| No log        | 2.9231  | 76   | 1.3215          | 0.3761  | 1.3215 | 1.1496 |
| No log        | 3.0     | 78   | 1.4685          | 0.1154  | 1.4685 | 1.2118 |
| No log        | 3.0769  | 80   | 1.7251          | 0.1869  | 1.7251 | 1.3134 |
| No log        | 3.1538  | 82   | 1.7651          | 0.2727  | 1.7651 | 1.3286 |
| No log        | 3.2308  | 84   | 1.5141          | 0.2703  | 1.5141 | 1.2305 |
| No log        | 3.3077  | 86   | 1.3037          | 0.3186  | 1.3037 | 1.1418 |
| No log        | 3.3846  | 88   | 1.3035          | 0.3158  | 1.3035 | 1.1417 |
| No log        | 3.4615  | 90   | 1.3707          | 0.3478  | 1.3707 | 1.1708 |
| No log        | 3.5385  | 92   | 1.6799          | 0.2906  | 1.6799 | 1.2961 |
| No log        | 3.6154  | 94   | 2.0216          | 0.1345  | 2.0216 | 1.4218 |
| No log        | 3.6923  | 96   | 2.1826          | 0.0     | 2.1826 | 1.4774 |
| No log        | 3.7692  | 98   | 1.9777          | 0.1789  | 1.9777 | 1.4063 |
| No log        | 3.8462  | 100  | 1.6970          | 0.2720  | 1.6970 | 1.3027 |
| No log        | 3.9231  | 102  | 1.4959          | 0.3548  | 1.4959 | 1.2231 |
| No log        | 4.0     | 104  | 1.5232          | 0.3651  | 1.5232 | 1.2342 |
| No log        | 4.0769  | 106  | 1.7344          | 0.2985  | 1.7344 | 1.3170 |
| No log        | 4.1538  | 108  | 1.7573          | 0.2963  | 1.7573 | 1.3256 |
| No log        | 4.2308  | 110  | 1.6000          | 0.3704  | 1.6000 | 1.2649 |
| No log        | 4.3077  | 112  | 1.2842          | 0.4806  | 1.2842 | 1.1332 |
| No log        | 4.3846  | 114  | 1.1684          | 0.4839  | 1.1684 | 1.0809 |
| No log        | 4.4615  | 116  | 1.1575          | 0.496   | 1.1575 | 1.0759 |
| No log        | 4.5385  | 118  | 1.3023          | 0.4923  | 1.3023 | 1.1412 |
| No log        | 4.6154  | 120  | 1.5338          | 0.4030  | 1.5338 | 1.2385 |
| No log        | 4.6923  | 122  | 1.5960          | 0.3704  | 1.5960 | 1.2633 |
| No log        | 4.7692  | 124  | 1.5824          | 0.4     | 1.5824 | 1.2579 |
| No log        | 4.8462  | 126  | 1.5952          | 0.3622  | 1.5952 | 1.2630 |
| No log        | 4.9231  | 128  | 1.5358          | 0.4     | 1.5358 | 1.2393 |
| No log        | 5.0     | 130  | 1.4859          | 0.3833  | 1.4859 | 1.2190 |
| No log        | 5.0769  | 132  | 1.5338          | 0.3710  | 1.5338 | 1.2385 |
| No log        | 5.1538  | 134  | 1.7542          | 0.2647  | 1.7542 | 1.3245 |
| No log        | 5.2308  | 136  | 2.0207          | 0.2143  | 2.0207 | 1.4215 |
| No log        | 5.3077  | 138  | 2.0904          | 0.2143  | 2.0904 | 1.4458 |
| No log        | 5.3846  | 140  | 1.9275          | 0.2429  | 1.9275 | 1.3884 |
| No log        | 5.4615  | 142  | 1.6620          | 0.352   | 1.6620 | 1.2892 |
| No log        | 5.5385  | 144  | 1.4107          | 0.2632  | 1.4107 | 1.1877 |
| No log        | 5.6154  | 146  | 1.4169          | 0.2301  | 1.4169 | 1.1903 |
| No log        | 5.6923  | 148  | 1.4008          | 0.2957  | 1.4008 | 1.1835 |
| No log        | 5.7692  | 150  | 1.5245          | 0.3390  | 1.5245 | 1.2347 |
| No log        | 5.8462  | 152  | 1.8064          | 0.1832  | 1.8064 | 1.3440 |
| No log        | 5.9231  | 154  | 1.9459          | 0.1818  | 1.9459 | 1.3949 |
| No log        | 6.0     | 156  | 1.9912          | 0.1955  | 1.9912 | 1.4111 |
| No log        | 6.0769  | 158  | 1.9502          | 0.1778  | 1.9502 | 1.3965 |
| No log        | 6.1538  | 160  | 1.8532          | 0.2074  | 1.8532 | 1.3613 |
| No log        | 6.2308  | 162  | 1.8072          | 0.2687  | 1.8072 | 1.3443 |
| No log        | 6.3077  | 164  | 1.8532          | 0.2353  | 1.8532 | 1.3613 |
| No log        | 6.3846  | 166  | 1.8543          | 0.1805  | 1.8543 | 1.3617 |
| No log        | 6.4615  | 168  | 1.7415          | 0.2742  | 1.7415 | 1.3197 |
| No log        | 6.5385  | 170  | 1.6579          | 0.3000  | 1.6579 | 1.2876 |
| No log        | 6.6154  | 172  | 1.5659          | 0.3471  | 1.5659 | 1.2514 |
| No log        | 6.6923  | 174  | 1.5015          | 0.4194  | 1.5015 | 1.2254 |
| No log        | 6.7692  | 176  | 1.5471          | 0.4462  | 1.5471 | 1.2438 |
| No log        | 6.8462  | 178  | 1.6884          | 0.3158  | 1.6884 | 1.2994 |
| No log        | 6.9231  | 180  | 1.8473          | 0.2754  | 1.8473 | 1.3592 |
| No log        | 7.0     | 182  | 2.0456          | 0.2378  | 2.0456 | 1.4302 |
| No log        | 7.0769  | 184  | 2.1090          | 0.1857  | 2.1090 | 1.4522 |
| No log        | 7.1538  | 186  | 2.0328          | 0.1606  | 2.0328 | 1.4258 |
| No log        | 7.2308  | 188  | 1.7821          | 0.272   | 1.7821 | 1.3349 |
| No log        | 7.3077  | 190  | 1.5096          | 0.3559  | 1.5096 | 1.2286 |
| No log        | 7.3846  | 192  | 1.4016          | 0.4237  | 1.4016 | 1.1839 |
| No log        | 7.4615  | 194  | 1.3605          | 0.3559  | 1.3605 | 1.1664 |
| No log        | 7.5385  | 196  | 1.3802          | 0.4167  | 1.3802 | 1.1748 |
| No log        | 7.6154  | 198  | 1.4510          | 0.4567  | 1.4510 | 1.2046 |
| No log        | 7.6923  | 200  | 1.5159          | 0.4462  | 1.5159 | 1.2312 |
| No log        | 7.7692  | 202  | 1.5902          | 0.4     | 1.5902 | 1.2610 |
| No log        | 7.8462  | 204  | 1.5893          | 0.4     | 1.5893 | 1.2607 |
| No log        | 7.9231  | 206  | 1.6442          | 0.3817  | 1.6442 | 1.2822 |
| No log        | 8.0     | 208  | 1.6174          | 0.4     | 1.6174 | 1.2718 |
| No log        | 8.0769  | 210  | 1.6300          | 0.4091  | 1.6300 | 1.2767 |
| No log        | 8.1538  | 212  | 1.5653          | 0.4122  | 1.5653 | 1.2511 |
| No log        | 8.2308  | 214  | 1.6822          | 0.3939  | 1.6822 | 1.2970 |
| No log        | 8.3077  | 216  | 1.9504          | 0.2590  | 1.9504 | 1.3966 |
| No log        | 8.3846  | 218  | 2.0896          | 0.2553  | 2.0896 | 1.4456 |
| No log        | 8.4615  | 220  | 2.0024          | 0.2302  | 2.0024 | 1.4151 |
| No log        | 8.5385  | 222  | 1.8530          | 0.2482  | 1.8530 | 1.3613 |
| No log        | 8.6154  | 224  | 1.6794          | 0.3538  | 1.6794 | 1.2959 |
| No log        | 8.6923  | 226  | 1.5367          | 0.4186  | 1.5367 | 1.2397 |
| No log        | 8.7692  | 228  | 1.4816          | 0.4531  | 1.4816 | 1.2172 |
| No log        | 8.8462  | 230  | 1.5195          | 0.4308  | 1.5195 | 1.2327 |
| No log        | 8.9231  | 232  | 1.6772          | 0.3759  | 1.6772 | 1.2951 |
| No log        | 9.0     | 234  | 1.9357          | 0.2817  | 1.9357 | 1.3913 |
| No log        | 9.0769  | 236  | 2.0415          | 0.2500  | 2.0415 | 1.4288 |
| No log        | 9.1538  | 238  | 1.9695          | 0.2676  | 1.9695 | 1.4034 |
| No log        | 9.2308  | 240  | 1.8010          | 0.3022  | 1.8010 | 1.3420 |
| No log        | 9.3077  | 242  | 1.7088          | 0.3188  | 1.7088 | 1.3072 |
| No log        | 9.3846  | 244  | 1.6934          | 0.3188  | 1.6934 | 1.3013 |
| No log        | 9.4615  | 246  | 1.7611          | 0.3022  | 1.7611 | 1.3271 |
| No log        | 9.5385  | 248  | 1.7970          | 0.2857  | 1.7970 | 1.3405 |
| No log        | 9.6154  | 250  | 1.7825          | 0.2857  | 1.7825 | 1.3351 |
| No log        | 9.6923  | 252  | 1.6866          | 0.3358  | 1.6866 | 1.2987 |
| No log        | 9.7692  | 254  | 1.6224          | 0.4060  | 1.6224 | 1.2738 |
| No log        | 9.8462  | 256  | 1.5681          | 0.3939  | 1.5681 | 1.2522 |
| No log        | 9.9231  | 258  | 1.5307          | 0.4060  | 1.5307 | 1.2372 |
| No log        | 10.0    | 260  | 1.5546          | 0.4030  | 1.5546 | 1.2468 |
| No log        | 10.0769 | 262  | 1.5831          | 0.3676  | 1.5831 | 1.2582 |
| No log        | 10.1538 | 264  | 1.5270          | 0.4     | 1.5270 | 1.2357 |
| No log        | 10.2308 | 266  | 1.4634          | 0.4179  | 1.4634 | 1.2097 |
| No log        | 10.3077 | 268  | 1.4387          | 0.4394  | 1.4387 | 1.1995 |
| No log        | 10.3846 | 270  | 1.5450          | 0.3731  | 1.5450 | 1.2430 |
| No log        | 10.4615 | 272  | 1.8087          | 0.3358  | 1.8087 | 1.3449 |
| No log        | 10.5385 | 274  | 1.8690          | 0.3088  | 1.8690 | 1.3671 |
| No log        | 10.6154 | 276  | 1.8088          | 0.3259  | 1.8088 | 1.3449 |
| No log        | 10.6923 | 278  | 1.6344          | 0.3556  | 1.6344 | 1.2784 |
| No log        | 10.7692 | 280  | 1.5576          | 0.3636  | 1.5576 | 1.2480 |
| No log        | 10.8462 | 282  | 1.4276          | 0.4462  | 1.4276 | 1.1948 |
| No log        | 10.9231 | 284  | 1.3497          | 0.5     | 1.3497 | 1.1618 |
| No log        | 11.0    | 286  | 1.3712          | 0.4688  | 1.3712 | 1.1710 |
| No log        | 11.0769 | 288  | 1.4553          | 0.4427  | 1.4553 | 1.2064 |
| No log        | 11.1538 | 290  | 1.4577          | 0.4427  | 1.4577 | 1.2074 |
| No log        | 11.2308 | 292  | 1.4639          | 0.4615  | 1.4639 | 1.2099 |
| No log        | 11.3077 | 294  | 1.5045          | 0.4394  | 1.5045 | 1.2266 |
| No log        | 11.3846 | 296  | 1.4810          | 0.4122  | 1.4810 | 1.2170 |
| No log        | 11.4615 | 298  | 1.5175          | 0.4122  | 1.5175 | 1.2319 |
| No log        | 11.5385 | 300  | 1.5313          | 0.4122  | 1.5313 | 1.2374 |
| No log        | 11.6154 | 302  | 1.5744          | 0.3810  | 1.5744 | 1.2547 |
| No log        | 11.6923 | 304  | 1.5777          | 0.3770  | 1.5777 | 1.2561 |
| No log        | 11.7692 | 306  | 1.5684          | 0.4062  | 1.5684 | 1.2524 |
| No log        | 11.8462 | 308  | 1.5405          | 0.3939  | 1.5405 | 1.2412 |
| No log        | 11.9231 | 310  | 1.5117          | 0.4     | 1.5117 | 1.2295 |
| No log        | 12.0    | 312  | 1.5376          | 0.4088  | 1.5376 | 1.2400 |
| No log        | 12.0769 | 314  | 1.5276          | 0.4058  | 1.5276 | 1.2360 |
| No log        | 12.1538 | 316  | 1.4294          | 0.4444  | 1.4294 | 1.1956 |
| No log        | 12.2308 | 318  | 1.3818          | 0.4603  | 1.3818 | 1.1755 |
| No log        | 12.3077 | 320  | 1.3833          | 0.4194  | 1.3833 | 1.1762 |
| No log        | 12.3846 | 322  | 1.4441          | 0.4186  | 1.4441 | 1.2017 |
| No log        | 12.4615 | 324  | 1.6153          | 0.3504  | 1.6153 | 1.2710 |
| No log        | 12.5385 | 326  | 1.8049          | 0.3022  | 1.8049 | 1.3435 |
| No log        | 12.6154 | 328  | 1.8551          | 0.3022  | 1.8551 | 1.3620 |
| No log        | 12.6923 | 330  | 1.7641          | 0.3333  | 1.7641 | 1.3282 |
| No log        | 12.7692 | 332  | 1.6214          | 0.3817  | 1.6214 | 1.2733 |
| No log        | 12.8462 | 334  | 1.5815          | 0.3876  | 1.5815 | 1.2576 |
| No log        | 12.9231 | 336  | 1.5732          | 0.3876  | 1.5732 | 1.2543 |
| No log        | 13.0    | 338  | 1.6407          | 0.3511  | 1.6407 | 1.2809 |
| No log        | 13.0769 | 340  | 1.6590          | 0.3333  | 1.6590 | 1.2880 |
| No log        | 13.1538 | 342  | 1.6521          | 0.3511  | 1.6521 | 1.2853 |
| No log        | 13.2308 | 344  | 1.5713          | 0.3876  | 1.5713 | 1.2535 |
| No log        | 13.3077 | 346  | 1.4851          | 0.4375  | 1.4851 | 1.2187 |
| No log        | 13.3846 | 348  | 1.4184          | 0.4603  | 1.4184 | 1.1910 |
| No log        | 13.4615 | 350  | 1.3683          | 0.4724  | 1.3683 | 1.1698 |
| No log        | 13.5385 | 352  | 1.3400          | 0.4733  | 1.3400 | 1.1576 |
| No log        | 13.6154 | 354  | 1.3224          | 0.5     | 1.3224 | 1.1499 |
| No log        | 13.6923 | 356  | 1.2938          | 0.5     | 1.2938 | 1.1374 |
| No log        | 13.7692 | 358  | 1.4060          | 0.4511  | 1.4060 | 1.1857 |
| No log        | 13.8462 | 360  | 1.6478          | 0.3188  | 1.6478 | 1.2837 |
| No log        | 13.9231 | 362  | 1.7950          | 0.2370  | 1.7950 | 1.3398 |
| No log        | 14.0    | 364  | 1.8001          | 0.2090  | 1.8001 | 1.3417 |
| No log        | 14.0769 | 366  | 1.6469          | 0.3556  | 1.6469 | 1.2833 |
| No log        | 14.1538 | 368  | 1.5918          | 0.3731  | 1.5918 | 1.2617 |
| No log        | 14.2308 | 370  | 1.5664          | 0.3731  | 1.5664 | 1.2516 |
| No log        | 14.3077 | 372  | 1.5156          | 0.3906  | 1.5156 | 1.2311 |
| No log        | 14.3846 | 374  | 1.5134          | 0.3780  | 1.5134 | 1.2302 |
| No log        | 14.4615 | 376  | 1.5294          | 0.3780  | 1.5294 | 1.2367 |
| No log        | 14.5385 | 378  | 1.5080          | 0.4252  | 1.5080 | 1.2280 |
| No log        | 14.6154 | 380  | 1.5835          | 0.3359  | 1.5835 | 1.2584 |
| No log        | 14.6923 | 382  | 1.6268          | 0.3556  | 1.6268 | 1.2755 |
| No log        | 14.7692 | 384  | 1.6263          | 0.3333  | 1.6263 | 1.2753 |
| No log        | 14.8462 | 386  | 1.7212          | 0.3000  | 1.7212 | 1.3119 |
| No log        | 14.9231 | 388  | 1.7367          | 0.3000  | 1.7367 | 1.3178 |
| No log        | 15.0    | 390  | 1.7626          | 0.2734  | 1.7626 | 1.3276 |
| No log        | 15.0769 | 392  | 1.7167          | 0.2734  | 1.7167 | 1.3102 |
| No log        | 15.1538 | 394  | 1.6410          | 0.3308  | 1.6410 | 1.2810 |
| No log        | 15.2308 | 396  | 1.5832          | 0.3609  | 1.5832 | 1.2583 |
| No log        | 15.3077 | 398  | 1.5133          | 0.3692  | 1.5133 | 1.2302 |
| No log        | 15.3846 | 400  | 1.5177          | 0.375   | 1.5177 | 1.2320 |
| No log        | 15.4615 | 402  | 1.5438          | 0.3664  | 1.5438 | 1.2425 |
| No log        | 15.5385 | 404  | 1.6691          | 0.3088  | 1.6691 | 1.2919 |
| No log        | 15.6154 | 406  | 1.7781          | 0.2286  | 1.7781 | 1.3334 |
| No log        | 15.6923 | 408  | 1.8601          | 0.2553  | 1.8601 | 1.3639 |
| No log        | 15.7692 | 410  | 1.8058          | 0.2553  | 1.8058 | 1.3438 |
| No log        | 15.8462 | 412  | 1.7396          | 0.2714  | 1.7395 | 1.3189 |
| No log        | 15.9231 | 414  | 1.6854          | 0.3066  | 1.6854 | 1.2982 |
| No log        | 16.0    | 416  | 1.6903          | 0.3235  | 1.6903 | 1.3001 |
| No log        | 16.0769 | 418  | 1.7343          | 0.3066  | 1.7343 | 1.3169 |
| No log        | 16.1538 | 420  | 1.7627          | 0.3066  | 1.7627 | 1.3277 |
| No log        | 16.2308 | 422  | 1.6962          | 0.3382  | 1.6962 | 1.3024 |
| No log        | 16.3077 | 424  | 1.5890          | 0.4     | 1.5890 | 1.2606 |
| No log        | 16.3846 | 426  | 1.5198          | 0.4186  | 1.5198 | 1.2328 |
| No log        | 16.4615 | 428  | 1.4958          | 0.4186  | 1.4958 | 1.2230 |
| No log        | 16.5385 | 430  | 1.5162          | 0.4154  | 1.5162 | 1.2313 |
| No log        | 16.6154 | 432  | 1.5406          | 0.4211  | 1.5406 | 1.2412 |
| No log        | 16.6923 | 434  | 1.5323          | 0.4211  | 1.5323 | 1.2379 |
| No log        | 16.7692 | 436  | 1.4958          | 0.4394  | 1.4958 | 1.2230 |
| No log        | 16.8462 | 438  | 1.4198          | 0.4154  | 1.4198 | 1.1916 |
| No log        | 16.9231 | 440  | 1.3761          | 0.4154  | 1.3761 | 1.1731 |
| No log        | 17.0    | 442  | 1.4076          | 0.4154  | 1.4076 | 1.1864 |
| No log        | 17.0769 | 444  | 1.4353          | 0.3876  | 1.4353 | 1.1981 |
| No log        | 17.1538 | 446  | 1.4714          | 0.375   | 1.4714 | 1.2130 |
| No log        | 17.2308 | 448  | 1.4673          | 0.3492  | 1.4673 | 1.2113 |
| No log        | 17.3077 | 450  | 1.5005          | 0.352   | 1.5005 | 1.2250 |
| No log        | 17.3846 | 452  | 1.5246          | 0.4098  | 1.5246 | 1.2347 |
| No log        | 17.4615 | 454  | 1.5720          | 0.4     | 1.5720 | 1.2538 |
| No log        | 17.5385 | 456  | 1.6316          | 0.3876  | 1.6316 | 1.2774 |
| No log        | 17.6154 | 458  | 1.6059          | 0.4122  | 1.6059 | 1.2672 |
| No log        | 17.6923 | 460  | 1.5324          | 0.4275  | 1.5324 | 1.2379 |
| No log        | 17.7692 | 462  | 1.4959          | 0.4275  | 1.4959 | 1.2231 |
| No log        | 17.8462 | 464  | 1.4729          | 0.4275  | 1.4729 | 1.2136 |
| No log        | 17.9231 | 466  | 1.5584          | 0.4394  | 1.5584 | 1.2484 |
| No log        | 18.0    | 468  | 1.6872          | 0.3582  | 1.6872 | 1.2989 |
| No log        | 18.0769 | 470  | 1.6779          | 0.3582  | 1.6779 | 1.2954 |
| No log        | 18.1538 | 472  | 1.6077          | 0.4122  | 1.6077 | 1.2679 |
| No log        | 18.2308 | 474  | 1.5076          | 0.4122  | 1.5076 | 1.2278 |
| No log        | 18.3077 | 476  | 1.5260          | 0.4122  | 1.5260 | 1.2353 |
| No log        | 18.3846 | 478  | 1.6072          | 0.3759  | 1.6072 | 1.2678 |
| No log        | 18.4615 | 480  | 1.6947          | 0.3382  | 1.6947 | 1.3018 |
| No log        | 18.5385 | 482  | 1.7472          | 0.3358  | 1.7472 | 1.3218 |
| No log        | 18.6154 | 484  | 1.7303          | 0.3358  | 1.7303 | 1.3154 |
| No log        | 18.6923 | 486  | 1.7003          | 0.3704  | 1.7003 | 1.3039 |
| No log        | 18.7692 | 488  | 1.6986          | 0.3704  | 1.6986 | 1.3033 |
| No log        | 18.8462 | 490  | 1.6898          | 0.3704  | 1.6898 | 1.2999 |
| No log        | 18.9231 | 492  | 1.7086          | 0.4091  | 1.7086 | 1.3071 |
| No log        | 19.0    | 494  | 1.7077          | 0.3969  | 1.7077 | 1.3068 |
| No log        | 19.0769 | 496  | 1.6524          | 0.3969  | 1.6524 | 1.2855 |
| No log        | 19.1538 | 498  | 1.6776          | 0.3910  | 1.6776 | 1.2952 |
| 0.4168        | 19.2308 | 500  | 1.7301          | 0.3212  | 1.7301 | 1.3154 |
| 0.4168        | 19.3077 | 502  | 1.7476          | 0.3212  | 1.7476 | 1.3220 |
| 0.4168        | 19.3846 | 504  | 1.7753          | 0.3188  | 1.7753 | 1.3324 |
| 0.4168        | 19.4615 | 506  | 1.7454          | 0.3358  | 1.7454 | 1.3211 |
| 0.4168        | 19.5385 | 508  | 1.6025          | 0.3939  | 1.6025 | 1.2659 |
| 0.4168        | 19.6154 | 510  | 1.5320          | 0.4122  | 1.5320 | 1.2377 |
| 0.4168        | 19.6923 | 512  | 1.5285          | 0.4122  | 1.5285 | 1.2363 |
| 0.4168        | 19.7692 | 514  | 1.5346          | 0.4091  | 1.5346 | 1.2388 |
| 0.4168        | 19.8462 | 516  | 1.4484          | 0.4122  | 1.4484 | 1.2035 |
| 0.4168        | 19.9231 | 518  | 1.4277          | 0.4122  | 1.4277 | 1.1949 |
| 0.4168        | 20.0    | 520  | 1.4447          | 0.4122  | 1.4447 | 1.2020 |
| 0.4168        | 20.0769 | 522  | 1.4327          | 0.4662  | 1.4327 | 1.1970 |
| 0.4168        | 20.1538 | 524  | 1.4076          | 0.4662  | 1.4076 | 1.1864 |
| 0.4168        | 20.2308 | 526  | 1.4135          | 0.4662  | 1.4135 | 1.1889 |
| 0.4168        | 20.3077 | 528  | 1.4424          | 0.4394  | 1.4424 | 1.2010 |
| 0.4168        | 20.3846 | 530  | 1.5516          | 0.4091  | 1.5516 | 1.2456 |
| 0.4168        | 20.4615 | 532  | 1.7237          | 0.3088  | 1.7237 | 1.3129 |
| 0.4168        | 20.5385 | 534  | 1.8376          | 0.2714  | 1.8376 | 1.3556 |
| 0.4168        | 20.6154 | 536  | 1.8741          | 0.2714  | 1.8741 | 1.3690 |
| 0.4168        | 20.6923 | 538  | 1.8297          | 0.2734  | 1.8297 | 1.3527 |
| 0.4168        | 20.7692 | 540  | 1.7207          | 0.3165  | 1.7207 | 1.3118 |


### Framework versions

- Transformers 4.44.2
- Pytorch 2.4.0+cu118
- Datasets 2.21.0
- Tokenizers 0.19.1