File size: 22,171 Bytes
7b63738
 
 
 
 
 
5d95b64
7b63738
 
 
 
 
 
5d95b64
7b63738
 
 
5d95b64
 
 
 
7b63738
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
5d95b64
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
7b63738
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
---
library_name: transformers
base_model: aubmindlab/bert-base-arabertv02
tags:
- generated_from_trainer
model-index:
- name: ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k14_task1_organization
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k14_task1_organization

This model is a fine-tuned version of [aubmindlab/bert-base-arabertv02](https://huggingface.co/aubmindlab/bert-base-arabertv02) on the None dataset.
It achieves the following results on the evaluation set:
- Loss: 2.0270
- Qwk: 0.1958
- Mse: 2.0270
- Rmse: 1.4237

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 2e-05
- train_batch_size: 8
- eval_batch_size: 8
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 100

### Training results

| Training Loss | Epoch  | Step | Validation Loss | Qwk     | Mse    | Rmse   |
|:-------------:|:------:|:----:|:---------------:|:-------:|:------:|:------:|
| No log        | 0.0328 | 2    | 6.9274          | 0.0114  | 6.9274 | 2.6320 |
| No log        | 0.0656 | 4    | 4.5546          | 0.0880  | 4.5546 | 2.1342 |
| No log        | 0.0984 | 6    | 3.6637          | 0.0     | 3.6637 | 1.9141 |
| No log        | 0.1311 | 8    | 2.3665          | 0.1127  | 2.3665 | 1.5383 |
| No log        | 0.1639 | 10   | 2.2955          | 0.0851  | 2.2955 | 1.5151 |
| No log        | 0.1967 | 12   | 2.6429          | 0.0     | 2.6429 | 1.6257 |
| No log        | 0.2295 | 14   | 2.2613          | 0.0593  | 2.2613 | 1.5037 |
| No log        | 0.2623 | 16   | 1.9187          | 0.2419  | 1.9187 | 1.3852 |
| No log        | 0.2951 | 18   | 1.8848          | 0.3125  | 1.8848 | 1.3729 |
| No log        | 0.3279 | 20   | 1.7835          | 0.3125  | 1.7835 | 1.3355 |
| No log        | 0.3607 | 22   | 2.0363          | 0.3008  | 2.0363 | 1.4270 |
| No log        | 0.3934 | 24   | 2.5680          | 0.0667  | 2.5680 | 1.6025 |
| No log        | 0.4262 | 26   | 2.4517          | 0.0680  | 2.4517 | 1.5658 |
| No log        | 0.4590 | 28   | 1.9914          | 0.2941  | 1.9914 | 1.4112 |
| No log        | 0.4918 | 30   | 2.1819          | 0.1618  | 2.1819 | 1.4771 |
| No log        | 0.5246 | 32   | 2.0332          | 0.2481  | 2.0332 | 1.4259 |
| No log        | 0.5574 | 34   | 1.7074          | 0.3443  | 1.7074 | 1.3067 |
| No log        | 0.5902 | 36   | 1.8844          | 0.3040  | 1.8844 | 1.3728 |
| No log        | 0.6230 | 38   | 2.0637          | 0.2481  | 2.0637 | 1.4366 |
| No log        | 0.6557 | 40   | 1.9860          | 0.1890  | 1.9860 | 1.4093 |
| No log        | 0.6885 | 42   | 1.6770          | 0.2655  | 1.6770 | 1.2950 |
| No log        | 0.7213 | 44   | 1.5206          | 0.1524  | 1.5206 | 1.2331 |
| No log        | 0.7541 | 46   | 1.6014          | 0.3091  | 1.6014 | 1.2655 |
| No log        | 0.7869 | 48   | 1.6020          | 0.3478  | 1.6020 | 1.2657 |
| No log        | 0.8197 | 50   | 1.4273          | 0.3186  | 1.4273 | 1.1947 |
| No log        | 0.8525 | 52   | 1.3192          | 0.3590  | 1.3192 | 1.1486 |
| No log        | 0.8852 | 54   | 1.2734          | 0.4516  | 1.2734 | 1.1285 |
| No log        | 0.9180 | 56   | 1.2537          | 0.4538  | 1.2537 | 1.1197 |
| No log        | 0.9508 | 58   | 1.6898          | 0.2735  | 1.6898 | 1.2999 |
| No log        | 0.9836 | 60   | 2.4103          | -0.0672 | 2.4103 | 1.5525 |
| No log        | 1.0164 | 62   | 1.8688          | 0.1565  | 1.8688 | 1.3670 |
| No log        | 1.0492 | 64   | 1.3162          | 0.5484  | 1.3162 | 1.1473 |
| No log        | 1.0820 | 66   | 1.1400          | 0.5303  | 1.1400 | 1.0677 |
| No log        | 1.1148 | 68   | 1.2388          | 0.5185  | 1.2388 | 1.1130 |
| No log        | 1.1475 | 70   | 1.1427          | 0.5669  | 1.1427 | 1.0690 |
| No log        | 1.1803 | 72   | 1.2571          | 0.4132  | 1.2571 | 1.1212 |
| No log        | 1.2131 | 74   | 1.8733          | 0.1897  | 1.8733 | 1.3687 |
| No log        | 1.2459 | 76   | 1.5707          | 0.2586  | 1.5707 | 1.2533 |
| No log        | 1.2787 | 78   | 1.1571          | 0.5528  | 1.1571 | 1.0757 |
| No log        | 1.3115 | 80   | 1.1585          | 0.4874  | 1.1585 | 1.0763 |
| No log        | 1.3443 | 82   | 1.2108          | 0.4138  | 1.2108 | 1.1004 |
| No log        | 1.3770 | 84   | 1.2961          | 0.4531  | 1.2961 | 1.1385 |
| No log        | 1.4098 | 86   | 1.4522          | 0.4     | 1.4522 | 1.2051 |
| No log        | 1.4426 | 88   | 1.4565          | 0.4     | 1.4565 | 1.2069 |
| No log        | 1.4754 | 90   | 1.2895          | 0.5352  | 1.2895 | 1.1356 |
| No log        | 1.5082 | 92   | 1.2483          | 0.4966  | 1.2483 | 1.1173 |
| No log        | 1.5410 | 94   | 1.2511          | 0.5270  | 1.2512 | 1.1185 |
| No log        | 1.5738 | 96   | 1.3083          | 0.56    | 1.3083 | 1.1438 |
| No log        | 1.6066 | 98   | 1.6990          | 0.2628  | 1.6990 | 1.3034 |
| No log        | 1.6393 | 100  | 2.3381          | 0.0611  | 2.3381 | 1.5291 |
| No log        | 1.6721 | 102  | 2.2811          | 0.1194  | 2.2811 | 1.5103 |
| No log        | 1.7049 | 104  | 1.9165          | 0.2143  | 1.9165 | 1.3844 |
| No log        | 1.7377 | 106  | 1.4842          | 0.4366  | 1.4842 | 1.2183 |
| No log        | 1.7705 | 108  | 1.1782          | 0.5714  | 1.1782 | 1.0855 |
| No log        | 1.8033 | 110  | 1.1039          | 0.6197  | 1.1039 | 1.0506 |
| No log        | 1.8361 | 112  | 1.1893          | 0.5693  | 1.1893 | 1.0906 |
| No log        | 1.8689 | 114  | 1.3521          | 0.4853  | 1.3521 | 1.1628 |
| No log        | 1.9016 | 116  | 1.4560          | 0.3971  | 1.4560 | 1.2067 |
| No log        | 1.9344 | 118  | 1.4200          | 0.4265  | 1.4200 | 1.1916 |
| No log        | 1.9672 | 120  | 1.2898          | 0.5     | 1.2898 | 1.1357 |
| No log        | 2.0    | 122  | 1.1797          | 0.5821  | 1.1797 | 1.0862 |
| No log        | 2.0328 | 124  | 1.1619          | 0.5630  | 1.1619 | 1.0779 |
| No log        | 2.0656 | 126  | 1.5712          | 0.3862  | 1.5712 | 1.2535 |
| No log        | 2.0984 | 128  | 1.8809          | 0.3099  | 1.8809 | 1.3715 |
| No log        | 2.1311 | 130  | 1.8950          | 0.3056  | 1.8950 | 1.3766 |
| No log        | 2.1639 | 132  | 1.8992          | 0.2270  | 1.8992 | 1.3781 |
| No log        | 2.1967 | 134  | 1.7846          | 0.2837  | 1.7846 | 1.3359 |
| No log        | 2.2295 | 136  | 1.6685          | 0.2464  | 1.6685 | 1.2917 |
| No log        | 2.2623 | 138  | 1.6713          | 0.2794  | 1.6713 | 1.2928 |
| No log        | 2.2951 | 140  | 1.6640          | 0.3212  | 1.6640 | 1.2900 |
| No log        | 2.3279 | 142  | 1.4735          | 0.4697  | 1.4735 | 1.2139 |
| No log        | 2.3607 | 144  | 1.3592          | 0.4962  | 1.3592 | 1.1658 |
| No log        | 2.3934 | 146  | 1.4105          | 0.4627  | 1.4105 | 1.1876 |
| No log        | 2.4262 | 148  | 1.6592          | 0.3768  | 1.6592 | 1.2881 |
| No log        | 2.4590 | 150  | 1.6767          | 0.3504  | 1.6767 | 1.2949 |
| No log        | 2.4918 | 152  | 1.5501          | 0.4088  | 1.5501 | 1.2450 |
| No log        | 2.5246 | 154  | 1.4932          | 0.4118  | 1.4932 | 1.2220 |
| No log        | 2.5574 | 156  | 1.6787          | 0.3000  | 1.6787 | 1.2956 |
| No log        | 2.5902 | 158  | 1.7515          | 0.3194  | 1.7515 | 1.3234 |
| No log        | 2.6230 | 160  | 1.5714          | 0.4354  | 1.5714 | 1.2536 |
| No log        | 2.6557 | 162  | 1.5580          | 0.4161  | 1.5580 | 1.2482 |
| No log        | 2.6885 | 164  | 1.5658          | 0.4138  | 1.5658 | 1.2513 |
| No log        | 2.7213 | 166  | 1.6001          | 0.3636  | 1.6001 | 1.2649 |
| No log        | 2.7541 | 168  | 1.4631          | 0.4143  | 1.4631 | 1.2096 |
| No log        | 2.7869 | 170  | 1.3314          | 0.4848  | 1.3314 | 1.1539 |
| No log        | 2.8197 | 172  | 1.2795          | 0.5507  | 1.2795 | 1.1312 |
| No log        | 2.8525 | 174  | 1.4941          | 0.4336  | 1.4941 | 1.2223 |
| No log        | 2.8852 | 176  | 1.7194          | 0.3239  | 1.7194 | 1.3113 |
| No log        | 2.9180 | 178  | 1.7645          | 0.3239  | 1.7645 | 1.3283 |
| No log        | 2.9508 | 180  | 1.4946          | 0.4414  | 1.4946 | 1.2225 |
| No log        | 2.9836 | 182  | 1.4097          | 0.4648  | 1.4097 | 1.1873 |
| No log        | 3.0164 | 184  | 1.6593          | 0.3521  | 1.6593 | 1.2882 |
| No log        | 3.0492 | 186  | 2.2001          | 0.2238  | 2.2001 | 1.4833 |
| No log        | 3.0820 | 188  | 2.4875          | 0.0876  | 2.4875 | 1.5772 |
| No log        | 3.1148 | 190  | 2.4102          | 0.1831  | 2.4102 | 1.5525 |
| No log        | 3.1475 | 192  | 2.4384          | 0.1667  | 2.4384 | 1.5615 |
| No log        | 3.1803 | 194  | 2.3360          | 0.2345  | 2.3360 | 1.5284 |
| No log        | 3.2131 | 196  | 2.0251          | 0.2500  | 2.0251 | 1.4231 |
| No log        | 3.2459 | 198  | 1.7605          | 0.3143  | 1.7605 | 1.3268 |
| No log        | 3.2787 | 200  | 1.6749          | 0.3529  | 1.6749 | 1.2942 |
| No log        | 3.3115 | 202  | 1.4837          | 0.3433  | 1.4837 | 1.2181 |
| No log        | 3.3443 | 204  | 1.5385          | 0.3556  | 1.5385 | 1.2404 |
| No log        | 3.3770 | 206  | 1.6565          | 0.3358  | 1.6565 | 1.2870 |
| No log        | 3.4098 | 208  | 1.5748          | 0.3881  | 1.5748 | 1.2549 |
| No log        | 3.4426 | 210  | 1.3758          | 0.4154  | 1.3758 | 1.1729 |
| No log        | 3.4754 | 212  | 1.2867          | 0.4697  | 1.2867 | 1.1343 |
| No log        | 3.5082 | 214  | 1.3233          | 0.4697  | 1.3233 | 1.1503 |
| No log        | 3.5410 | 216  | 1.5454          | 0.3942  | 1.5454 | 1.2431 |
| No log        | 3.5738 | 218  | 1.8644          | 0.2676  | 1.8644 | 1.3654 |
| No log        | 3.6066 | 220  | 2.0092          | 0.2345  | 2.0092 | 1.4175 |
| No log        | 3.6393 | 222  | 1.9203          | 0.2500  | 1.9203 | 1.3857 |
| No log        | 3.6721 | 224  | 1.5958          | 0.3571  | 1.5958 | 1.2633 |
| No log        | 3.7049 | 226  | 1.4899          | 0.3676  | 1.4899 | 1.2206 |
| No log        | 3.7377 | 228  | 1.5724          | 0.3650  | 1.5724 | 1.2539 |
| No log        | 3.7705 | 230  | 1.7095          | 0.3309  | 1.7095 | 1.3075 |
| No log        | 3.8033 | 232  | 1.7848          | 0.2734  | 1.7848 | 1.3360 |
| No log        | 3.8361 | 234  | 1.7954          | 0.2676  | 1.7954 | 1.3399 |
| No log        | 3.8689 | 236  | 1.8446          | 0.2639  | 1.8446 | 1.3582 |
| No log        | 3.9016 | 238  | 1.8912          | 0.2621  | 1.8912 | 1.3752 |
| No log        | 3.9344 | 240  | 2.0237          | 0.2621  | 2.0237 | 1.4226 |
| No log        | 3.9672 | 242  | 2.0469          | 0.2621  | 2.0469 | 1.4307 |
| No log        | 4.0    | 244  | 1.8729          | 0.2797  | 1.8729 | 1.3685 |
| No log        | 4.0328 | 246  | 1.7282          | 0.3885  | 1.7282 | 1.3146 |
| No log        | 4.0656 | 248  | 1.6984          | 0.3768  | 1.6984 | 1.3032 |
| No log        | 4.0984 | 250  | 1.8686          | 0.2676  | 1.8686 | 1.3670 |
| No log        | 4.1311 | 252  | 2.1460          | 0.2500  | 2.1460 | 1.4649 |
| No log        | 4.1639 | 254  | 2.1047          | 0.2500  | 2.1047 | 1.4508 |
| No log        | 4.1967 | 256  | 2.1241          | 0.2500  | 2.1241 | 1.4574 |
| No log        | 4.2295 | 258  | 2.1727          | 0.2345  | 2.1727 | 1.4740 |
| No log        | 4.2623 | 260  | 2.0199          | 0.2517  | 2.0199 | 1.4212 |
| No log        | 4.2951 | 262  | 1.8132          | 0.3099  | 1.8132 | 1.3465 |
| No log        | 4.3279 | 264  | 1.8222          | 0.3099  | 1.8222 | 1.3499 |
| No log        | 4.3607 | 266  | 1.9455          | 0.2517  | 1.9455 | 1.3948 |
| No log        | 4.3934 | 268  | 2.0643          | 0.2098  | 2.0643 | 1.4368 |
| No log        | 4.4262 | 270  | 2.1044          | 0.1678  | 2.1044 | 1.4507 |
| No log        | 4.4590 | 272  | 1.9808          | 0.2098  | 1.9808 | 1.4074 |
| No log        | 4.4918 | 274  | 1.8321          | 0.2590  | 1.8321 | 1.3536 |
| No log        | 4.5246 | 276  | 1.5873          | 0.3504  | 1.5873 | 1.2599 |
| No log        | 4.5574 | 278  | 1.5065          | 0.4394  | 1.5065 | 1.2274 |
| No log        | 4.5902 | 280  | 1.6186          | 0.3111  | 1.6186 | 1.2722 |
| No log        | 4.6230 | 282  | 1.8344          | 0.2590  | 1.8344 | 1.3544 |
| No log        | 4.6557 | 284  | 2.0936          | 0.1806  | 2.0936 | 1.4469 |
| No log        | 4.6885 | 286  | 2.1929          | 0.1806  | 2.1929 | 1.4809 |
| No log        | 4.7213 | 288  | 2.1543          | 0.1806  | 2.1543 | 1.4677 |
| No log        | 4.7541 | 290  | 1.9524          | 0.2098  | 1.9524 | 1.3973 |
| No log        | 4.7869 | 292  | 1.9466          | 0.2254  | 1.9466 | 1.3952 |
| No log        | 4.8197 | 294  | 2.0611          | 0.2361  | 2.0611 | 1.4357 |
| No log        | 4.8525 | 296  | 2.0938          | 0.2361  | 2.0938 | 1.4470 |
| No log        | 4.8852 | 298  | 2.0528          | 0.2361  | 2.0528 | 1.4328 |
| No log        | 4.9180 | 300  | 1.9472          | 0.2254  | 1.9472 | 1.3954 |
| No log        | 4.9508 | 302  | 1.8155          | 0.2206  | 1.8155 | 1.3474 |
| No log        | 4.9836 | 304  | 1.7635          | 0.2464  | 1.7635 | 1.3280 |
| No log        | 5.0164 | 306  | 1.7547          | 0.2676  | 1.7547 | 1.3247 |
| No log        | 5.0492 | 308  | 1.7933          | 0.2657  | 1.7933 | 1.3391 |
| No log        | 5.0820 | 310  | 1.9107          | 0.2639  | 1.9107 | 1.3823 |
| No log        | 5.1148 | 312  | 1.7747          | 0.2817  | 1.7747 | 1.3322 |
| No log        | 5.1475 | 314  | 1.6128          | 0.3857  | 1.6128 | 1.2700 |
| No log        | 5.1803 | 316  | 1.6292          | 0.3597  | 1.6292 | 1.2764 |
| No log        | 5.2131 | 318  | 1.7802          | 0.2714  | 1.7802 | 1.3342 |
| No log        | 5.2459 | 320  | 1.8351          | 0.2714  | 1.8351 | 1.3547 |
| No log        | 5.2787 | 322  | 1.7236          | 0.3358  | 1.7236 | 1.3129 |
| No log        | 5.3115 | 324  | 1.7507          | 0.3453  | 1.7507 | 1.3232 |
| No log        | 5.3443 | 326  | 1.9038          | 0.2817  | 1.9038 | 1.3798 |
| No log        | 5.3770 | 328  | 2.1008          | 0.1806  | 2.1008 | 1.4494 |
| No log        | 5.4098 | 330  | 2.1172          | 0.1806  | 2.1172 | 1.4551 |
| No log        | 5.4426 | 332  | 1.9811          | 0.1958  | 1.9811 | 1.4075 |
| No log        | 5.4754 | 334  | 1.9634          | 0.1702  | 1.9634 | 1.4012 |
| No log        | 5.5082 | 336  | 1.8444          | 0.2590  | 1.8444 | 1.3581 |
| No log        | 5.5410 | 338  | 1.7689          | 0.3333  | 1.7689 | 1.3300 |
| No log        | 5.5738 | 340  | 1.7631          | 0.3333  | 1.7631 | 1.3278 |
| No log        | 5.6066 | 342  | 1.8331          | 0.3099  | 1.8331 | 1.3539 |
| No log        | 5.6393 | 344  | 1.9543          | 0.2378  | 1.9543 | 1.3980 |
| No log        | 5.6721 | 346  | 2.1829          | 0.1958  | 2.1829 | 1.4774 |
| No log        | 5.7049 | 348  | 2.3709          | 0.1793  | 2.3709 | 1.5398 |
| No log        | 5.7377 | 350  | 2.2390          | 0.2254  | 2.2390 | 1.4963 |
| No log        | 5.7705 | 352  | 2.0096          | 0.2411  | 2.0096 | 1.4176 |
| No log        | 5.8033 | 354  | 1.9457          | 0.2378  | 1.9457 | 1.3949 |
| No log        | 5.8361 | 356  | 1.8676          | 0.2639  | 1.8676 | 1.3666 |
| No log        | 5.8689 | 358  | 1.8751          | 0.2937  | 1.8751 | 1.3694 |
| No log        | 5.9016 | 360  | 1.9176          | 0.2553  | 1.9176 | 1.3848 |
| No log        | 5.9344 | 362  | 2.0070          | 0.2254  | 2.0070 | 1.4167 |
| No log        | 5.9672 | 364  | 2.0383          | 0.1538  | 2.0383 | 1.4277 |
| No log        | 6.0    | 366  | 1.9729          | 0.2098  | 1.9729 | 1.4046 |
| No log        | 6.0328 | 368  | 1.7557          | 0.2714  | 1.7557 | 1.3250 |
| No log        | 6.0656 | 370  | 1.6827          | 0.3286  | 1.6827 | 1.2972 |
| No log        | 6.0984 | 372  | 1.6672          | 0.3309  | 1.6672 | 1.2912 |
| No log        | 6.1311 | 374  | 1.6777          | 0.3286  | 1.6777 | 1.2953 |
| No log        | 6.1639 | 376  | 1.7946          | 0.2553  | 1.7946 | 1.3396 |
| No log        | 6.1967 | 378  | 1.9796          | 0.2394  | 1.9796 | 1.4070 |
| No log        | 6.2295 | 380  | 2.0549          | 0.1806  | 2.0549 | 1.4335 |
| No log        | 6.2623 | 382  | 1.9746          | 0.2098  | 1.9746 | 1.4052 |
| No log        | 6.2951 | 384  | 1.9283          | 0.2394  | 1.9283 | 1.3886 |
| No log        | 6.3279 | 386  | 1.8555          | 0.2429  | 1.8555 | 1.3622 |
| No log        | 6.3607 | 388  | 1.9432          | 0.1844  | 1.9432 | 1.3940 |
| No log        | 6.3934 | 390  | 2.0936          | 0.1844  | 2.0936 | 1.4469 |
| No log        | 6.4262 | 392  | 2.0968          | 0.1844  | 2.0968 | 1.4480 |
| No log        | 6.4590 | 394  | 1.9531          | 0.2394  | 1.9531 | 1.3975 |
| No log        | 6.4918 | 396  | 1.7152          | 0.2857  | 1.7152 | 1.3096 |
| No log        | 6.5246 | 398  | 1.6000          | 0.3529  | 1.6000 | 1.2649 |
| No log        | 6.5574 | 400  | 1.5615          | 0.3704  | 1.5615 | 1.2496 |
| No log        | 6.5902 | 402  | 1.6877          | 0.3259  | 1.6877 | 1.2991 |
| No log        | 6.6230 | 404  | 1.9193          | 0.2553  | 1.9193 | 1.3854 |
| No log        | 6.6557 | 406  | 1.8935          | 0.2553  | 1.8935 | 1.3761 |
| No log        | 6.6885 | 408  | 1.9035          | 0.2553  | 1.9035 | 1.3797 |
| No log        | 6.7213 | 410  | 1.9923          | 0.2254  | 1.9923 | 1.4115 |
| No log        | 6.7541 | 412  | 2.1026          | 0.1958  | 2.1026 | 1.4500 |
| No log        | 6.7869 | 414  | 2.0569          | 0.2517  | 2.0569 | 1.4342 |
| No log        | 6.8197 | 416  | 1.8925          | 0.2837  | 1.8925 | 1.3757 |
| No log        | 6.8525 | 418  | 1.6951          | 0.2878  | 1.6951 | 1.3020 |
| No log        | 6.8852 | 420  | 1.5833          | 0.4179  | 1.5833 | 1.2583 |
| No log        | 6.9180 | 422  | 1.6395          | 0.3382  | 1.6395 | 1.2804 |
| No log        | 6.9508 | 424  | 1.7606          | 0.2837  | 1.7606 | 1.3269 |
| No log        | 6.9836 | 426  | 1.8552          | 0.2837  | 1.8552 | 1.3621 |
| No log        | 7.0164 | 428  | 1.9491          | 0.2222  | 1.9491 | 1.3961 |
| No log        | 7.0492 | 430  | 1.9351          | 0.25    | 1.9351 | 1.3911 |
| No log        | 7.0820 | 432  | 1.9882          | 0.2483  | 1.9882 | 1.4100 |
| No log        | 7.1148 | 434  | 2.0765          | 0.2222  | 2.0765 | 1.4410 |
| No log        | 7.1475 | 436  | 2.1152          | 0.2222  | 2.1152 | 1.4544 |
| No log        | 7.1803 | 438  | 2.1237          | 0.1958  | 2.1237 | 1.4573 |
| No log        | 7.2131 | 440  | 1.9446          | 0.2254  | 1.9446 | 1.3945 |
| No log        | 7.2459 | 442  | 1.5827          | 0.3485  | 1.5827 | 1.2581 |
| No log        | 7.2787 | 444  | 1.4383          | 0.4341  | 1.4383 | 1.1993 |
| No log        | 7.3115 | 446  | 1.4932          | 0.4     | 1.4932 | 1.2220 |
| No log        | 7.3443 | 448  | 1.6519          | 0.3433  | 1.6519 | 1.2852 |
| No log        | 7.3770 | 450  | 1.9293          | 0.2553  | 1.9293 | 1.3890 |
| No log        | 7.4098 | 452  | 2.0775          | 0.1702  | 2.0775 | 1.4414 |
| No log        | 7.4426 | 454  | 2.0549          | 0.1151  | 2.0549 | 1.4335 |
| No log        | 7.4754 | 456  | 2.0828          | 0.1151  | 2.0828 | 1.4432 |
| No log        | 7.5082 | 458  | 2.0795          | 0.1277  | 2.0795 | 1.4421 |
| No log        | 7.5410 | 460  | 2.1101          | 0.1806  | 2.1101 | 1.4526 |
| No log        | 7.5738 | 462  | 2.1957          | 0.1806  | 2.1957 | 1.4818 |
| No log        | 7.6066 | 464  | 2.1914          | 0.1806  | 2.1914 | 1.4804 |
| No log        | 7.6393 | 466  | 2.0900          | 0.1806  | 2.0900 | 1.4457 |
| No log        | 7.6721 | 468  | 1.9215          | 0.2098  | 1.9215 | 1.3862 |
| No log        | 7.7049 | 470  | 1.7424          | 0.2857  | 1.7424 | 1.3200 |
| No log        | 7.7377 | 472  | 1.6896          | 0.3796  | 1.6896 | 1.2999 |
| No log        | 7.7705 | 474  | 1.6581          | 0.3796  | 1.6581 | 1.2877 |
| No log        | 7.8033 | 476  | 1.7274          | 0.3188  | 1.7274 | 1.3143 |
| No log        | 7.8361 | 478  | 1.8115          | 0.2517  | 1.8115 | 1.3459 |
| No log        | 7.8689 | 480  | 1.9006          | 0.2222  | 1.9006 | 1.3786 |
| No log        | 7.9016 | 482  | 1.9916          | 0.2222  | 1.9916 | 1.4112 |
| No log        | 7.9344 | 484  | 1.8777          | 0.2517  | 1.8777 | 1.3703 |
| No log        | 7.9672 | 486  | 1.6141          | 0.3478  | 1.6141 | 1.2705 |
| No log        | 8.0    | 488  | 1.5371          | 0.3824  | 1.5371 | 1.2398 |
| No log        | 8.0328 | 490  | 1.6912          | 0.3121  | 1.6912 | 1.3005 |
| No log        | 8.0656 | 492  | 1.9362          | 0.2238  | 1.9362 | 1.3915 |
| No log        | 8.0984 | 494  | 2.0200          | 0.2222  | 2.0200 | 1.4213 |
| No log        | 8.1311 | 496  | 1.9730          | 0.2222  | 1.9730 | 1.4046 |
| No log        | 8.1639 | 498  | 1.8267          | 0.2571  | 1.8267 | 1.3515 |
| 0.421         | 8.1967 | 500  | 1.7251          | 0.2941  | 1.7251 | 1.3134 |
| 0.421         | 8.2295 | 502  | 1.7126          | 0.2941  | 1.7126 | 1.3087 |
| 0.421         | 8.2623 | 504  | 1.6526          | 0.3382  | 1.6526 | 1.2855 |
| 0.421         | 8.2951 | 506  | 1.6645          | 0.3212  | 1.6645 | 1.2901 |
| 0.421         | 8.3279 | 508  | 1.6930          | 0.2714  | 1.6930 | 1.3011 |
| 0.421         | 8.3607 | 510  | 1.7930          | 0.2837  | 1.7930 | 1.3390 |
| 0.421         | 8.3934 | 512  | 1.9624          | 0.2254  | 1.9624 | 1.4008 |
| 0.421         | 8.4262 | 514  | 2.1160          | 0.1958  | 2.1160 | 1.4547 |
| 0.421         | 8.4590 | 516  | 2.0270          | 0.1958  | 2.0270 | 1.4237 |


### Framework versions

- Transformers 4.44.2
- Pytorch 2.4.0+cu118
- Datasets 2.21.0
- Tokenizers 0.19.1