File size: 22,971 Bytes
e235c32
 
 
 
 
 
e599656
e235c32
 
 
 
 
 
e599656
e235c32
 
 
e599656
 
 
 
e235c32
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
e599656
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
e235c32
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
---
library_name: transformers
base_model: aubmindlab/bert-base-arabertv02
tags:
- generated_from_trainer
model-index:
- name: ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k17_task1_organization
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k17_task1_organization

This model is a fine-tuned version of [aubmindlab/bert-base-arabertv02](https://huggingface.co/aubmindlab/bert-base-arabertv02) on the None dataset.
It achieves the following results on the evaluation set:
- Loss: 1.8110
- Qwk: 0.2754
- Mse: 1.8110
- Rmse: 1.3457

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 2e-05
- train_batch_size: 8
- eval_batch_size: 8
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 100

### Training results

| Training Loss | Epoch  | Step | Validation Loss | Qwk     | Mse    | Rmse   |
|:-------------:|:------:|:----:|:---------------:|:-------:|:------:|:------:|
| No log        | 0.0270 | 2    | 7.2082          | -0.0162 | 7.2082 | 2.6848 |
| No log        | 0.0541 | 4    | 4.4178          | 0.0833  | 4.4178 | 2.1018 |
| No log        | 0.0811 | 6    | 3.6012          | -0.0423 | 3.6012 | 1.8977 |
| No log        | 0.1081 | 8    | 3.9013          | -0.0796 | 3.9013 | 1.9752 |
| No log        | 0.1351 | 10   | 2.2566          | 0.1194  | 2.2566 | 1.5022 |
| No log        | 0.1622 | 12   | 1.8780          | 0.1593  | 1.8780 | 1.3704 |
| No log        | 0.1892 | 14   | 2.1948          | -0.0625 | 2.1948 | 1.4815 |
| No log        | 0.2162 | 16   | 2.2320          | -0.0472 | 2.2320 | 1.4940 |
| No log        | 0.2432 | 18   | 2.2639          | 0.0305  | 2.2639 | 1.5046 |
| No log        | 0.2703 | 20   | 2.2500          | 0.0606  | 2.2500 | 1.5000 |
| No log        | 0.2973 | 22   | 2.1048          | 0.1157  | 2.1048 | 1.4508 |
| No log        | 0.3243 | 24   | 2.0103          | 0.2018  | 2.0103 | 1.4179 |
| No log        | 0.3514 | 26   | 1.9807          | 0.1869  | 1.9807 | 1.4074 |
| No log        | 0.3784 | 28   | 1.9049          | 0.1698  | 1.9049 | 1.3802 |
| No log        | 0.4054 | 30   | 1.8210          | 0.1714  | 1.8210 | 1.3494 |
| No log        | 0.4324 | 32   | 1.7544          | 0.1714  | 1.7544 | 1.3245 |
| No log        | 0.4595 | 34   | 1.6969          | 0.1154  | 1.6969 | 1.3027 |
| No log        | 0.4865 | 36   | 1.6768          | 0.2569  | 1.6768 | 1.2949 |
| No log        | 0.5135 | 38   | 1.8115          | 0.2459  | 1.8115 | 1.3459 |
| No log        | 0.5405 | 40   | 1.8102          | 0.2459  | 1.8102 | 1.3454 |
| No log        | 0.5676 | 42   | 1.8407          | 0.3465  | 1.8407 | 1.3567 |
| No log        | 0.5946 | 44   | 1.6912          | 0.2735  | 1.6912 | 1.3005 |
| No log        | 0.6216 | 46   | 1.5411          | 0.1682  | 1.5411 | 1.2414 |
| No log        | 0.6486 | 48   | 1.4974          | 0.1524  | 1.4974 | 1.2237 |
| No log        | 0.6757 | 50   | 1.5038          | 0.2243  | 1.5038 | 1.2263 |
| No log        | 0.7027 | 52   | 1.5548          | 0.2202  | 1.5548 | 1.2469 |
| No log        | 0.7297 | 54   | 1.5638          | 0.2321  | 1.5638 | 1.2505 |
| No log        | 0.7568 | 56   | 1.5255          | 0.2301  | 1.5255 | 1.2351 |
| No log        | 0.7838 | 58   | 1.4802          | 0.2182  | 1.4802 | 1.2166 |
| No log        | 0.8108 | 60   | 1.4783          | 0.2056  | 1.4783 | 1.2159 |
| No log        | 0.8378 | 62   | 1.5381          | 0.2407  | 1.5381 | 1.2402 |
| No log        | 0.8649 | 64   | 1.5067          | 0.2545  | 1.5067 | 1.2275 |
| No log        | 0.8919 | 66   | 1.4023          | 0.3509  | 1.4023 | 1.1842 |
| No log        | 0.9189 | 68   | 1.2808          | 0.3966  | 1.2808 | 1.1317 |
| No log        | 0.9459 | 70   | 1.1520          | 0.5116  | 1.1520 | 1.0733 |
| No log        | 0.9730 | 72   | 1.1067          | 0.5238  | 1.1067 | 1.0520 |
| No log        | 1.0    | 74   | 1.1387          | 0.5167  | 1.1387 | 1.0671 |
| No log        | 1.0270 | 76   | 1.2173          | 0.5366  | 1.2173 | 1.1033 |
| No log        | 1.0541 | 78   | 1.3335          | 0.4500  | 1.3335 | 1.1548 |
| No log        | 1.0811 | 80   | 1.3091          | 0.5082  | 1.3091 | 1.1442 |
| No log        | 1.1081 | 82   | 1.2611          | 0.5124  | 1.2611 | 1.1230 |
| No log        | 1.1351 | 84   | 1.3162          | 0.4370  | 1.3162 | 1.1473 |
| No log        | 1.1622 | 86   | 1.2898          | 0.4667  | 1.2898 | 1.1357 |
| No log        | 1.1892 | 88   | 1.2614          | 0.4715  | 1.2614 | 1.1231 |
| No log        | 1.2162 | 90   | 1.5039          | 0.3636  | 1.5039 | 1.2263 |
| No log        | 1.2432 | 92   | 1.7922          | 0.2581  | 1.7922 | 1.3387 |
| No log        | 1.2703 | 94   | 1.6562          | 0.2812  | 1.6562 | 1.2869 |
| No log        | 1.2973 | 96   | 1.6710          | 0.2879  | 1.6710 | 1.2927 |
| No log        | 1.3243 | 98   | 1.6769          | 0.2899  | 1.6769 | 1.2950 |
| No log        | 1.3514 | 100  | 1.7390          | 0.3022  | 1.7390 | 1.3187 |
| No log        | 1.3784 | 102  | 1.6659          | 0.3022  | 1.6659 | 1.2907 |
| No log        | 1.4054 | 104  | 1.6323          | 0.3212  | 1.6323 | 1.2776 |
| No log        | 1.4324 | 106  | 1.5980          | 0.3636  | 1.5980 | 1.2641 |
| No log        | 1.4595 | 108  | 1.4648          | 0.4427  | 1.4648 | 1.2103 |
| No log        | 1.4865 | 110  | 1.4642          | 0.5203  | 1.4642 | 1.2100 |
| No log        | 1.5135 | 112  | 1.5540          | 0.3016  | 1.5540 | 1.2466 |
| No log        | 1.5405 | 114  | 1.7152          | 0.2344  | 1.7152 | 1.3096 |
| No log        | 1.5676 | 116  | 1.6887          | 0.3030  | 1.6887 | 1.2995 |
| No log        | 1.5946 | 118  | 1.6345          | 0.3478  | 1.6345 | 1.2785 |
| No log        | 1.6216 | 120  | 1.5541          | 0.3889  | 1.5541 | 1.2466 |
| No log        | 1.6486 | 122  | 1.7321          | 0.3429  | 1.7321 | 1.3161 |
| No log        | 1.6757 | 124  | 1.7849          | 0.3429  | 1.7849 | 1.3360 |
| No log        | 1.7027 | 126  | 1.7942          | 0.3212  | 1.7942 | 1.3395 |
| No log        | 1.7297 | 128  | 1.6782          | 0.3478  | 1.6782 | 1.2954 |
| No log        | 1.7568 | 130  | 1.6333          | 0.2791  | 1.6333 | 1.2780 |
| No log        | 1.7838 | 132  | 1.6812          | 0.2764  | 1.6812 | 1.2966 |
| No log        | 1.8108 | 134  | 1.6148          | 0.2759  | 1.6148 | 1.2707 |
| No log        | 1.8378 | 136  | 1.5928          | 0.3306  | 1.5928 | 1.2621 |
| No log        | 1.8649 | 138  | 1.5961          | 0.3252  | 1.5961 | 1.2634 |
| No log        | 1.8919 | 140  | 1.6132          | 0.2951  | 1.6132 | 1.2701 |
| No log        | 1.9189 | 142  | 1.6740          | 0.3876  | 1.6740 | 1.2938 |
| No log        | 1.9459 | 144  | 1.5854          | 0.3281  | 1.5854 | 1.2591 |
| No log        | 1.9730 | 146  | 1.5721          | 0.3492  | 1.5721 | 1.2538 |
| No log        | 2.0    | 148  | 1.5770          | 0.3759  | 1.5770 | 1.2558 |
| No log        | 2.0270 | 150  | 1.4834          | 0.3360  | 1.4834 | 1.2179 |
| No log        | 2.0541 | 152  | 1.3675          | 0.3871  | 1.3675 | 1.1694 |
| No log        | 2.0811 | 154  | 1.3421          | 0.3577  | 1.3421 | 1.1585 |
| No log        | 2.1081 | 156  | 1.5974          | 0.3942  | 1.5974 | 1.2639 |
| No log        | 2.1351 | 158  | 1.7204          | 0.3597  | 1.7204 | 1.3117 |
| No log        | 2.1622 | 160  | 1.5333          | 0.3852  | 1.5333 | 1.2382 |
| No log        | 2.1892 | 162  | 1.4891          | 0.3622  | 1.4891 | 1.2203 |
| No log        | 2.2162 | 164  | 1.6118          | 0.3459  | 1.6118 | 1.2696 |
| No log        | 2.2432 | 166  | 1.8269          | 0.3358  | 1.8269 | 1.3516 |
| No log        | 2.2703 | 168  | 1.6298          | 0.3259  | 1.6298 | 1.2766 |
| No log        | 2.2973 | 170  | 1.5699          | 0.3134  | 1.5699 | 1.2530 |
| No log        | 2.3243 | 172  | 1.5849          | 0.3529  | 1.5849 | 1.2589 |
| No log        | 2.3514 | 174  | 1.6959          | 0.3478  | 1.6959 | 1.3023 |
| No log        | 2.3784 | 176  | 1.8324          | 0.2857  | 1.8324 | 1.3537 |
| No log        | 2.4054 | 178  | 1.6801          | 0.3741  | 1.6801 | 1.2962 |
| No log        | 2.4324 | 180  | 1.6340          | 0.3623  | 1.6340 | 1.2783 |
| No log        | 2.4595 | 182  | 1.5266          | 0.4427  | 1.5266 | 1.2355 |
| No log        | 2.4865 | 184  | 1.4815          | 0.3770  | 1.4815 | 1.2172 |
| No log        | 2.5135 | 186  | 1.4268          | 0.3130  | 1.4268 | 1.1945 |
| No log        | 2.5405 | 188  | 1.3539          | 0.3478  | 1.3539 | 1.1636 |
| No log        | 2.5676 | 190  | 1.4250          | 0.4545  | 1.4250 | 1.1937 |
| No log        | 2.5946 | 192  | 1.6666          | 0.3768  | 1.6666 | 1.2910 |
| No log        | 2.6216 | 194  | 1.8661          | 0.2878  | 1.8661 | 1.3661 |
| No log        | 2.6486 | 196  | 1.8096          | 0.3121  | 1.8096 | 1.3452 |
| No log        | 2.6757 | 198  | 1.5584          | 0.3942  | 1.5584 | 1.2484 |
| No log        | 2.7027 | 200  | 1.3693          | 0.5481  | 1.3693 | 1.1702 |
| No log        | 2.7297 | 202  | 1.3817          | 0.5185  | 1.3817 | 1.1755 |
| No log        | 2.7568 | 204  | 1.4770          | 0.4478  | 1.4770 | 1.2153 |
| No log        | 2.7838 | 206  | 1.6677          | 0.3597  | 1.6677 | 1.2914 |
| No log        | 2.8108 | 208  | 1.7582          | 0.3453  | 1.7582 | 1.3260 |
| No log        | 2.8378 | 210  | 1.6186          | 0.4060  | 1.6186 | 1.2722 |
| No log        | 2.8649 | 212  | 1.4199          | 0.4286  | 1.4199 | 1.1916 |
| No log        | 2.8919 | 214  | 1.3802          | 0.4567  | 1.3802 | 1.1748 |
| No log        | 2.9189 | 216  | 1.5417          | 0.4380  | 1.5417 | 1.2416 |
| No log        | 2.9459 | 218  | 2.0088          | 0.2207  | 2.0088 | 1.4173 |
| No log        | 2.9730 | 220  | 2.2277          | 0.1408  | 2.2277 | 1.4925 |
| No log        | 3.0    | 222  | 2.1407          | 0.0597  | 2.1407 | 1.4631 |
| No log        | 3.0270 | 224  | 1.8514          | 0.1951  | 1.8514 | 1.3607 |
| No log        | 3.0541 | 226  | 1.6430          | 0.3740  | 1.6430 | 1.2818 |
| No log        | 3.0811 | 228  | 1.5615          | 0.4127  | 1.5615 | 1.2496 |
| No log        | 3.1081 | 230  | 1.5855          | 0.4627  | 1.5855 | 1.2592 |
| No log        | 3.1351 | 232  | 1.6564          | 0.3429  | 1.6564 | 1.2870 |
| No log        | 3.1622 | 234  | 1.5814          | 0.4203  | 1.5814 | 1.2576 |
| No log        | 3.1892 | 236  | 1.4123          | 0.4923  | 1.4123 | 1.1884 |
| No log        | 3.2162 | 238  | 1.4214          | 0.4961  | 1.4214 | 1.1922 |
| No log        | 3.2432 | 240  | 1.5848          | 0.3971  | 1.5848 | 1.2589 |
| No log        | 3.2703 | 242  | 1.7020          | 0.3885  | 1.7020 | 1.3046 |
| No log        | 3.2973 | 244  | 1.8595          | 0.2483  | 1.8595 | 1.3636 |
| No log        | 3.3243 | 246  | 2.0443          | 0.1806  | 2.0443 | 1.4298 |
| No log        | 3.3514 | 248  | 2.0324          | 0.1806  | 2.0324 | 1.4256 |
| No log        | 3.3784 | 250  | 1.8233          | 0.2254  | 1.8233 | 1.3503 |
| No log        | 3.4054 | 252  | 1.6159          | 0.3910  | 1.6159 | 1.2712 |
| No log        | 3.4324 | 254  | 1.5849          | 0.3759  | 1.5849 | 1.2589 |
| No log        | 3.4595 | 256  | 1.6667          | 0.3876  | 1.6667 | 1.2910 |
| No log        | 3.4865 | 258  | 1.8424          | 0.2590  | 1.8424 | 1.3574 |
| No log        | 3.5135 | 260  | 1.9403          | 0.1958  | 1.9403 | 1.3929 |
| No log        | 3.5405 | 262  | 2.0503          | 0.1655  | 2.0502 | 1.4319 |
| No log        | 3.5676 | 264  | 1.8608          | 0.2817  | 1.8608 | 1.3641 |
| No log        | 3.5946 | 266  | 1.7975          | 0.3077  | 1.7975 | 1.3407 |
| No log        | 3.6216 | 268  | 1.8322          | 0.2254  | 1.8322 | 1.3536 |
| No log        | 3.6486 | 270  | 1.9213          | 0.2254  | 1.9213 | 1.3861 |
| No log        | 3.6757 | 272  | 1.9880          | 0.2254  | 1.9880 | 1.4100 |
| No log        | 3.7027 | 274  | 1.9393          | 0.2254  | 1.9393 | 1.3926 |
| No log        | 3.7297 | 276  | 1.8321          | 0.2270  | 1.8321 | 1.3536 |
| No log        | 3.7568 | 278  | 1.8982          | 0.2254  | 1.8982 | 1.3778 |
| No log        | 3.7838 | 280  | 1.9421          | 0.2254  | 1.9421 | 1.3936 |
| No log        | 3.8108 | 282  | 2.0218          | 0.2254  | 2.0218 | 1.4219 |
| No log        | 3.8378 | 284  | 1.9314          | 0.2553  | 1.9314 | 1.3898 |
| No log        | 3.8649 | 286  | 1.8592          | 0.2571  | 1.8592 | 1.3635 |
| No log        | 3.8919 | 288  | 1.6958          | 0.2963  | 1.6958 | 1.3022 |
| No log        | 3.9189 | 290  | 1.6157          | 0.3840  | 1.6157 | 1.2711 |
| No log        | 3.9459 | 292  | 1.6598          | 0.3101  | 1.6598 | 1.2883 |
| No log        | 3.9730 | 294  | 1.5943          | 0.4394  | 1.5943 | 1.2626 |
| No log        | 4.0    | 296  | 1.4468          | 0.4615  | 1.4468 | 1.2028 |
| No log        | 4.0270 | 298  | 1.3742          | 0.4567  | 1.3742 | 1.1723 |
| No log        | 4.0541 | 300  | 1.3576          | 0.4531  | 1.3576 | 1.1651 |
| No log        | 4.0811 | 302  | 1.5542          | 0.3881  | 1.5542 | 1.2467 |
| No log        | 4.1081 | 304  | 1.7148          | 0.2979  | 1.7148 | 1.3095 |
| No log        | 4.1351 | 306  | 1.7422          | 0.3099  | 1.7422 | 1.3199 |
| No log        | 4.1622 | 308  | 1.8653          | 0.2817  | 1.8653 | 1.3658 |
| No log        | 4.1892 | 310  | 1.8779          | 0.2817  | 1.8779 | 1.3704 |
| No log        | 4.2162 | 312  | 1.9154          | 0.2517  | 1.9154 | 1.3840 |
| No log        | 4.2432 | 314  | 1.8347          | 0.2817  | 1.8347 | 1.3545 |
| No log        | 4.2703 | 316  | 1.7254          | 0.2937  | 1.7254 | 1.3135 |
| No log        | 4.2973 | 318  | 1.7849          | 0.2937  | 1.7849 | 1.3360 |
| No log        | 4.3243 | 320  | 2.0441          | 0.2207  | 2.0441 | 1.4297 |
| No log        | 4.3514 | 322  | 2.0704          | 0.2207  | 2.0704 | 1.4389 |
| No log        | 4.3784 | 324  | 2.0644          | 0.2222  | 2.0644 | 1.4368 |
| No log        | 4.4054 | 326  | 1.8950          | 0.2817  | 1.8950 | 1.3766 |
| No log        | 4.4324 | 328  | 1.6892          | 0.3088  | 1.6892 | 1.2997 |
| No log        | 4.4595 | 330  | 1.6061          | 0.3284  | 1.6061 | 1.2673 |
| No log        | 4.4865 | 332  | 1.6050          | 0.3284  | 1.6050 | 1.2669 |
| No log        | 4.5135 | 334  | 1.6380          | 0.2707  | 1.6380 | 1.2798 |
| No log        | 4.5405 | 336  | 1.6928          | 0.2628  | 1.6928 | 1.3011 |
| No log        | 4.5676 | 338  | 1.6034          | 0.3088  | 1.6034 | 1.2662 |
| No log        | 4.5946 | 340  | 1.5406          | 0.3704  | 1.5406 | 1.2412 |
| No log        | 4.6216 | 342  | 1.6825          | 0.2899  | 1.6825 | 1.2971 |
| No log        | 4.6486 | 344  | 1.7879          | 0.2553  | 1.7879 | 1.3371 |
| No log        | 4.6757 | 346  | 1.7188          | 0.3000  | 1.7188 | 1.3110 |
| No log        | 4.7027 | 348  | 1.6851          | 0.2794  | 1.6851 | 1.2981 |
| No log        | 4.7297 | 350  | 1.7611          | 0.2256  | 1.7611 | 1.3271 |
| No log        | 4.7568 | 352  | 1.9253          | 0.2090  | 1.9253 | 1.3875 |
| No log        | 4.7838 | 354  | 2.0759          | 0.1515  | 2.0759 | 1.4408 |
| No log        | 4.8108 | 356  | 2.0925          | 0.1571  | 2.0925 | 1.4465 |
| No log        | 4.8378 | 358  | 2.0788          | 0.1944  | 2.0788 | 1.4418 |
| No log        | 4.8649 | 360  | 1.9254          | 0.2553  | 1.9254 | 1.3876 |
| No log        | 4.8919 | 362  | 1.6860          | 0.3088  | 1.6860 | 1.2985 |
| No log        | 4.9189 | 364  | 1.6780          | 0.3459  | 1.6780 | 1.2954 |
| No log        | 4.9459 | 366  | 1.6791          | 0.3459  | 1.6791 | 1.2958 |
| No log        | 4.9730 | 368  | 1.6670          | 0.4242  | 1.6670 | 1.2911 |
| No log        | 5.0    | 370  | 1.5885          | 0.4122  | 1.5885 | 1.2604 |
| No log        | 5.0270 | 372  | 1.5051          | 0.3906  | 1.5051 | 1.2268 |
| No log        | 5.0541 | 374  | 1.4867          | 0.3810  | 1.4867 | 1.2193 |
| No log        | 5.0811 | 376  | 1.5628          | 0.4     | 1.5628 | 1.2501 |
| No log        | 5.1081 | 378  | 1.6585          | 0.3731  | 1.6585 | 1.2878 |
| No log        | 5.1351 | 380  | 1.8380          | 0.2734  | 1.8380 | 1.3557 |
| No log        | 5.1622 | 382  | 1.9378          | 0.2270  | 1.9378 | 1.3920 |
| No log        | 5.1892 | 384  | 1.9140          | 0.2270  | 1.9140 | 1.3835 |
| No log        | 5.2162 | 386  | 1.7157          | 0.3066  | 1.7157 | 1.3099 |
| No log        | 5.2432 | 388  | 1.5721          | 0.3910  | 1.5721 | 1.2538 |
| No log        | 5.2703 | 390  | 1.5407          | 0.4375  | 1.5407 | 1.2413 |
| No log        | 5.2973 | 392  | 1.4930          | 0.4375  | 1.4930 | 1.2219 |
| No log        | 5.3243 | 394  | 1.4746          | 0.4375  | 1.4746 | 1.2143 |
| No log        | 5.3514 | 396  | 1.4671          | 0.4308  | 1.4671 | 1.2113 |
| No log        | 5.3784 | 398  | 1.4099          | 0.4341  | 1.4099 | 1.1874 |
| No log        | 5.4054 | 400  | 1.4354          | 0.4394  | 1.4354 | 1.1981 |
| No log        | 5.4324 | 402  | 1.5180          | 0.3881  | 1.5180 | 1.2321 |
| No log        | 5.4595 | 404  | 1.6601          | 0.3433  | 1.6601 | 1.2885 |
| No log        | 5.4865 | 406  | 1.7180          | 0.3043  | 1.7180 | 1.3107 |
| No log        | 5.5135 | 408  | 1.6135          | 0.3556  | 1.6135 | 1.2702 |
| No log        | 5.5405 | 410  | 1.5487          | 0.4328  | 1.5487 | 1.2445 |
| No log        | 5.5676 | 412  | 1.6277          | 0.3731  | 1.6277 | 1.2758 |
| No log        | 5.5946 | 414  | 1.7122          | 0.3235  | 1.7122 | 1.3085 |
| No log        | 5.6216 | 416  | 1.8522          | 0.2734  | 1.8522 | 1.3610 |
| No log        | 5.6486 | 418  | 1.9405          | 0.2553  | 1.9405 | 1.3930 |
| No log        | 5.6757 | 420  | 1.9563          | 0.2553  | 1.9563 | 1.3987 |
| No log        | 5.7027 | 422  | 1.8105          | 0.2734  | 1.8105 | 1.3455 |
| No log        | 5.7297 | 424  | 1.6032          | 0.4242  | 1.6032 | 1.2662 |
| No log        | 5.7568 | 426  | 1.4874          | 0.3968  | 1.4874 | 1.2196 |
| No log        | 5.7838 | 428  | 1.5161          | 0.368   | 1.5161 | 1.2313 |
| No log        | 5.8108 | 430  | 1.7124          | 0.4091  | 1.7124 | 1.3086 |
| No log        | 5.8378 | 432  | 1.8787          | 0.2734  | 1.8787 | 1.3706 |
| No log        | 5.8649 | 434  | 1.9319          | 0.2553  | 1.9319 | 1.3899 |
| No log        | 5.8919 | 436  | 1.8562          | 0.2734  | 1.8562 | 1.3624 |
| No log        | 5.9189 | 438  | 1.7858          | 0.2899  | 1.7858 | 1.3363 |
| No log        | 5.9459 | 440  | 1.9567          | 0.2254  | 1.9567 | 1.3988 |
| No log        | 5.9730 | 442  | 2.0003          | 0.2254  | 2.0003 | 1.4143 |
| No log        | 6.0    | 444  | 1.9405          | 0.2254  | 1.9405 | 1.3930 |
| No log        | 6.0270 | 446  | 1.7613          | 0.2899  | 1.7613 | 1.3271 |
| No log        | 6.0541 | 448  | 1.6111          | 0.4242  | 1.6111 | 1.2693 |
| No log        | 6.0811 | 450  | 1.6096          | 0.3731  | 1.6096 | 1.2687 |
| No log        | 6.1081 | 452  | 1.8084          | 0.2734  | 1.8084 | 1.3447 |
| No log        | 6.1351 | 454  | 2.0332          | 0.2254  | 2.0332 | 1.4259 |
| No log        | 6.1622 | 456  | 2.0020          | 0.2254  | 2.0020 | 1.4149 |
| No log        | 6.1892 | 458  | 1.8074          | 0.2734  | 1.8074 | 1.3444 |
| No log        | 6.2162 | 460  | 1.5295          | 0.4265  | 1.5295 | 1.2367 |
| No log        | 6.2432 | 462  | 1.4173          | 0.5191  | 1.4173 | 1.1905 |
| No log        | 6.2703 | 464  | 1.4113          | 0.4882  | 1.4113 | 1.1880 |
| No log        | 6.2973 | 466  | 1.5022          | 0.4580  | 1.5022 | 1.2256 |
| No log        | 6.3243 | 468  | 1.6681          | 0.3731  | 1.6681 | 1.2915 |
| No log        | 6.3514 | 470  | 1.7982          | 0.3407  | 1.7982 | 1.3410 |
| No log        | 6.3784 | 472  | 1.7536          | 0.3284  | 1.7536 | 1.3242 |
| No log        | 6.4054 | 474  | 1.5888          | 0.4179  | 1.5888 | 1.2605 |
| No log        | 6.4324 | 476  | 1.4139          | 0.5303  | 1.4139 | 1.1891 |
| No log        | 6.4595 | 478  | 1.4145          | 0.4962  | 1.4145 | 1.1893 |
| No log        | 6.4865 | 480  | 1.5579          | 0.4242  | 1.5579 | 1.2481 |
| No log        | 6.5135 | 482  | 1.7630          | 0.2754  | 1.7630 | 1.3278 |
| No log        | 6.5405 | 484  | 1.8474          | 0.2411  | 1.8474 | 1.3592 |
| No log        | 6.5676 | 486  | 1.7922          | 0.2446  | 1.7922 | 1.3387 |
| No log        | 6.5946 | 488  | 1.6658          | 0.4242  | 1.6658 | 1.2907 |
| No log        | 6.6216 | 490  | 1.5592          | 0.4098  | 1.5592 | 1.2487 |
| No log        | 6.6486 | 492  | 1.5511          | 0.3761  | 1.5511 | 1.2454 |
| No log        | 6.6757 | 494  | 1.5523          | 0.4500  | 1.5523 | 1.2459 |
| No log        | 6.7027 | 496  | 1.6037          | 0.4031  | 1.6037 | 1.2664 |
| No log        | 6.7297 | 498  | 1.6611          | 0.3731  | 1.6611 | 1.2888 |
| 0.3936        | 6.7568 | 500  | 1.6958          | 0.3235  | 1.6958 | 1.3022 |
| 0.3936        | 6.7838 | 502  | 1.6762          | 0.3235  | 1.6762 | 1.2947 |
| 0.3936        | 6.8108 | 504  | 1.6236          | 0.3852  | 1.6236 | 1.2742 |
| 0.3936        | 6.8378 | 506  | 1.5538          | 0.3852  | 1.5538 | 1.2465 |
| 0.3936        | 6.8649 | 508  | 1.5990          | 0.3852  | 1.5990 | 1.2645 |
| 0.3936        | 6.8919 | 510  | 1.6781          | 0.3407  | 1.6781 | 1.2954 |
| 0.3936        | 6.9189 | 512  | 1.7600          | 0.2920  | 1.7600 | 1.3267 |
| 0.3936        | 6.9459 | 514  | 1.7322          | 0.2920  | 1.7322 | 1.3161 |
| 0.3936        | 6.9730 | 516  | 1.6869          | 0.3556  | 1.6869 | 1.2988 |
| 0.3936        | 7.0    | 518  | 1.6151          | 0.3609  | 1.6151 | 1.2709 |
| 0.3936        | 7.0270 | 520  | 1.5323          | 0.4478  | 1.5323 | 1.2378 |
| 0.3936        | 7.0541 | 522  | 1.4406          | 0.4603  | 1.4406 | 1.2003 |
| 0.3936        | 7.0811 | 524  | 1.4687          | 0.4662  | 1.4687 | 1.2119 |
| 0.3936        | 7.1081 | 526  | 1.5421          | 0.4179  | 1.5421 | 1.2418 |
| 0.3936        | 7.1351 | 528  | 1.6858          | 0.2920  | 1.6858 | 1.2984 |
| 0.3936        | 7.1622 | 530  | 1.8141          | 0.2754  | 1.8141 | 1.3469 |
| 0.3936        | 7.1892 | 532  | 2.0164          | 0.1690  | 2.0164 | 1.4200 |
| 0.3936        | 7.2162 | 534  | 2.0350          | 0.1690  | 2.0350 | 1.4265 |
| 0.3936        | 7.2432 | 536  | 1.8110          | 0.2754  | 1.8110 | 1.3457 |


### Framework versions

- Transformers 4.44.2
- Pytorch 2.4.0+cu118
- Datasets 2.21.0
- Tokenizers 0.19.1