File size: 21,911 Bytes
6f51ceb
 
 
 
 
 
1ae9911
6f51ceb
 
 
 
 
 
1ae9911
6f51ceb
 
 
1ae9911
 
 
 
6f51ceb
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1ae9911
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
6f51ceb
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
---
library_name: transformers
base_model: aubmindlab/bert-base-arabertv02
tags:
- generated_from_trainer
model-index:
- name: ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k12_task1_organization
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k12_task1_organization

This model is a fine-tuned version of [aubmindlab/bert-base-arabertv02](https://huggingface.co/aubmindlab/bert-base-arabertv02) on the None dataset.
It achieves the following results on the evaluation set:
- Loss: 2.1699
- Qwk: 0.1986
- Mse: 2.1699
- Rmse: 1.4731

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 2e-05
- train_batch_size: 8
- eval_batch_size: 8
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 100

### Training results

| Training Loss | Epoch  | Step | Validation Loss | Qwk    | Mse    | Rmse   |
|:-------------:|:------:|:----:|:---------------:|:------:|:------:|:------:|
| No log        | 0.0385 | 2    | 7.0106          | 0.0110 | 7.0106 | 2.6478 |
| No log        | 0.0769 | 4    | 3.8273          | 0.0563 | 3.8273 | 1.9563 |
| No log        | 0.1154 | 6    | 2.5387          | 0.1053 | 2.5387 | 1.5933 |
| No log        | 0.1538 | 8    | 2.2145          | 0.2113 | 2.2145 | 1.4881 |
| No log        | 0.1923 | 10   | 1.8804          | 0.2595 | 1.8804 | 1.3713 |
| No log        | 0.2308 | 12   | 1.8987          | 0.2576 | 1.8987 | 1.3779 |
| No log        | 0.2692 | 14   | 1.8656          | 0.25   | 1.8656 | 1.3659 |
| No log        | 0.3077 | 16   | 1.8859          | 0.2222 | 1.8859 | 1.3733 |
| No log        | 0.3462 | 18   | 1.5803          | 0.2759 | 1.5803 | 1.2571 |
| No log        | 0.3846 | 20   | 1.4827          | 0.3063 | 1.4827 | 1.2176 |
| No log        | 0.4231 | 22   | 1.7357          | 0.2321 | 1.7357 | 1.3174 |
| No log        | 0.4615 | 24   | 1.9034          | 0.2063 | 1.9034 | 1.3796 |
| No log        | 0.5    | 26   | 1.7106          | 0.3871 | 1.7106 | 1.3079 |
| No log        | 0.5385 | 28   | 1.6575          | 0.3415 | 1.6575 | 1.2874 |
| No log        | 0.5769 | 30   | 1.8172          | 0.3089 | 1.8172 | 1.3480 |
| No log        | 0.6154 | 32   | 1.6655          | 0.3276 | 1.6655 | 1.2905 |
| No log        | 0.6538 | 34   | 1.4711          | 0.1682 | 1.4711 | 1.2129 |
| No log        | 0.6923 | 36   | 1.3565          | 0.2075 | 1.3565 | 1.1647 |
| No log        | 0.7308 | 38   | 1.3373          | 0.375  | 1.3373 | 1.1564 |
| No log        | 0.7692 | 40   | 1.3324          | 0.3423 | 1.3324 | 1.1543 |
| No log        | 0.8077 | 42   | 1.3235          | 0.3929 | 1.3235 | 1.1504 |
| No log        | 0.8462 | 44   | 1.3372          | 0.3860 | 1.3372 | 1.1564 |
| No log        | 0.8846 | 46   | 1.4138          | 0.3036 | 1.4138 | 1.1890 |
| No log        | 0.9231 | 48   | 1.4634          | 0.2957 | 1.4634 | 1.2097 |
| No log        | 0.9615 | 50   | 1.6369          | 0.3000 | 1.6369 | 1.2794 |
| No log        | 1.0    | 52   | 1.6389          | 0.3025 | 1.6389 | 1.2802 |
| No log        | 1.0385 | 54   | 1.2617          | 0.4959 | 1.2617 | 1.1233 |
| No log        | 1.0769 | 56   | 1.1732          | 0.4174 | 1.1732 | 1.0832 |
| No log        | 1.1154 | 58   | 1.1795          | 0.4211 | 1.1795 | 1.0860 |
| No log        | 1.1538 | 60   | 1.1749          | 0.4522 | 1.1749 | 1.0839 |
| No log        | 1.1923 | 62   | 1.2630          | 0.4237 | 1.2630 | 1.1238 |
| No log        | 1.2308 | 64   | 1.2066          | 0.4444 | 1.2066 | 1.0984 |
| No log        | 1.2692 | 66   | 1.1627          | 0.4957 | 1.1627 | 1.0783 |
| No log        | 1.3077 | 68   | 1.4266          | 0.3652 | 1.4266 | 1.1944 |
| No log        | 1.3462 | 70   | 1.5852          | 0.2523 | 1.5852 | 1.2591 |
| No log        | 1.3846 | 72   | 1.6459          | 0.2523 | 1.6459 | 1.2829 |
| No log        | 1.4231 | 74   | 1.8123          | 0.2364 | 1.8123 | 1.3462 |
| No log        | 1.4615 | 76   | 1.5848          | 0.2523 | 1.5848 | 1.2589 |
| No log        | 1.5    | 78   | 1.2874          | 0.4138 | 1.2874 | 1.1347 |
| No log        | 1.5385 | 80   | 1.1688          | 0.4706 | 1.1688 | 1.0811 |
| No log        | 1.5769 | 82   | 1.0486          | 0.5124 | 1.0486 | 1.0240 |
| No log        | 1.6154 | 84   | 1.0477          | 0.5410 | 1.0477 | 1.0236 |
| No log        | 1.6538 | 86   | 1.0801          | 0.5210 | 1.0801 | 1.0393 |
| No log        | 1.6923 | 88   | 1.2462          | 0.4746 | 1.2462 | 1.1164 |
| No log        | 1.7308 | 90   | 1.3532          | 0.4444 | 1.3532 | 1.1633 |
| No log        | 1.7692 | 92   | 1.4525          | 0.3826 | 1.4525 | 1.2052 |
| No log        | 1.8077 | 94   | 1.3830          | 0.5210 | 1.3830 | 1.1760 |
| No log        | 1.8462 | 96   | 1.3397          | 0.5124 | 1.3397 | 1.1575 |
| No log        | 1.8846 | 98   | 1.3361          | 0.5124 | 1.3361 | 1.1559 |
| No log        | 1.9231 | 100  | 1.3744          | 0.4959 | 1.3744 | 1.1723 |
| No log        | 1.9615 | 102  | 1.3757          | 0.5041 | 1.3757 | 1.1729 |
| No log        | 2.0    | 104  | 1.2787          | 0.4874 | 1.2787 | 1.1308 |
| No log        | 2.0385 | 106  | 1.1971          | 0.4957 | 1.1971 | 1.0941 |
| No log        | 2.0769 | 108  | 1.2036          | 0.5042 | 1.2036 | 1.0971 |
| No log        | 2.1154 | 110  | 1.2938          | 0.5    | 1.2938 | 1.1375 |
| No log        | 2.1538 | 112  | 1.5911          | 0.3307 | 1.5911 | 1.2614 |
| No log        | 2.1923 | 114  | 1.6967          | 0.2927 | 1.6967 | 1.3026 |
| No log        | 2.2308 | 116  | 1.5949          | 0.3810 | 1.5949 | 1.2629 |
| No log        | 2.2692 | 118  | 1.5120          | 0.3876 | 1.5120 | 1.2297 |
| No log        | 2.3077 | 120  | 1.4842          | 0.4296 | 1.4842 | 1.2183 |
| No log        | 2.3462 | 122  | 1.5705          | 0.3650 | 1.5705 | 1.2532 |
| No log        | 2.3846 | 124  | 1.6742          | 0.3022 | 1.6742 | 1.2939 |
| No log        | 2.4231 | 126  | 1.6864          | 0.3188 | 1.6864 | 1.2986 |
| No log        | 2.4615 | 128  | 1.6059          | 0.3235 | 1.6059 | 1.2672 |
| No log        | 2.5    | 130  | 1.4311          | 0.3817 | 1.4311 | 1.1963 |
| No log        | 2.5385 | 132  | 1.4580          | 0.3939 | 1.4580 | 1.2075 |
| No log        | 2.5769 | 134  | 1.7735          | 0.2676 | 1.7735 | 1.3317 |
| No log        | 2.6154 | 136  | 1.9811          | 0.2270 | 1.9811 | 1.4075 |
| No log        | 2.6538 | 138  | 2.0044          | 0.2014 | 2.0044 | 1.4158 |
| No log        | 2.6923 | 140  | 1.9034          | 0.2302 | 1.9034 | 1.3797 |
| No log        | 2.7308 | 142  | 1.7913          | 0.2446 | 1.7913 | 1.3384 |
| No log        | 2.7692 | 144  | 1.8269          | 0.2714 | 1.8269 | 1.3516 |
| No log        | 2.8077 | 146  | 1.9552          | 0.2113 | 1.9552 | 1.3983 |
| No log        | 2.8462 | 148  | 1.9938          | 0.2113 | 1.9938 | 1.4120 |
| No log        | 2.8846 | 150  | 1.8603          | 0.2571 | 1.8603 | 1.3639 |
| No log        | 2.9231 | 152  | 1.7587          | 0.2609 | 1.7587 | 1.3262 |
| No log        | 2.9615 | 154  | 1.7944          | 0.2609 | 1.7944 | 1.3396 |
| No log        | 3.0    | 156  | 1.8311          | 0.2336 | 1.8311 | 1.3532 |
| No log        | 3.0385 | 158  | 1.8497          | 0.1871 | 1.8497 | 1.3600 |
| No log        | 3.0769 | 160  | 1.8930          | 0.2000 | 1.8930 | 1.3759 |
| No log        | 3.1154 | 162  | 1.7529          | 0.2336 | 1.7529 | 1.3240 |
| No log        | 3.1538 | 164  | 1.7123          | 0.2920 | 1.7123 | 1.3085 |
| No log        | 3.1923 | 166  | 1.7492          | 0.2734 | 1.7492 | 1.3226 |
| No log        | 3.2308 | 168  | 1.9579          | 0.2429 | 1.9579 | 1.3993 |
| No log        | 3.2692 | 170  | 2.0207          | 0.2143 | 2.0207 | 1.4215 |
| No log        | 3.3077 | 172  | 1.9818          | 0.2609 | 1.9818 | 1.4078 |
| No log        | 3.3462 | 174  | 1.9404          | 0.2482 | 1.9404 | 1.3930 |
| No log        | 3.3846 | 176  | 1.8950          | 0.2609 | 1.8950 | 1.3766 |
| No log        | 3.4231 | 178  | 1.7193          | 0.3259 | 1.7193 | 1.3112 |
| No log        | 3.4615 | 180  | 1.6644          | 0.3485 | 1.6644 | 1.2901 |
| No log        | 3.5    | 182  | 1.6966          | 0.3308 | 1.6966 | 1.3026 |
| No log        | 3.5385 | 184  | 1.7434          | 0.3433 | 1.7434 | 1.3204 |
| No log        | 3.5769 | 186  | 1.8357          | 0.3066 | 1.8357 | 1.3549 |
| No log        | 3.6154 | 188  | 1.9015          | 0.2411 | 1.9015 | 1.3790 |
| No log        | 3.6538 | 190  | 1.9849          | 0.2098 | 1.9849 | 1.4088 |
| No log        | 3.6923 | 192  | 2.0120          | 0.1831 | 2.0120 | 1.4184 |
| No log        | 3.7308 | 194  | 1.9805          | 0.2143 | 1.9805 | 1.4073 |
| No log        | 3.7692 | 196  | 1.9783          | 0.2128 | 1.9783 | 1.4065 |
| No log        | 3.8077 | 198  | 1.8793          | 0.2609 | 1.8793 | 1.3709 |
| No log        | 3.8462 | 200  | 1.8131          | 0.2774 | 1.8131 | 1.3465 |
| No log        | 3.8846 | 202  | 1.7349          | 0.2941 | 1.7349 | 1.3172 |
| No log        | 3.9231 | 204  | 1.6625          | 0.2985 | 1.6625 | 1.2894 |
| No log        | 3.9615 | 206  | 1.6809          | 0.2687 | 1.6809 | 1.2965 |
| No log        | 4.0    | 208  | 1.7763          | 0.2647 | 1.7763 | 1.3328 |
| No log        | 4.0385 | 210  | 1.8171          | 0.2647 | 1.8171 | 1.3480 |
| No log        | 4.0769 | 212  | 1.7906          | 0.2647 | 1.7906 | 1.3381 |
| No log        | 4.1154 | 214  | 1.7554          | 0.2815 | 1.7554 | 1.3249 |
| No log        | 4.1538 | 216  | 1.7394          | 0.2985 | 1.7394 | 1.3189 |
| No log        | 4.1923 | 218  | 1.7363          | 0.2794 | 1.7363 | 1.3177 |
| No log        | 4.2308 | 220  | 1.7863          | 0.2429 | 1.7863 | 1.3365 |
| No log        | 4.2692 | 222  | 1.9634          | 0.1986 | 1.9634 | 1.4012 |
| No log        | 4.3077 | 224  | 2.0619          | 0.1986 | 2.0619 | 1.4359 |
| No log        | 4.3462 | 226  | 2.0701          | 0.2206 | 2.0701 | 1.4388 |
| No log        | 4.3846 | 228  | 2.0258          | 0.2270 | 2.0258 | 1.4233 |
| No log        | 4.4231 | 230  | 1.9454          | 0.2143 | 1.9454 | 1.3948 |
| No log        | 4.4615 | 232  | 1.9086          | 0.2286 | 1.9086 | 1.3815 |
| No log        | 4.5    | 234  | 1.9611          | 0.2143 | 1.9611 | 1.4004 |
| No log        | 4.5385 | 236  | 1.9628          | 0.2143 | 1.9628 | 1.4010 |
| No log        | 4.5769 | 238  | 1.9271          | 0.2336 | 1.9271 | 1.3882 |
| No log        | 4.6154 | 240  | 1.9074          | 0.2174 | 1.9074 | 1.3811 |
| No log        | 4.6538 | 242  | 1.8305          | 0.2482 | 1.8306 | 1.3530 |
| No log        | 4.6923 | 244  | 1.8184          | 0.2206 | 1.8184 | 1.3485 |
| No log        | 4.7308 | 246  | 1.7788          | 0.2482 | 1.7788 | 1.3337 |
| No log        | 4.7692 | 248  | 1.8828          | 0.2446 | 1.8828 | 1.3722 |
| No log        | 4.8077 | 250  | 2.0021          | 0.2286 | 2.0021 | 1.4149 |
| No log        | 4.8462 | 252  | 1.9045          | 0.2206 | 1.9045 | 1.3800 |
| No log        | 4.8846 | 254  | 1.8872          | 0.2206 | 1.8872 | 1.3738 |
| No log        | 4.9231 | 256  | 1.9712          | 0.2336 | 1.9712 | 1.4040 |
| No log        | 4.9615 | 258  | 1.9222          | 0.2446 | 1.9222 | 1.3864 |
| No log        | 5.0    | 260  | 1.8588          | 0.2446 | 1.8588 | 1.3634 |
| No log        | 5.0385 | 262  | 1.8605          | 0.3000 | 1.8605 | 1.3640 |
| No log        | 5.0769 | 264  | 1.8908          | 0.3000 | 1.8908 | 1.3750 |
| No log        | 5.1154 | 266  | 1.8207          | 0.3121 | 1.8207 | 1.3493 |
| No log        | 5.1538 | 268  | 1.8435          | 0.2429 | 1.8435 | 1.3578 |
| No log        | 5.1923 | 270  | 1.7808          | 0.2920 | 1.7808 | 1.3345 |
| No log        | 5.2308 | 272  | 1.5541          | 0.3846 | 1.5541 | 1.2466 |
| No log        | 5.2692 | 274  | 1.5043          | 0.3846 | 1.5043 | 1.2265 |
| No log        | 5.3077 | 276  | 1.6743          | 0.3910 | 1.6743 | 1.2940 |
| No log        | 5.3462 | 278  | 2.0347          | 0.2128 | 2.0347 | 1.4264 |
| No log        | 5.3846 | 280  | 2.1816          | 0.1831 | 2.1816 | 1.4770 |
| No log        | 5.4231 | 282  | 2.1176          | 0.1986 | 2.1176 | 1.4552 |
| No log        | 5.4615 | 284  | 2.0060          | 0.1986 | 2.0060 | 1.4163 |
| No log        | 5.5    | 286  | 1.9175          | 0.2254 | 1.9175 | 1.3847 |
| No log        | 5.5385 | 288  | 2.0607          | 0.1986 | 2.0607 | 1.4355 |
| No log        | 5.5769 | 290  | 2.1332          | 0.2286 | 2.1332 | 1.4606 |
| No log        | 5.6154 | 292  | 2.0945          | 0.2286 | 2.0945 | 1.4472 |
| No log        | 5.6538 | 294  | 1.9801          | 0.2590 | 1.9801 | 1.4071 |
| No log        | 5.6923 | 296  | 1.8692          | 0.2590 | 1.8692 | 1.3672 |
| No log        | 5.7308 | 298  | 1.7779          | 0.2429 | 1.7779 | 1.3334 |
| No log        | 5.7692 | 300  | 1.8025          | 0.2429 | 1.8025 | 1.3426 |
| No log        | 5.8077 | 302  | 1.7735          | 0.2734 | 1.7735 | 1.3317 |
| No log        | 5.8462 | 304  | 1.8060          | 0.2158 | 1.8060 | 1.3439 |
| No log        | 5.8846 | 306  | 1.9705          | 0.1986 | 1.9705 | 1.4037 |
| No log        | 5.9231 | 308  | 2.1156          | 0.1690 | 2.1156 | 1.4545 |
| No log        | 5.9615 | 310  | 2.0885          | 0.1690 | 2.0885 | 1.4452 |
| No log        | 6.0    | 312  | 2.0990          | 0.1690 | 2.0990 | 1.4488 |
| No log        | 6.0385 | 314  | 1.9561          | 0.2286 | 1.9561 | 1.3986 |
| No log        | 6.0769 | 316  | 1.8070          | 0.3284 | 1.8070 | 1.3443 |
| No log        | 6.1154 | 318  | 1.8565          | 0.2628 | 1.8565 | 1.3625 |
| No log        | 6.1538 | 320  | 2.0776          | 0.1986 | 2.0776 | 1.4414 |
| No log        | 6.1923 | 322  | 2.3001          | 0.1538 | 2.3001 | 1.5166 |
| No log        | 6.2308 | 324  | 2.3108          | 0.1538 | 2.3108 | 1.5201 |
| No log        | 6.2692 | 326  | 2.1940          | 0.1831 | 2.1940 | 1.4812 |
| No log        | 6.3077 | 328  | 2.0123          | 0.2429 | 2.0123 | 1.4185 |
| No log        | 6.3462 | 330  | 1.9141          | 0.2590 | 1.9141 | 1.3835 |
| No log        | 6.3846 | 332  | 1.9368          | 0.2590 | 1.9368 | 1.3917 |
| No log        | 6.4231 | 334  | 2.1365          | 0.2128 | 2.1365 | 1.4617 |
| No log        | 6.4615 | 336  | 2.1801          | 0.1831 | 2.1801 | 1.4765 |
| No log        | 6.5    | 338  | 2.1140          | 0.2446 | 2.1140 | 1.4540 |
| No log        | 6.5385 | 340  | 1.9350          | 0.2353 | 1.9350 | 1.3910 |
| No log        | 6.5769 | 342  | 1.9133          | 0.2388 | 1.9133 | 1.3832 |
| No log        | 6.6154 | 344  | 2.0282          | 0.2319 | 2.0282 | 1.4241 |
| No log        | 6.6538 | 346  | 2.1678          | 0.1986 | 2.1678 | 1.4723 |
| No log        | 6.6923 | 348  | 2.2251          | 0.1986 | 2.2251 | 1.4917 |
| No log        | 6.7308 | 350  | 2.2410          | 0.1986 | 2.2410 | 1.4970 |
| No log        | 6.7692 | 352  | 2.2236          | 0.1986 | 2.2236 | 1.4912 |
| No log        | 6.8077 | 354  | 2.2881          | 0.1986 | 2.2881 | 1.5126 |
| No log        | 6.8462 | 356  | 2.1662          | 0.1986 | 2.1662 | 1.4718 |
| No log        | 6.8846 | 358  | 1.9949          | 0.2302 | 1.9949 | 1.4124 |
| No log        | 6.9231 | 360  | 1.9865          | 0.2286 | 1.9865 | 1.4094 |
| No log        | 6.9615 | 362  | 2.0797          | 0.2158 | 2.0797 | 1.4421 |
| No log        | 7.0    | 364  | 2.2238          | 0.1986 | 2.2238 | 1.4912 |
| No log        | 7.0385 | 366  | 2.1935          | 0.1986 | 2.1935 | 1.4811 |
| No log        | 7.0769 | 368  | 2.1497          | 0.1986 | 2.1497 | 1.4662 |
| No log        | 7.1154 | 370  | 2.2406          | 0.1690 | 2.2406 | 1.4969 |
| No log        | 7.1538 | 372  | 2.2447          | 0.1690 | 2.2447 | 1.4982 |
| No log        | 7.1923 | 374  | 2.1370          | 0.1690 | 2.1370 | 1.4618 |
| No log        | 7.2308 | 376  | 2.1687          | 0.1690 | 2.1687 | 1.4726 |
| No log        | 7.2692 | 378  | 2.2175          | 0.1690 | 2.2175 | 1.4891 |
| No log        | 7.3077 | 380  | 2.0855          | 0.1857 | 2.0855 | 1.4441 |
| No log        | 7.3462 | 382  | 2.0098          | 0.2158 | 2.0098 | 1.4177 |
| No log        | 7.3846 | 384  | 1.9385          | 0.2628 | 1.9385 | 1.3923 |
| No log        | 7.4231 | 386  | 2.0233          | 0.2464 | 2.0233 | 1.4224 |
| No log        | 7.4615 | 388  | 2.2312          | 0.1857 | 2.2312 | 1.4937 |
| No log        | 7.5    | 390  | 2.5518          | 0.1528 | 2.5518 | 1.5974 |
| No log        | 7.5385 | 392  | 2.7413          | 0.1216 | 2.7413 | 1.6557 |
| No log        | 7.5769 | 394  | 2.6588          | 0.1538 | 2.6588 | 1.6306 |
| No log        | 7.6154 | 396  | 2.3735          | 0.1538 | 2.3735 | 1.5406 |
| No log        | 7.6538 | 398  | 2.0793          | 0.2128 | 2.0793 | 1.4420 |
| No log        | 7.6923 | 400  | 1.8799          | 0.2590 | 1.8799 | 1.3711 |
| No log        | 7.7308 | 402  | 1.8458          | 0.2590 | 1.8458 | 1.3586 |
| No log        | 7.7692 | 404  | 1.9264          | 0.2590 | 1.9264 | 1.3879 |
| No log        | 7.8077 | 406  | 2.0177          | 0.2158 | 2.0177 | 1.4204 |
| No log        | 7.8462 | 408  | 2.1205          | 0.1986 | 2.1205 | 1.4562 |
| No log        | 7.8846 | 410  | 2.1876          | 0.1831 | 2.1876 | 1.4791 |
| No log        | 7.9231 | 412  | 2.2487          | 0.1818 | 2.2487 | 1.4996 |
| No log        | 7.9615 | 414  | 2.0567          | 0.2128 | 2.0567 | 1.4341 |
| No log        | 8.0    | 416  | 1.8364          | 0.3022 | 1.8364 | 1.3551 |
| No log        | 8.0385 | 418  | 1.8690          | 0.3022 | 1.8690 | 1.3671 |
| No log        | 8.0769 | 420  | 2.1269          | 0.1972 | 2.1269 | 1.4584 |
| No log        | 8.1154 | 422  | 2.3328          | 0.1678 | 2.3328 | 1.5274 |
| No log        | 8.1538 | 424  | 2.2863          | 0.1678 | 2.2863 | 1.5120 |
| No log        | 8.1923 | 426  | 2.1301          | 0.1986 | 2.1301 | 1.4595 |
| No log        | 8.2308 | 428  | 1.8995          | 0.2837 | 1.8995 | 1.3782 |
| No log        | 8.2692 | 430  | 1.7192          | 0.3188 | 1.7192 | 1.3112 |
| No log        | 8.3077 | 432  | 1.7214          | 0.3407 | 1.7214 | 1.3120 |
| No log        | 8.3462 | 434  | 1.8217          | 0.2353 | 1.8217 | 1.3497 |
| No log        | 8.3846 | 436  | 1.9919          | 0.2029 | 1.9919 | 1.4113 |
| No log        | 8.4231 | 438  | 2.1989          | 0.1831 | 2.1989 | 1.4829 |
| No log        | 8.4615 | 440  | 2.3416          | 0.1538 | 2.3416 | 1.5302 |
| No log        | 8.5    | 442  | 2.3719          | 0.1538 | 2.3719 | 1.5401 |
| No log        | 8.5385 | 444  | 2.1923          | 0.1831 | 2.1923 | 1.4806 |
| No log        | 8.5769 | 446  | 2.0381          | 0.2158 | 2.0381 | 1.4276 |
| No log        | 8.6154 | 448  | 1.9033          | 0.2174 | 1.9033 | 1.3796 |
| No log        | 8.6538 | 450  | 1.9075          | 0.2174 | 1.9075 | 1.3811 |
| No log        | 8.6923 | 452  | 1.9876          | 0.2174 | 1.9876 | 1.4098 |
| No log        | 8.7308 | 454  | 2.0381          | 0.2174 | 2.0381 | 1.4276 |
| No log        | 8.7692 | 456  | 1.9313          | 0.2174 | 1.9313 | 1.3897 |
| No log        | 8.8077 | 458  | 1.7666          | 0.2336 | 1.7666 | 1.3291 |
| No log        | 8.8462 | 460  | 1.7371          | 0.2609 | 1.7371 | 1.3180 |
| No log        | 8.8846 | 462  | 1.7925          | 0.2336 | 1.7925 | 1.3389 |
| No log        | 8.9231 | 464  | 1.8024          | 0.2174 | 1.8024 | 1.3425 |
| No log        | 8.9615 | 466  | 1.7908          | 0.2446 | 1.7908 | 1.3382 |
| No log        | 9.0    | 468  | 1.8067          | 0.2714 | 1.8067 | 1.3441 |
| No log        | 9.0385 | 470  | 1.9043          | 0.2446 | 1.9043 | 1.3800 |
| No log        | 9.0769 | 472  | 1.9619          | 0.2429 | 1.9619 | 1.4007 |
| No log        | 9.1154 | 474  | 1.8928          | 0.2446 | 1.8928 | 1.3758 |
| No log        | 9.1538 | 476  | 1.7157          | 0.2837 | 1.7157 | 1.3099 |
| No log        | 9.1923 | 478  | 1.5404          | 0.3556 | 1.5404 | 1.2411 |
| No log        | 9.2308 | 480  | 1.4832          | 0.3852 | 1.4832 | 1.2179 |
| No log        | 9.2692 | 482  | 1.5094          | 0.4118 | 1.5094 | 1.2286 |
| No log        | 9.3077 | 484  | 1.4935          | 0.4118 | 1.4935 | 1.2221 |
| No log        | 9.3462 | 486  | 1.4971          | 0.4118 | 1.4971 | 1.2235 |
| No log        | 9.3846 | 488  | 1.4762          | 0.4593 | 1.4762 | 1.2150 |
| No log        | 9.4231 | 490  | 1.5684          | 0.3407 | 1.5684 | 1.2523 |
| No log        | 9.4615 | 492  | 1.6185          | 0.3504 | 1.6185 | 1.2722 |
| No log        | 9.5    | 494  | 1.6003          | 0.3824 | 1.6003 | 1.2650 |
| No log        | 9.5385 | 496  | 1.6562          | 0.3284 | 1.6562 | 1.2869 |
| No log        | 9.5769 | 498  | 1.6810          | 0.3259 | 1.6810 | 1.2965 |
| 0.4083        | 9.6154 | 500  | 1.6824          | 0.3259 | 1.6824 | 1.2971 |
| 0.4083        | 9.6538 | 502  | 1.5954          | 0.3876 | 1.5954 | 1.2631 |
| 0.4083        | 9.6923 | 504  | 1.6016          | 0.4122 | 1.6016 | 1.2655 |
| 0.4083        | 9.7308 | 506  | 1.6833          | 0.3284 | 1.6833 | 1.2974 |
| 0.4083        | 9.7692 | 508  | 1.7513          | 0.2941 | 1.7513 | 1.3234 |
| 0.4083        | 9.8077 | 510  | 1.7431          | 0.3235 | 1.7431 | 1.3203 |
| 0.4083        | 9.8462 | 512  | 1.8102          | 0.2734 | 1.8102 | 1.3454 |
| 0.4083        | 9.8846 | 514  | 1.9838          | 0.2254 | 1.9838 | 1.4085 |
| 0.4083        | 9.9231 | 516  | 2.1699          | 0.1986 | 2.1699 | 1.4731 |


### Framework versions

- Transformers 4.44.2
- Pytorch 2.4.0+cu118
- Datasets 2.21.0
- Tokenizers 0.19.1