--- library_name: transformers base_model: aubmindlab/bert-base-arabertv02 tags: - generated_from_trainer model-index: - name: ArabicNewSplits7_OSS_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k3_task1_organization results: [] --- # ArabicNewSplits7_OSS_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k3_task1_organization This model is a fine-tuned version of [aubmindlab/bert-base-arabertv02](https://huggingface.co/aubmindlab/bert-base-arabertv02) on the None dataset. It achieves the following results on the evaluation set: - Loss: 0.6083 - Qwk: 0.7613 - Mse: 0.6083 - Rmse: 0.7800 ## Model description More information needed ## Intended uses & limitations More information needed ## Training and evaluation data More information needed ## Training procedure ### Training hyperparameters The following hyperparameters were used during training: - learning_rate: 2e-05 - train_batch_size: 8 - eval_batch_size: 8 - seed: 42 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08 - lr_scheduler_type: linear - num_epochs: 100 ### Training results | Training Loss | Epoch | Step | Validation Loss | Qwk | Mse | Rmse | |:-------------:|:-------:|:----:|:---------------:|:------:|:------:|:------:| | No log | 0.0870 | 2 | 6.7965 | 0.0242 | 6.7965 | 2.6070 | | No log | 0.1739 | 4 | 5.2676 | 0.0366 | 5.2676 | 2.2951 | | No log | 0.2609 | 6 | 3.0917 | 0.0595 | 3.0917 | 1.7583 | | No log | 0.3478 | 8 | 2.5803 | 0.0132 | 2.5803 | 1.6063 | | No log | 0.4348 | 10 | 3.5005 | 0.0787 | 3.5005 | 1.8710 | | No log | 0.5217 | 12 | 2.6461 | 0.0141 | 2.6461 | 1.6267 | | No log | 0.6087 | 14 | 1.7385 | 0.2478 | 1.7385 | 1.3185 | | No log | 0.6957 | 16 | 1.6891 | 0.0583 | 1.6891 | 1.2996 | | No log | 0.7826 | 18 | 1.6908 | 0.1296 | 1.6908 | 1.3003 | | No log | 0.8696 | 20 | 1.6275 | 0.1308 | 1.6275 | 1.2757 | | No log | 0.9565 | 22 | 1.4872 | 0.1538 | 1.4872 | 1.2195 | | No log | 1.0435 | 24 | 1.5368 | 0.3158 | 1.5368 | 1.2397 | | No log | 1.1304 | 26 | 1.3818 | 0.3158 | 1.3818 | 1.1755 | | No log | 1.2174 | 28 | 1.2881 | 0.3932 | 1.2881 | 1.1349 | | No log | 1.3043 | 30 | 1.1907 | 0.3621 | 1.1907 | 1.0912 | | No log | 1.3913 | 32 | 1.1694 | 0.3652 | 1.1694 | 1.0814 | | No log | 1.4783 | 34 | 1.1661 | 0.3214 | 1.1661 | 1.0798 | | No log | 1.5652 | 36 | 1.0867 | 0.4138 | 1.0867 | 1.0425 | | No log | 1.6522 | 38 | 1.0225 | 0.4959 | 1.0225 | 1.0112 | | No log | 1.7391 | 40 | 0.9464 | 0.6970 | 0.9464 | 0.9728 | | No log | 1.8261 | 42 | 0.8481 | 0.7482 | 0.8481 | 0.9209 | | No log | 1.9130 | 44 | 0.7664 | 0.7260 | 0.7664 | 0.8754 | | No log | 2.0 | 46 | 0.7207 | 0.7651 | 0.7207 | 0.8489 | | No log | 2.0870 | 48 | 0.9562 | 0.5926 | 0.9562 | 0.9779 | | No log | 2.1739 | 50 | 1.2811 | 0.5224 | 1.2811 | 1.1319 | | No log | 2.2609 | 52 | 1.1457 | 0.5481 | 1.1457 | 1.0704 | | No log | 2.3478 | 54 | 1.0695 | 0.5630 | 1.0695 | 1.0342 | | No log | 2.4348 | 56 | 1.2533 | 0.5180 | 1.2533 | 1.1195 | | No log | 2.5217 | 58 | 1.4337 | 0.4714 | 1.4337 | 1.1974 | | No log | 2.6087 | 60 | 1.1399 | 0.5693 | 1.1399 | 1.0677 | | No log | 2.6957 | 62 | 0.8858 | 0.5926 | 0.8858 | 0.9412 | | No log | 2.7826 | 64 | 0.9129 | 0.6567 | 0.9129 | 0.9555 | | No log | 2.8696 | 66 | 1.2352 | 0.5 | 1.2352 | 1.1114 | | No log | 2.9565 | 68 | 1.1034 | 0.5606 | 1.1034 | 1.0504 | | No log | 3.0435 | 70 | 0.9522 | 0.5891 | 0.9522 | 0.9758 | | No log | 3.1304 | 72 | 0.9261 | 0.6142 | 0.9261 | 0.9624 | | No log | 3.2174 | 74 | 0.9060 | 0.6515 | 0.9060 | 0.9519 | | No log | 3.3043 | 76 | 0.8631 | 0.6667 | 0.8631 | 0.9290 | | No log | 3.3913 | 78 | 0.8798 | 0.6522 | 0.8798 | 0.9380 | | No log | 3.4783 | 80 | 0.8796 | 0.6324 | 0.8796 | 0.9379 | | No log | 3.5652 | 82 | 0.9746 | 0.6222 | 0.9746 | 0.9872 | | No log | 3.6522 | 84 | 1.0278 | 0.5899 | 1.0278 | 1.0138 | | No log | 3.7391 | 86 | 0.9362 | 0.6479 | 0.9362 | 0.9676 | | No log | 3.8261 | 88 | 0.9420 | 0.6383 | 0.9420 | 0.9706 | | No log | 3.9130 | 90 | 1.0282 | 0.6383 | 1.0282 | 1.0140 | | No log | 4.0 | 92 | 1.3175 | 0.5 | 1.3175 | 1.1478 | | No log | 4.0870 | 94 | 1.2619 | 0.5324 | 1.2619 | 1.1234 | | No log | 4.1739 | 96 | 0.9363 | 0.6716 | 0.9363 | 0.9676 | | No log | 4.2609 | 98 | 0.7244 | 0.7194 | 0.7244 | 0.8511 | | No log | 4.3478 | 100 | 0.7534 | 0.7586 | 0.7534 | 0.8680 | | No log | 4.4348 | 102 | 0.7001 | 0.7286 | 0.7001 | 0.8367 | | No log | 4.5217 | 104 | 0.7011 | 0.7324 | 0.7011 | 0.8373 | | No log | 4.6087 | 106 | 0.7827 | 0.6897 | 0.7827 | 0.8847 | | No log | 4.6957 | 108 | 0.7922 | 0.7034 | 0.7922 | 0.8900 | | No log | 4.7826 | 110 | 0.8235 | 0.6377 | 0.8235 | 0.9075 | | No log | 4.8696 | 112 | 0.8034 | 0.6331 | 0.8034 | 0.8963 | | No log | 4.9565 | 114 | 0.7506 | 0.6897 | 0.7506 | 0.8664 | | No log | 5.0435 | 116 | 0.8669 | 0.6525 | 0.8669 | 0.9311 | | No log | 5.1304 | 118 | 0.9777 | 0.6241 | 0.9777 | 0.9888 | | No log | 5.2174 | 120 | 0.8365 | 0.6525 | 0.8365 | 0.9146 | | No log | 5.3043 | 122 | 0.7675 | 0.7034 | 0.7675 | 0.8761 | | No log | 5.3913 | 124 | 0.8405 | 0.7222 | 0.8405 | 0.9168 | | No log | 5.4783 | 126 | 0.8176 | 0.7020 | 0.8176 | 0.9042 | | No log | 5.5652 | 128 | 0.7173 | 0.7027 | 0.7173 | 0.8469 | | No log | 5.6522 | 130 | 0.7593 | 0.6897 | 0.7593 | 0.8714 | | No log | 5.7391 | 132 | 0.7562 | 0.6806 | 0.7562 | 0.8696 | | No log | 5.8261 | 134 | 0.7676 | 0.6475 | 0.7676 | 0.8761 | | No log | 5.9130 | 136 | 0.7785 | 0.6812 | 0.7785 | 0.8823 | | No log | 6.0 | 138 | 0.8224 | 0.6667 | 0.8224 | 0.9069 | | No log | 6.0870 | 140 | 0.7774 | 0.6963 | 0.7774 | 0.8817 | | No log | 6.1739 | 142 | 0.7749 | 0.6906 | 0.7749 | 0.8803 | | No log | 6.2609 | 144 | 0.7668 | 0.6906 | 0.7668 | 0.8757 | | No log | 6.3478 | 146 | 0.7373 | 0.7273 | 0.7373 | 0.8587 | | No log | 6.4348 | 148 | 0.7192 | 0.7310 | 0.7192 | 0.8481 | | No log | 6.5217 | 150 | 0.7090 | 0.7333 | 0.7090 | 0.8420 | | No log | 6.6087 | 152 | 0.7434 | 0.7248 | 0.7434 | 0.8622 | | No log | 6.6957 | 154 | 0.9131 | 0.6957 | 0.9131 | 0.9555 | | No log | 6.7826 | 156 | 1.0124 | 0.6497 | 1.0124 | 1.0062 | | No log | 6.8696 | 158 | 1.0566 | 0.6364 | 1.0566 | 1.0279 | | No log | 6.9565 | 160 | 0.9694 | 0.6316 | 0.9694 | 0.9846 | | No log | 7.0435 | 162 | 0.8067 | 0.7042 | 0.8067 | 0.8982 | | No log | 7.1304 | 164 | 0.7349 | 0.6944 | 0.7349 | 0.8573 | | No log | 7.2174 | 166 | 0.6986 | 0.7310 | 0.6986 | 0.8358 | | No log | 7.3043 | 168 | 0.6657 | 0.7582 | 0.6657 | 0.8159 | | No log | 7.3913 | 170 | 0.6363 | 0.7516 | 0.6363 | 0.7977 | | No log | 7.4783 | 172 | 0.6082 | 0.7625 | 0.6082 | 0.7799 | | No log | 7.5652 | 174 | 0.7006 | 0.7248 | 0.7006 | 0.8370 | | No log | 7.6522 | 176 | 0.7965 | 0.6906 | 0.7965 | 0.8925 | | No log | 7.7391 | 178 | 0.8408 | 0.6715 | 0.8408 | 0.9169 | | No log | 7.8261 | 180 | 0.8113 | 0.6815 | 0.8113 | 0.9007 | | No log | 7.9130 | 182 | 0.7450 | 0.7101 | 0.7450 | 0.8631 | | No log | 8.0 | 184 | 0.7569 | 0.6765 | 0.7569 | 0.8700 | | No log | 8.0870 | 186 | 0.8218 | 0.6364 | 0.8218 | 0.9065 | | No log | 8.1739 | 188 | 0.8568 | 0.7353 | 0.8568 | 0.9256 | | No log | 8.2609 | 190 | 0.8843 | 0.7007 | 0.8843 | 0.9404 | | No log | 8.3478 | 192 | 0.8448 | 0.7092 | 0.8448 | 0.9191 | | No log | 8.4348 | 194 | 0.8084 | 0.7133 | 0.8084 | 0.8991 | | No log | 8.5217 | 196 | 0.8005 | 0.6901 | 0.8005 | 0.8947 | | No log | 8.6087 | 198 | 0.8825 | 0.6099 | 0.8825 | 0.9394 | | No log | 8.6957 | 200 | 0.9992 | 0.5899 | 0.9992 | 0.9996 | | No log | 8.7826 | 202 | 0.9517 | 0.6471 | 0.9517 | 0.9756 | | No log | 8.8696 | 204 | 0.7884 | 0.6619 | 0.7884 | 0.8879 | | No log | 8.9565 | 206 | 0.6833 | 0.7483 | 0.6833 | 0.8266 | | No log | 9.0435 | 208 | 0.6564 | 0.7534 | 0.6564 | 0.8102 | | No log | 9.1304 | 210 | 0.6524 | 0.7260 | 0.6524 | 0.8077 | | No log | 9.2174 | 212 | 0.7133 | 0.7114 | 0.7133 | 0.8446 | | No log | 9.3043 | 214 | 0.7107 | 0.7097 | 0.7107 | 0.8430 | | No log | 9.3913 | 216 | 0.6151 | 0.7248 | 0.6151 | 0.7843 | | No log | 9.4783 | 218 | 0.5884 | 0.7632 | 0.5884 | 0.7671 | | No log | 9.5652 | 220 | 0.6203 | 0.7453 | 0.6203 | 0.7876 | | No log | 9.6522 | 222 | 0.6408 | 0.7586 | 0.6408 | 0.8005 | | No log | 9.7391 | 224 | 0.5502 | 0.8136 | 0.5502 | 0.7417 | | No log | 9.8261 | 226 | 0.5383 | 0.8095 | 0.5383 | 0.7337 | | No log | 9.9130 | 228 | 0.5737 | 0.7738 | 0.5737 | 0.7575 | | No log | 10.0 | 230 | 0.7389 | 0.7317 | 0.7389 | 0.8596 | | No log | 10.0870 | 232 | 0.7915 | 0.6933 | 0.7915 | 0.8897 | | No log | 10.1739 | 234 | 0.7053 | 0.7042 | 0.7053 | 0.8398 | | No log | 10.2609 | 236 | 0.6509 | 0.7639 | 0.6509 | 0.8068 | | No log | 10.3478 | 238 | 0.6944 | 0.7448 | 0.6944 | 0.8333 | | No log | 10.4348 | 240 | 0.6575 | 0.7867 | 0.6575 | 0.8109 | | No log | 10.5217 | 242 | 0.6312 | 0.8077 | 0.6312 | 0.7945 | | No log | 10.6087 | 244 | 0.5962 | 0.7413 | 0.5962 | 0.7721 | | No log | 10.6957 | 246 | 0.7272 | 0.7117 | 0.7272 | 0.8528 | | No log | 10.7826 | 248 | 0.9181 | 0.7159 | 0.9181 | 0.9582 | | No log | 10.8696 | 250 | 0.9041 | 0.7273 | 0.9041 | 0.9509 | | No log | 10.9565 | 252 | 0.7246 | 0.7261 | 0.7246 | 0.8512 | | No log | 11.0435 | 254 | 0.6210 | 0.7123 | 0.6210 | 0.7880 | | No log | 11.1304 | 256 | 0.6441 | 0.7975 | 0.6441 | 0.8026 | | No log | 11.2174 | 258 | 0.6400 | 0.7722 | 0.6400 | 0.8000 | | No log | 11.3043 | 260 | 0.6608 | 0.7133 | 0.6608 | 0.8129 | | No log | 11.3913 | 262 | 0.6943 | 0.7050 | 0.6943 | 0.8333 | | No log | 11.4783 | 264 | 0.7331 | 0.7194 | 0.7331 | 0.8562 | | No log | 11.5652 | 266 | 0.8334 | 0.6619 | 0.8334 | 0.9129 | | No log | 11.6522 | 268 | 0.8575 | 0.6277 | 0.8575 | 0.9260 | | No log | 11.7391 | 270 | 0.7644 | 0.6765 | 0.7644 | 0.8743 | | No log | 11.8261 | 272 | 0.6426 | 0.7552 | 0.6426 | 0.8016 | | No log | 11.9130 | 274 | 0.6004 | 0.7792 | 0.6004 | 0.7749 | | No log | 12.0 | 276 | 0.5728 | 0.7871 | 0.5728 | 0.7569 | | No log | 12.0870 | 278 | 0.5652 | 0.7831 | 0.5652 | 0.7518 | | No log | 12.1739 | 280 | 0.6229 | 0.7727 | 0.6229 | 0.7893 | | No log | 12.2609 | 282 | 0.6352 | 0.7574 | 0.6352 | 0.7970 | | No log | 12.3478 | 284 | 0.6230 | 0.7712 | 0.6230 | 0.7893 | | No log | 12.4348 | 286 | 0.6832 | 0.7143 | 0.6832 | 0.8266 | | No log | 12.5217 | 288 | 0.7361 | 0.7429 | 0.7361 | 0.8580 | | No log | 12.6087 | 290 | 0.7906 | 0.7092 | 0.7906 | 0.8892 | | No log | 12.6957 | 292 | 0.7854 | 0.6901 | 0.7854 | 0.8863 | | No log | 12.7826 | 294 | 0.7310 | 0.7172 | 0.7310 | 0.8550 | | No log | 12.8696 | 296 | 0.6754 | 0.7432 | 0.6754 | 0.8219 | | No log | 12.9565 | 298 | 0.6937 | 0.7347 | 0.6937 | 0.8329 | | No log | 13.0435 | 300 | 0.7777 | 0.7172 | 0.7777 | 0.8819 | | No log | 13.1304 | 302 | 0.8698 | 0.6806 | 0.8698 | 0.9326 | | No log | 13.2174 | 304 | 0.8839 | 0.6806 | 0.8839 | 0.9402 | | No log | 13.3043 | 306 | 0.8234 | 0.6901 | 0.8234 | 0.9074 | | No log | 13.3913 | 308 | 0.7608 | 0.6950 | 0.7608 | 0.8722 | | No log | 13.4783 | 310 | 0.6967 | 0.7222 | 0.6967 | 0.8347 | | No log | 13.5652 | 312 | 0.6828 | 0.7083 | 0.6828 | 0.8263 | | No log | 13.6522 | 314 | 0.7175 | 0.7342 | 0.7175 | 0.8470 | | No log | 13.7391 | 316 | 0.7009 | 0.7545 | 0.7009 | 0.8372 | | No log | 13.8261 | 318 | 0.5856 | 0.7619 | 0.5856 | 0.7653 | | No log | 13.9130 | 320 | 0.5438 | 0.7516 | 0.5438 | 0.7374 | | No log | 14.0 | 322 | 0.5434 | 0.8075 | 0.5434 | 0.7371 | | No log | 14.0870 | 324 | 0.5506 | 0.7949 | 0.5506 | 0.7420 | | No log | 14.1739 | 326 | 0.5678 | 0.7722 | 0.5678 | 0.7535 | | No log | 14.2609 | 328 | 0.6371 | 0.6986 | 0.6371 | 0.7982 | | No log | 14.3478 | 330 | 0.7045 | 0.7034 | 0.7045 | 0.8394 | | No log | 14.4348 | 332 | 0.6817 | 0.6901 | 0.6817 | 0.8256 | | No log | 14.5217 | 334 | 0.6294 | 0.7222 | 0.6294 | 0.7933 | | No log | 14.6087 | 336 | 0.6336 | 0.7361 | 0.6336 | 0.7960 | | No log | 14.6957 | 338 | 0.6504 | 0.7222 | 0.6504 | 0.8065 | | No log | 14.7826 | 340 | 0.7387 | 0.7034 | 0.7387 | 0.8595 | | No log | 14.8696 | 342 | 0.7726 | 0.7485 | 0.7726 | 0.8790 | | No log | 14.9565 | 344 | 0.6830 | 0.7389 | 0.6830 | 0.8264 | | No log | 15.0435 | 346 | 0.5874 | 0.7582 | 0.5874 | 0.7664 | | No log | 15.1304 | 348 | 0.5782 | 0.7895 | 0.5782 | 0.7604 | | No log | 15.2174 | 350 | 0.5740 | 0.7895 | 0.5740 | 0.7576 | | No log | 15.3043 | 352 | 0.5592 | 0.7821 | 0.5592 | 0.7478 | | No log | 15.3913 | 354 | 0.5783 | 0.7643 | 0.5783 | 0.7605 | | No log | 15.4783 | 356 | 0.6894 | 0.7152 | 0.6894 | 0.8303 | | No log | 15.5652 | 358 | 0.8083 | 0.7152 | 0.8083 | 0.8991 | | No log | 15.6522 | 360 | 0.7990 | 0.7034 | 0.7990 | 0.8938 | | No log | 15.7391 | 362 | 0.7269 | 0.7391 | 0.7269 | 0.8526 | | No log | 15.8261 | 364 | 0.6937 | 0.7286 | 0.6937 | 0.8329 | | No log | 15.9130 | 366 | 0.6747 | 0.7413 | 0.6747 | 0.8214 | | No log | 16.0 | 368 | 0.7028 | 0.7391 | 0.7028 | 0.8384 | | No log | 16.0870 | 370 | 0.7329 | 0.7042 | 0.7329 | 0.8561 | | No log | 16.1739 | 372 | 0.7263 | 0.7042 | 0.7263 | 0.8522 | | No log | 16.2609 | 374 | 0.6680 | 0.7234 | 0.6680 | 0.8173 | | No log | 16.3478 | 376 | 0.6554 | 0.7324 | 0.6554 | 0.8096 | | No log | 16.4348 | 378 | 0.6463 | 0.7092 | 0.6463 | 0.8039 | | No log | 16.5217 | 380 | 0.6519 | 0.6993 | 0.6519 | 0.8074 | | No log | 16.6087 | 382 | 0.7800 | 0.7355 | 0.7800 | 0.8832 | | No log | 16.6957 | 384 | 0.8796 | 0.7135 | 0.8796 | 0.9379 | | No log | 16.7826 | 386 | 0.8313 | 0.7412 | 0.8313 | 0.9117 | | No log | 16.8696 | 388 | 0.7209 | 0.7403 | 0.7209 | 0.8491 | | No log | 16.9565 | 390 | 0.6469 | 0.6993 | 0.6469 | 0.8043 | | No log | 17.0435 | 392 | 0.6308 | 0.7429 | 0.6308 | 0.7942 | | No log | 17.1304 | 394 | 0.6557 | 0.7391 | 0.6557 | 0.8098 | | No log | 17.2174 | 396 | 0.6678 | 0.7206 | 0.6678 | 0.8172 | | No log | 17.3043 | 398 | 0.6687 | 0.7299 | 0.6687 | 0.8177 | | No log | 17.3913 | 400 | 0.6655 | 0.7299 | 0.6655 | 0.8158 | | No log | 17.4783 | 402 | 0.6923 | 0.7286 | 0.6923 | 0.8321 | | No log | 17.5652 | 404 | 0.6951 | 0.7092 | 0.6951 | 0.8337 | | No log | 17.6522 | 406 | 0.6981 | 0.7299 | 0.6981 | 0.8355 | | No log | 17.7391 | 408 | 0.6696 | 0.7259 | 0.6696 | 0.8183 | | No log | 17.8261 | 410 | 0.6481 | 0.7338 | 0.6481 | 0.8051 | | No log | 17.9130 | 412 | 0.6289 | 0.7465 | 0.6289 | 0.7930 | | No log | 18.0 | 414 | 0.6130 | 0.7448 | 0.6130 | 0.7829 | | No log | 18.0870 | 416 | 0.6391 | 0.7172 | 0.6391 | 0.7995 | | No log | 18.1739 | 418 | 0.6525 | 0.7285 | 0.6525 | 0.8078 | | No log | 18.2609 | 420 | 0.6984 | 0.6993 | 0.6984 | 0.8357 | | No log | 18.3478 | 422 | 0.7015 | 0.6993 | 0.7015 | 0.8376 | | No log | 18.4348 | 424 | 0.6479 | 0.7083 | 0.6479 | 0.8049 | | No log | 18.5217 | 426 | 0.6102 | 0.7568 | 0.6102 | 0.7812 | | No log | 18.6087 | 428 | 0.6221 | 0.7619 | 0.6221 | 0.7887 | | No log | 18.6957 | 430 | 0.6196 | 0.7682 | 0.6196 | 0.7871 | | No log | 18.7826 | 432 | 0.6425 | 0.7465 | 0.6425 | 0.8016 | | No log | 18.8696 | 434 | 0.7384 | 0.7564 | 0.7384 | 0.8593 | | No log | 18.9565 | 436 | 0.7683 | 0.7468 | 0.7683 | 0.8765 | | No log | 19.0435 | 438 | 0.7516 | 0.7355 | 0.7516 | 0.8670 | | No log | 19.1304 | 440 | 0.6607 | 0.76 | 0.6607 | 0.8129 | | No log | 19.2174 | 442 | 0.6014 | 0.7552 | 0.6014 | 0.7755 | | No log | 19.3043 | 444 | 0.5984 | 0.7552 | 0.5984 | 0.7736 | | No log | 19.3913 | 446 | 0.5899 | 0.7273 | 0.5899 | 0.7681 | | No log | 19.4783 | 448 | 0.6044 | 0.7632 | 0.6044 | 0.7774 | | No log | 19.5652 | 450 | 0.6503 | 0.7333 | 0.6503 | 0.8064 | | No log | 19.6522 | 452 | 0.6377 | 0.7333 | 0.6377 | 0.7985 | | No log | 19.7391 | 454 | 0.6340 | 0.7451 | 0.6340 | 0.7962 | | No log | 19.8261 | 456 | 0.6477 | 0.7451 | 0.6477 | 0.8048 | | No log | 19.9130 | 458 | 0.6841 | 0.7448 | 0.6841 | 0.8271 | | No log | 20.0 | 460 | 0.6696 | 0.7376 | 0.6696 | 0.8183 | | No log | 20.0870 | 462 | 0.6422 | 0.7586 | 0.6422 | 0.8014 | | No log | 20.1739 | 464 | 0.6321 | 0.7483 | 0.6321 | 0.7951 | | No log | 20.2609 | 466 | 0.6653 | 0.7586 | 0.6653 | 0.8157 | | No log | 20.3478 | 468 | 0.7282 | 0.7162 | 0.7282 | 0.8533 | | No log | 20.4348 | 470 | 0.8254 | 0.6939 | 0.8254 | 0.9085 | | No log | 20.5217 | 472 | 0.8982 | 0.675 | 0.8982 | 0.9478 | | No log | 20.6087 | 474 | 0.9288 | 0.6667 | 0.9288 | 0.9638 | | No log | 20.6957 | 476 | 0.8928 | 0.6757 | 0.8928 | 0.9449 | | No log | 20.7826 | 478 | 0.7766 | 0.6993 | 0.7766 | 0.8812 | | No log | 20.8696 | 480 | 0.7318 | 0.6861 | 0.7318 | 0.8554 | | No log | 20.9565 | 482 | 0.7215 | 0.7299 | 0.7215 | 0.8494 | | No log | 21.0435 | 484 | 0.7576 | 0.7050 | 0.7576 | 0.8704 | | No log | 21.1304 | 486 | 0.8378 | 0.6901 | 0.8378 | 0.9153 | | No log | 21.2174 | 488 | 0.8329 | 0.6713 | 0.8329 | 0.9126 | | No log | 21.3043 | 490 | 0.7573 | 0.6806 | 0.7573 | 0.8702 | | No log | 21.3913 | 492 | 0.6638 | 0.7534 | 0.6638 | 0.8147 | | No log | 21.4783 | 494 | 0.6208 | 0.7712 | 0.6208 | 0.7879 | | No log | 21.5652 | 496 | 0.5694 | 0.7771 | 0.5694 | 0.7546 | | No log | 21.6522 | 498 | 0.5471 | 0.7643 | 0.5471 | 0.7397 | | 0.3686 | 21.7391 | 500 | 0.5431 | 0.7643 | 0.5431 | 0.7369 | | 0.3686 | 21.8261 | 502 | 0.5557 | 0.7875 | 0.5557 | 0.7455 | | 0.3686 | 21.9130 | 504 | 0.6282 | 0.7907 | 0.6282 | 0.7926 | | 0.3686 | 22.0 | 506 | 0.6934 | 0.7746 | 0.6934 | 0.8327 | | 0.3686 | 22.0870 | 508 | 0.7206 | 0.7283 | 0.7206 | 0.8489 | | 0.3686 | 22.1739 | 510 | 0.6874 | 0.775 | 0.6874 | 0.8291 | | 0.3686 | 22.2609 | 512 | 0.6474 | 0.7517 | 0.6474 | 0.8046 | | 0.3686 | 22.3478 | 514 | 0.6205 | 0.7660 | 0.6205 | 0.7877 | | 0.3686 | 22.4348 | 516 | 0.6134 | 0.7660 | 0.6134 | 0.7832 | | 0.3686 | 22.5217 | 518 | 0.6145 | 0.7606 | 0.6145 | 0.7839 | | 0.3686 | 22.6087 | 520 | 0.6451 | 0.7552 | 0.6451 | 0.8032 | | 0.3686 | 22.6957 | 522 | 0.7010 | 0.7564 | 0.7010 | 0.8372 | | 0.3686 | 22.7826 | 524 | 0.6915 | 0.7673 | 0.6915 | 0.8316 | | 0.3686 | 22.8696 | 526 | 0.6316 | 0.775 | 0.6316 | 0.7947 | | 0.3686 | 22.9565 | 528 | 0.5589 | 0.7925 | 0.5589 | 0.7476 | | 0.3686 | 23.0435 | 530 | 0.5466 | 0.8101 | 0.5466 | 0.7393 | | 0.3686 | 23.1304 | 532 | 0.5849 | 0.7922 | 0.5849 | 0.7648 | | 0.3686 | 23.2174 | 534 | 0.6205 | 0.7397 | 0.6205 | 0.7877 | | 0.3686 | 23.3043 | 536 | 0.6262 | 0.7586 | 0.6262 | 0.7913 | | 0.3686 | 23.3913 | 538 | 0.6058 | 0.7778 | 0.6058 | 0.7783 | | 0.3686 | 23.4783 | 540 | 0.5877 | 0.7862 | 0.5877 | 0.7666 | | 0.3686 | 23.5652 | 542 | 0.5880 | 0.7838 | 0.5880 | 0.7668 | | 0.3686 | 23.6522 | 544 | 0.6254 | 0.7534 | 0.6254 | 0.7908 | | 0.3686 | 23.7391 | 546 | 0.6427 | 0.7417 | 0.6427 | 0.8017 | | 0.3686 | 23.8261 | 548 | 0.6254 | 0.75 | 0.6254 | 0.7909 | | 0.3686 | 23.9130 | 550 | 0.6155 | 0.7550 | 0.6155 | 0.7845 | | 0.3686 | 24.0 | 552 | 0.6083 | 0.7613 | 0.6083 | 0.7800 | ### Framework versions - Transformers 4.44.2 - Pytorch 2.4.0+cu118 - Datasets 2.21.0 - Tokenizers 0.19.1