Hugging Face's logo

MayBashendy
/
ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k12_task1_organization

Text Classification
Transformers
Safetensors
bert
Generated from Trainer
Inference Endpoints
Model card Files Community
ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k12_task1_organization / README.md
MayBashendy's picture
MayBashendy
End of training
1ae9911 verified
preview code
|
raw
history blame contribute delete
21.9 kB
metadata
library_name: transformers
base_model: aubmindlab/bert-base-arabertv02
tags:
  - generated_from_trainer
model-index:
  - name: >-
      ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k12_task1_organization
    results: []

ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k12_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

  • Loss: 2.1699
  • Qwk: 0.1986
  • Mse: 2.1699
  • Rmse: 1.4731

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • learning_rate: 2e-05
  • train_batch_size: 8
  • eval_batch_size: 8
  • seed: 42
  • optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  • lr_scheduler_type: linear
  • num_epochs: 100

Training results

Training Loss Epoch Step Validation Loss Qwk Mse Rmse
No log 0.0385 2 7.0106 0.0110 7.0106 2.6478
No log 0.0769 4 3.8273 0.0563 3.8273 1.9563
No log 0.1154 6 2.5387 0.1053 2.5387 1.5933
No log 0.1538 8 2.2145 0.2113 2.2145 1.4881
No log 0.1923 10 1.8804 0.2595 1.8804 1.3713
No log 0.2308 12 1.8987 0.2576 1.8987 1.3779
No log 0.2692 14 1.8656 0.25 1.8656 1.3659
No log 0.3077 16 1.8859 0.2222 1.8859 1.3733
No log 0.3462 18 1.5803 0.2759 1.5803 1.2571
No log 0.3846 20 1.4827 0.3063 1.4827 1.2176
No log 0.4231 22 1.7357 0.2321 1.7357 1.3174
No log 0.4615 24 1.9034 0.2063 1.9034 1.3796
No log 0.5 26 1.7106 0.3871 1.7106 1.3079
No log 0.5385 28 1.6575 0.3415 1.6575 1.2874
No log 0.5769 30 1.8172 0.3089 1.8172 1.3480
No log 0.6154 32 1.6655 0.3276 1.6655 1.2905
No log 0.6538 34 1.4711 0.1682 1.4711 1.2129
No log 0.6923 36 1.3565 0.2075 1.3565 1.1647
No log 0.7308 38 1.3373 0.375 1.3373 1.1564
No log 0.7692 40 1.3324 0.3423 1.3324 1.1543
No log 0.8077 42 1.3235 0.3929 1.3235 1.1504
No log 0.8462 44 1.3372 0.3860 1.3372 1.1564
No log 0.8846 46 1.4138 0.3036 1.4138 1.1890
No log 0.9231 48 1.4634 0.2957 1.4634 1.2097
No log 0.9615 50 1.6369 0.3000 1.6369 1.2794
No log 1.0 52 1.6389 0.3025 1.6389 1.2802
No log 1.0385 54 1.2617 0.4959 1.2617 1.1233
No log 1.0769 56 1.1732 0.4174 1.1732 1.0832
No log 1.1154 58 1.1795 0.4211 1.1795 1.0860
No log 1.1538 60 1.1749 0.4522 1.1749 1.0839
No log 1.1923 62 1.2630 0.4237 1.2630 1.1238
No log 1.2308 64 1.2066 0.4444 1.2066 1.0984
No log 1.2692 66 1.1627 0.4957 1.1627 1.0783
No log 1.3077 68 1.4266 0.3652 1.4266 1.1944
No log 1.3462 70 1.5852 0.2523 1.5852 1.2591
No log 1.3846 72 1.6459 0.2523 1.6459 1.2829
No log 1.4231 74 1.8123 0.2364 1.8123 1.3462
No log 1.4615 76 1.5848 0.2523 1.5848 1.2589
No log 1.5 78 1.2874 0.4138 1.2874 1.1347
No log 1.5385 80 1.1688 0.4706 1.1688 1.0811
No log 1.5769 82 1.0486 0.5124 1.0486 1.0240
No log 1.6154 84 1.0477 0.5410 1.0477 1.0236
No log 1.6538 86 1.0801 0.5210 1.0801 1.0393
No log 1.6923 88 1.2462 0.4746 1.2462 1.1164
No log 1.7308 90 1.3532 0.4444 1.3532 1.1633
No log 1.7692 92 1.4525 0.3826 1.4525 1.2052
No log 1.8077 94 1.3830 0.5210 1.3830 1.1760
No log 1.8462 96 1.3397 0.5124 1.3397 1.1575
No log 1.8846 98 1.3361 0.5124 1.3361 1.1559
No log 1.9231 100 1.3744 0.4959 1.3744 1.1723
No log 1.9615 102 1.3757 0.5041 1.3757 1.1729
No log 2.0 104 1.2787 0.4874 1.2787 1.1308
No log 2.0385 106 1.1971 0.4957 1.1971 1.0941
No log 2.0769 108 1.2036 0.5042 1.2036 1.0971
No log 2.1154 110 1.2938 0.5 1.2938 1.1375
No log 2.1538 112 1.5911 0.3307 1.5911 1.2614
No log 2.1923 114 1.6967 0.2927 1.6967 1.3026
No log 2.2308 116 1.5949 0.3810 1.5949 1.2629
No log 2.2692 118 1.5120 0.3876 1.5120 1.2297
No log 2.3077 120 1.4842 0.4296 1.4842 1.2183
No log 2.3462 122 1.5705 0.3650 1.5705 1.2532
No log 2.3846 124 1.6742 0.3022 1.6742 1.2939
No log 2.4231 126 1.6864 0.3188 1.6864 1.2986
No log 2.4615 128 1.6059 0.3235 1.6059 1.2672
No log 2.5 130 1.4311 0.3817 1.4311 1.1963
No log 2.5385 132 1.4580 0.3939 1.4580 1.2075
No log 2.5769 134 1.7735 0.2676 1.7735 1.3317
No log 2.6154 136 1.9811 0.2270 1.9811 1.4075
No log 2.6538 138 2.0044 0.2014 2.0044 1.4158
No log 2.6923 140 1.9034 0.2302 1.9034 1.3797
No log 2.7308 142 1.7913 0.2446 1.7913 1.3384
No log 2.7692 144 1.8269 0.2714 1.8269 1.3516
No log 2.8077 146 1.9552 0.2113 1.9552 1.3983
No log 2.8462 148 1.9938 0.2113 1.9938 1.4120
No log 2.8846 150 1.8603 0.2571 1.8603 1.3639
No log 2.9231 152 1.7587 0.2609 1.7587 1.3262
No log 2.9615 154 1.7944 0.2609 1.7944 1.3396
No log 3.0 156 1.8311 0.2336 1.8311 1.3532
No log 3.0385 158 1.8497 0.1871 1.8497 1.3600
No log 3.0769 160 1.8930 0.2000 1.8930 1.3759
No log 3.1154 162 1.7529 0.2336 1.7529 1.3240
No log 3.1538 164 1.7123 0.2920 1.7123 1.3085
No log 3.1923 166 1.7492 0.2734 1.7492 1.3226
No log 3.2308 168 1.9579 0.2429 1.9579 1.3993
No log 3.2692 170 2.0207 0.2143 2.0207 1.4215
No log 3.3077 172 1.9818 0.2609 1.9818 1.4078
No log 3.3462 174 1.9404 0.2482 1.9404 1.3930
No log 3.3846 176 1.8950 0.2609 1.8950 1.3766
No log 3.4231 178 1.7193 0.3259 1.7193 1.3112
No log 3.4615 180 1.6644 0.3485 1.6644 1.2901
No log 3.5 182 1.6966 0.3308 1.6966 1.3026
No log 3.5385 184 1.7434 0.3433 1.7434 1.3204
No log 3.5769 186 1.8357 0.3066 1.8357 1.3549
No log 3.6154 188 1.9015 0.2411 1.9015 1.3790
No log 3.6538 190 1.9849 0.2098 1.9849 1.4088
No log 3.6923 192 2.0120 0.1831 2.0120 1.4184
No log 3.7308 194 1.9805 0.2143 1.9805 1.4073
No log 3.7692 196 1.9783 0.2128 1.9783 1.4065
No log 3.8077 198 1.8793 0.2609 1.8793 1.3709
No log 3.8462 200 1.8131 0.2774 1.8131 1.3465
No log 3.8846 202 1.7349 0.2941 1.7349 1.3172
No log 3.9231 204 1.6625 0.2985 1.6625 1.2894
No log 3.9615 206 1.6809 0.2687 1.6809 1.2965
No log 4.0 208 1.7763 0.2647 1.7763 1.3328
No log 4.0385 210 1.8171 0.2647 1.8171 1.3480
No log 4.0769 212 1.7906 0.2647 1.7906 1.3381
No log 4.1154 214 1.7554 0.2815 1.7554 1.3249
No log 4.1538 216 1.7394 0.2985 1.7394 1.3189
No log 4.1923 218 1.7363 0.2794 1.7363 1.3177
No log 4.2308 220 1.7863 0.2429 1.7863 1.3365
No log 4.2692 222 1.9634 0.1986 1.9634 1.4012
No log 4.3077 224 2.0619 0.1986 2.0619 1.4359
No log 4.3462 226 2.0701 0.2206 2.0701 1.4388
No log 4.3846 228 2.0258 0.2270 2.0258 1.4233
No log 4.4231 230 1.9454 0.2143 1.9454 1.3948
No log 4.4615 232 1.9086 0.2286 1.9086 1.3815
No log 4.5 234 1.9611 0.2143 1.9611 1.4004
No log 4.5385 236 1.9628 0.2143 1.9628 1.4010
No log 4.5769 238 1.9271 0.2336 1.9271 1.3882
No log 4.6154 240 1.9074 0.2174 1.9074 1.3811
No log 4.6538 242 1.8305 0.2482 1.8306 1.3530
No log 4.6923 244 1.8184 0.2206 1.8184 1.3485
No log 4.7308 246 1.7788 0.2482 1.7788 1.3337
No log 4.7692 248 1.8828 0.2446 1.8828 1.3722
No log 4.8077 250 2.0021 0.2286 2.0021 1.4149
No log 4.8462 252 1.9045 0.2206 1.9045 1.3800
No log 4.8846 254 1.8872 0.2206 1.8872 1.3738
No log 4.9231 256 1.9712 0.2336 1.9712 1.4040
No log 4.9615 258 1.9222 0.2446 1.9222 1.3864
No log 5.0 260 1.8588 0.2446 1.8588 1.3634
No log 5.0385 262 1.8605 0.3000 1.8605 1.3640
No log 5.0769 264 1.8908 0.3000 1.8908 1.3750
No log 5.1154 266 1.8207 0.3121 1.8207 1.3493
No log 5.1538 268 1.8435 0.2429 1.8435 1.3578
No log 5.1923 270 1.7808 0.2920 1.7808 1.3345
No log 5.2308 272 1.5541 0.3846 1.5541 1.2466
No log 5.2692 274 1.5043 0.3846 1.5043 1.2265
No log 5.3077 276 1.6743 0.3910 1.6743 1.2940
No log 5.3462 278 2.0347 0.2128 2.0347 1.4264
No log 5.3846 280 2.1816 0.1831 2.1816 1.4770
No log 5.4231 282 2.1176 0.1986 2.1176 1.4552
No log 5.4615 284 2.0060 0.1986 2.0060 1.4163
No log 5.5 286 1.9175 0.2254 1.9175 1.3847
No log 5.5385 288 2.0607 0.1986 2.0607 1.4355
No log 5.5769 290 2.1332 0.2286 2.1332 1.4606
No log 5.6154 292 2.0945 0.2286 2.0945 1.4472
No log 5.6538 294 1.9801 0.2590 1.9801 1.4071
No log 5.6923 296 1.8692 0.2590 1.8692 1.3672
No log 5.7308 298 1.7779 0.2429 1.7779 1.3334
No log 5.7692 300 1.8025 0.2429 1.8025 1.3426
No log 5.8077 302 1.7735 0.2734 1.7735 1.3317
No log 5.8462 304 1.8060 0.2158 1.8060 1.3439
No log 5.8846 306 1.9705 0.1986 1.9705 1.4037
No log 5.9231 308 2.1156 0.1690 2.1156 1.4545
No log 5.9615 310 2.0885 0.1690 2.0885 1.4452
No log 6.0 312 2.0990 0.1690 2.0990 1.4488
No log 6.0385 314 1.9561 0.2286 1.9561 1.3986
No log 6.0769 316 1.8070 0.3284 1.8070 1.3443
No log 6.1154 318 1.8565 0.2628 1.8565 1.3625
No log 6.1538 320 2.0776 0.1986 2.0776 1.4414
No log 6.1923 322 2.3001 0.1538 2.3001 1.5166
No log 6.2308 324 2.3108 0.1538 2.3108 1.5201
No log 6.2692 326 2.1940 0.1831 2.1940 1.4812
No log 6.3077 328 2.0123 0.2429 2.0123 1.4185
No log 6.3462 330 1.9141 0.2590 1.9141 1.3835
No log 6.3846 332 1.9368 0.2590 1.9368 1.3917
No log 6.4231 334 2.1365 0.2128 2.1365 1.4617
No log 6.4615 336 2.1801 0.1831 2.1801 1.4765
No log 6.5 338 2.1140 0.2446 2.1140 1.4540
No log 6.5385 340 1.9350 0.2353 1.9350 1.3910
No log 6.5769 342 1.9133 0.2388 1.9133 1.3832
No log 6.6154 344 2.0282 0.2319 2.0282 1.4241
No log 6.6538 346 2.1678 0.1986 2.1678 1.4723
No log 6.6923 348 2.2251 0.1986 2.2251 1.4917
No log 6.7308 350 2.2410 0.1986 2.2410 1.4970
No log 6.7692 352 2.2236 0.1986 2.2236 1.4912
No log 6.8077 354 2.2881 0.1986 2.2881 1.5126
No log 6.8462 356 2.1662 0.1986 2.1662 1.4718
No log 6.8846 358 1.9949 0.2302 1.9949 1.4124
No log 6.9231 360 1.9865 0.2286 1.9865 1.4094
No log 6.9615 362 2.0797 0.2158 2.0797 1.4421
No log 7.0 364 2.2238 0.1986 2.2238 1.4912
No log 7.0385 366 2.1935 0.1986 2.1935 1.4811
No log 7.0769 368 2.1497 0.1986 2.1497 1.4662
No log 7.1154 370 2.2406 0.1690 2.2406 1.4969
No log 7.1538 372 2.2447 0.1690 2.2447 1.4982
No log 7.1923 374 2.1370 0.1690 2.1370 1.4618
No log 7.2308 376 2.1687 0.1690 2.1687 1.4726
No log 7.2692 378 2.2175 0.1690 2.2175 1.4891
No log 7.3077 380 2.0855 0.1857 2.0855 1.4441
No log 7.3462 382 2.0098 0.2158 2.0098 1.4177
No log 7.3846 384 1.9385 0.2628 1.9385 1.3923
No log 7.4231 386 2.0233 0.2464 2.0233 1.4224
No log 7.4615 388 2.2312 0.1857 2.2312 1.4937
No log 7.5 390 2.5518 0.1528 2.5518 1.5974
No log 7.5385 392 2.7413 0.1216 2.7413 1.6557
No log 7.5769 394 2.6588 0.1538 2.6588 1.6306
No log 7.6154 396 2.3735 0.1538 2.3735 1.5406
No log 7.6538 398 2.0793 0.2128 2.0793 1.4420
No log 7.6923 400 1.8799 0.2590 1.8799 1.3711
No log 7.7308 402 1.8458 0.2590 1.8458 1.3586
No log 7.7692 404 1.9264 0.2590 1.9264 1.3879
No log 7.8077 406 2.0177 0.2158 2.0177 1.4204
No log 7.8462 408 2.1205 0.1986 2.1205 1.4562
No log 7.8846 410 2.1876 0.1831 2.1876 1.4791
No log 7.9231 412 2.2487 0.1818 2.2487 1.4996
No log 7.9615 414 2.0567 0.2128 2.0567 1.4341
No log 8.0 416 1.8364 0.3022 1.8364 1.3551
No log 8.0385 418 1.8690 0.3022 1.8690 1.3671
No log 8.0769 420 2.1269 0.1972 2.1269 1.4584
No log 8.1154 422 2.3328 0.1678 2.3328 1.5274
No log 8.1538 424 2.2863 0.1678 2.2863 1.5120
No log 8.1923 426 2.1301 0.1986 2.1301 1.4595
No log 8.2308 428 1.8995 0.2837 1.8995 1.3782
No log 8.2692 430 1.7192 0.3188 1.7192 1.3112
No log 8.3077 432 1.7214 0.3407 1.7214 1.3120
No log 8.3462 434 1.8217 0.2353 1.8217 1.3497
No log 8.3846 436 1.9919 0.2029 1.9919 1.4113
No log 8.4231 438 2.1989 0.1831 2.1989 1.4829
No log 8.4615 440 2.3416 0.1538 2.3416 1.5302
No log 8.5 442 2.3719 0.1538 2.3719 1.5401
No log 8.5385 444 2.1923 0.1831 2.1923 1.4806
No log 8.5769 446 2.0381 0.2158 2.0381 1.4276
No log 8.6154 448 1.9033 0.2174 1.9033 1.3796
No log 8.6538 450 1.9075 0.2174 1.9075 1.3811
No log 8.6923 452 1.9876 0.2174 1.9876 1.4098
No log 8.7308 454 2.0381 0.2174 2.0381 1.4276
No log 8.7692 456 1.9313 0.2174 1.9313 1.3897
No log 8.8077 458 1.7666 0.2336 1.7666 1.3291
No log 8.8462 460 1.7371 0.2609 1.7371 1.3180
No log 8.8846 462 1.7925 0.2336 1.7925 1.3389
No log 8.9231 464 1.8024 0.2174 1.8024 1.3425
No log 8.9615 466 1.7908 0.2446 1.7908 1.3382
No log 9.0 468 1.8067 0.2714 1.8067 1.3441
No log 9.0385 470 1.9043 0.2446 1.9043 1.3800
No log 9.0769 472 1.9619 0.2429 1.9619 1.4007
No log 9.1154 474 1.8928 0.2446 1.8928 1.3758
No log 9.1538 476 1.7157 0.2837 1.7157 1.3099
No log 9.1923 478 1.5404 0.3556 1.5404 1.2411
No log 9.2308 480 1.4832 0.3852 1.4832 1.2179
No log 9.2692 482 1.5094 0.4118 1.5094 1.2286
No log 9.3077 484 1.4935 0.4118 1.4935 1.2221
No log 9.3462 486 1.4971 0.4118 1.4971 1.2235
No log 9.3846 488 1.4762 0.4593 1.4762 1.2150
No log 9.4231 490 1.5684 0.3407 1.5684 1.2523
No log 9.4615 492 1.6185 0.3504 1.6185 1.2722
No log 9.5 494 1.6003 0.3824 1.6003 1.2650
No log 9.5385 496 1.6562 0.3284 1.6562 1.2869
No log 9.5769 498 1.6810 0.3259 1.6810 1.2965
0.4083 9.6154 500 1.6824 0.3259 1.6824 1.2971
0.4083 9.6538 502 1.5954 0.3876 1.5954 1.2631
0.4083 9.6923 504 1.6016 0.4122 1.6016 1.2655
0.4083 9.7308 506 1.6833 0.3284 1.6833 1.2974
0.4083 9.7692 508 1.7513 0.2941 1.7513 1.3234
0.4083 9.8077 510 1.7431 0.3235 1.7431 1.3203
0.4083 9.8462 512 1.8102 0.2734 1.8102 1.3454
0.4083 9.8846 514 1.9838 0.2254 1.9838 1.4085
0.4083 9.9231 516 2.1699 0.1986 2.1699 1.4731

Framework versions

  • Transformers 4.44.2
  • Pytorch 2.4.0+cu118
  • Datasets 2.21.0
  • Tokenizers 0.19.1