Hugging Face's logo

MayBashendy
/
ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k14_task1_organization

Text Classification
Transformers
Safetensors
bert
Generated from Trainer
Inference Endpoints
Model card Files Community
ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k14_task1_organization / README.md
MayBashendy's picture
MayBashendy
End of training
5d95b64 verified
preview code
|
raw
history blame contribute delete
22.2 kB
metadata
library_name: transformers
base_model: aubmindlab/bert-base-arabertv02
tags:
  - generated_from_trainer
model-index:
  - name: >-
      ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k14_task1_organization
    results: []

ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k14_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

  • Loss: 2.0270
  • Qwk: 0.1958
  • Mse: 2.0270
  • Rmse: 1.4237

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • learning_rate: 2e-05
  • train_batch_size: 8
  • eval_batch_size: 8
  • seed: 42
  • optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  • lr_scheduler_type: linear
  • num_epochs: 100

Training results

Training Loss Epoch Step Validation Loss Qwk Mse Rmse
No log 0.0328 2 6.9274 0.0114 6.9274 2.6320
No log 0.0656 4 4.5546 0.0880 4.5546 2.1342
No log 0.0984 6 3.6637 0.0 3.6637 1.9141
No log 0.1311 8 2.3665 0.1127 2.3665 1.5383
No log 0.1639 10 2.2955 0.0851 2.2955 1.5151
No log 0.1967 12 2.6429 0.0 2.6429 1.6257
No log 0.2295 14 2.2613 0.0593 2.2613 1.5037
No log 0.2623 16 1.9187 0.2419 1.9187 1.3852
No log 0.2951 18 1.8848 0.3125 1.8848 1.3729
No log 0.3279 20 1.7835 0.3125 1.7835 1.3355
No log 0.3607 22 2.0363 0.3008 2.0363 1.4270
No log 0.3934 24 2.5680 0.0667 2.5680 1.6025
No log 0.4262 26 2.4517 0.0680 2.4517 1.5658
No log 0.4590 28 1.9914 0.2941 1.9914 1.4112
No log 0.4918 30 2.1819 0.1618 2.1819 1.4771
No log 0.5246 32 2.0332 0.2481 2.0332 1.4259
No log 0.5574 34 1.7074 0.3443 1.7074 1.3067
No log 0.5902 36 1.8844 0.3040 1.8844 1.3728
No log 0.6230 38 2.0637 0.2481 2.0637 1.4366
No log 0.6557 40 1.9860 0.1890 1.9860 1.4093
No log 0.6885 42 1.6770 0.2655 1.6770 1.2950
No log 0.7213 44 1.5206 0.1524 1.5206 1.2331
No log 0.7541 46 1.6014 0.3091 1.6014 1.2655
No log 0.7869 48 1.6020 0.3478 1.6020 1.2657
No log 0.8197 50 1.4273 0.3186 1.4273 1.1947
No log 0.8525 52 1.3192 0.3590 1.3192 1.1486
No log 0.8852 54 1.2734 0.4516 1.2734 1.1285
No log 0.9180 56 1.2537 0.4538 1.2537 1.1197
No log 0.9508 58 1.6898 0.2735 1.6898 1.2999
No log 0.9836 60 2.4103 -0.0672 2.4103 1.5525
No log 1.0164 62 1.8688 0.1565 1.8688 1.3670
No log 1.0492 64 1.3162 0.5484 1.3162 1.1473
No log 1.0820 66 1.1400 0.5303 1.1400 1.0677
No log 1.1148 68 1.2388 0.5185 1.2388 1.1130
No log 1.1475 70 1.1427 0.5669 1.1427 1.0690
No log 1.1803 72 1.2571 0.4132 1.2571 1.1212
No log 1.2131 74 1.8733 0.1897 1.8733 1.3687
No log 1.2459 76 1.5707 0.2586 1.5707 1.2533
No log 1.2787 78 1.1571 0.5528 1.1571 1.0757
No log 1.3115 80 1.1585 0.4874 1.1585 1.0763
No log 1.3443 82 1.2108 0.4138 1.2108 1.1004
No log 1.3770 84 1.2961 0.4531 1.2961 1.1385
No log 1.4098 86 1.4522 0.4 1.4522 1.2051
No log 1.4426 88 1.4565 0.4 1.4565 1.2069
No log 1.4754 90 1.2895 0.5352 1.2895 1.1356
No log 1.5082 92 1.2483 0.4966 1.2483 1.1173
No log 1.5410 94 1.2511 0.5270 1.2512 1.1185
No log 1.5738 96 1.3083 0.56 1.3083 1.1438
No log 1.6066 98 1.6990 0.2628 1.6990 1.3034
No log 1.6393 100 2.3381 0.0611 2.3381 1.5291
No log 1.6721 102 2.2811 0.1194 2.2811 1.5103
No log 1.7049 104 1.9165 0.2143 1.9165 1.3844
No log 1.7377 106 1.4842 0.4366 1.4842 1.2183
No log 1.7705 108 1.1782 0.5714 1.1782 1.0855
No log 1.8033 110 1.1039 0.6197 1.1039 1.0506
No log 1.8361 112 1.1893 0.5693 1.1893 1.0906
No log 1.8689 114 1.3521 0.4853 1.3521 1.1628
No log 1.9016 116 1.4560 0.3971 1.4560 1.2067
No log 1.9344 118 1.4200 0.4265 1.4200 1.1916
No log 1.9672 120 1.2898 0.5 1.2898 1.1357
No log 2.0 122 1.1797 0.5821 1.1797 1.0862
No log 2.0328 124 1.1619 0.5630 1.1619 1.0779
No log 2.0656 126 1.5712 0.3862 1.5712 1.2535
No log 2.0984 128 1.8809 0.3099 1.8809 1.3715
No log 2.1311 130 1.8950 0.3056 1.8950 1.3766
No log 2.1639 132 1.8992 0.2270 1.8992 1.3781
No log 2.1967 134 1.7846 0.2837 1.7846 1.3359
No log 2.2295 136 1.6685 0.2464 1.6685 1.2917
No log 2.2623 138 1.6713 0.2794 1.6713 1.2928
No log 2.2951 140 1.6640 0.3212 1.6640 1.2900
No log 2.3279 142 1.4735 0.4697 1.4735 1.2139
No log 2.3607 144 1.3592 0.4962 1.3592 1.1658
No log 2.3934 146 1.4105 0.4627 1.4105 1.1876
No log 2.4262 148 1.6592 0.3768 1.6592 1.2881
No log 2.4590 150 1.6767 0.3504 1.6767 1.2949
No log 2.4918 152 1.5501 0.4088 1.5501 1.2450
No log 2.5246 154 1.4932 0.4118 1.4932 1.2220
No log 2.5574 156 1.6787 0.3000 1.6787 1.2956
No log 2.5902 158 1.7515 0.3194 1.7515 1.3234
No log 2.6230 160 1.5714 0.4354 1.5714 1.2536
No log 2.6557 162 1.5580 0.4161 1.5580 1.2482
No log 2.6885 164 1.5658 0.4138 1.5658 1.2513
No log 2.7213 166 1.6001 0.3636 1.6001 1.2649
No log 2.7541 168 1.4631 0.4143 1.4631 1.2096
No log 2.7869 170 1.3314 0.4848 1.3314 1.1539
No log 2.8197 172 1.2795 0.5507 1.2795 1.1312
No log 2.8525 174 1.4941 0.4336 1.4941 1.2223
No log 2.8852 176 1.7194 0.3239 1.7194 1.3113
No log 2.9180 178 1.7645 0.3239 1.7645 1.3283
No log 2.9508 180 1.4946 0.4414 1.4946 1.2225
No log 2.9836 182 1.4097 0.4648 1.4097 1.1873
No log 3.0164 184 1.6593 0.3521 1.6593 1.2882
No log 3.0492 186 2.2001 0.2238 2.2001 1.4833
No log 3.0820 188 2.4875 0.0876 2.4875 1.5772
No log 3.1148 190 2.4102 0.1831 2.4102 1.5525
No log 3.1475 192 2.4384 0.1667 2.4384 1.5615
No log 3.1803 194 2.3360 0.2345 2.3360 1.5284
No log 3.2131 196 2.0251 0.2500 2.0251 1.4231
No log 3.2459 198 1.7605 0.3143 1.7605 1.3268
No log 3.2787 200 1.6749 0.3529 1.6749 1.2942
No log 3.3115 202 1.4837 0.3433 1.4837 1.2181
No log 3.3443 204 1.5385 0.3556 1.5385 1.2404
No log 3.3770 206 1.6565 0.3358 1.6565 1.2870
No log 3.4098 208 1.5748 0.3881 1.5748 1.2549
No log 3.4426 210 1.3758 0.4154 1.3758 1.1729
No log 3.4754 212 1.2867 0.4697 1.2867 1.1343
No log 3.5082 214 1.3233 0.4697 1.3233 1.1503
No log 3.5410 216 1.5454 0.3942 1.5454 1.2431
No log 3.5738 218 1.8644 0.2676 1.8644 1.3654
No log 3.6066 220 2.0092 0.2345 2.0092 1.4175
No log 3.6393 222 1.9203 0.2500 1.9203 1.3857
No log 3.6721 224 1.5958 0.3571 1.5958 1.2633
No log 3.7049 226 1.4899 0.3676 1.4899 1.2206
No log 3.7377 228 1.5724 0.3650 1.5724 1.2539
No log 3.7705 230 1.7095 0.3309 1.7095 1.3075
No log 3.8033 232 1.7848 0.2734 1.7848 1.3360
No log 3.8361 234 1.7954 0.2676 1.7954 1.3399
No log 3.8689 236 1.8446 0.2639 1.8446 1.3582
No log 3.9016 238 1.8912 0.2621 1.8912 1.3752
No log 3.9344 240 2.0237 0.2621 2.0237 1.4226
No log 3.9672 242 2.0469 0.2621 2.0469 1.4307
No log 4.0 244 1.8729 0.2797 1.8729 1.3685
No log 4.0328 246 1.7282 0.3885 1.7282 1.3146
No log 4.0656 248 1.6984 0.3768 1.6984 1.3032
No log 4.0984 250 1.8686 0.2676 1.8686 1.3670
No log 4.1311 252 2.1460 0.2500 2.1460 1.4649
No log 4.1639 254 2.1047 0.2500 2.1047 1.4508
No log 4.1967 256 2.1241 0.2500 2.1241 1.4574
No log 4.2295 258 2.1727 0.2345 2.1727 1.4740
No log 4.2623 260 2.0199 0.2517 2.0199 1.4212
No log 4.2951 262 1.8132 0.3099 1.8132 1.3465
No log 4.3279 264 1.8222 0.3099 1.8222 1.3499
No log 4.3607 266 1.9455 0.2517 1.9455 1.3948
No log 4.3934 268 2.0643 0.2098 2.0643 1.4368
No log 4.4262 270 2.1044 0.1678 2.1044 1.4507
No log 4.4590 272 1.9808 0.2098 1.9808 1.4074
No log 4.4918 274 1.8321 0.2590 1.8321 1.3536
No log 4.5246 276 1.5873 0.3504 1.5873 1.2599
No log 4.5574 278 1.5065 0.4394 1.5065 1.2274
No log 4.5902 280 1.6186 0.3111 1.6186 1.2722
No log 4.6230 282 1.8344 0.2590 1.8344 1.3544
No log 4.6557 284 2.0936 0.1806 2.0936 1.4469
No log 4.6885 286 2.1929 0.1806 2.1929 1.4809
No log 4.7213 288 2.1543 0.1806 2.1543 1.4677
No log 4.7541 290 1.9524 0.2098 1.9524 1.3973
No log 4.7869 292 1.9466 0.2254 1.9466 1.3952
No log 4.8197 294 2.0611 0.2361 2.0611 1.4357
No log 4.8525 296 2.0938 0.2361 2.0938 1.4470
No log 4.8852 298 2.0528 0.2361 2.0528 1.4328
No log 4.9180 300 1.9472 0.2254 1.9472 1.3954
No log 4.9508 302 1.8155 0.2206 1.8155 1.3474
No log 4.9836 304 1.7635 0.2464 1.7635 1.3280
No log 5.0164 306 1.7547 0.2676 1.7547 1.3247
No log 5.0492 308 1.7933 0.2657 1.7933 1.3391
No log 5.0820 310 1.9107 0.2639 1.9107 1.3823
No log 5.1148 312 1.7747 0.2817 1.7747 1.3322
No log 5.1475 314 1.6128 0.3857 1.6128 1.2700
No log 5.1803 316 1.6292 0.3597 1.6292 1.2764
No log 5.2131 318 1.7802 0.2714 1.7802 1.3342
No log 5.2459 320 1.8351 0.2714 1.8351 1.3547
No log 5.2787 322 1.7236 0.3358 1.7236 1.3129
No log 5.3115 324 1.7507 0.3453 1.7507 1.3232
No log 5.3443 326 1.9038 0.2817 1.9038 1.3798
No log 5.3770 328 2.1008 0.1806 2.1008 1.4494
No log 5.4098 330 2.1172 0.1806 2.1172 1.4551
No log 5.4426 332 1.9811 0.1958 1.9811 1.4075
No log 5.4754 334 1.9634 0.1702 1.9634 1.4012
No log 5.5082 336 1.8444 0.2590 1.8444 1.3581
No log 5.5410 338 1.7689 0.3333 1.7689 1.3300
No log 5.5738 340 1.7631 0.3333 1.7631 1.3278
No log 5.6066 342 1.8331 0.3099 1.8331 1.3539
No log 5.6393 344 1.9543 0.2378 1.9543 1.3980
No log 5.6721 346 2.1829 0.1958 2.1829 1.4774
No log 5.7049 348 2.3709 0.1793 2.3709 1.5398
No log 5.7377 350 2.2390 0.2254 2.2390 1.4963
No log 5.7705 352 2.0096 0.2411 2.0096 1.4176
No log 5.8033 354 1.9457 0.2378 1.9457 1.3949
No log 5.8361 356 1.8676 0.2639 1.8676 1.3666
No log 5.8689 358 1.8751 0.2937 1.8751 1.3694
No log 5.9016 360 1.9176 0.2553 1.9176 1.3848
No log 5.9344 362 2.0070 0.2254 2.0070 1.4167
No log 5.9672 364 2.0383 0.1538 2.0383 1.4277
No log 6.0 366 1.9729 0.2098 1.9729 1.4046
No log 6.0328 368 1.7557 0.2714 1.7557 1.3250
No log 6.0656 370 1.6827 0.3286 1.6827 1.2972
No log 6.0984 372 1.6672 0.3309 1.6672 1.2912
No log 6.1311 374 1.6777 0.3286 1.6777 1.2953
No log 6.1639 376 1.7946 0.2553 1.7946 1.3396
No log 6.1967 378 1.9796 0.2394 1.9796 1.4070
No log 6.2295 380 2.0549 0.1806 2.0549 1.4335
No log 6.2623 382 1.9746 0.2098 1.9746 1.4052
No log 6.2951 384 1.9283 0.2394 1.9283 1.3886
No log 6.3279 386 1.8555 0.2429 1.8555 1.3622
No log 6.3607 388 1.9432 0.1844 1.9432 1.3940
No log 6.3934 390 2.0936 0.1844 2.0936 1.4469
No log 6.4262 392 2.0968 0.1844 2.0968 1.4480
No log 6.4590 394 1.9531 0.2394 1.9531 1.3975
No log 6.4918 396 1.7152 0.2857 1.7152 1.3096
No log 6.5246 398 1.6000 0.3529 1.6000 1.2649
No log 6.5574 400 1.5615 0.3704 1.5615 1.2496
No log 6.5902 402 1.6877 0.3259 1.6877 1.2991
No log 6.6230 404 1.9193 0.2553 1.9193 1.3854
No log 6.6557 406 1.8935 0.2553 1.8935 1.3761
No log 6.6885 408 1.9035 0.2553 1.9035 1.3797
No log 6.7213 410 1.9923 0.2254 1.9923 1.4115
No log 6.7541 412 2.1026 0.1958 2.1026 1.4500
No log 6.7869 414 2.0569 0.2517 2.0569 1.4342
No log 6.8197 416 1.8925 0.2837 1.8925 1.3757
No log 6.8525 418 1.6951 0.2878 1.6951 1.3020
No log 6.8852 420 1.5833 0.4179 1.5833 1.2583
No log 6.9180 422 1.6395 0.3382 1.6395 1.2804
No log 6.9508 424 1.7606 0.2837 1.7606 1.3269
No log 6.9836 426 1.8552 0.2837 1.8552 1.3621
No log 7.0164 428 1.9491 0.2222 1.9491 1.3961
No log 7.0492 430 1.9351 0.25 1.9351 1.3911
No log 7.0820 432 1.9882 0.2483 1.9882 1.4100
No log 7.1148 434 2.0765 0.2222 2.0765 1.4410
No log 7.1475 436 2.1152 0.2222 2.1152 1.4544
No log 7.1803 438 2.1237 0.1958 2.1237 1.4573
No log 7.2131 440 1.9446 0.2254 1.9446 1.3945
No log 7.2459 442 1.5827 0.3485 1.5827 1.2581
No log 7.2787 444 1.4383 0.4341 1.4383 1.1993
No log 7.3115 446 1.4932 0.4 1.4932 1.2220
No log 7.3443 448 1.6519 0.3433 1.6519 1.2852
No log 7.3770 450 1.9293 0.2553 1.9293 1.3890
No log 7.4098 452 2.0775 0.1702 2.0775 1.4414
No log 7.4426 454 2.0549 0.1151 2.0549 1.4335
No log 7.4754 456 2.0828 0.1151 2.0828 1.4432
No log 7.5082 458 2.0795 0.1277 2.0795 1.4421
No log 7.5410 460 2.1101 0.1806 2.1101 1.4526
No log 7.5738 462 2.1957 0.1806 2.1957 1.4818
No log 7.6066 464 2.1914 0.1806 2.1914 1.4804
No log 7.6393 466 2.0900 0.1806 2.0900 1.4457
No log 7.6721 468 1.9215 0.2098 1.9215 1.3862
No log 7.7049 470 1.7424 0.2857 1.7424 1.3200
No log 7.7377 472 1.6896 0.3796 1.6896 1.2999
No log 7.7705 474 1.6581 0.3796 1.6581 1.2877
No log 7.8033 476 1.7274 0.3188 1.7274 1.3143
No log 7.8361 478 1.8115 0.2517 1.8115 1.3459
No log 7.8689 480 1.9006 0.2222 1.9006 1.3786
No log 7.9016 482 1.9916 0.2222 1.9916 1.4112
No log 7.9344 484 1.8777 0.2517 1.8777 1.3703
No log 7.9672 486 1.6141 0.3478 1.6141 1.2705
No log 8.0 488 1.5371 0.3824 1.5371 1.2398
No log 8.0328 490 1.6912 0.3121 1.6912 1.3005
No log 8.0656 492 1.9362 0.2238 1.9362 1.3915
No log 8.0984 494 2.0200 0.2222 2.0200 1.4213
No log 8.1311 496 1.9730 0.2222 1.9730 1.4046
No log 8.1639 498 1.8267 0.2571 1.8267 1.3515
0.421 8.1967 500 1.7251 0.2941 1.7251 1.3134
0.421 8.2295 502 1.7126 0.2941 1.7126 1.3087
0.421 8.2623 504 1.6526 0.3382 1.6526 1.2855
0.421 8.2951 506 1.6645 0.3212 1.6645 1.2901
0.421 8.3279 508 1.6930 0.2714 1.6930 1.3011
0.421 8.3607 510 1.7930 0.2837 1.7930 1.3390
0.421 8.3934 512 1.9624 0.2254 1.9624 1.4008
0.421 8.4262 514 2.1160 0.1958 2.1160 1.4547
0.421 8.4590 516 2.0270 0.1958 2.0270 1.4237

Framework versions

  • Transformers 4.44.2
  • Pytorch 2.4.0+cu118
  • Datasets 2.21.0
  • Tokenizers 0.19.1