Hugging Face's logo

MayBashendy
/
ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k3_task1_organization

Text Classification
Transformers
Safetensors
bert
Generated from Trainer
Inference Endpoints
Model card Files Community
ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k3_task1_organization / README.md
MayBashendy's picture
MayBashendy
End of training
bc7cd05 verified
preview code
|
raw
history blame contribute delete
22.4 kB
metadata
library_name: transformers
base_model: aubmindlab/bert-base-arabertv02
tags:
  - generated_from_trainer
model-index:
  - name: >-
      ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k3_task1_organization
    results: []

ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k3_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

  • Loss: 0.9627
  • Qwk: 0.6129
  • Mse: 0.9627
  • Rmse: 0.9812

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • learning_rate: 2e-05
  • train_batch_size: 8
  • eval_batch_size: 8
  • seed: 42
  • optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  • lr_scheduler_type: linear
  • num_epochs: 100

Training results

Training Loss Epoch Step Validation Loss Qwk Mse Rmse
No log 0.1538 2 6.8306 0.0174 6.8306 2.6135
No log 0.3077 4 4.5677 0.0346 4.5677 2.1372
No log 0.4615 6 3.5238 -0.0423 3.5238 1.8772
No log 0.6154 8 2.6745 0.1408 2.6745 1.6354
No log 0.7692 10 2.0035 0.1270 2.0035 1.4155
No log 0.9231 12 1.8710 0.2069 1.8710 1.3679
No log 1.0769 14 2.3353 0.1325 2.3353 1.5282
No log 1.2308 16 1.9808 0.2727 1.9808 1.4074
No log 1.3846 18 1.5191 0.2162 1.5191 1.2325
No log 1.5385 20 1.5185 0.2385 1.5185 1.2323
No log 1.6923 22 1.6201 0.2593 1.6201 1.2728
No log 1.8462 24 1.4833 0.2342 1.4833 1.2179
No log 2.0 26 1.6055 0.4286 1.6055 1.2671
No log 2.1538 28 1.8217 0.3662 1.8217 1.3497
No log 2.3077 30 1.7126 0.4324 1.7126 1.3087
No log 2.4615 32 1.9554 0.2000 1.9554 1.3984
No log 2.6154 34 4.1494 -0.3333 4.1494 2.0370
No log 2.7692 36 5.1844 -0.3850 5.1844 2.2769
No log 2.9231 38 3.1087 -0.1719 3.1087 1.7632
No log 3.0769 40 1.2302 0.4174 1.2302 1.1092
No log 3.2308 42 1.4134 0.3770 1.4134 1.1889
No log 3.3846 44 1.5365 0.3902 1.5365 1.2395
No log 3.5385 46 1.3101 0.3333 1.3101 1.1446
No log 3.6923 48 1.2681 0.3363 1.2681 1.1261
No log 3.8462 50 1.2728 0.3363 1.2728 1.1282
No log 4.0 52 1.2079 0.4538 1.2079 1.0990
No log 4.1538 54 1.2043 0.5082 1.2043 1.0974
No log 4.3077 56 1.3553 0.4000 1.3553 1.1642
No log 4.4615 58 1.2024 0.4 1.2024 1.0965
No log 4.6154 60 1.0938 0.5197 1.0938 1.0458
No log 4.7692 62 1.0657 0.5426 1.0657 1.0323
No log 4.9231 64 1.1821 0.4286 1.1821 1.0872
No log 5.0769 66 1.3141 0.4160 1.3141 1.1464
No log 5.2308 68 1.3378 0.4160 1.3378 1.1566
No log 5.3846 70 1.2014 0.4444 1.2014 1.0961
No log 5.5385 72 1.2206 0.4409 1.2206 1.1048
No log 5.6923 74 1.3453 0.4409 1.3453 1.1599
No log 5.8462 76 1.3290 0.4733 1.3290 1.1528
No log 6.0 78 1.0980 0.5426 1.0980 1.0479
No log 6.1538 80 1.0872 0.4715 1.0872 1.0427
No log 6.3077 82 1.0458 0.528 1.0458 1.0226
No log 6.4615 84 1.0046 0.6364 1.0046 1.0023
No log 6.6154 86 0.9983 0.6277 0.9983 0.9991
No log 6.7692 88 1.1125 0.5630 1.1125 1.0548
No log 6.9231 90 1.2689 0.5362 1.2689 1.1265
No log 7.0769 92 1.4772 0.4234 1.4772 1.2154
No log 7.2308 94 1.2053 0.5401 1.2053 1.0979
No log 7.3846 96 1.0376 0.6165 1.0376 1.0186
No log 7.5385 98 1.4595 0.4626 1.4595 1.2081
No log 7.6923 100 1.4567 0.4626 1.4567 1.2069
No log 7.8462 102 1.1269 0.4812 1.1269 1.0615
No log 8.0 104 1.0851 0.5781 1.0851 1.0417
No log 8.1538 106 1.3079 0.4688 1.3079 1.1437
No log 8.3077 108 1.3051 0.4961 1.3051 1.1424
No log 8.4615 110 1.1076 0.5410 1.1076 1.0524
No log 8.6154 112 1.0202 0.6718 1.0202 1.0101
No log 8.7692 114 0.9950 0.6815 0.9950 0.9975
No log 8.9231 116 1.0301 0.6 1.0301 1.0150
No log 9.0769 118 1.0636 0.5846 1.0636 1.0313
No log 9.2308 120 1.0364 0.6 1.0364 1.0180
No log 9.3846 122 1.0068 0.5827 1.0068 1.0034
No log 9.5385 124 1.0269 0.5760 1.0269 1.0134
No log 9.6923 126 1.0738 0.5574 1.0738 1.0362
No log 9.8462 128 1.1679 0.5312 1.1679 1.0807
No log 10.0 130 1.2342 0.5469 1.2342 1.1109
No log 10.1538 132 1.1431 0.5378 1.1431 1.0691
No log 10.3077 134 1.0688 0.5574 1.0688 1.0338
No log 10.4615 136 1.0413 0.5484 1.0413 1.0204
No log 10.6154 138 1.1121 0.5781 1.1121 1.0546
No log 10.7692 140 1.2641 0.5156 1.2641 1.1243
No log 10.9231 142 1.1989 0.5606 1.1989 1.0949
No log 11.0769 144 1.0257 0.5827 1.0257 1.0128
No log 11.2308 146 0.9760 0.5938 0.9760 0.9879
No log 11.3846 148 1.0125 0.5625 1.0125 1.0062
No log 11.5385 150 1.0962 0.5496 1.0962 1.0470
No log 11.6923 152 1.1014 0.5692 1.1014 1.0495
No log 11.8462 154 1.0914 0.5873 1.0914 1.0447
No log 12.0 156 1.1489 0.5333 1.1489 1.0719
No log 12.1538 158 1.1486 0.5299 1.1486 1.0717
No log 12.3077 160 1.1330 0.5299 1.1330 1.0644
No log 12.4615 162 1.0991 0.5254 1.0991 1.0484
No log 12.6154 164 1.0170 0.5210 1.0170 1.0085
No log 12.7692 166 0.8927 0.5968 0.8927 0.9448
No log 12.9231 168 0.8150 0.6567 0.8150 0.9028
No log 13.0769 170 0.9098 0.6370 0.9098 0.9538
No log 13.2308 172 0.9373 0.6165 0.9373 0.9681
No log 13.3846 174 1.0533 0.544 1.0533 1.0263
No log 13.5385 176 1.0762 0.5455 1.0762 1.0374
No log 13.6923 178 1.0324 0.5984 1.0324 1.0161
No log 13.8462 180 1.0158 0.6061 1.0158 1.0079
No log 14.0 182 1.0080 0.5827 1.0080 1.0040
No log 14.1538 184 1.0286 0.5455 1.0286 1.0142
No log 14.3077 186 1.0920 0.5000 1.0920 1.0450
No log 14.4615 188 1.1172 0.5082 1.1172 1.0570
No log 14.6154 190 1.0039 0.56 1.0039 1.0019
No log 14.7692 192 1.0031 0.5455 1.0031 1.0015
No log 14.9231 194 1.1771 0.5077 1.1771 1.0849
No log 15.0769 196 1.1740 0.4806 1.1740 1.0835
No log 15.2308 198 1.0642 0.4333 1.0642 1.0316
No log 15.3846 200 1.1044 0.5645 1.1044 1.0509
No log 15.5385 202 1.1526 0.56 1.1526 1.0736
No log 15.6923 204 1.1656 0.5714 1.1656 1.0796
No log 15.8462 206 1.0880 0.5714 1.0880 1.0431
No log 16.0 208 0.9915 0.6154 0.9915 0.9958
No log 16.1538 210 1.0115 0.5891 1.0115 1.0057
No log 16.3077 212 1.1285 0.5397 1.1285 1.0623
No log 16.4615 214 1.2111 0.5397 1.2111 1.1005
No log 16.6154 216 1.1892 0.5366 1.1892 1.0905
No log 16.7692 218 1.1487 0.5210 1.1487 1.0718
No log 16.9231 220 1.0788 0.5691 1.0788 1.0386
No log 17.0769 222 1.0265 0.5484 1.0265 1.0132
No log 17.2308 224 0.9780 0.6617 0.9780 0.9889
No log 17.3846 226 1.0127 0.5846 1.0127 1.0063
No log 17.5385 228 1.0108 0.5496 1.0108 1.0054
No log 17.6923 230 0.9956 0.5496 0.9956 0.9978
No log 17.8462 232 1.0136 0.5846 1.0136 1.0068
No log 18.0 234 1.0026 0.5891 1.0026 1.0013
No log 18.1538 236 1.0330 0.5891 1.0330 1.0164
No log 18.3077 238 1.0296 0.5891 1.0296 1.0147
No log 18.4615 240 0.9383 0.6519 0.9383 0.9687
No log 18.6154 242 0.9259 0.6519 0.9259 0.9622
No log 18.7692 244 0.9545 0.6519 0.9545 0.9770
No log 18.9231 246 1.0408 0.6154 1.0408 1.0202
No log 19.0769 248 1.2367 0.5156 1.2367 1.1121
No log 19.2308 250 1.3020 0.4462 1.3020 1.1411
No log 19.3846 252 1.2406 0.544 1.2406 1.1138
No log 19.5385 254 1.1353 0.5484 1.1353 1.0655
No log 19.6923 256 1.0439 0.624 1.0439 1.0217
No log 19.8462 258 0.9950 0.5806 0.9950 0.9975
No log 20.0 260 0.9777 0.5760 0.9777 0.9888
No log 20.1538 262 0.9784 0.6667 0.9784 0.9891
No log 20.3077 264 1.0972 0.5954 1.0972 1.0475
No log 20.4615 266 1.2346 0.5075 1.2346 1.1111
No log 20.6154 268 1.2520 0.5303 1.2520 1.1189
No log 20.7692 270 1.2184 0.5625 1.2184 1.1038
No log 20.9231 272 1.1491 0.5714 1.1491 1.0720
No log 21.0769 274 1.0320 0.6462 1.0320 1.0159
No log 21.2308 276 0.9577 0.6260 0.9577 0.9786
No log 21.3846 278 0.9395 0.6466 0.9395 0.9693
No log 21.5385 280 1.0001 0.6260 1.0001 1.0000
No log 21.6923 282 1.0482 0.5846 1.0482 1.0238
No log 21.8462 284 1.0683 0.5891 1.0683 1.0336
No log 22.0 286 1.0246 0.6094 1.0246 1.0122
No log 22.1538 288 0.9842 0.6094 0.9842 0.9921
No log 22.3077 290 0.9648 0.6357 0.9648 0.9822
No log 22.4615 292 0.9988 0.6094 0.9988 0.9994
No log 22.6154 294 1.0349 0.5938 1.0349 1.0173
No log 22.7692 296 1.0426 0.6094 1.0426 1.0211
No log 22.9231 298 1.1013 0.5873 1.1013 1.0494
No log 23.0769 300 1.1945 0.5410 1.1945 1.0929
No log 23.2308 302 1.1808 0.5378 1.1808 1.0866
No log 23.3846 304 1.1244 0.5546 1.1244 1.0604
No log 23.5385 306 1.0985 0.5546 1.0985 1.0481
No log 23.6923 308 1.1145 0.5546 1.1145 1.0557
No log 23.8462 310 1.1587 0.5484 1.1587 1.0764
No log 24.0 312 1.2434 0.5538 1.2434 1.1151
No log 24.1538 314 1.2203 0.5344 1.2203 1.1047
No log 24.3077 316 1.0951 0.5873 1.0951 1.0465
No log 24.4615 318 0.9960 0.625 0.9960 0.9980
No log 24.6154 320 0.9924 0.6142 0.9924 0.9962
No log 24.7692 322 1.0249 0.625 1.0249 1.0124
No log 24.9231 324 1.1008 0.5873 1.1008 1.0492
No log 25.0769 326 1.1732 0.5645 1.1732 1.0831
No log 25.2308 328 1.2155 0.5455 1.2155 1.1025
No log 25.3846 330 1.2090 0.5167 1.2090 1.0996
No log 25.5385 332 1.1968 0.5085 1.1968 1.0940
No log 25.6923 334 1.1439 0.5378 1.1439 1.0695
No log 25.8462 336 1.1020 0.5254 1.1020 1.0498
No log 26.0 338 1.1115 0.5254 1.1115 1.0543
No log 26.1538 340 1.1098 0.55 1.1098 1.0534
No log 26.3077 342 1.1324 0.5806 1.1324 1.0641
No log 26.4615 344 1.1195 0.5938 1.1195 1.0581
No log 26.6154 346 1.0987 0.6047 1.0987 1.0482
No log 26.7692 348 1.0242 0.6512 1.0242 1.0120
No log 26.9231 350 0.9875 0.6406 0.9875 0.9937
No log 27.0769 352 1.0023 0.6190 1.0023 1.0012
No log 27.2308 354 1.0152 0.6190 1.0152 1.0075
No log 27.3846 356 1.0196 0.6512 1.0196 1.0097
No log 27.5385 358 1.0227 0.6308 1.0227 1.0113
No log 27.6923 360 1.0047 0.6308 1.0047 1.0023
No log 27.8462 362 0.9866 0.6512 0.9866 0.9933
No log 28.0 364 0.9613 0.6142 0.9613 0.9804
No log 28.1538 366 0.9707 0.6512 0.9707 0.9852
No log 28.3077 368 1.0162 0.6406 1.0162 1.0081
No log 28.4615 370 1.0329 0.6357 1.0329 1.0163
No log 28.6154 372 1.0590 0.6094 1.0590 1.0291
No log 28.7692 374 1.0990 0.6094 1.0990 1.0483
No log 28.9231 376 1.1203 0.6094 1.1203 1.0585
No log 29.0769 378 1.0988 0.6094 1.0988 1.0483
No log 29.2308 380 1.0958 0.6154 1.0958 1.0468
No log 29.3846 382 1.0257 0.6412 1.0257 1.0128
No log 29.5385 384 0.9581 0.6515 0.9581 0.9788
No log 29.6923 386 0.9538 0.6515 0.9538 0.9766
No log 29.8462 388 1.0066 0.6515 1.0066 1.0033
No log 30.0 390 1.0653 0.6202 1.0653 1.0321
No log 30.1538 392 1.1202 0.5645 1.1202 1.0584
No log 30.3077 394 1.1331 0.5289 1.1331 1.0645
No log 30.4615 396 1.1017 0.5574 1.1017 1.0496
No log 30.6154 398 1.0450 0.6406 1.0450 1.0223
No log 30.7692 400 1.0533 0.625 1.0533 1.0263
No log 30.9231 402 1.1167 0.6154 1.1167 1.0568
No log 31.0769 404 1.1115 0.6154 1.1115 1.0543
No log 31.2308 406 1.0613 0.6260 1.0613 1.0302
No log 31.3846 408 1.0491 0.6260 1.0491 1.0242
No log 31.5385 410 1.0544 0.6515 1.0544 1.0269
No log 31.6923 412 1.0468 0.6406 1.0468 1.0231
No log 31.8462 414 1.0614 0.6129 1.0614 1.0302
No log 32.0 416 1.0778 0.6032 1.0778 1.0382
No log 32.1538 418 1.1322 0.56 1.1322 1.0640
No log 32.3077 420 1.1547 0.5669 1.1547 1.0746
No log 32.4615 422 1.1130 0.5512 1.1130 1.0550
No log 32.6154 424 1.0970 0.5512 1.0970 1.0474
No log 32.7692 426 1.0550 0.6047 1.0550 1.0272
No log 32.9231 428 1.0732 0.6260 1.0732 1.0359
No log 33.0769 430 1.0683 0.6260 1.0683 1.0336
No log 33.2308 432 1.0613 0.6260 1.0613 1.0302
No log 33.3846 434 1.0324 0.6617 1.0324 1.0161
No log 33.5385 436 1.0318 0.6094 1.0318 1.0158
No log 33.6923 438 1.0377 0.6202 1.0377 1.0187
No log 33.8462 440 1.0597 0.6260 1.0597 1.0294
No log 34.0 442 1.0667 0.6260 1.0667 1.0328
No log 34.1538 444 1.0325 0.6047 1.0325 1.0161
No log 34.3077 446 0.9682 0.6364 0.9682 0.9840
No log 34.4615 448 0.9548 0.5891 0.9548 0.9771
No log 34.6154 450 0.9546 0.6 0.9546 0.9770
No log 34.7692 452 0.9154 0.6364 0.9154 0.9568
No log 34.9231 454 0.9065 0.6515 0.9065 0.9521
No log 35.0769 456 1.0139 0.6765 1.0139 1.0069
No log 35.2308 458 1.2056 0.4706 1.2056 1.0980
No log 35.3846 460 1.3113 0.4638 1.3113 1.1451
No log 35.5385 462 1.2824 0.4638 1.2824 1.1324
No log 35.6923 464 1.1688 0.4889 1.1688 1.0811
No log 35.8462 466 1.0560 0.6466 1.0560 1.0276
No log 36.0 468 0.9463 0.6767 0.9463 0.9728
No log 36.1538 470 0.9203 0.6357 0.9203 0.9593
No log 36.3077 472 0.9418 0.5920 0.9418 0.9705
No log 36.4615 474 0.9655 0.6190 0.9655 0.9826
No log 36.6154 476 1.0024 0.6349 1.0024 1.0012
No log 36.7692 478 1.0736 0.625 1.0736 1.0362
No log 36.9231 480 1.1813 0.5758 1.1813 1.0869
No log 37.0769 482 1.2212 0.5224 1.2212 1.1051
No log 37.2308 484 1.1506 0.5455 1.1506 1.0727
No log 37.3846 486 1.0486 0.6308 1.0486 1.0240
No log 37.5385 488 0.9972 0.6565 0.9972 0.9986
No log 37.6923 490 0.9792 0.6615 0.9792 0.9895
No log 37.8462 492 0.9589 0.6615 0.9589 0.9792
No log 38.0 494 0.9517 0.6617 0.9517 0.9755
No log 38.1538 496 0.9850 0.6716 0.9850 0.9925
No log 38.3077 498 1.0294 0.6260 1.0294 1.0146
0.2816 38.4615 500 1.0496 0.6260 1.0496 1.0245
0.2816 38.6154 502 1.0295 0.6154 1.0295 1.0146
0.2816 38.7692 504 0.9851 0.6515 0.9851 0.9925
0.2816 38.9231 506 0.9701 0.6667 0.9701 0.9849
0.2816 39.0769 508 1.0121 0.6202 1.0121 1.0060
0.2816 39.2308 510 1.0302 0.6202 1.0302 1.0150
0.2816 39.3846 512 1.0021 0.5827 1.0021 1.0011
0.2816 39.5385 514 0.9662 0.625 0.9662 0.9830
0.2816 39.6923 516 0.9627 0.6129 0.9627 0.9812

Framework versions

  • Transformers 4.44.2
  • Pytorch 2.4.0+cu118
  • Datasets 2.21.0
  • Tokenizers 0.19.1