Hugging Face's logo

MayBashendy
/
ArabicNewSplits7_OSS_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k11_task1_organization

Text Classification
Transformers
Safetensors
bert
Generated from Trainer
Inference Endpoints
Model card Files Community
ArabicNewSplits7_OSS_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k11_task1_organization / README.md
MayBashendy's picture
MayBashendy
End of training
9b967c5 verified
preview code
|
raw
history blame contribute delete
21.9 kB
metadata
library_name: transformers
base_model: aubmindlab/bert-base-arabertv02
tags:
  - generated_from_trainer
model-index:
  - name: >-
      ArabicNewSplits7_OSS_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k11_task1_organization
    results: []

ArabicNewSplits7_OSS_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k11_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

  • Loss: 0.8464
  • Qwk: 0.6755
  • Mse: 0.8464
  • Rmse: 0.9200

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • learning_rate: 2e-05
  • train_batch_size: 8
  • eval_batch_size: 8
  • seed: 42
  • optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  • lr_scheduler_type: linear
  • num_epochs: 100

Training results

Training Loss Epoch Step Validation Loss Qwk Mse Rmse
No log 0.0244 2 7.6165 -0.0256 7.6165 2.7598
No log 0.0488 4 4.9018 0.0519 4.9018 2.2140
No log 0.0732 6 3.3316 0.0860 3.3316 1.8253
No log 0.0976 8 2.0935 0.2462 2.0935 1.4469
No log 0.1220 10 1.8309 0.1495 1.8309 1.3531
No log 0.1463 12 1.6642 0.1538 1.6642 1.2900
No log 0.1707 14 1.6474 0.1165 1.6474 1.2835
No log 0.1951 16 1.5831 0.0784 1.5831 1.2582
No log 0.2195 18 1.4829 0.2075 1.4829 1.2177
No log 0.2439 20 1.4671 0.1905 1.4671 1.2112
No log 0.2683 22 1.4567 0.2364 1.4567 1.2069
No log 0.2927 24 1.3252 0.2857 1.3252 1.1512
No log 0.3171 26 1.1934 0.2857 1.1934 1.0924
No log 0.3415 28 1.1724 0.4211 1.1724 1.0828
No log 0.3659 30 1.1860 0.4348 1.1860 1.0890
No log 0.3902 32 1.0245 0.5512 1.0245 1.0122
No log 0.4146 34 1.0117 0.544 1.0117 1.0058
No log 0.4390 36 1.2305 0.5000 1.2305 1.1093
No log 0.4634 38 1.7426 0.2381 1.7426 1.3201
No log 0.4878 40 1.9963 0.2794 1.9963 1.4129
No log 0.5122 42 1.9076 0.3571 1.9076 1.3811
No log 0.5366 44 1.8613 0.3803 1.8613 1.3643
No log 0.5610 46 1.3423 0.4706 1.3423 1.1586
No log 0.5854 48 1.0859 0.5 1.0859 1.0421
No log 0.6098 50 0.9909 0.6047 0.9909 0.9954
No log 0.6341 52 1.0012 0.6154 1.0012 1.0006
No log 0.6585 54 1.0941 0.5865 1.0941 1.0460
No log 0.6829 56 1.1556 0.5857 1.1556 1.0750
No log 0.7073 58 1.0671 0.5692 1.0671 1.0330
No log 0.7317 60 0.9920 0.6154 0.9920 0.9960
No log 0.7561 62 1.0068 0.6466 1.0068 1.0034
No log 0.7805 64 1.1685 0.5735 1.1685 1.0810
No log 0.8049 66 1.1926 0.5827 1.1926 1.0921
No log 0.8293 68 1.1983 0.5344 1.1983 1.0947
No log 0.8537 70 1.1960 0.5147 1.1960 1.0936
No log 0.8780 72 1.2415 0.5571 1.2415 1.1142
No log 0.9024 74 1.1956 0.5652 1.1956 1.0934
No log 0.9268 76 1.1764 0.5547 1.1764 1.0846
No log 0.9512 78 1.2871 0.5072 1.2871 1.1345
No log 0.9756 80 1.3635 0.4853 1.3635 1.1677
No log 1.0 82 1.2743 0.5455 1.2743 1.1288
No log 1.0244 84 1.1181 0.5649 1.1181 1.0574
No log 1.0488 86 1.0023 0.5865 1.0023 1.0011
No log 1.0732 88 0.9497 0.6471 0.9497 0.9745
No log 1.0976 90 0.9949 0.6074 0.9949 0.9974
No log 1.1220 92 1.0148 0.6061 1.0148 1.0074
No log 1.1463 94 1.1205 0.5839 1.1205 1.0585
No log 1.1707 96 1.0986 0.5778 1.0986 1.0481
No log 1.1951 98 1.0460 0.5649 1.0460 1.0227
No log 1.2195 100 1.0453 0.6119 1.0453 1.0224
No log 1.2439 102 1.1340 0.5931 1.1340 1.0649
No log 1.2683 104 1.1541 0.5957 1.1541 1.0743
No log 1.2927 106 1.0553 0.6111 1.0553 1.0273
No log 1.3171 108 1.0141 0.6081 1.0141 1.0070
No log 1.3415 110 0.9003 0.6892 0.9003 0.9489
No log 1.3659 112 0.9160 0.6792 0.9160 0.9571
No log 1.3902 114 0.8782 0.6795 0.8782 0.9371
No log 1.4146 116 0.8832 0.6573 0.8832 0.9398
No log 1.4390 118 1.1524 0.6375 1.1524 1.0735
No log 1.4634 120 1.3371 0.625 1.3371 1.1563
No log 1.4878 122 1.2287 0.6506 1.2287 1.1085
No log 1.5122 124 0.9339 0.6364 0.9339 0.9664
No log 1.5366 126 0.7977 0.6515 0.7977 0.8931
No log 1.5610 128 0.8250 0.6617 0.8250 0.9083
No log 1.5854 130 0.8447 0.6519 0.8447 0.9191
No log 1.6098 132 0.8952 0.6715 0.8952 0.9461
No log 1.6341 134 0.9761 0.6043 0.9761 0.9880
No log 1.6585 136 1.1902 0.5839 1.1902 1.0910
No log 1.6829 138 1.2350 0.5714 1.2350 1.1113
No log 1.7073 140 1.2820 0.5795 1.2820 1.1323
No log 1.7317 142 1.3277 0.5650 1.3277 1.1523
No log 1.7561 144 1.2380 0.6024 1.2380 1.1127
No log 1.7805 146 1.0942 0.6099 1.0942 1.0460
No log 1.8049 148 0.8698 0.6107 0.8698 0.9326
No log 1.8293 150 0.8496 0.6202 0.8496 0.9218
No log 1.8537 152 0.8618 0.625 0.8618 0.9283
No log 1.8780 154 0.9836 0.6767 0.9836 0.9917
No log 1.9024 156 1.1339 0.5594 1.1339 1.0648
No log 1.9268 158 1.1433 0.6627 1.1433 1.0693
No log 1.9512 160 0.9125 0.7066 0.9125 0.9553
No log 1.9756 162 0.9019 0.6933 0.9019 0.9497
No log 2.0 164 0.8926 0.6933 0.8926 0.9448
No log 2.0244 166 0.9515 0.6842 0.9515 0.9755
No log 2.0488 168 1.0819 0.6369 1.0819 1.0402
No log 2.0732 170 1.0885 0.5890 1.0885 1.0433
No log 2.0976 172 0.8934 0.6809 0.8934 0.9452
No log 2.1220 174 0.8617 0.7050 0.8617 0.9283
No log 2.1463 176 0.8625 0.6765 0.8625 0.9287
No log 2.1707 178 0.9199 0.6316 0.9199 0.9591
No log 2.1951 180 0.9402 0.5865 0.9402 0.9696
No log 2.2195 182 0.9922 0.625 0.9922 0.9961
No log 2.2439 184 1.2184 0.6386 1.2184 1.1038
No log 2.2683 186 1.3164 0.6592 1.3164 1.1473
No log 2.2927 188 1.0609 0.6667 1.0609 1.0300
No log 2.3171 190 0.7818 0.6301 0.7818 0.8842
No log 2.3415 192 0.7664 0.6528 0.7664 0.8755
No log 2.3659 194 0.7689 0.6423 0.7689 0.8769
No log 2.3902 196 1.0288 0.6538 1.0288 1.0143
No log 2.4146 198 1.2157 0.5926 1.2157 1.1026
No log 2.4390 200 1.0564 0.6345 1.0564 1.0278
No log 2.4634 202 0.9115 0.6131 0.9115 0.9547
No log 2.4878 204 0.8351 0.6618 0.8351 0.9138
No log 2.5122 206 0.8553 0.6618 0.8553 0.9248
No log 2.5366 208 0.8209 0.6569 0.8209 0.9060
No log 2.5610 210 0.7635 0.6714 0.7635 0.8738
No log 2.5854 212 0.8193 0.6761 0.8193 0.9051
No log 2.6098 214 1.0372 0.6486 1.0372 1.0184
No log 2.6341 216 1.1746 0.6145 1.1746 1.0838
No log 2.6585 218 1.0083 0.6711 1.0083 1.0041
No log 2.6829 220 0.7721 0.6569 0.7721 0.8787
No log 2.7073 222 0.7570 0.6866 0.7570 0.8701
No log 2.7317 224 0.7902 0.6715 0.7902 0.8889
No log 2.7561 226 0.8144 0.6423 0.8144 0.9024
No log 2.7805 228 0.7433 0.6715 0.7433 0.8622
No log 2.8049 230 0.7336 0.6957 0.7336 0.8565
No log 2.8293 232 0.7767 0.6429 0.7767 0.8813
No log 2.8537 234 0.8307 0.6429 0.8307 0.9114
No log 2.8780 236 0.7697 0.6857 0.7697 0.8773
No log 2.9024 238 0.6946 0.6950 0.6946 0.8334
No log 2.9268 240 0.6784 0.6944 0.6784 0.8237
No log 2.9512 242 0.7771 0.7081 0.7771 0.8815
No log 2.9756 244 0.9807 0.6946 0.9807 0.9903
No log 3.0 246 0.9268 0.6443 0.9268 0.9627
No log 3.0244 248 0.8223 0.6763 0.8223 0.9068
No log 3.0488 250 0.7872 0.7153 0.7872 0.8873
No log 3.0732 252 0.8334 0.6761 0.8334 0.9129
No log 3.0976 254 1.0119 0.6541 1.0119 1.0059
No log 3.1220 256 1.1239 0.6429 1.1239 1.0601
No log 3.1463 258 1.0480 0.6824 1.0480 1.0237
No log 3.1707 260 0.9033 0.6790 0.9033 0.9504
No log 3.1951 262 0.8150 0.6429 0.8150 0.9028
No log 3.2195 264 0.8084 0.6522 0.8084 0.8991
No log 3.2439 266 0.8299 0.6377 0.8299 0.9110
No log 3.2683 268 0.8824 0.6519 0.8824 0.9394
No log 3.2927 270 0.8832 0.6528 0.8832 0.9398
No log 3.3171 272 0.8433 0.6389 0.8433 0.9183
No log 3.3415 274 0.8276 0.6301 0.8276 0.9097
No log 3.3659 276 0.7838 0.6119 0.7838 0.8853
No log 3.3902 278 0.7763 0.6912 0.7763 0.8811
No log 3.4146 280 0.9018 0.6914 0.9018 0.9496
No log 3.4390 282 1.0291 0.6786 1.0291 1.0144
No log 3.4634 284 1.0116 0.6786 1.0116 1.0058
No log 3.4878 286 0.8722 0.6918 0.8722 0.9339
No log 3.5122 288 0.7671 0.7347 0.7671 0.8759
No log 3.5366 290 0.7363 0.7034 0.7363 0.8581
No log 3.5610 292 0.7529 0.6846 0.7529 0.8677
No log 3.5854 294 0.7677 0.6950 0.7677 0.8762
No log 3.6098 296 0.7775 0.6713 0.7775 0.8818
No log 3.6341 298 0.8949 0.6667 0.8949 0.9460
No log 3.6585 300 1.1345 0.6538 1.1345 1.0651
No log 3.6829 302 1.1516 0.5793 1.1516 1.0731
No log 3.7073 304 0.9584 0.6269 0.9584 0.9790
No log 3.7317 306 0.8727 0.6357 0.8727 0.9342
No log 3.7561 308 0.8492 0.5760 0.8492 0.9215
No log 3.7805 310 0.8615 0.6202 0.8615 0.9282
No log 3.8049 312 1.0254 0.64 1.0254 1.0126
No log 3.8293 314 1.3184 0.5943 1.3184 1.1482
No log 3.8537 316 1.3347 0.5909 1.3347 1.1553
No log 3.8780 318 1.2526 0.6279 1.2526 1.1192
No log 3.9024 320 1.0347 0.6289 1.0347 1.0172
No log 3.9268 322 0.8660 0.6154 0.8660 0.9306
No log 3.9512 324 0.8792 0.6154 0.8792 0.9377
No log 3.9756 326 0.9155 0.6154 0.9155 0.9568
No log 4.0 328 0.9295 0.5954 0.9295 0.9641
No log 4.0244 330 0.8827 0.6061 0.8827 0.9395
No log 4.0488 332 0.8483 0.6324 0.8483 0.9210
No log 4.0732 334 0.9358 0.6267 0.9358 0.9674
No log 4.0976 336 0.8839 0.6624 0.8839 0.9401
No log 4.1220 338 0.8292 0.6792 0.8292 0.9106
No log 4.1463 340 0.7474 0.7114 0.7474 0.8646
No log 4.1707 342 0.7325 0.7338 0.7325 0.8558
No log 4.1951 344 0.7360 0.7101 0.7360 0.8579
No log 4.2195 346 0.7580 0.6861 0.7580 0.8707
No log 4.2439 348 0.8582 0.6575 0.8582 0.9264
No log 4.2683 350 0.9010 0.6490 0.9010 0.9492
No log 4.2927 352 0.8493 0.6331 0.8493 0.9216
No log 4.3171 354 0.8848 0.6316 0.8848 0.9406
No log 4.3415 356 0.9025 0.6074 0.9025 0.9500
No log 4.3659 358 0.9107 0.6176 0.9107 0.9543
No log 4.3902 360 0.9632 0.6099 0.9632 0.9814
No log 4.4146 362 0.9728 0.5931 0.9728 0.9863
No log 4.4390 364 0.9274 0.6400 0.9274 0.9630
No log 4.4634 366 0.8939 0.6528 0.8939 0.9455
No log 4.4878 368 0.8161 0.6522 0.8161 0.9034
No log 4.5122 370 0.8077 0.6364 0.8077 0.8987
No log 4.5366 372 0.8089 0.6308 0.8089 0.8994
No log 4.5610 374 0.8337 0.6716 0.8337 0.9130
No log 4.5854 376 1.0006 0.6309 1.0006 1.0003
No log 4.6098 378 1.1286 0.6289 1.1286 1.0624
No log 4.6341 380 1.1534 0.6548 1.1534 1.0740
No log 4.6585 382 0.9705 0.6452 0.9705 0.9852
No log 4.6829 384 0.7981 0.6519 0.7981 0.8934
No log 4.7073 386 0.7707 0.6917 0.7707 0.8779
No log 4.7317 388 0.7582 0.6917 0.7582 0.8708
No log 4.7561 390 0.7701 0.6906 0.7701 0.8776
No log 4.7805 392 0.9190 0.6875 0.9190 0.9587
No log 4.8049 394 1.0723 0.6471 1.0723 1.0355
No log 4.8293 396 1.0019 0.7093 1.0019 1.0010
No log 4.8537 398 0.8132 0.7186 0.8132 0.9018
No log 4.8780 400 0.7199 0.6849 0.7199 0.8485
No log 4.9024 402 0.7359 0.7059 0.7359 0.8579
No log 4.9268 404 0.7706 0.6818 0.7706 0.8778
No log 4.9512 406 0.7969 0.6718 0.7969 0.8927
No log 4.9756 408 0.9296 0.6525 0.9296 0.9642
No log 5.0 410 1.1808 0.5802 1.1808 1.0866
No log 5.0244 412 1.3288 0.5488 1.3288 1.1527
No log 5.0488 414 1.2418 0.5034 1.2418 1.1144
No log 5.0732 416 1.1527 0.5954 1.1527 1.0736
No log 5.0976 418 1.0989 0.6412 1.0989 1.0483
No log 5.1220 420 1.1049 0.6364 1.1049 1.0511
No log 5.1463 422 1.1341 0.5833 1.1341 1.0650
No log 5.1707 424 1.1316 0.6259 1.1316 1.0638
No log 5.1951 426 1.1481 0.6242 1.1481 1.0715
No log 5.2195 428 1.0562 0.6405 1.0562 1.0277
No log 5.2439 430 0.8647 0.6383 0.8647 0.9299
No log 5.2683 432 0.7759 0.7101 0.7759 0.8808
No log 5.2927 434 0.7609 0.6861 0.7609 0.8723
No log 5.3171 436 0.7920 0.6853 0.7920 0.8899
No log 5.3415 438 0.7818 0.7 0.7818 0.8842
No log 5.3659 440 0.7644 0.7194 0.7644 0.8743
No log 5.3902 442 0.7782 0.7234 0.7782 0.8821
No log 5.4146 444 0.7950 0.7143 0.7950 0.8916
No log 5.4390 446 0.8467 0.7143 0.8467 0.9201
No log 5.4634 448 0.8668 0.6765 0.8668 0.9310
No log 5.4878 450 0.8624 0.6667 0.8624 0.9286
No log 5.5122 452 0.8755 0.6667 0.8755 0.9357
No log 5.5366 454 0.9514 0.6395 0.9514 0.9754
No log 5.5610 456 0.9966 0.6093 0.9966 0.9983
No log 5.5854 458 1.0195 0.6335 1.0195 1.0097
No log 5.6098 460 0.9353 0.6667 0.9353 0.9671
No log 5.6341 462 0.7721 0.7183 0.7721 0.8787
No log 5.6585 464 0.7060 0.7429 0.7060 0.8402
No log 5.6829 466 0.6737 0.7299 0.6737 0.8208
No log 5.7073 468 0.6647 0.7429 0.6647 0.8153
No log 5.7317 470 0.7131 0.7310 0.7131 0.8445
No log 5.7561 472 0.7636 0.7531 0.7636 0.8739
No log 5.7805 474 0.7277 0.7355 0.7277 0.8531
No log 5.8049 476 0.6934 0.7273 0.6934 0.8327
No log 5.8293 478 0.7459 0.7183 0.7459 0.8637
No log 5.8537 480 0.8362 0.6906 0.8362 0.9144
No log 5.8780 482 0.8880 0.6906 0.8880 0.9423
No log 5.9024 484 0.8536 0.6906 0.8536 0.9239
No log 5.9268 486 0.8010 0.7 0.8010 0.8950
No log 5.9512 488 0.8100 0.6901 0.8100 0.9000
No log 5.9756 490 0.8426 0.6986 0.8426 0.9179
No log 6.0 492 0.8930 0.6846 0.8930 0.9450
No log 6.0244 494 0.8467 0.7 0.8467 0.9202
No log 6.0488 496 0.8101 0.7 0.8101 0.9000
No log 6.0732 498 0.7571 0.7101 0.7571 0.8701
0.4196 6.0976 500 0.7238 0.7518 0.7238 0.8507
0.4196 6.1220 502 0.7168 0.7015 0.7168 0.8466
0.4196 6.1463 504 0.7218 0.6667 0.7218 0.8496
0.4196 6.1707 506 0.7034 0.6912 0.7034 0.8387
0.4196 6.1951 508 0.7578 0.6857 0.7578 0.8705
0.4196 6.2195 510 0.8464 0.6755 0.8464 0.9200

Framework versions

  • Transformers 4.44.2
  • Pytorch 2.4.0+cu118
  • Datasets 2.21.0
  • Tokenizers 0.19.1