Hugging Face's logo

salbatarni
/
arabert_cross_relevance_task4_fold2

TensorBoard
Safetensors
bert
Generated from Trainer
Model card Files Metrics Community
salbatarni commited on
Commit
ada303b
·
verified ·
1 Parent(s): 458917e

End of training

Browse files
Files changed (1) hide show
  1. README.md +97 -92
README.md CHANGED
@@ -3,20 +3,20 @@ base_model: aubmindlab/bert-base-arabertv02
3
  tags:
4
  - generated_from_trainer
5
  model-index:
6
- - name: arabert_cross_relevance_task4_fold1
7
  results: []
8
  ---
9
 
10
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
11
  should probably proofread and complete it, then remove this comment. -->
12
 
13
- # arabert_cross_relevance_task4_fold1
14
 
15
  This model is a fine-tuned version of [aubmindlab/bert-base-arabertv02](https://huggingface.co/aubmindlab/bert-base-arabertv02) on the None dataset.
16
  It achieves the following results on the evaluation set:
17
- - Loss: 0.1626
18
- - Qwk: 0.0272
19
- - Mse: 0.1626
20
 
21
  ## Model description
22
 
@@ -45,93 +45,98 @@ The following hyperparameters were used during training:
45
 
46
  ### Training results
47
 
48
- | Training Loss | Epoch | Step | Validation Loss | Qwk | Mse |
49
- |:-------------:|:------:|:----:|:---------------:|:------:|:------:|
50
- | No log | 0.1176 | 2 | 0.6734 | 0.0010 | 0.6734 |
51
- | No log | 0.2353 | 4 | 0.1546 | 0.0127 | 0.1546 |
52
- | No log | 0.3529 | 6 | 0.1344 | 0.0033 | 0.1344 |
53
- | No log | 0.4706 | 8 | 0.2292 | 0.0185 | 0.2292 |
54
- | No log | 0.5882 | 10 | 0.2260 | 0.0185 | 0.2260 |
55
- | No log | 0.7059 | 12 | 0.1786 | 0.0273 | 0.1786 |
56
- | No log | 0.8235 | 14 | 0.1782 | 0.0359 | 0.1782 |
57
- | No log | 0.9412 | 16 | 0.1951 | 0.0339 | 0.1951 |
58
- | No log | 1.0588 | 18 | 0.2431 | 0.0300 | 0.2431 |
59
- | No log | 1.1765 | 20 | 0.2607 | 0.0228 | 0.2607 |
60
- | No log | 1.2941 | 22 | 0.1938 | 0.0332 | 0.1938 |
61
- | No log | 1.4118 | 24 | 0.1436 | 0.0511 | 0.1436 |
62
- | No log | 1.5294 | 26 | 0.1294 | 0.0733 | 0.1294 |
63
- | No log | 1.6471 | 28 | 0.1285 | 0.0553 | 0.1285 |
64
- | No log | 1.7647 | 30 | 0.1515 | 0.0273 | 0.1515 |
65
- | No log | 1.8824 | 32 | 0.1764 | 0.0273 | 0.1764 |
66
- | No log | 2.0 | 34 | 0.1880 | 0.0273 | 0.1880 |
67
- | No log | 2.1176 | 36 | 0.1700 | 0.0254 | 0.1700 |
68
- | No log | 2.2353 | 38 | 0.1359 | 0.0273 | 0.1359 |
69
- | No log | 2.3529 | 40 | 0.1300 | 0.0307 | 0.1300 |
70
- | No log | 2.4706 | 42 | 0.1359 | 0.0304 | 0.1359 |
71
- | No log | 2.5882 | 44 | 0.1557 | 0.0319 | 0.1557 |
72
- | No log | 2.7059 | 46 | 0.1602 | 0.0335 | 0.1602 |
73
- | No log | 2.8235 | 48 | 0.1456 | 0.0423 | 0.1456 |
74
- | No log | 2.9412 | 50 | 0.1501 | 0.0339 | 0.1501 |
75
- | No log | 3.0588 | 52 | 0.1611 | 0.0339 | 0.1611 |
76
- | No log | 3.1765 | 54 | 0.1440 | 0.0355 | 0.1440 |
77
- | No log | 3.2941 | 56 | 0.1348 | 0.0441 | 0.1348 |
78
- | No log | 3.4118 | 58 | 0.1332 | 0.0475 | 0.1332 |
79
- | No log | 3.5294 | 60 | 0.1443 | 0.0458 | 0.1443 |
80
- | No log | 3.6471 | 62 | 0.1652 | 0.0389 | 0.1652 |
81
- | No log | 3.7647 | 64 | 0.1647 | 0.0458 | 0.1647 |
82
- | No log | 3.8824 | 66 | 0.1513 | 0.0529 | 0.1513 |
83
- | No log | 4.0 | 68 | 0.1475 | 0.0603 | 0.1475 |
84
- | No log | 4.1176 | 70 | 0.1571 | 0.0510 | 0.1571 |
85
- | No log | 4.2353 | 72 | 0.1593 | 0.0529 | 0.1593 |
86
- | No log | 4.3529 | 74 | 0.1445 | 0.0510 | 0.1445 |
87
- | No log | 4.4706 | 76 | 0.1337 | 0.0675 | 0.1337 |
88
- | No log | 4.5882 | 78 | 0.1314 | 0.0614 | 0.1314 |
89
- | No log | 4.7059 | 80 | 0.1364 | 0.0516 | 0.1364 |
90
- | No log | 4.8235 | 82 | 0.1610 | 0.0406 | 0.1610 |
91
- | No log | 4.9412 | 84 | 0.1875 | 0.0355 | 0.1875 |
92
- | No log | 5.0588 | 86 | 0.1836 | 0.0335 | 0.1836 |
93
- | No log | 5.1765 | 88 | 0.1626 | 0.0389 | 0.1626 |
94
- | No log | 5.2941 | 90 | 0.1440 | 0.0493 | 0.1440 |
95
- | No log | 5.4118 | 92 | 0.1353 | 0.0939 | 0.1353 |
96
- | No log | 5.5294 | 94 | 0.1367 | 0.1075 | 0.1367 |
97
- | No log | 5.6471 | 96 | 0.1399 | 0.0853 | 0.1399 |
98
- | No log | 5.7647 | 98 | 0.1521 | 0.0470 | 0.1521 |
99
- | No log | 5.8824 | 100 | 0.1665 | 0.0352 | 0.1665 |
100
- | No log | 6.0 | 102 | 0.1631 | 0.0372 | 0.1631 |
101
- | No log | 6.1176 | 104 | 0.1511 | 0.0372 | 0.1511 |
102
- | No log | 6.2353 | 106 | 0.1430 | 0.0463 | 0.1430 |
103
- | No log | 6.3529 | 108 | 0.1385 | 0.0708 | 0.1385 |
104
- | No log | 6.4706 | 110 | 0.1378 | 0.1029 | 0.1378 |
105
- | No log | 6.5882 | 112 | 0.1410 | 0.0775 | 0.1410 |
106
- | No log | 6.7059 | 114 | 0.1514 | 0.0515 | 0.1514 |
107
- | No log | 6.8235 | 116 | 0.1742 | 0.0351 | 0.1742 |
108
- | No log | 6.9412 | 118 | 0.1831 | 0.0317 | 0.1831 |
109
- | No log | 7.0588 | 120 | 0.1684 | 0.0347 | 0.1684 |
110
- | No log | 7.1765 | 122 | 0.1531 | 0.0652 | 0.1531 |
111
- | No log | 7.2941 | 124 | 0.1443 | 0.0679 | 0.1443 |
112
- | No log | 7.4118 | 126 | 0.1417 | 0.0749 | 0.1417 |
113
- | No log | 7.5294 | 128 | 0.1432 | 0.0618 | 0.1432 |
114
- | No log | 7.6471 | 130 | 0.1495 | 0.0614 | 0.1495 |
115
- | No log | 7.7647 | 132 | 0.1521 | 0.0495 | 0.1521 |
116
- | No log | 7.8824 | 134 | 0.1575 | 0.0420 | 0.1575 |
117
- | No log | 8.0 | 136 | 0.1621 | 0.0415 | 0.1621 |
118
- | No log | 8.1176 | 138 | 0.1649 | 0.0360 | 0.1649 |
119
- | No log | 8.2353 | 140 | 0.1614 | 0.0397 | 0.1614 |
120
- | No log | 8.3529 | 142 | 0.1589 | 0.0415 | 0.1589 |
121
- | No log | 8.4706 | 144 | 0.1604 | 0.0397 | 0.1604 |
122
- | No log | 8.5882 | 146 | 0.1587 | 0.0420 | 0.1587 |
123
- | No log | 8.7059 | 148 | 0.1531 | 0.0457 | 0.1531 |
124
- | No log | 8.8235 | 150 | 0.1511 | 0.0515 | 0.1511 |
125
- | No log | 8.9412 | 152 | 0.1466 | 0.0614 | 0.1466 |
126
- | No log | 9.0588 | 154 | 0.1458 | 0.0514 | 0.1458 |
127
- | No log | 9.1765 | 156 | 0.1471 | 0.0514 | 0.1471 |
128
- | No log | 9.2941 | 158 | 0.1511 | 0.0495 | 0.1511 |
129
- | No log | 9.4118 | 160 | 0.1570 | 0.0438 | 0.1570 |
130
- | No log | 9.5294 | 162 | 0.1612 | 0.0290 | 0.1612 |
131
- | No log | 9.6471 | 164 | 0.1642 | 0.0272 | 0.1642 |
132
- | No log | 9.7647 | 166 | 0.1639 | 0.0272 | 0.1639 |
133
- | No log | 9.8824 | 168 | 0.1630 | 0.0272 | 0.1630 |
134
- | No log | 10.0 | 170 | 0.1626 | 0.0272 | 0.1626 |
 
 
 
 
 
135
 
136
 
137
  ### Framework versions
 
3
  tags:
4
  - generated_from_trainer
5
  model-index:
6
+ - name: arabert_cross_relevance_task4_fold2
7
  results: []
8
  ---
9
 
10
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
11
  should probably proofread and complete it, then remove this comment. -->
12
 
13
+ # arabert_cross_relevance_task4_fold2
14
 
15
  This model is a fine-tuned version of [aubmindlab/bert-base-arabertv02](https://huggingface.co/aubmindlab/bert-base-arabertv02) on the None dataset.
16
  It achieves the following results on the evaluation set:
17
+ - Loss: 0.4752
18
+ - Qwk: 0.1093
19
+ - Mse: 0.4759
20
 
21
  ## Model description
22
 
 
45
 
46
  ### Training results
47
 
48
+ | Training Loss | Epoch | Step | Validation Loss | Qwk | Mse |
49
+ |:-------------:|:------:|:----:|:---------------:|:-------:|:------:|
50
+ | No log | 0.1111 | 2 | 0.5785 | 0.0868 | 0.5777 |
51
+ | No log | 0.2222 | 4 | 0.2943 | -0.0164 | 0.2947 |
52
+ | No log | 0.3333 | 6 | 0.3987 | 0.0024 | 0.3993 |
53
+ | No log | 0.4444 | 8 | 0.3899 | 0.0752 | 0.3904 |
54
+ | No log | 0.5556 | 10 | 0.3473 | -0.0042 | 0.3477 |
55
+ | No log | 0.6667 | 12 | 0.4204 | 0.0370 | 0.4209 |
56
+ | No log | 0.7778 | 14 | 0.5631 | -0.0284 | 0.5638 |
57
+ | No log | 0.8889 | 16 | 0.5554 | -0.0028 | 0.5561 |
58
+ | No log | 1.0 | 18 | 0.5578 | 0.0426 | 0.5584 |
59
+ | No log | 1.1111 | 20 | 0.4455 | 0.0325 | 0.4461 |
60
+ | No log | 1.2222 | 22 | 0.3963 | 0.0368 | 0.3969 |
61
+ | No log | 1.3333 | 24 | 0.3919 | 0.0243 | 0.3924 |
62
+ | No log | 1.4444 | 26 | 0.4089 | 0.0665 | 0.4094 |
63
+ | No log | 1.5556 | 28 | 0.3918 | 0.0619 | 0.3923 |
64
+ | No log | 1.6667 | 30 | 0.4355 | -0.0079 | 0.4360 |
65
+ | No log | 1.7778 | 32 | 0.4965 | 0.1166 | 0.4971 |
66
+ | No log | 1.8889 | 34 | 0.5320 | -0.0186 | 0.5326 |
67
+ | No log | 2.0 | 36 | 0.5879 | 0.0536 | 0.5885 |
68
+ | No log | 2.1111 | 38 | 0.5920 | 0.1117 | 0.5926 |
69
+ | No log | 2.2222 | 40 | 0.5586 | 0.1740 | 0.5592 |
70
+ | No log | 2.3333 | 42 | 0.4887 | 0.0570 | 0.4892 |
71
+ | No log | 2.4444 | 44 | 0.4523 | 0.0512 | 0.4527 |
72
+ | No log | 2.5556 | 46 | 0.4295 | 0.0633 | 0.4299 |
73
+ | No log | 2.6667 | 48 | 0.4439 | 0.0643 | 0.4444 |
74
+ | No log | 2.7778 | 50 | 0.4579 | -0.0142 | 0.4585 |
75
+ | No log | 2.8889 | 52 | 0.4404 | 0.0594 | 0.4409 |
76
+ | No log | 3.0 | 54 | 0.4585 | 0.0325 | 0.4590 |
77
+ | No log | 3.1111 | 56 | 0.5216 | 0.1088 | 0.5222 |
78
+ | No log | 3.2222 | 58 | 0.5552 | 0.0747 | 0.5559 |
79
+ | No log | 3.3333 | 60 | 0.5458 | 0.1373 | 0.5465 |
80
+ | No log | 3.4444 | 62 | 0.4947 | 0.1774 | 0.4953 |
81
+ | No log | 3.5556 | 64 | 0.4605 | 0.0419 | 0.4611 |
82
+ | No log | 3.6667 | 66 | 0.4341 | -0.0514 | 0.4346 |
83
+ | No log | 3.7778 | 68 | 0.4227 | -0.0500 | 0.4232 |
84
+ | No log | 3.8889 | 70 | 0.4149 | -0.0016 | 0.4154 |
85
+ | No log | 4.0 | 72 | 0.4133 | 0.0112 | 0.4138 |
86
+ | No log | 4.1111 | 74 | 0.4299 | 0.0681 | 0.4304 |
87
+ | No log | 4.2222 | 76 | 0.4431 | 0.0874 | 0.4437 |
88
+ | No log | 4.3333 | 78 | 0.4609 | 0.1618 | 0.4615 |
89
+ | No log | 4.4444 | 80 | 0.4845 | 0.1449 | 0.4851 |
90
+ | No log | 4.5556 | 82 | 0.5171 | 0.1801 | 0.5178 |
91
+ | No log | 4.6667 | 84 | 0.5429 | 0.0638 | 0.5436 |
92
+ | No log | 4.7778 | 86 | 0.5295 | 0.1054 | 0.5302 |
93
+ | No log | 4.8889 | 88 | 0.4873 | 0.1361 | 0.4880 |
94
+ | No log | 5.0 | 90 | 0.4385 | 0.0551 | 0.4391 |
95
+ | No log | 5.1111 | 92 | 0.4189 | 0.0586 | 0.4195 |
96
+ | No log | 5.2222 | 94 | 0.4360 | 0.0730 | 0.4366 |
97
+ | No log | 5.3333 | 96 | 0.4771 | 0.0422 | 0.4778 |
98
+ | No log | 5.4444 | 98 | 0.4940 | 0.0473 | 0.4947 |
99
+ | No log | 5.5556 | 100 | 0.5040 | 0.0525 | 0.5047 |
100
+ | No log | 5.6667 | 102 | 0.4813 | 0.0030 | 0.4819 |
101
+ | No log | 5.7778 | 104 | 0.4381 | 0.0917 | 0.4387 |
102
+ | No log | 5.8889 | 106 | 0.3938 | -0.0553 | 0.3943 |
103
+ | No log | 6.0 | 108 | 0.3964 | -0.0475 | 0.3969 |
104
+ | No log | 6.1111 | 110 | 0.4237 | 0.0059 | 0.4242 |
105
+ | No log | 6.2222 | 112 | 0.4695 | 0.1283 | 0.4701 |
106
+ | No log | 6.3333 | 114 | 0.4933 | 0.0923 | 0.4940 |
107
+ | No log | 6.4444 | 116 | 0.5089 | 0.0578 | 0.5096 |
108
+ | No log | 6.5556 | 118 | 0.5097 | 0.0886 | 0.5105 |
109
+ | No log | 6.6667 | 120 | 0.4867 | 0.0724 | 0.4874 |
110
+ | No log | 6.7778 | 122 | 0.4496 | 0.0831 | 0.4502 |
111
+ | No log | 6.8889 | 124 | 0.4192 | 0.0197 | 0.4198 |
112
+ | No log | 7.0 | 126 | 0.4075 | 0.0496 | 0.4081 |
113
+ | No log | 7.1111 | 128 | 0.4043 | 0.0369 | 0.4049 |
114
+ | No log | 7.2222 | 130 | 0.4164 | 0.0326 | 0.4170 |
115
+ | No log | 7.3333 | 132 | 0.4361 | 0.0815 | 0.4367 |
116
+ | No log | 7.4444 | 134 | 0.4517 | 0.1068 | 0.4524 |
117
+ | No log | 7.5556 | 136 | 0.4513 | 0.1209 | 0.4519 |
118
+ | No log | 7.6667 | 138 | 0.4452 | 0.1056 | 0.4458 |
119
+ | No log | 7.7778 | 140 | 0.4514 | 0.0743 | 0.4520 |
120
+ | No log | 7.8889 | 142 | 0.4671 | 0.1472 | 0.4677 |
121
+ | No log | 8.0 | 144 | 0.4902 | 0.0969 | 0.4909 |
122
+ | No log | 8.1111 | 146 | 0.5000 | -0.0230 | 0.5007 |
123
+ | No log | 8.2222 | 148 | 0.4999 | -0.0028 | 0.5006 |
124
+ | No log | 8.3333 | 150 | 0.4924 | 0.0374 | 0.4931 |
125
+ | No log | 8.4444 | 152 | 0.4849 | 0.0857 | 0.4855 |
126
+ | No log | 8.5556 | 154 | 0.4790 | 0.0857 | 0.4796 |
127
+ | No log | 8.6667 | 156 | 0.4774 | 0.0857 | 0.4780 |
128
+ | No log | 8.7778 | 158 | 0.4814 | 0.1004 | 0.4820 |
129
+ | No log | 8.8889 | 160 | 0.4916 | 0.0866 | 0.4923 |
130
+ | No log | 9.0 | 162 | 0.4998 | 0.0525 | 0.5005 |
131
+ | No log | 9.1111 | 164 | 0.5009 | 0.0676 | 0.5016 |
132
+ | No log | 9.2222 | 166 | 0.4971 | 0.0676 | 0.4978 |
133
+ | No log | 9.3333 | 168 | 0.4903 | 0.1166 | 0.4910 |
134
+ | No log | 9.4444 | 170 | 0.4831 | 0.1641 | 0.4838 |
135
+ | No log | 9.5556 | 172 | 0.4811 | 0.1832 | 0.4818 |
136
+ | No log | 9.6667 | 174 | 0.4780 | 0.1534 | 0.4786 |
137
+ | No log | 9.7778 | 176 | 0.4767 | 0.1239 | 0.4774 |
138
+ | No log | 9.8889 | 178 | 0.4754 | 0.1093 | 0.4760 |
139
+ | No log | 10.0 | 180 | 0.4752 | 0.1093 | 0.4759 |
140
 
141
 
142
  ### Framework versions