Hugging Face's logo

salbatarni
/
arabert_cross_organization_task2_fold6

TensorBoard
Safetensors
bert
Generated from Trainer
Model card Files Metrics Community
salbatarni commited on
Commit
90d851a
·
verified ·
1 Parent(s): 077ac5e

Training in progress, step 160

Browse files
Files changed (3) hide show
  1. README.md +83 -38
  2. model.safetensors +1 -1
  3. training_args.bin +1 -1
README.md CHANGED
@@ -3,20 +3,20 @@ base_model: aubmindlab/bert-base-arabertv02
3
  tags:
4
  - generated_from_trainer
5
  model-index:
6
- - name: arabert_cross_organization_task2_fold6
7
  results: []
8
  ---
9
 
10
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
11
  should probably proofread and complete it, then remove this comment. -->
12
 
13
- # arabert_cross_organization_task2_fold6
14
 
15
  This model is a fine-tuned version of [aubmindlab/bert-base-arabertv02](https://huggingface.co/aubmindlab/bert-base-arabertv02) on the None dataset.
16
  It achieves the following results on the evaluation set:
17
- - Loss: 0.5405
18
- - Qwk: 0.5769
19
- - Mse: 0.5374
20
 
21
  ## Model description
22
 
@@ -36,47 +36,92 @@ More information needed
36
 
37
  The following hyperparameters were used during training:
38
  - learning_rate: 2e-05
39
- - train_batch_size: 16
40
- - eval_batch_size: 16
41
  - seed: 42
42
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
43
  - lr_scheduler_type: linear
44
- - num_epochs: 1
45
 
46
  ### Training results
47
 
48
  | Training Loss | Epoch | Step | Validation Loss | Qwk | Mse |
49
  |:-------------:|:------:|:----:|:---------------:|:------:|:------:|
50
- | No log | 0.0328 | 2 | 1.3700 | 0.0428 | 1.3711 |
51
- | No log | 0.0656 | 4 | 0.8939 | 0.4052 | 0.8922 |
52
- | No log | 0.0984 | 6 | 0.8358 | 0.4121 | 0.8330 |
53
- | No log | 0.1311 | 8 | 0.7643 | 0.4593 | 0.7574 |
54
- | No log | 0.1639 | 10 | 1.3628 | 0.2785 | 1.3486 |
55
- | No log | 0.1967 | 12 | 1.0487 | 0.3652 | 1.0368 |
56
- | No log | 0.2295 | 14 | 0.5515 | 0.6035 | 0.5471 |
57
- | No log | 0.2623 | 16 | 0.4996 | 0.7025 | 0.4979 |
58
- | No log | 0.2951 | 18 | 0.5462 | 0.5894 | 0.5430 |
59
- | No log | 0.3279 | 20 | 0.6511 | 0.5043 | 0.6470 |
60
- | No log | 0.3607 | 22 | 0.5897 | 0.5324 | 0.5869 |
61
- | No log | 0.3934 | 24 | 0.4993 | 0.5944 | 0.4978 |
62
- | No log | 0.4262 | 26 | 0.4818 | 0.6368 | 0.4803 |
63
- | No log | 0.4590 | 28 | 0.4771 | 0.6505 | 0.4754 |
64
- | No log | 0.4918 | 30 | 0.4839 | 0.7169 | 0.4826 |
65
- | No log | 0.5246 | 32 | 0.4884 | 0.7213 | 0.4870 |
66
- | No log | 0.5574 | 34 | 0.4735 | 0.6441 | 0.4707 |
67
- | No log | 0.5902 | 36 | 0.6035 | 0.4994 | 0.5981 |
68
- | No log | 0.6230 | 38 | 0.7071 | 0.4588 | 0.7006 |
69
- | No log | 0.6557 | 40 | 0.6491 | 0.4791 | 0.6430 |
70
- | No log | 0.6885 | 42 | 0.5600 | 0.5624 | 0.5551 |
71
- | No log | 0.7213 | 44 | 0.5255 | 0.5644 | 0.5213 |
72
- | No log | 0.7541 | 46 | 0.5290 | 0.5648 | 0.5250 |
73
- | No log | 0.7869 | 48 | 0.5428 | 0.5657 | 0.5387 |
74
- | No log | 0.8197 | 50 | 0.5776 | 0.5475 | 0.5730 |
75
- | No log | 0.8525 | 52 | 0.6069 | 0.5376 | 0.6019 |
76
- | No log | 0.8852 | 54 | 0.5893 | 0.5459 | 0.5848 |
77
- | No log | 0.9180 | 56 | 0.5610 | 0.5740 | 0.5572 |
78
- | No log | 0.9508 | 58 | 0.5461 | 0.5817 | 0.5428 |
79
- | No log | 0.9836 | 60 | 0.5405 | 0.5769 | 0.5374 |
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
80
 
81
 
82
  ### Framework versions
 
3
  tags:
4
  - generated_from_trainer
5
  model-index:
6
+ - name: arabert_cross_organization_task2_fold5
7
  results: []
8
  ---
9
 
10
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
11
  should probably proofread and complete it, then remove this comment. -->
12
 
13
+ # arabert_cross_organization_task2_fold5
14
 
15
  This model is a fine-tuned version of [aubmindlab/bert-base-arabertv02](https://huggingface.co/aubmindlab/bert-base-arabertv02) on the None dataset.
16
  It achieves the following results on the evaluation set:
17
+ - Loss: 0.4864
18
+ - Qwk: 0.6953
19
+ - Mse: 0.4868
20
 
21
  ## Model description
22
 
 
36
 
37
  The following hyperparameters were used during training:
38
  - learning_rate: 2e-05
39
+ - train_batch_size: 64
40
+ - eval_batch_size: 64
41
  - seed: 42
42
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
43
  - lr_scheduler_type: linear
44
+ - num_epochs: 10
45
 
46
  ### Training results
47
 
48
  | Training Loss | Epoch | Step | Validation Loss | Qwk | Mse |
49
  |:-------------:|:------:|:----:|:---------------:|:------:|:------:|
50
+ | No log | 0.1333 | 2 | 1.3091 | 0.2225 | 1.3089 |
51
+ | No log | 0.2667 | 4 | 0.8804 | 0.3887 | 0.8814 |
52
+ | No log | 0.4 | 6 | 1.3858 | 0.5574 | 1.3875 |
53
+ | No log | 0.5333 | 8 | 0.8835 | 0.6154 | 0.8852 |
54
+ | No log | 0.6667 | 10 | 0.7015 | 0.4522 | 0.7026 |
55
+ | No log | 0.8 | 12 | 0.6464 | 0.5054 | 0.6475 |
56
+ | No log | 0.9333 | 14 | 0.7433 | 0.7082 | 0.7448 |
57
+ | No log | 1.0667 | 16 | 0.8118 | 0.7522 | 0.8134 |
58
+ | No log | 1.2 | 18 | 0.6135 | 0.7499 | 0.6147 |
59
+ | No log | 1.3333 | 20 | 0.5249 | 0.6739 | 0.5259 |
60
+ | No log | 1.4667 | 22 | 0.5390 | 0.7248 | 0.5401 |
61
+ | No log | 1.6 | 24 | 0.6195 | 0.7729 | 0.6207 |
62
+ | No log | 1.7333 | 26 | 0.5748 | 0.7628 | 0.5759 |
63
+ | No log | 1.8667 | 28 | 0.5013 | 0.7261 | 0.5022 |
64
+ | No log | 2.0 | 30 | 0.5356 | 0.7773 | 0.5366 |
65
+ | No log | 2.1333 | 32 | 0.5953 | 0.7981 | 0.5964 |
66
+ | No log | 2.2667 | 34 | 0.6287 | 0.8036 | 0.6298 |
67
+ | No log | 2.4 | 36 | 0.5427 | 0.7642 | 0.5438 |
68
+ | No log | 2.5333 | 38 | 0.4766 | 0.6805 | 0.4773 |
69
+ | No log | 2.6667 | 40 | 0.4783 | 0.6777 | 0.4789 |
70
+ | No log | 2.8 | 42 | 0.5040 | 0.7282 | 0.5048 |
71
+ | No log | 2.9333 | 44 | 0.5170 | 0.7463 | 0.5179 |
72
+ | No log | 3.0667 | 46 | 0.4870 | 0.7115 | 0.4876 |
73
+ | No log | 3.2 | 48 | 0.5068 | 0.7429 | 0.5075 |
74
+ | No log | 3.3333 | 50 | 0.5038 | 0.7270 | 0.5044 |
75
+ | No log | 3.4667 | 52 | 0.4985 | 0.7013 | 0.4989 |
76
+ | No log | 3.6 | 54 | 0.4972 | 0.6846 | 0.4975 |
77
+ | No log | 3.7333 | 56 | 0.4943 | 0.6912 | 0.4947 |
78
+ | No log | 3.8667 | 58 | 0.5072 | 0.7104 | 0.5078 |
79
+ | No log | 4.0 | 60 | 0.5132 | 0.7203 | 0.5139 |
80
+ | No log | 4.1333 | 62 | 0.5679 | 0.7897 | 0.5689 |
81
+ | No log | 4.2667 | 64 | 0.5555 | 0.7899 | 0.5566 |
82
+ | No log | 4.4 | 66 | 0.4706 | 0.6934 | 0.4712 |
83
+ | No log | 4.5333 | 68 | 0.4707 | 0.6425 | 0.4710 |
84
+ | No log | 4.6667 | 70 | 0.4678 | 0.6421 | 0.4680 |
85
+ | No log | 4.8 | 72 | 0.4657 | 0.6697 | 0.4660 |
86
+ | No log | 4.9333 | 74 | 0.4644 | 0.7034 | 0.4648 |
87
+ | No log | 5.0667 | 76 | 0.4691 | 0.7052 | 0.4695 |
88
+ | No log | 5.2 | 78 | 0.4782 | 0.7024 | 0.4787 |
89
+ | No log | 5.3333 | 80 | 0.4778 | 0.6948 | 0.4782 |
90
+ | No log | 5.4667 | 82 | 0.4788 | 0.6806 | 0.4792 |
91
+ | No log | 5.6 | 84 | 0.4857 | 0.7050 | 0.4862 |
92
+ | No log | 5.7333 | 86 | 0.4827 | 0.7024 | 0.4832 |
93
+ | No log | 5.8667 | 88 | 0.4770 | 0.6872 | 0.4774 |
94
+ | No log | 6.0 | 90 | 0.4795 | 0.6277 | 0.4798 |
95
+ | No log | 6.1333 | 92 | 0.4708 | 0.6656 | 0.4712 |
96
+ | No log | 6.2667 | 94 | 0.4697 | 0.7074 | 0.4702 |
97
+ | No log | 6.4 | 96 | 0.4653 | 0.6945 | 0.4656 |
98
+ | No log | 6.5333 | 98 | 0.4668 | 0.6693 | 0.4671 |
99
+ | No log | 6.6667 | 100 | 0.4669 | 0.6885 | 0.4672 |
100
+ | No log | 6.8 | 102 | 0.4696 | 0.6978 | 0.4700 |
101
+ | No log | 6.9333 | 104 | 0.4724 | 0.6954 | 0.4727 |
102
+ | No log | 7.0667 | 106 | 0.4741 | 0.6619 | 0.4743 |
103
+ | No log | 7.2 | 108 | 0.4803 | 0.6229 | 0.4804 |
104
+ | No log | 7.3333 | 110 | 0.4719 | 0.6396 | 0.4721 |
105
+ | No log | 7.4667 | 112 | 0.4673 | 0.7015 | 0.4677 |
106
+ | No log | 7.6 | 114 | 0.4766 | 0.7129 | 0.4772 |
107
+ | No log | 7.7333 | 116 | 0.4720 | 0.7071 | 0.4725 |
108
+ | No log | 7.8667 | 118 | 0.4730 | 0.6457 | 0.4733 |
109
+ | No log | 8.0 | 120 | 0.4829 | 0.6097 | 0.4831 |
110
+ | No log | 8.1333 | 122 | 0.4865 | 0.6055 | 0.4866 |
111
+ | No log | 8.2667 | 124 | 0.4796 | 0.6640 | 0.4799 |
112
+ | No log | 8.4 | 126 | 0.4806 | 0.6954 | 0.4811 |
113
+ | No log | 8.5333 | 128 | 0.4865 | 0.7119 | 0.4870 |
114
+ | No log | 8.6667 | 130 | 0.4841 | 0.7139 | 0.4846 |
115
+ | No log | 8.8 | 132 | 0.4802 | 0.6936 | 0.4806 |
116
+ | No log | 8.9333 | 134 | 0.4820 | 0.6650 | 0.4823 |
117
+ | No log | 9.0667 | 136 | 0.4843 | 0.6546 | 0.4846 |
118
+ | No log | 9.2 | 138 | 0.4842 | 0.6572 | 0.4845 |
119
+ | No log | 9.3333 | 140 | 0.4837 | 0.6715 | 0.4840 |
120
+ | No log | 9.4667 | 142 | 0.4849 | 0.6959 | 0.4853 |
121
+ | No log | 9.6 | 144 | 0.4863 | 0.6988 | 0.4867 |
122
+ | No log | 9.7333 | 146 | 0.4865 | 0.6953 | 0.4869 |
123
+ | No log | 9.8667 | 148 | 0.4864 | 0.6953 | 0.4868 |
124
+ | No log | 10.0 | 150 | 0.4864 | 0.6953 | 0.4868 |
125
 
126
 
127
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ec86f2fa0bf69c849762cfa84bf12b804971cee80ee7a173b5a1c151d43e96f2
3
  size 540799996
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2ceef355354c0ef68615f4008051e091c92a8d39c3894b222e90f85af3dfbc36
3
  size 540799996
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:fcc95b77637c5626d7d9aafd8a1cfcf5cc72345d82dda3324103145682a3f36c
3
  size 5240
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4dcb40b4ff1691bd014f04c51bfc12c2f920cb1087a8ade79977192ef4ac3dca
3
  size 5240