ArabicNewSplits8_usingALLEssays_FineTuningAraBERT_run2_AugV5_k9_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.5540
• Qwk: 0.4314
• Mse: 0.5540
• Rmse: 0.7443

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0426	2	4.4125	-0.0208	4.4125	2.1006
No log	0.0851	4	2.2796	0.0011	2.2796	1.5098
No log	0.1277	6	1.4910	-0.0880	1.4910	1.2211
No log	0.1702	8	0.9245	0.0248	0.9245	0.9615
No log	0.2128	10	0.9615	0.0568	0.9615	0.9806
No log	0.2553	12	1.4699	0.1269	1.4699	1.2124
No log	0.2979	14	0.9964	0.0905	0.9964	0.9982
No log	0.3404	16	0.7632	0.1497	0.7632	0.8736
No log	0.3830	18	0.9420	-0.0183	0.9420	0.9706
No log	0.4255	20	1.0201	-0.0561	1.0201	1.0100
No log	0.4681	22	1.0221	0.0441	1.0221	1.0110
No log	0.5106	24	0.9558	0.1022	0.9558	0.9776
No log	0.5532	26	0.8890	0.1888	0.8890	0.9429
No log	0.5957	28	0.7999	0.2123	0.7999	0.8944
No log	0.6383	30	0.7439	0.2662	0.7439	0.8625
No log	0.6809	32	0.7484	0.2682	0.7484	0.8651
No log	0.7234	34	0.7408	0.2650	0.7408	0.8607
No log	0.7660	36	0.7484	0.2792	0.7484	0.8651
No log	0.8085	38	0.8704	0.2405	0.8704	0.9329
No log	0.8511	40	1.2310	0.1132	1.2310	1.1095
No log	0.8936	42	1.4960	0.1277	1.4960	1.2231
No log	0.9362	44	1.5276	0.0874	1.5276	1.2360
No log	0.9787	46	1.4596	0.0936	1.4596	1.2081
No log	1.0213	48	1.2087	0.0955	1.2087	1.0994
No log	1.0638	50	0.8793	0.2314	0.8793	0.9377
No log	1.1064	52	0.7582	0.2977	0.7582	0.8708
No log	1.1489	54	0.7300	0.2933	0.7300	0.8544
No log	1.1915	56	0.7407	0.3203	0.7407	0.8606
No log	1.2340	58	0.7822	0.3117	0.7822	0.8844
No log	1.2766	60	0.7726	0.2884	0.7726	0.8790
No log	1.3191	62	0.8646	0.1566	0.8646	0.9299
No log	1.3617	64	1.0077	0.1172	1.0077	1.0038
No log	1.4043	66	1.0442	0.1847	1.0442	1.0219
No log	1.4468	68	1.0144	0.2466	1.0144	1.0072
No log	1.4894	70	0.8351	0.3147	0.8351	0.9139
No log	1.5319	72	0.7012	0.4636	0.7012	0.8374
No log	1.5745	74	0.6699	0.4603	0.6699	0.8185
No log	1.6170	76	0.6725	0.4210	0.6725	0.8201
No log	1.6596	78	0.6189	0.4615	0.6189	0.7867
No log	1.7021	80	0.5851	0.4313	0.5851	0.7649
No log	1.7447	82	0.5880	0.4185	0.5880	0.7668
No log	1.7872	84	0.6078	0.4430	0.6078	0.7796
No log	1.8298	86	0.6252	0.4370	0.6252	0.7907
No log	1.8723	88	0.7551	0.5093	0.7551	0.8690
No log	1.9149	90	0.9196	0.3984	0.9196	0.9590
No log	1.9574	92	1.0018	0.3249	1.0018	1.0009
No log	2.0	94	0.9347	0.3961	0.9347	0.9668
No log	2.0426	96	0.7642	0.5322	0.7642	0.8742
No log	2.0851	98	0.6267	0.5359	0.6267	0.7917
No log	2.1277	100	0.6067	0.4184	0.6067	0.7789
No log	2.1702	102	0.6156	0.4458	0.6156	0.7846
No log	2.2128	104	0.6467	0.4402	0.6467	0.8042
No log	2.2553	106	0.6699	0.4863	0.6699	0.8185
No log	2.2979	108	0.7075	0.4492	0.7075	0.8411
No log	2.3404	110	0.6541	0.3663	0.6541	0.8087
No log	2.3830	112	1.0734	0.3158	1.0734	1.0361
No log	2.4255	114	1.4772	0.1649	1.4772	1.2154
No log	2.4681	116	1.2638	0.2254	1.2638	1.1242
No log	2.5106	118	0.8474	0.4274	0.8474	0.9206
No log	2.5532	120	0.7143	0.4249	0.7143	0.8452
No log	2.5957	122	0.7495	0.4375	0.7495	0.8658
No log	2.6383	124	0.8840	0.4056	0.8840	0.9402
No log	2.6809	126	0.7801	0.4051	0.7801	0.8832
No log	2.7234	128	0.6650	0.4654	0.6650	0.8155
No log	2.7660	130	0.6495	0.4900	0.6495	0.8059
No log	2.8085	132	0.6486	0.4648	0.6486	0.8054
No log	2.8511	134	0.6505	0.4388	0.6505	0.8065
No log	2.8936	136	0.7017	0.4847	0.7017	0.8377
No log	2.9362	138	0.8408	0.4385	0.8408	0.9170
No log	2.9787	140	1.0557	0.3699	1.0557	1.0275
No log	3.0213	142	0.8824	0.4301	0.8824	0.9394
No log	3.0638	144	0.6093	0.5138	0.6093	0.7806
No log	3.1064	146	0.7477	0.3774	0.7477	0.8647
No log	3.1489	148	0.8204	0.3483	0.8204	0.9057
No log	3.1915	150	0.7406	0.3707	0.7406	0.8606
No log	3.2340	152	0.6159	0.4585	0.6159	0.7848
No log	3.2766	154	0.7518	0.4942	0.7518	0.8671
No log	3.3191	156	0.9678	0.4185	0.9678	0.9837
No log	3.3617	158	0.9515	0.4408	0.9515	0.9754
No log	3.4043	160	0.7239	0.4816	0.7239	0.8508
No log	3.4468	162	0.5608	0.4833	0.5608	0.7489
No log	3.4894	164	0.5629	0.4795	0.5629	0.7503
No log	3.5319	166	0.5600	0.4861	0.5600	0.7483
No log	3.5745	168	0.5712	0.5135	0.5712	0.7558
No log	3.6170	170	0.5980	0.5452	0.5980	0.7733
No log	3.6596	172	0.6401	0.5419	0.6401	0.8001
No log	3.7021	174	0.6190	0.5420	0.6190	0.7867
No log	3.7447	176	0.6019	0.5163	0.6019	0.7758
No log	3.7872	178	0.6150	0.5190	0.6150	0.7842
No log	3.8298	180	0.6769	0.4850	0.6769	0.8227
No log	3.8723	182	0.7544	0.4899	0.7544	0.8686
No log	3.9149	184	0.7430	0.4899	0.7430	0.8620
No log	3.9574	186	0.6552	0.4628	0.6552	0.8095
No log	4.0	188	0.6132	0.4365	0.6132	0.7831
No log	4.0426	190	0.6210	0.3831	0.6210	0.7880
No log	4.0851	192	0.6135	0.4325	0.6135	0.7833
No log	4.1277	194	0.6319	0.4788	0.6319	0.7949
No log	4.1702	196	0.6804	0.4847	0.6804	0.8249
No log	4.2128	198	0.6550	0.4818	0.6550	0.8093
No log	4.2553	200	0.6195	0.4579	0.6195	0.7871
No log	4.2979	202	0.6351	0.4488	0.6351	0.7969
No log	4.3404	204	0.6596	0.4812	0.6596	0.8122
No log	4.3830	206	0.6418	0.4178	0.6418	0.8011
No log	4.4255	208	0.6376	0.4467	0.6376	0.7985
No log	4.4681	210	0.6334	0.4763	0.6334	0.7959
No log	4.5106	212	0.7010	0.4445	0.7010	0.8372
No log	4.5532	214	0.8458	0.4321	0.8458	0.9197
No log	4.5957	216	0.8149	0.4428	0.8149	0.9027
No log	4.6383	218	0.6684	0.4946	0.6684	0.8176
No log	4.6809	220	0.6225	0.4102	0.6225	0.7890
No log	4.7234	222	0.6254	0.3961	0.6254	0.7908
No log	4.7660	224	0.6228	0.4242	0.6228	0.7892
No log	4.8085	226	0.7302	0.5335	0.7302	0.8545
No log	4.8511	228	0.8814	0.4131	0.8814	0.9388
No log	4.8936	230	0.8762	0.4232	0.8762	0.9361
No log	4.9362	232	0.7088	0.5066	0.7088	0.8419
No log	4.9787	234	0.6446	0.4250	0.6446	0.8028
No log	5.0213	236	0.7312	0.4336	0.7312	0.8551
No log	5.0638	238	0.7170	0.4515	0.7170	0.8468
No log	5.1064	240	0.6329	0.3749	0.6329	0.7956
No log	5.1489	242	0.6211	0.4220	0.6211	0.7881
No log	5.1915	244	0.6794	0.4431	0.6794	0.8242
No log	5.2340	246	0.6899	0.4962	0.6899	0.8306
No log	5.2766	248	0.6475	0.5016	0.6475	0.8046
No log	5.3191	250	0.6384	0.4939	0.6384	0.7990
No log	5.3617	252	0.6671	0.5408	0.6671	0.8168
No log	5.4043	254	0.6696	0.5161	0.6696	0.8183
No log	5.4468	256	0.7265	0.5250	0.7265	0.8524
No log	5.4894	258	0.8151	0.5291	0.8151	0.9028
No log	5.5319	260	0.8421	0.5029	0.8421	0.9176
No log	5.5745	262	0.7450	0.5153	0.7450	0.8631
No log	5.6170	264	0.6341	0.4928	0.6341	0.7963
No log	5.6596	266	0.6153	0.4611	0.6153	0.7844
No log	5.7021	268	0.6153	0.3989	0.6153	0.7844
No log	5.7447	270	0.5978	0.3972	0.5978	0.7732
No log	5.7872	272	0.5963	0.4367	0.5963	0.7722
No log	5.8298	274	0.6222	0.4137	0.6222	0.7888
No log	5.8723	276	0.6578	0.4385	0.6578	0.8111
No log	5.9149	278	0.6400	0.4218	0.6400	0.8000
No log	5.9574	280	0.6161	0.4763	0.6161	0.7849
No log	6.0	282	0.6472	0.4817	0.6472	0.8045
No log	6.0426	284	0.6450	0.4862	0.6450	0.8031
No log	6.0851	286	0.6197	0.4474	0.6197	0.7872
No log	6.1277	288	0.6593	0.4751	0.6593	0.8120
No log	6.1702	290	0.6936	0.4518	0.6936	0.8328
No log	6.2128	292	0.6552	0.4853	0.6552	0.8094
No log	6.2553	294	0.6133	0.4712	0.6133	0.7831
No log	6.2979	296	0.6082	0.4615	0.6082	0.7799
No log	6.3404	298	0.6057	0.4530	0.6057	0.7783
No log	6.3830	300	0.6373	0.4882	0.6373	0.7983
No log	6.4255	302	0.6761	0.5057	0.6761	0.8223
No log	6.4681	304	0.6554	0.5155	0.6554	0.8096
No log	6.5106	306	0.6209	0.4451	0.6209	0.7880
No log	6.5532	308	0.6201	0.4074	0.6201	0.7874
No log	6.5957	310	0.6298	0.4352	0.6298	0.7936
No log	6.6383	312	0.6711	0.5131	0.6711	0.8192
No log	6.6809	314	0.6513	0.4877	0.6513	0.8070
No log	6.7234	316	0.6280	0.4594	0.6280	0.7925
No log	6.7660	318	0.6331	0.5038	0.6331	0.7957
No log	6.8085	320	0.6200	0.4777	0.6200	0.7874
No log	6.8511	322	0.6058	0.4677	0.6058	0.7783
No log	6.8936	324	0.5869	0.4329	0.5869	0.7661
No log	6.9362	326	0.5828	0.4428	0.5828	0.7634
No log	6.9787	328	0.5890	0.4853	0.5890	0.7675
No log	7.0213	330	0.5874	0.5292	0.5874	0.7664
No log	7.0638	332	0.5846	0.5530	0.5846	0.7646
No log	7.1064	334	0.5966	0.5609	0.5966	0.7724
No log	7.1489	336	0.5978	0.5855	0.5978	0.7732
No log	7.1915	338	0.6303	0.5362	0.6303	0.7939
No log	7.2340	340	0.6522	0.5195	0.6522	0.8076
No log	7.2766	342	0.6401	0.5362	0.6401	0.8001
No log	7.3191	344	0.6522	0.5288	0.6522	0.8076
No log	7.3617	346	0.6342	0.5283	0.6342	0.7964
No log	7.4043	348	0.6274	0.4789	0.6274	0.7921
No log	7.4468	350	0.6576	0.4913	0.6576	0.8109
No log	7.4894	352	0.7218	0.4643	0.7218	0.8496
No log	7.5319	354	0.6825	0.4203	0.6825	0.8261
No log	7.5745	356	0.6048	0.4474	0.6048	0.7777
No log	7.6170	358	0.5977	0.4497	0.5977	0.7731
No log	7.6596	360	0.6305	0.4558	0.6305	0.7940
No log	7.7021	362	0.6552	0.4969	0.6552	0.8095
No log	7.7447	364	0.6301	0.4840	0.6301	0.7938
No log	7.7872	366	0.6029	0.4381	0.6029	0.7765
No log	7.8298	368	0.6027	0.4570	0.6027	0.7763
No log	7.8723	370	0.6060	0.4971	0.6060	0.7785
No log	7.9149	372	0.6054	0.5088	0.6054	0.7780
No log	7.9574	374	0.6158	0.5137	0.6158	0.7847
No log	8.0	376	0.6439	0.5224	0.6439	0.8024
No log	8.0426	378	0.6286	0.5153	0.6286	0.7929
No log	8.0851	380	0.6354	0.5104	0.6354	0.7971
No log	8.1277	382	0.6128	0.5446	0.6128	0.7828
No log	8.1702	384	0.5967	0.4596	0.5967	0.7725
No log	8.2128	386	0.5958	0.4728	0.5958	0.7719
No log	8.2553	388	0.5948	0.4284	0.5948	0.7712
No log	8.2979	390	0.6048	0.4871	0.6048	0.7777
No log	8.3404	392	0.6224	0.5153	0.6224	0.7889
No log	8.3830	394	0.6398	0.5101	0.6398	0.7999
No log	8.4255	396	0.6376	0.5024	0.6376	0.7985
No log	8.4681	398	0.6108	0.4625	0.6108	0.7815
No log	8.5106	400	0.6131	0.4329	0.6131	0.7830
No log	8.5532	402	0.6333	0.4382	0.6333	0.7958
No log	8.5957	404	0.6168	0.4482	0.6168	0.7854
No log	8.6383	406	0.6016	0.4036	0.6016	0.7756
No log	8.6809	408	0.6021	0.4505	0.6021	0.7760
No log	8.7234	410	0.6081	0.4269	0.6081	0.7798
No log	8.7660	412	0.6024	0.4601	0.6024	0.7761
No log	8.8085	414	0.6042	0.4563	0.6042	0.7773
No log	8.8511	416	0.6135	0.5029	0.6135	0.7832
No log	8.8936	418	0.6337	0.4849	0.6337	0.7960
No log	8.9362	420	0.6245	0.4681	0.6245	0.7902
No log	8.9787	422	0.6240	0.5078	0.6240	0.7899
No log	9.0213	424	0.6007	0.4781	0.6007	0.7751
No log	9.0638	426	0.6068	0.5158	0.6068	0.7790
No log	9.1064	428	0.6097	0.5158	0.6097	0.7808
No log	9.1489	430	0.6345	0.4773	0.6345	0.7966
No log	9.1915	432	0.6574	0.4577	0.6574	0.8108
No log	9.2340	434	0.6353	0.4207	0.6353	0.7970
No log	9.2766	436	0.6073	0.4909	0.6073	0.7793
No log	9.3191	438	0.6146	0.4909	0.6146	0.7840
No log	9.3617	440	0.6354	0.5062	0.6354	0.7971
No log	9.4043	442	0.6932	0.4799	0.6932	0.8326
No log	9.4468	444	0.7803	0.4642	0.7803	0.8834
No log	9.4894	446	0.7201	0.4806	0.7201	0.8486
No log	9.5319	448	0.6186	0.5092	0.6186	0.7865
No log	9.5745	450	0.6033	0.4829	0.6033	0.7767
No log	9.6170	452	0.5946	0.5111	0.5946	0.7711
No log	9.6596	454	0.5954	0.4991	0.5954	0.7716
No log	9.7021	456	0.5902	0.5017	0.5902	0.7682
No log	9.7447	458	0.5851	0.4673	0.5851	0.7649
No log	9.7872	460	0.6018	0.5214	0.6018	0.7757
No log	9.8298	462	0.6108	0.5317	0.6108	0.7815
No log	9.8723	464	0.5827	0.4753	0.5827	0.7633
No log	9.9149	466	0.5709	0.4839	0.5709	0.7556
No log	9.9574	468	0.5766	0.5359	0.5766	0.7593
No log	10.0	470	0.6022	0.5426	0.6022	0.7760
No log	10.0426	472	0.5836	0.5169	0.5836	0.7639
No log	10.0851	474	0.5721	0.5039	0.5721	0.7564
No log	10.1277	476	0.5561	0.5059	0.5561	0.7457
No log	10.1702	478	0.5597	0.5422	0.5597	0.7482
No log	10.2128	480	0.5835	0.5490	0.5835	0.7639
No log	10.2553	482	0.5678	0.5599	0.5678	0.7536
No log	10.2979	484	0.5562	0.5396	0.5562	0.7458
No log	10.3404	486	0.5687	0.5180	0.5687	0.7541
No log	10.3830	488	0.5608	0.5133	0.5608	0.7489
No log	10.4255	490	0.5609	0.5402	0.5609	0.7490
No log	10.4681	492	0.5816	0.4301	0.5816	0.7627
No log	10.5106	494	0.5703	0.5048	0.5703	0.7552
No log	10.5532	496	0.5656	0.5440	0.5656	0.7521
No log	10.5957	498	0.5964	0.5289	0.5964	0.7723
0.3872	10.6383	500	0.6281	0.4734	0.6281	0.7925
0.3872	10.6809	502	0.6009	0.5107	0.6009	0.7752
0.3872	10.7234	504	0.5538	0.5549	0.5538	0.7442
0.3872	10.7660	506	0.5617	0.5382	0.5617	0.7495
0.3872	10.8085	508	0.5598	0.5243	0.5598	0.7482
0.3872	10.8511	510	0.5736	0.5113	0.5736	0.7574
0.3872	10.8936	512	0.6364	0.4969	0.6364	0.7977
0.3872	10.9362	514	0.7031	0.4666	0.7031	0.8385
0.3872	10.9787	516	0.6629	0.4775	0.6629	0.8142
0.3872	11.0213	518	0.5956	0.5076	0.5956	0.7717
0.3872	11.0638	520	0.5781	0.5635	0.5781	0.7603
0.3872	11.1064	522	0.5807	0.5474	0.5807	0.7620
0.3872	11.1489	524	0.5896	0.5613	0.5896	0.7679
0.3872	11.1915	526	0.6157	0.5063	0.6157	0.7846
0.3872	11.2340	528	0.6400	0.4895	0.6400	0.8000
0.3872	11.2766	530	0.6724	0.4771	0.6724	0.8200
0.3872	11.3191	532	0.6703	0.4704	0.6703	0.8187
0.3872	11.3617	534	0.6343	0.4847	0.6343	0.7964
0.3872	11.4043	536	0.5904	0.4783	0.5904	0.7684
0.3872	11.4468	538	0.5925	0.3917	0.5925	0.7698
0.3872	11.4894	540	0.5979	0.3917	0.5979	0.7733
0.3872	11.5319	542	0.5871	0.4134	0.5871	0.7662
0.3872	11.5745	544	0.5777	0.4640	0.5777	0.7600
0.3872	11.6170	546	0.6167	0.5003	0.6167	0.7853
0.3872	11.6596	548	0.6686	0.4525	0.6686	0.8176
0.3872	11.7021	550	0.6645	0.4803	0.6645	0.8152
0.3872	11.7447	552	0.6133	0.5003	0.6133	0.7831
0.3872	11.7872	554	0.5948	0.5098	0.5948	0.7712
0.3872	11.8298	556	0.5762	0.4700	0.5762	0.7591
0.3872	11.8723	558	0.5726	0.5198	0.5726	0.7567
0.3872	11.9149	560	0.5680	0.5143	0.5680	0.7536
0.3872	11.9574	562	0.5557	0.5317	0.5557	0.7454
0.3872	12.0	564	0.5584	0.5169	0.5584	0.7473
0.3872	12.0426	566	0.5578	0.5169	0.5578	0.7469
0.3872	12.0851	568	0.5533	0.5396	0.5533	0.7439
0.3872	12.1277	570	0.5540	0.5396	0.5540	0.7443
0.3872	12.1702	572	0.5521	0.5285	0.5521	0.7430
0.3872	12.2128	574	0.5681	0.4990	0.5681	0.7537
0.3872	12.2553	576	0.5525	0.5218	0.5525	0.7433
0.3872	12.2979	578	0.5394	0.5251	0.5394	0.7344
0.3872	12.3404	580	0.5479	0.4923	0.5479	0.7402
0.3872	12.3830	582	0.5443	0.4937	0.5443	0.7377
0.3872	12.4255	584	0.5419	0.4937	0.5419	0.7361
0.3872	12.4681	586	0.5526	0.4533	0.5526	0.7434
0.3872	12.5106	588	0.5803	0.4360	0.5803	0.7617
0.3872	12.5532	590	0.5835	0.4367	0.5835	0.7638
0.3872	12.5957	592	0.5712	0.4438	0.5712	0.7558
0.3872	12.6383	594	0.5540	0.4314	0.5540	0.7443

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1