ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k16_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.3764
• Qwk: 0.4593
• Mse: 1.3764
• Rmse: 1.1732

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0286	2	6.8337	0.0242	6.8337	2.6141
No log	0.0571	4	4.4891	0.0928	4.4891	2.1187
No log	0.0857	6	3.6095	-0.0417	3.6095	1.8999
No log	0.1143	8	2.6066	0.0805	2.6066	1.6145
No log	0.1429	10	2.3240	0.0833	2.3240	1.5245
No log	0.1714	12	2.4556	0.0946	2.4556	1.5670
No log	0.2	14	2.0410	0.0960	2.0410	1.4286
No log	0.2286	16	1.8799	0.2931	1.8799	1.3711
No log	0.2571	18	1.7234	0.2957	1.7234	1.3128
No log	0.2857	20	1.5811	0.3036	1.5811	1.2574
No log	0.3143	22	1.4460	0.1869	1.4460	1.2025
No log	0.3429	24	1.5540	0.1321	1.5540	1.2466
No log	0.3714	26	1.4213	0.2222	1.4213	1.1922
No log	0.4	28	1.5136	0.3193	1.5136	1.2303
No log	0.4286	30	1.9478	0.2105	1.9478	1.3956
No log	0.4571	32	2.0764	0.2014	2.0764	1.4410
No log	0.4857	34	1.5700	0.3281	1.5700	1.2530
No log	0.5143	36	1.2381	0.3826	1.2381	1.1127
No log	0.5429	38	1.2643	0.3423	1.2643	1.1244
No log	0.5714	40	1.2574	0.4068	1.2574	1.1213
No log	0.6	42	1.2750	0.4298	1.2750	1.1291
No log	0.6286	44	1.6089	0.3220	1.6089	1.2684
No log	0.6571	46	1.6026	0.3636	1.6026	1.2659
No log	0.6857	48	1.0863	0.5156	1.0863	1.0423
No log	0.7143	50	0.9043	0.6809	0.9043	0.9509
No log	0.7429	52	1.0416	0.5538	1.0416	1.0206
No log	0.7714	54	1.5162	0.3200	1.5162	1.2313
No log	0.8	56	1.3478	0.4580	1.3478	1.1610
No log	0.8286	58	0.9924	0.6269	0.9924	0.9962
No log	0.8571	60	0.9594	0.6763	0.9594	0.9795
No log	0.8857	62	1.1393	0.5481	1.1393	1.0674
No log	0.9143	64	1.1885	0.5255	1.1885	1.0902
No log	0.9429	66	1.0726	0.6222	1.0726	1.0357
No log	0.9714	68	1.0284	0.5649	1.0284	1.0141
No log	1.0	70	1.0905	0.6324	1.0905	1.0443
No log	1.0286	72	1.0872	0.6131	1.0872	1.0427
No log	1.0571	74	1.1639	0.5493	1.1639	1.0788
No log	1.0857	76	1.4816	0.4965	1.4816	1.2172
No log	1.1143	78	1.4626	0.5143	1.4626	1.2094
No log	1.1429	80	1.4851	0.5180	1.4851	1.2186
No log	1.1714	82	1.3317	0.4889	1.3317	1.1540
No log	1.2	84	1.2976	0.4062	1.2976	1.1391
No log	1.2286	86	1.4304	0.4032	1.4304	1.1960
No log	1.2571	88	1.7350	0.3333	1.7350	1.3172
No log	1.2857	90	1.8839	0.2880	1.8839	1.3725
No log	1.3143	92	1.8076	0.2326	1.8076	1.3445
No log	1.3429	94	1.2636	0.5109	1.2636	1.1241
No log	1.3714	96	1.0193	0.5857	1.0193	1.0096
No log	1.4	98	1.2112	0.5674	1.2112	1.1005
No log	1.4286	100	1.5935	0.4113	1.5935	1.2623
No log	1.4571	102	1.3159	0.5217	1.3159	1.1471
No log	1.4857	104	0.8062	0.7050	0.8062	0.8979
No log	1.5143	106	0.7865	0.7391	0.7865	0.8869
No log	1.5429	108	0.9035	0.6418	0.9035	0.9505
No log	1.5714	110	1.2976	0.4964	1.2976	1.1391
No log	1.6	112	1.3322	0.4964	1.3322	1.1542
No log	1.6286	114	1.0269	0.6074	1.0269	1.0134
No log	1.6571	116	0.8800	0.6377	0.8800	0.9381
No log	1.6857	118	0.9260	0.6331	0.9260	0.9623
No log	1.7143	120	1.1650	0.5315	1.1650	1.0794
No log	1.7429	122	1.4832	0.4895	1.4832	1.2179
No log	1.7714	124	1.4908	0.4615	1.4908	1.2210
No log	1.8	126	1.4700	0.4476	1.4700	1.2124
No log	1.8286	128	1.2040	0.5468	1.2040	1.0972
No log	1.8571	130	1.0580	0.6615	1.0580	1.0286
No log	1.8857	132	1.0125	0.4959	1.0125	1.0062
No log	1.9143	134	1.0953	0.6299	1.0953	1.0466
No log	1.9429	136	1.3044	0.5075	1.3044	1.1421
No log	1.9714	138	1.4761	0.4265	1.4761	1.2150
No log	2.0	140	1.4946	0.4265	1.4946	1.2225
No log	2.0286	142	1.3233	0.5263	1.3233	1.1504
No log	2.0571	144	1.2769	0.5926	1.2769	1.1300
No log	2.0857	146	1.5574	0.3942	1.5574	1.2480
No log	2.1143	148	1.7650	0.2222	1.7650	1.3285
No log	2.1429	150	1.6343	0.3333	1.6343	1.2784
No log	2.1714	152	1.4845	0.3971	1.4845	1.2184
No log	2.2	154	1.2324	0.5152	1.2324	1.1101
No log	2.2286	156	1.0931	0.5938	1.0931	1.0455
No log	2.2571	158	1.0929	0.5645	1.0929	1.0454
No log	2.2857	160	1.2566	0.4812	1.2566	1.1210
No log	2.3143	162	1.2894	0.4812	1.2894	1.1355
No log	2.3429	164	1.2423	0.5075	1.2423	1.1146
No log	2.3714	166	1.1305	0.5758	1.1305	1.0633
No log	2.4	168	0.9736	0.6471	0.9736	0.9867
No log	2.4286	170	0.9289	0.6567	0.9289	0.9638
No log	2.4571	172	1.0946	0.6232	1.0946	1.0462
No log	2.4857	174	1.4287	0.4593	1.4287	1.1953
No log	2.5143	176	1.3580	0.4706	1.3580	1.1653
No log	2.5429	178	1.0219	0.6232	1.0219	1.0109
No log	2.5714	180	0.9143	0.6277	0.9143	0.9562
No log	2.6	182	0.9552	0.6232	0.9552	0.9773
No log	2.6286	184	1.0716	0.5857	1.0716	1.0352
No log	2.6571	186	0.9842	0.6232	0.9842	0.9921
No log	2.6857	188	0.8826	0.6471	0.8826	0.9395
No log	2.7143	190	1.0422	0.6176	1.0422	1.0209
No log	2.7429	192	1.2937	0.4889	1.2937	1.1374
No log	2.7714	194	1.3087	0.4889	1.3087	1.1440
No log	2.8	196	1.0811	0.6087	1.0811	1.0398
No log	2.8286	198	0.8948	0.6418	0.8948	0.9459
No log	2.8571	200	0.9906	0.6187	0.9906	0.9953
No log	2.8857	202	1.3906	0.4593	1.3906	1.1792
No log	2.9143	204	1.5787	0.3429	1.5787	1.2564
No log	2.9429	206	1.3830	0.4662	1.3830	1.1760
No log	2.9714	208	1.1465	0.5385	1.1465	1.0707
No log	3.0	210	1.0218	0.6129	1.0218	1.0108
No log	3.0286	212	1.0315	0.5246	1.0315	1.0156
No log	3.0571	214	1.1276	0.6032	1.1276	1.0619
No log	3.0857	216	1.4077	0.4320	1.4077	1.1865
No log	3.1143	218	1.5440	0.4531	1.5440	1.2426
No log	3.1429	220	1.5291	0.4531	1.5291	1.2365
No log	3.1714	222	1.3984	0.5039	1.3984	1.1825
No log	3.2	224	1.4500	0.4341	1.4500	1.2041
No log	3.2286	226	1.6216	0.2923	1.6216	1.2734
No log	3.2571	228	1.5246	0.3556	1.5246	1.2347
No log	3.2857	230	1.3671	0.4783	1.3671	1.1692
No log	3.3143	232	1.4404	0.4265	1.4404	1.2001
No log	3.3429	234	1.7448	0.2609	1.7448	1.3209
No log	3.3714	236	1.8269	0.2774	1.8269	1.3516
No log	3.4	238	1.5437	0.3582	1.5437	1.2425
No log	3.4286	240	1.2087	0.5191	1.2087	1.0994
No log	3.4571	242	1.0510	0.6212	1.0510	1.0252
No log	3.4857	244	1.0694	0.5954	1.0694	1.0341
No log	3.5143	246	1.2784	0.5263	1.2784	1.1307
No log	3.5429	248	1.4112	0.4925	1.4112	1.1879
No log	3.5714	250	1.5436	0.4058	1.5436	1.2424
No log	3.6	252	1.4830	0.4234	1.4830	1.2178
No log	3.6286	254	1.5739	0.3571	1.5739	1.2546
No log	3.6571	256	1.5217	0.4058	1.5217	1.2336
No log	3.6857	258	1.4990	0.4148	1.4990	1.2243
No log	3.7143	260	1.4782	0.4030	1.4782	1.2158
No log	3.7429	262	1.4390	0.4545	1.4390	1.1996
No log	3.7714	264	1.4553	0.4545	1.4553	1.2064
No log	3.8	266	1.3295	0.5191	1.3295	1.1531
No log	3.8286	268	1.2024	0.5564	1.2024	1.0965
No log	3.8571	270	1.1636	0.5735	1.1636	1.0787
No log	3.8857	272	1.2539	0.5	1.2539	1.1198
No log	3.9143	274	1.3901	0.4559	1.3901	1.1790
No log	3.9429	276	1.3526	0.4818	1.3526	1.1630
No log	3.9714	278	1.4592	0.4511	1.4592	1.2080
No log	4.0	280	1.8012	0.2774	1.8012	1.3421
No log	4.0286	282	2.0166	0.2014	2.0166	1.4201
No log	4.0571	284	1.7866	0.3066	1.7866	1.3366
No log	4.0857	286	1.3599	0.4627	1.3599	1.1662
No log	4.1143	288	1.0635	0.5865	1.0635	1.0313
No log	4.1429	290	1.0123	0.6119	1.0123	1.0061
No log	4.1714	292	1.1615	0.5693	1.1615	1.0777
No log	4.2	294	1.3948	0.4593	1.3948	1.1810
No log	4.2286	296	1.3104	0.4889	1.3104	1.1447
No log	4.2571	298	1.0651	0.5778	1.0651	1.0320
No log	4.2857	300	0.9699	0.6519	0.9699	0.9849
No log	4.3143	302	1.0309	0.6176	1.0309	1.0153
No log	4.3429	304	1.3110	0.4706	1.3110	1.1450
No log	4.3714	306	1.7069	0.3478	1.7069	1.3065
No log	4.4	308	1.7723	0.2899	1.7723	1.3313
No log	4.4286	310	1.5822	0.4088	1.5822	1.2578
No log	4.4571	312	1.3861	0.5	1.3861	1.1773
No log	4.4857	314	1.3641	0.5	1.3641	1.1679
No log	4.5143	316	1.4717	0.4203	1.4717	1.2131
No log	4.5429	318	1.6087	0.3768	1.6087	1.2683
No log	4.5714	320	1.6747	0.3453	1.6747	1.2941
No log	4.6	322	1.5752	0.3942	1.5752	1.2551
No log	4.6286	324	1.4327	0.4203	1.4327	1.1970
No log	4.6571	326	1.2610	0.5496	1.2610	1.1230
No log	4.6857	328	1.1840	0.5758	1.1840	1.0881
No log	4.7143	330	1.2157	0.5496	1.2157	1.1026
No log	4.7429	332	1.3424	0.5075	1.3424	1.1586
No log	4.7714	334	1.5371	0.3407	1.5371	1.2398
No log	4.8	336	1.6706	0.2878	1.6706	1.2925
No log	4.8286	338	1.6747	0.2714	1.6747	1.2941
No log	4.8571	340	1.5275	0.3731	1.5275	1.2359
No log	4.8857	342	1.3610	0.5414	1.3610	1.1666
No log	4.9143	344	1.3677	0.5075	1.3677	1.1695
No log	4.9429	346	1.4244	0.4889	1.4244	1.1935
No log	4.9714	348	1.4352	0.4380	1.4352	1.1980
No log	5.0	350	1.4374	0.4380	1.4374	1.1989
No log	5.0286	352	1.2030	0.5333	1.2030	1.0968
No log	5.0571	354	1.1369	0.5821	1.1369	1.0662
No log	5.0857	356	1.2578	0.5333	1.2578	1.1215
No log	5.1143	358	1.5682	0.3623	1.5682	1.2523
No log	5.1429	360	1.7093	0.3212	1.7093	1.3074
No log	5.1714	362	1.6142	0.3286	1.6142	1.2705
No log	5.2	364	1.4060	0.4706	1.4060	1.1858
No log	5.2286	366	1.2391	0.5414	1.2391	1.1131
No log	5.2571	368	1.1590	0.5426	1.1590	1.0766
No log	5.2857	370	1.1743	0.5426	1.1743	1.0837
No log	5.3143	372	1.1697	0.5692	1.1697	1.0815
No log	5.3429	374	1.2521	0.5714	1.2521	1.1190
No log	5.3714	376	1.4472	0.4706	1.4472	1.2030
No log	5.4	378	1.4903	0.4706	1.4903	1.2208
No log	5.4286	380	1.4069	0.4706	1.4069	1.1861
No log	5.4571	382	1.3369	0.5075	1.3369	1.1563
No log	5.4857	384	1.3297	0.5075	1.3297	1.1531
No log	5.5143	386	1.2427	0.5455	1.2427	1.1148
No log	5.5429	388	1.0827	0.5649	1.0827	1.0405
No log	5.5714	390	0.9922	0.5692	0.9922	0.9961
No log	5.6	392	0.9703	0.6015	0.9703	0.9851
No log	5.6286	394	1.0948	0.5821	1.0948	1.0463
No log	5.6571	396	1.3265	0.5147	1.3265	1.1517
No log	5.6857	398	1.3873	0.4889	1.3873	1.1778
No log	5.7143	400	1.2730	0.5373	1.2730	1.1283
No log	5.7429	402	1.2221	0.5481	1.2221	1.1055
No log	5.7714	404	1.1536	0.5649	1.1536	1.0741
No log	5.8	406	1.1435	0.6015	1.1435	1.0694
No log	5.8286	408	1.0895	0.6	1.0895	1.0438
No log	5.8571	410	1.1584	0.5891	1.1584	1.0763
No log	5.8857	412	1.2302	0.5846	1.2302	1.1091
No log	5.9143	414	1.2604	0.5606	1.2604	1.1227
No log	5.9429	416	1.2379	0.5714	1.2379	1.1126
No log	5.9714	418	1.0615	0.5649	1.0615	1.0303
No log	6.0	420	0.9040	0.6015	0.9040	0.9508
No log	6.0286	422	0.8775	0.5970	0.8775	0.9367
No log	6.0571	424	1.0238	0.5714	1.0238	1.0118
No log	6.0857	426	1.2761	0.4889	1.2761	1.1297
No log	6.1143	428	1.3554	0.5072	1.3554	1.1642
No log	6.1429	430	1.2540	0.4885	1.2540	1.1198
No log	6.1714	432	1.0339	0.5231	1.0339	1.0168
No log	6.2	434	0.9861	0.5736	0.9861	0.9930
No log	6.2286	436	1.1010	0.5385	1.1010	1.0493
No log	6.2571	438	1.2149	0.5455	1.2149	1.1022
No log	6.2857	440	1.3697	0.5077	1.3697	1.1703
No log	6.3143	442	1.3210	0.5970	1.3210	1.1494
No log	6.3429	444	1.2623	0.5985	1.2623	1.1235
No log	6.3714	446	1.2335	0.5821	1.2335	1.1106
No log	6.4	448	1.2572	0.5564	1.2572	1.1213
No log	6.4286	450	1.2073	0.5564	1.2073	1.0988
No log	6.4571	452	1.1963	0.5303	1.1963	1.0938
No log	6.4857	454	1.2310	0.5564	1.2310	1.1095
No log	6.5143	456	1.2620	0.5778	1.2620	1.1234
No log	6.5429	458	1.2205	0.5714	1.2205	1.1048
No log	6.5714	460	1.1813	0.5758	1.1813	1.0869
No log	6.6	462	1.1858	0.5758	1.1858	1.0890
No log	6.6286	464	1.2509	0.5758	1.2509	1.1184
No log	6.6571	466	1.3665	0.4593	1.3665	1.1690
No log	6.6857	468	1.3494	0.4706	1.3494	1.1616
No log	6.7143	470	1.3706	0.4818	1.3706	1.1707
No log	6.7429	472	1.2916	0.5072	1.2916	1.1365
No log	6.7714	474	1.1484	0.5985	1.1484	1.0716
No log	6.8	476	1.1952	0.5985	1.1952	1.0932
No log	6.8286	478	1.2637	0.5441	1.2637	1.1241
No log	6.8571	480	1.2950	0.5441	1.2950	1.1380
No log	6.8857	482	1.2568	0.5778	1.2568	1.1211
No log	6.9143	484	1.2612	0.5778	1.2612	1.1230
No log	6.9429	486	1.1672	0.5821	1.1672	1.0804
No log	6.9714	488	1.1548	0.5649	1.1548	1.0746
No log	7.0	490	1.2945	0.5522	1.2945	1.1378
No log	7.0286	492	1.4219	0.4812	1.4219	1.1924
No log	7.0571	494	1.3554	0.5152	1.3554	1.1642
No log	7.0857	496	1.2111	0.5197	1.2111	1.1005
No log	7.1143	498	1.2144	0.4793	1.2144	1.1020
0.3532	7.1429	500	1.2226	0.5323	1.2226	1.1057
0.3532	7.1714	502	1.2471	0.5385	1.2471	1.1167
0.3532	7.2	504	1.3811	0.4925	1.3811	1.1752
0.3532	7.2286	506	1.4908	0.3971	1.4908	1.2210
0.3532	7.2571	508	1.4098	0.5	1.4098	1.1874
0.3532	7.2857	510	1.3510	0.5	1.3510	1.1623
0.3532	7.3143	512	1.3337	0.5373	1.3337	1.1549
0.3532	7.3429	514	1.2646	0.5649	1.2646	1.1245
0.3532	7.3714	516	1.2132	0.5938	1.2132	1.1015
0.3532	7.4	518	1.2061	0.5938	1.2061	1.0982
0.3532	7.4286	520	1.2082	0.5649	1.2082	1.0992
0.3532	7.4571	522	1.2063	0.5649	1.2063	1.0983
0.3532	7.4857	524	1.2944	0.5373	1.2944	1.1377
0.3532	7.5143	526	1.3583	0.4672	1.3583	1.1654
0.3532	7.5429	528	1.3764	0.4783	1.3764	1.1732
0.3532	7.5714	530	1.4234	0.4853	1.4234	1.1931
0.3532	7.6	532	1.5196	0.4234	1.5196	1.2327
0.3532	7.6286	534	1.3764	0.4593	1.3764	1.1732

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1