ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k10_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 2.1693
• Qwk: 0.1831
• Mse: 2.1693
• Rmse: 1.4728

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0455	2	7.0895	0.0057	7.0895	2.6626
No log	0.0909	4	4.7478	0.0565	4.7478	2.1789
No log	0.1364	6	3.9747	-0.0505	3.9747	1.9937
No log	0.1818	8	2.5900	0.1351	2.5900	1.6093
No log	0.2273	10	1.9907	0.1311	1.9907	1.4109
No log	0.2727	12	1.8751	0.0536	1.8751	1.3694
No log	0.3182	14	2.2222	0.0164	2.2222	1.4907
No log	0.3636	16	2.8589	-0.0274	2.8589	1.6908
No log	0.4091	18	2.5167	0.0429	2.5167	1.5864
No log	0.4545	20	2.0094	0.0640	2.0094	1.4175
No log	0.5	22	1.9987	0.1562	1.9987	1.4138
No log	0.5455	24	1.9117	0.3231	1.9117	1.3827
No log	0.5909	26	2.0568	0.2286	2.0568	1.4342
No log	0.6364	28	2.1574	0.125	2.1574	1.4688
No log	0.6818	30	2.2435	0.0544	2.2435	1.4978
No log	0.7273	32	2.0353	0.2774	2.0353	1.4266
No log	0.7727	34	1.9802	0.3906	1.9802	1.4072
No log	0.8182	36	2.0736	0.1583	2.0736	1.4400
No log	0.8636	38	2.0518	0.2370	2.0518	1.4324
No log	0.9091	40	1.9817	0.3846	1.9817	1.4077
No log	0.9545	42	1.9613	0.3906	1.9613	1.4005
No log	1.0	44	1.9192	0.3594	1.9192	1.3854
No log	1.0455	46	1.8035	0.3636	1.8035	1.3430
No log	1.0909	48	1.5298	0.3478	1.5298	1.2369
No log	1.1364	50	1.3674	0.1887	1.3674	1.1694
No log	1.1818	52	1.3455	0.2056	1.3455	1.1600
No log	1.2273	54	1.3763	0.3063	1.3763	1.1732
No log	1.2727	56	1.4238	0.3063	1.4238	1.1932
No log	1.3182	58	1.5439	0.3103	1.5439	1.2425
No log	1.3636	60	1.5795	0.3810	1.5795	1.2568
No log	1.4091	62	1.4686	0.3968	1.4686	1.2119
No log	1.4545	64	1.5749	0.3692	1.5749	1.2550
No log	1.5	66	1.7223	0.3692	1.7223	1.3124
No log	1.5455	68	1.4890	0.3438	1.4890	1.2202
No log	1.5909	70	1.3120	0.3276	1.3120	1.1454
No log	1.6364	72	1.2441	0.3186	1.2441	1.1154
No log	1.6818	74	1.2246	0.3540	1.2246	1.1066
No log	1.7273	76	1.2269	0.3717	1.2269	1.1077
No log	1.7727	78	1.3114	0.3193	1.3114	1.1452
No log	1.8182	80	1.4085	0.352	1.4085	1.1868
No log	1.8636	82	1.4412	0.3548	1.4412	1.2005
No log	1.9091	84	1.3225	0.3009	1.3225	1.1500
No log	1.9545	86	1.2901	0.3684	1.2901	1.1358
No log	2.0	88	1.3372	0.2727	1.3372	1.1564
No log	2.0455	90	1.4074	0.3684	1.4074	1.1864
No log	2.0909	92	1.4709	0.3793	1.4709	1.2128
No log	2.1364	94	1.5271	0.3932	1.5271	1.2358
No log	2.1818	96	1.4938	0.3932	1.4938	1.2222
No log	2.2273	98	1.4163	0.3684	1.4163	1.1901
No log	2.2727	100	1.4152	0.2727	1.4152	1.1896
No log	2.3182	102	1.4499	0.1887	1.4499	1.2041
No log	2.3636	104	1.4171	0.1905	1.4171	1.1904
No log	2.4091	106	1.3982	0.4386	1.3982	1.1824
No log	2.4545	108	1.4768	0.3478	1.4768	1.2152
No log	2.5	110	1.5606	0.3248	1.5606	1.2492
No log	2.5455	112	1.6272	0.3252	1.6272	1.2756
No log	2.5909	114	1.6511	0.3231	1.6511	1.2849
No log	2.6364	116	1.6269	0.3609	1.6269	1.2755
No log	2.6818	118	1.4837	0.3281	1.4837	1.2181
No log	2.7273	120	1.4089	0.4375	1.4089	1.1870
No log	2.7727	122	1.4547	0.3969	1.4547	1.2061
No log	2.8182	124	1.3248	0.4127	1.3248	1.1510
No log	2.8636	126	1.2957	0.4667	1.2957	1.1383
No log	2.9091	128	1.4916	0.3833	1.4916	1.2213
No log	2.9545	130	1.5257	0.3276	1.5257	1.2352
No log	3.0	132	1.4994	0.4132	1.4994	1.2245
No log	3.0455	134	1.3807	0.3761	1.3807	1.1750
No log	3.0909	136	1.3915	0.3898	1.3915	1.1796
No log	3.1364	138	1.3629	0.4333	1.3629	1.1675
No log	3.1818	140	1.5369	0.4462	1.5369	1.2397
No log	3.2273	142	1.8449	0.2676	1.8449	1.3583
No log	3.2727	144	2.1437	0.1793	2.1437	1.4641
No log	3.3182	146	2.1164	0.1549	2.1164	1.4548
No log	3.3636	148	2.1327	0.1460	2.1327	1.4604
No log	3.4091	150	2.2419	0.1277	2.2419	1.4973
No log	3.4545	152	2.2384	0.1678	2.2384	1.4961
No log	3.5	154	2.0268	0.2128	2.0268	1.4237
No log	3.5455	156	1.8132	0.2344	1.8132	1.3465
No log	3.5909	158	1.9453	0.2411	1.9453	1.3947
No log	3.6364	160	2.2830	0.1361	2.2830	1.5109
No log	3.6818	162	2.2742	0.1361	2.2742	1.5080
No log	3.7273	164	1.9874	0.2571	1.9874	1.4098
No log	3.7727	166	1.7676	0.2677	1.7676	1.3295
No log	3.8182	168	1.8060	0.2615	1.8060	1.3439
No log	3.8636	170	1.9237	0.2878	1.9237	1.3870
No log	3.9091	172	1.8549	0.3796	1.8549	1.3620
No log	3.9545	174	1.6793	0.3065	1.6793	1.2959
No log	4.0	176	1.6122	0.3415	1.6122	1.2697
No log	4.0455	178	1.6231	0.3622	1.6231	1.2740
No log	4.0909	180	1.6391	0.4122	1.6391	1.2803
No log	4.1364	182	1.6511	0.4179	1.6511	1.2850
No log	4.1818	184	1.7211	0.3942	1.7211	1.3119
No log	4.2273	186	1.9561	0.2553	1.9561	1.3986
No log	4.2727	188	2.0956	0.2740	2.0956	1.4476
No log	4.3182	190	2.0843	0.2603	2.0843	1.4437
No log	4.3636	192	1.9676	0.2797	1.9676	1.4027
No log	4.4091	194	2.0137	0.2917	2.0137	1.4190
No log	4.4545	196	2.1587	0.1667	2.1587	1.4693
No log	4.5	198	2.2434	0.1379	2.2434	1.4978
No log	4.5455	200	2.1947	0.1379	2.1947	1.4815
No log	4.5909	202	1.9413	0.2657	1.9413	1.3933
No log	4.6364	204	1.6689	0.3206	1.6689	1.2919
No log	4.6818	206	1.6127	0.3125	1.6127	1.2699
No log	4.7273	208	1.6399	0.4511	1.6399	1.2806
No log	4.7727	210	1.7397	0.3796	1.7397	1.3190
No log	4.8182	212	1.6738	0.4060	1.6738	1.2938
No log	4.8636	214	1.5059	0.3866	1.5059	1.2271
No log	4.9091	216	1.3987	0.4483	1.3987	1.1827
No log	4.9545	218	1.3618	0.48	1.3618	1.1670
No log	5.0	220	1.5089	0.3796	1.5089	1.2284
No log	5.0455	222	1.8414	0.2657	1.8414	1.3570
No log	5.0909	224	1.8304	0.2917	1.8304	1.3529
No log	5.1364	226	1.6310	0.2937	1.6310	1.2771
No log	5.1818	228	1.4509	0.4118	1.4509	1.2045
No log	5.2273	230	1.5407	0.3571	1.5407	1.2412
No log	5.2727	232	1.7465	0.2797	1.7465	1.3215
No log	5.3182	234	1.7655	0.2817	1.7655	1.3287
No log	5.3636	236	1.6634	0.3143	1.6634	1.2897
No log	5.4091	238	1.7222	0.3404	1.7222	1.3123
No log	5.4545	240	1.7026	0.3714	1.7026	1.3048
No log	5.5	242	1.6150	0.3453	1.6150	1.2708
No log	5.5455	244	1.7014	0.2917	1.7014	1.3044
No log	5.5909	246	1.8043	0.2917	1.8043	1.3432
No log	5.6364	248	1.9027	0.2917	1.9027	1.3794
No log	5.6818	250	1.8126	0.3217	1.8126	1.3463
No log	5.7273	252	1.7711	0.3217	1.7711	1.3308
No log	5.7727	254	1.5707	0.4058	1.5707	1.2533
No log	5.8182	256	1.4797	0.4444	1.4797	1.2164
No log	5.8636	258	1.5244	0.4211	1.5244	1.2347
No log	5.9091	260	1.7310	0.3404	1.7310	1.3157
No log	5.9545	262	1.8659	0.2657	1.8659	1.3660
No log	6.0	264	1.7690	0.2979	1.7690	1.3301
No log	6.0455	266	1.5015	0.4733	1.5015	1.2254
No log	6.0909	268	1.4184	0.3697	1.4184	1.1910
No log	6.1364	270	1.4777	0.4640	1.4777	1.2156
No log	6.1818	272	1.7338	0.3714	1.7338	1.3167
No log	6.2273	274	1.8850	0.2917	1.8850	1.3729
No log	6.2727	276	1.8656	0.2917	1.8656	1.3659
No log	6.3182	278	1.6642	0.3885	1.6642	1.2900
No log	6.3636	280	1.4312	0.4361	1.4312	1.1963
No log	6.4091	282	1.4156	0.4593	1.4156	1.1898
No log	6.4545	284	1.6247	0.3429	1.6247	1.2746
No log	6.5	286	1.9626	0.2917	1.9626	1.4009
No log	6.5455	288	2.1171	0.2345	2.1171	1.4550
No log	6.5909	290	2.1009	0.2897	2.1009	1.4495
No log	6.6364	292	1.7800	0.2897	1.7800	1.3342
No log	6.6818	294	1.4149	0.4526	1.4149	1.1895
No log	6.7273	296	1.3450	0.4812	1.3450	1.1597
No log	6.7727	298	1.4358	0.4	1.4358	1.1983
No log	6.8182	300	1.7279	0.3077	1.7279	1.3145
No log	6.8636	302	2.0884	0.2345	2.0884	1.4451
No log	6.9091	304	2.1915	0.1667	2.1915	1.4804
No log	6.9545	306	2.0651	0.1818	2.0651	1.4370
No log	7.0	308	1.7858	0.3404	1.7858	1.3364
No log	7.0455	310	1.5719	0.3876	1.5719	1.2537
No log	7.0909	312	1.4760	0.3740	1.4760	1.2149
No log	7.1364	314	1.4931	0.4062	1.4931	1.2219
No log	7.1818	316	1.6581	0.3741	1.6581	1.2877
No log	7.2273	318	1.9301	0.2917	1.9301	1.3893
No log	7.2727	320	1.9632	0.2917	1.9632	1.4011
No log	7.3182	322	1.8376	0.2917	1.8376	1.3556
No log	7.3636	324	1.6933	0.3239	1.6933	1.3013
No log	7.4091	326	1.6842	0.3380	1.6842	1.2978
No log	7.4545	328	1.5971	0.3571	1.5971	1.2638
No log	7.5	330	1.6283	0.3380	1.6283	1.2761
No log	7.5455	332	1.8088	0.2759	1.8088	1.3449
No log	7.5909	334	1.8436	0.2759	1.8436	1.3578
No log	7.6364	336	1.7180	0.2759	1.7180	1.3107
No log	7.6818	338	1.5819	0.3796	1.5819	1.2577
No log	7.7273	340	1.5102	0.3871	1.5102	1.2289
No log	7.7727	342	1.5187	0.4580	1.5187	1.2324
No log	7.8182	344	1.6159	0.3714	1.6159	1.2712
No log	7.8636	346	1.6883	0.3380	1.6883	1.2993
No log	7.9091	348	1.6220	0.3741	1.6220	1.2736
No log	7.9545	350	1.5280	0.3089	1.5280	1.2361
No log	8.0	352	1.5495	0.2787	1.5495	1.2448
No log	8.0455	354	1.6498	0.2857	1.6498	1.2844
No log	8.0909	356	1.8624	0.3143	1.8624	1.3647
No log	8.1364	358	2.3092	0.2055	2.3092	1.5196
No log	8.1818	360	2.4277	0.1667	2.4277	1.5581
No log	8.2273	362	2.2672	0.1818	2.2672	1.5057
No log	8.2727	364	2.0894	0.1831	2.0894	1.4455
No log	8.3182	366	1.9145	0.2429	1.9145	1.3837
No log	8.3636	368	1.8447	0.2482	1.8447	1.3582
No log	8.4091	370	1.9688	0.2270	1.9688	1.4031
No log	8.4545	372	2.2243	0.1818	2.2243	1.4914
No log	8.5	374	2.4274	0.1818	2.4274	1.5580
No log	8.5455	376	2.2932	0.1818	2.2932	1.5143
No log	8.5909	378	1.9665	0.1972	1.9665	1.4023
No log	8.6364	380	1.7603	0.2920	1.7603	1.3268
No log	8.6818	382	1.6910	0.3008	1.6910	1.3004
No log	8.7273	384	1.8457	0.2590	1.8457	1.3586
No log	8.7727	386	2.2306	0.1831	2.2306	1.4935
No log	8.8182	388	2.3887	0.1831	2.3887	1.5455
No log	8.8636	390	2.2474	0.1831	2.2474	1.4991
No log	8.9091	392	1.9620	0.2098	1.9620	1.4007
No log	8.9545	394	1.6945	0.3188	1.6945	1.3017
No log	9.0	396	1.4983	0.3817	1.4983	1.2241
No log	9.0455	398	1.4505	0.4286	1.4505	1.2044
No log	9.0909	400	1.5192	0.3538	1.5192	1.2326
No log	9.1364	402	1.6679	0.3623	1.6679	1.2915
No log	9.1818	404	1.8469	0.2609	1.8469	1.3590
No log	9.2273	406	1.8585	0.2609	1.8585	1.3633
No log	9.2727	408	1.8311	0.2920	1.8311	1.3532
No log	9.3182	410	1.8361	0.2754	1.8361	1.3550
No log	9.3636	412	1.7547	0.3664	1.7547	1.3247
No log	9.4091	414	1.8237	0.2941	1.8237	1.3504
No log	9.4545	416	2.0895	0.1831	2.0895	1.4455
No log	9.5	418	2.3153	0.1818	2.3153	1.5216
No log	9.5455	420	2.1457	0.1831	2.1457	1.4648
No log	9.5909	422	1.8759	0.1986	1.8759	1.3696
No log	9.6364	424	1.7396	0.2794	1.7396	1.3189
No log	9.6818	426	1.7396	0.2985	1.7396	1.3190
No log	9.7273	428	1.7908	0.2794	1.7908	1.3382
No log	9.7727	430	1.7677	0.2985	1.7677	1.3295
No log	9.8182	432	1.8648	0.1986	1.8648	1.3656
No log	9.8636	434	2.0003	0.1831	2.0003	1.4143
No log	9.9091	436	2.1938	0.1818	2.1938	1.4812
No log	9.9545	438	2.4049	0.1818	2.4049	1.5508
No log	10.0	440	2.3997	0.1818	2.3997	1.5491
No log	10.0455	442	2.1646	0.1831	2.1646	1.4713
No log	10.0909	444	2.0230	0.1702	2.0230	1.4223
No log	10.1364	446	1.9547	0.1702	1.9547	1.3981
No log	10.1818	448	1.9259	0.1972	1.9259	1.3878
No log	10.2273	450	1.9617	0.2098	1.9617	1.4006
No log	10.2727	452	2.0495	0.2098	2.0495	1.4316
No log	10.3182	454	2.0725	0.2098	2.0725	1.4396
No log	10.3636	456	1.9185	0.2098	1.9185	1.3851
No log	10.4091	458	1.7019	0.2899	1.7019	1.3046
No log	10.4545	460	1.5970	0.3704	1.5970	1.2637
No log	10.5	462	1.7201	0.2734	1.7201	1.3115
No log	10.5455	464	1.8729	0.2098	1.8729	1.3685
No log	10.5909	466	2.0014	0.1831	2.0014	1.4147
No log	10.6364	468	1.9982	0.1831	1.9982	1.4136
No log	10.6818	470	1.8923	0.1831	1.8923	1.3756
No log	10.7273	472	1.8391	0.1986	1.8391	1.3561
No log	10.7727	474	1.7711	0.2206	1.7711	1.3308
No log	10.8182	476	1.8874	0.1871	1.8874	1.3738
No log	10.8636	478	1.9921	0.1702	1.9921	1.4114
No log	10.9091	480	1.9066	0.1926	1.9066	1.3808
No log	10.9545	482	1.7945	0.2137	1.7945	1.3396
No log	11.0	484	1.8608	0.2121	1.8608	1.3641
No log	11.0455	486	2.0173	0.1702	2.0173	1.4203
No log	11.0909	488	2.2057	0.1831	2.2057	1.4852
No log	11.1364	490	2.3298	0.1831	2.3298	1.5264
No log	11.1818	492	2.2773	0.2098	2.2773	1.5091
No log	11.2273	494	2.0890	0.2098	2.0890	1.4453
No log	11.2727	496	1.8784	0.2254	1.8784	1.3706
No log	11.3182	498	1.8453	0.2553	1.8453	1.3584
0.5083	11.3636	500	1.9346	0.2098	1.9346	1.3909
0.5083	11.4091	502	2.0880	0.1831	2.0880	1.4450
0.5083	11.4545	504	2.2255	0.1667	2.2255	1.4918
0.5083	11.5	506	2.2907	0.1667	2.2907	1.5135
0.5083	11.5455	508	2.2583	0.1818	2.2583	1.5028
0.5083	11.5909	510	2.1693	0.1831	2.1693	1.4728

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1