ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k13_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.9276
• Qwk: 0.2254
• Mse: 1.9276
• Rmse: 1.3884

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0351	2	6.8937	0.0056	6.8937	2.6256
No log	0.0702	4	4.2982	0.1129	4.2982	2.0732
No log	0.1053	6	3.0362	0.0235	3.0362	1.7425
No log	0.1404	8	2.6921	0.1528	2.6921	1.6408
No log	0.1754	10	2.4855	0.0593	2.4855	1.5765
No log	0.2105	12	1.8873	0.1217	1.8873	1.3738
No log	0.2456	14	1.6451	0.1887	1.6451	1.2826
No log	0.2807	16	1.7132	0.2124	1.7132	1.3089
No log	0.3158	18	2.1412	0.2059	2.1412	1.4633
No log	0.3509	20	2.2782	0.1224	2.2782	1.5094
No log	0.3860	22	2.4239	0.0400	2.4239	1.5569
No log	0.4211	24	2.2288	0.1143	2.2288	1.4929
No log	0.4561	26	2.0400	0.2290	2.0400	1.4283
No log	0.4912	28	1.8505	0.2202	1.8505	1.3603
No log	0.5263	30	1.7987	0.25	1.7987	1.3411
No log	0.5614	32	1.7971	0.3103	1.7971	1.3406
No log	0.5965	34	1.7501	0.2655	1.7501	1.3229
No log	0.6316	36	1.7692	0.2931	1.7692	1.3301
No log	0.6667	38	1.7571	0.2632	1.7571	1.3256
No log	0.7018	40	1.6374	0.1524	1.6374	1.2796
No log	0.7368	42	1.6056	0.1538	1.6056	1.2671
No log	0.7719	44	1.5640	0.1538	1.5640	1.2506
No log	0.8070	46	1.5410	0.1524	1.5410	1.2414
No log	0.8421	48	1.5708	0.1495	1.5708	1.2533
No log	0.8772	50	1.7164	0.3167	1.7164	1.3101
No log	0.9123	52	1.8544	0.3721	1.8544	1.3618
No log	0.9474	54	1.8584	0.4062	1.8584	1.3632
No log	0.9825	56	1.7734	0.3548	1.7734	1.3317
No log	1.0175	58	1.6410	0.2456	1.6410	1.2810
No log	1.0526	60	1.5766	0.1132	1.5766	1.2556
No log	1.0877	62	1.5996	0.1132	1.5996	1.2648
No log	1.1228	64	1.6181	0.1308	1.6181	1.2720
No log	1.1579	66	1.6206	0.2385	1.6206	1.2730
No log	1.1930	68	1.6477	0.1495	1.6477	1.2836
No log	1.2281	70	1.9786	0.0	1.9786	1.4066
No log	1.2632	72	2.3141	0.0945	2.3141	1.5212
No log	1.2982	74	1.9623	0.1803	1.9623	1.4008
No log	1.3333	76	1.4947	0.2342	1.4947	1.2226
No log	1.3684	78	1.4044	0.2883	1.4044	1.1851
No log	1.4035	80	1.3713	0.3684	1.3713	1.1710
No log	1.4386	82	1.3394	0.3540	1.3394	1.1573
No log	1.4737	84	1.3059	0.3717	1.3059	1.1428
No log	1.5088	86	1.3010	0.3717	1.3010	1.1406
No log	1.5439	88	1.3011	0.3393	1.3011	1.1406
No log	1.5789	90	1.3003	0.3393	1.3003	1.1403
No log	1.6140	92	1.3424	0.4274	1.3424	1.1586
No log	1.6491	94	1.3990	0.4628	1.3990	1.1828
No log	1.6842	96	1.4835	0.5161	1.4835	1.2180
No log	1.7193	98	1.4651	0.4878	1.4651	1.2104
No log	1.7544	100	1.3721	0.4754	1.3721	1.1714
No log	1.7895	102	1.2657	0.5	1.2657	1.1250
No log	1.8246	104	1.2562	0.4538	1.2562	1.1208
No log	1.8596	106	1.2928	0.4407	1.2928	1.1370
No log	1.8947	108	1.2953	0.5366	1.2953	1.1381
No log	1.9298	110	1.2928	0.5079	1.2928	1.1370
No log	1.9649	112	1.4851	0.4462	1.4851	1.2186
No log	2.0	114	1.6076	0.3704	1.6076	1.2679
No log	2.0351	116	1.6067	0.3433	1.6067	1.2675
No log	2.0702	118	1.6423	0.2857	1.6423	1.2815
No log	2.1053	120	1.6176	0.3597	1.6176	1.2719
No log	2.1404	122	1.7096	0.3404	1.7096	1.3075
No log	2.1754	124	1.7624	0.3077	1.7624	1.3276
No log	2.2105	126	1.6728	0.2676	1.6728	1.2934
No log	2.2456	128	1.4015	0.4478	1.4015	1.1839
No log	2.2807	130	1.3751	0.4812	1.3751	1.1726
No log	2.3158	132	1.5698	0.3597	1.5698	1.2529
No log	2.3509	134	1.8173	0.2917	1.8173	1.3481
No log	2.3860	136	1.9235	0.2973	1.9235	1.3869
No log	2.4211	138	1.8622	0.2759	1.8622	1.3646
No log	2.4561	140	1.6228	0.3857	1.6228	1.2739
No log	2.4912	142	1.5927	0.3971	1.5927	1.2620
No log	2.5263	144	1.5599	0.4308	1.5599	1.2490
No log	2.5614	146	1.5802	0.3651	1.5802	1.2570
No log	2.5965	148	1.6424	0.3077	1.6424	1.2816
No log	2.6316	150	1.6699	0.4	1.6699	1.2922
No log	2.6667	152	1.6955	0.3688	1.6955	1.3021
No log	2.7018	154	1.7287	0.2937	1.7287	1.3148
No log	2.7368	156	1.7583	0.3121	1.7583	1.3260
No log	2.7719	158	1.6967	0.3066	1.6967	1.3026
No log	2.8070	160	1.7398	0.3143	1.7398	1.3190
No log	2.8421	162	1.6100	0.3309	1.6100	1.2689
No log	2.8772	164	1.4327	0.3741	1.4327	1.1969
No log	2.9123	166	1.2835	0.4762	1.2835	1.1329
No log	2.9474	168	1.3221	0.4407	1.3221	1.1498
No log	2.9825	170	1.4148	0.3932	1.4148	1.1895
No log	3.0175	172	1.5693	0.3220	1.5693	1.2527
No log	3.0526	174	1.7630	0.3407	1.7630	1.3278
No log	3.0877	176	1.9140	0.2609	1.9140	1.3835
No log	3.1228	178	1.8823	0.2609	1.8823	1.3720
No log	3.1579	180	1.7344	0.3407	1.7344	1.3170
No log	3.1930	182	1.5498	0.4580	1.5498	1.2449
No log	3.2281	184	1.4569	0.4733	1.4569	1.2070
No log	3.2632	186	1.5220	0.3824	1.5220	1.2337
No log	3.2982	188	1.7279	0.2979	1.7279	1.3145
No log	3.3333	190	1.8295	0.2657	1.8295	1.3526
No log	3.3684	192	1.7575	0.2657	1.7575	1.3257
No log	3.4035	194	1.6227	0.3000	1.6227	1.2738
No log	3.4386	196	1.5403	0.3913	1.5403	1.2411
No log	3.4737	198	1.6416	0.3429	1.6416	1.2812
No log	3.5088	200	1.8045	0.2695	1.8045	1.3433
No log	3.5439	202	1.9352	0.2394	1.9352	1.3911
No log	3.5789	204	1.8522	0.2695	1.8522	1.3610
No log	3.6140	206	1.7044	0.3333	1.7044	1.3055
No log	3.6491	208	1.6430	0.3308	1.6430	1.2818
No log	3.6842	210	1.6750	0.2963	1.6750	1.2942
No log	3.7193	212	1.6770	0.3088	1.6770	1.2950
No log	3.7544	214	1.7478	0.2464	1.7478	1.3220
No log	3.7895	216	1.7032	0.2774	1.7032	1.3051
No log	3.8246	218	1.5258	0.3780	1.5258	1.2353
No log	3.8596	220	1.4581	0.4651	1.4581	1.2075
No log	3.8947	222	1.5493	0.4242	1.5493	1.2447
No log	3.9298	224	1.5299	0.4242	1.5299	1.2369
No log	3.9649	226	1.4912	0.4769	1.4912	1.2212
No log	4.0	228	1.4418	0.5038	1.4418	1.2008
No log	4.0351	230	1.4538	0.5	1.4538	1.2057
No log	4.0702	232	1.4750	0.4394	1.4750	1.2145
No log	4.1053	234	1.5624	0.3453	1.5624	1.2500
No log	4.1404	236	1.6692	0.3121	1.6692	1.2920
No log	4.1754	238	1.6579	0.3143	1.6579	1.2876
No log	4.2105	240	1.4517	0.4593	1.4517	1.2049
No log	4.2456	242	1.3388	0.5191	1.3388	1.1571
No log	4.2807	244	1.3336	0.5263	1.3336	1.1548
No log	4.3158	246	1.3977	0.4091	1.3977	1.1823
No log	4.3509	248	1.4818	0.4031	1.4818	1.2173
No log	4.3860	250	1.6350	0.2963	1.6350	1.2787
No log	4.4211	252	1.6557	0.2963	1.6557	1.2868
No log	4.4561	254	1.5095	0.4030	1.5095	1.2286
No log	4.4912	256	1.3477	0.4921	1.3477	1.1609
No log	4.5263	258	1.3502	0.5	1.3502	1.1620
No log	4.5614	260	1.4870	0.4427	1.4870	1.2194
No log	4.5965	262	1.6471	0.3235	1.6471	1.2834
No log	4.6316	264	1.7098	0.2667	1.7098	1.3076
No log	4.6667	266	1.5796	0.3759	1.5796	1.2568
No log	4.7018	268	1.4563	0.4286	1.4563	1.2068
No log	4.7368	270	1.3390	0.4677	1.3390	1.1571
No log	4.7719	272	1.2708	0.4793	1.2708	1.1273
No log	4.8070	274	1.3217	0.4603	1.3217	1.1497
No log	4.8421	276	1.4835	0.4394	1.4835	1.2180
No log	4.8772	278	1.5281	0.4058	1.5281	1.2362
No log	4.9123	280	1.6700	0.3309	1.6700	1.2923
No log	4.9474	282	1.8180	0.2817	1.8180	1.3483
No log	4.9825	284	1.8594	0.2517	1.8594	1.3636
No log	5.0175	286	1.7524	0.2817	1.7524	1.3238
No log	5.0526	288	1.8069	0.2553	1.8069	1.3442
No log	5.0877	290	1.7674	0.3286	1.7674	1.3294
No log	5.1228	292	1.7024	0.3623	1.7024	1.3048
No log	5.1579	294	1.6388	0.3623	1.6388	1.2802
No log	5.1930	296	1.7104	0.3623	1.7104	1.3078
No log	5.2281	298	1.9958	0.2361	1.9958	1.4127
No log	5.2632	300	2.2870	0.1944	2.2870	1.5123
No log	5.2982	302	2.3444	0.1277	2.3444	1.5312
No log	5.3333	304	2.1208	0.1944	2.1208	1.4563
No log	5.3684	306	1.6932	0.3453	1.6932	1.3012
No log	5.4035	308	1.4131	0.5038	1.4131	1.1887
No log	5.4386	310	1.4045	0.5038	1.4045	1.1851
No log	5.4737	312	1.5840	0.3623	1.5840	1.2586
No log	5.5088	314	1.8038	0.2857	1.8038	1.3431
No log	5.5439	316	1.9186	0.2500	1.9186	1.3851
No log	5.5789	318	1.8892	0.2500	1.8892	1.3745
No log	5.6140	320	1.8162	0.2817	1.8162	1.3477
No log	5.6491	322	1.7182	0.2979	1.7182	1.3108
No log	5.6842	324	1.6683	0.3259	1.6683	1.2916
No log	5.7193	326	1.5973	0.3937	1.5973	1.2638
No log	5.7544	328	1.6243	0.3465	1.6243	1.2745
No log	5.7895	330	1.6646	0.3175	1.6646	1.2902
No log	5.8246	332	1.6347	0.3721	1.6347	1.2785
No log	5.8596	334	1.6306	0.3846	1.6306	1.2769
No log	5.8947	336	1.6757	0.3459	1.6757	1.2945
No log	5.9298	338	1.7104	0.3382	1.7104	1.3078
No log	5.9649	340	1.7226	0.3623	1.7226	1.3125
No log	6.0	342	1.7364	0.3453	1.7364	1.3177
No log	6.0351	344	1.7441	0.3121	1.7441	1.3206
No log	6.0702	346	1.7410	0.3286	1.7410	1.3195
No log	6.1053	348	1.7388	0.3121	1.7388	1.3186
No log	6.1404	350	1.8501	0.2657	1.8501	1.3602
No log	6.1754	352	1.7730	0.2676	1.7730	1.3315
No log	6.2105	354	1.5283	0.3971	1.5283	1.2362
No log	6.2456	356	1.3169	0.4724	1.3169	1.1476
No log	6.2807	358	1.2752	0.512	1.2752	1.1292
No log	6.3158	360	1.3096	0.5079	1.3096	1.1444
No log	6.3509	362	1.4524	0.4697	1.4524	1.2052
No log	6.3860	364	1.6352	0.2837	1.6352	1.2788
No log	6.4211	366	1.7693	0.2553	1.7693	1.3301
No log	6.4561	368	1.7602	0.2553	1.7602	1.3267
No log	6.4912	370	1.6447	0.2878	1.6447	1.2825
No log	6.5263	372	1.5651	0.3529	1.5651	1.2511
No log	6.5614	374	1.5021	0.4242	1.5021	1.2256
No log	6.5965	376	1.5386	0.3768	1.5386	1.2404
No log	6.6316	378	1.6264	0.2837	1.6264	1.2753
No log	6.6667	380	1.5636	0.3022	1.5636	1.2504
No log	6.7018	382	1.5869	0.3286	1.5869	1.2597
No log	6.7368	384	1.7058	0.2817	1.7058	1.3061
No log	6.7719	386	1.7299	0.2553	1.7299	1.3152
No log	6.8070	388	1.6261	0.3262	1.6261	1.2752
No log	6.8421	390	1.5742	0.3942	1.5742	1.2547
No log	6.8772	392	1.5924	0.3121	1.5924	1.2619
No log	6.9123	394	1.6596	0.3077	1.6596	1.2882
No log	6.9474	396	1.7946	0.2817	1.7946	1.3396
No log	6.9825	398	1.7970	0.2837	1.7970	1.3405
No log	7.0175	400	1.5864	0.3143	1.5864	1.2595
No log	7.0526	402	1.4128	0.4328	1.4128	1.1886
No log	7.0877	404	1.4784	0.4	1.4784	1.2159
No log	7.1228	406	1.6315	0.3099	1.6315	1.2773
No log	7.1579	408	1.7981	0.2778	1.7981	1.3409
No log	7.1930	410	1.8962	0.2778	1.8962	1.3770
No log	7.2281	412	1.8572	0.2517	1.8572	1.3628
No log	7.2632	414	1.7802	0.2517	1.7802	1.3342
No log	7.2982	416	1.7106	0.2676	1.7106	1.3079
No log	7.3333	418	1.7945	0.2676	1.7945	1.3396
No log	7.3684	420	1.9580	0.2254	1.9580	1.3993
No log	7.4035	422	2.0158	0.2098	2.0158	1.4198
No log	7.4386	424	1.8343	0.2517	1.8343	1.3544
No log	7.4737	426	1.6457	0.3309	1.6457	1.2828
No log	7.5088	428	1.5329	0.4060	1.5329	1.2381
No log	7.5439	430	1.4531	0.4462	1.4531	1.2055
No log	7.5789	432	1.5024	0.4361	1.5024	1.2257
No log	7.6140	434	1.7247	0.2254	1.7247	1.3133
No log	7.6491	436	1.8756	0.2254	1.8756	1.3695
No log	7.6842	438	1.9190	0.2254	1.9190	1.3853
No log	7.7193	440	1.7918	0.2553	1.7918	1.3386
No log	7.7544	442	1.6730	0.2553	1.6730	1.2934
No log	7.7895	444	1.6370	0.2899	1.6370	1.2795
No log	7.8246	446	1.6066	0.3382	1.6066	1.2675
No log	7.8596	448	1.5474	0.3650	1.5474	1.2440
No log	7.8947	450	1.5581	0.3382	1.5581	1.2483
No log	7.9298	452	1.5408	0.3382	1.5408	1.2413
No log	7.9649	454	1.4831	0.3969	1.4831	1.2178
No log	8.0	456	1.5463	0.3759	1.5463	1.2435
No log	8.0351	458	1.5557	0.3382	1.5557	1.2473
No log	8.0702	460	1.4684	0.3556	1.4684	1.2118
No log	8.1053	462	1.3506	0.4615	1.3506	1.1622
No log	8.1404	464	1.2711	0.5312	1.2711	1.1274
No log	8.1754	466	1.2615	0.5312	1.2615	1.1232
No log	8.2105	468	1.3601	0.4308	1.3601	1.1662
No log	8.2456	470	1.5816	0.3212	1.5816	1.2576
No log	8.2807	472	1.6956	0.2857	1.6956	1.3022
No log	8.3158	474	1.6793	0.2878	1.6793	1.2959
No log	8.3509	476	1.6790	0.2774	1.6790	1.2958
No log	8.3860	478	1.6771	0.2590	1.6771	1.2950
No log	8.4211	480	1.6155	0.3066	1.6155	1.2710
No log	8.4561	482	1.5636	0.3582	1.5636	1.2504
No log	8.4912	484	1.5579	0.3235	1.5579	1.2482
No log	8.5263	486	1.5909	0.3235	1.5909	1.2613
No log	8.5614	488	1.7021	0.2553	1.7021	1.3046
No log	8.5965	490	1.8205	0.2553	1.8205	1.3493
No log	8.6316	492	1.9234	0.2553	1.9234	1.3869
No log	8.6667	494	1.7547	0.2553	1.7547	1.3247
No log	8.7018	496	1.5786	0.3309	1.5786	1.2564
No log	8.7368	498	1.4748	0.3704	1.4748	1.2144
0.4462	8.7719	500	1.4764	0.3704	1.4764	1.2151
0.4462	8.8070	502	1.5064	0.3704	1.5064	1.2274
0.4462	8.8421	504	1.5960	0.3504	1.5960	1.2633
0.4462	8.8772	506	1.8004	0.2254	1.8004	1.3418
0.4462	8.9123	508	1.9008	0.2254	1.9008	1.3787
0.4462	8.9474	510	1.9276	0.2254	1.9276	1.3884

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1