ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k15_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.7167
• Qwk: 0.3022
• Mse: 1.7167
• Rmse: 1.3102

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0303	2	6.9944	0.0057	6.9944	2.6447
No log	0.0606	4	4.5153	0.0407	4.5153	2.1249
No log	0.0909	6	3.7162	-0.0635	3.7162	1.9278
No log	0.1212	8	3.7143	-0.1047	3.7143	1.9273
No log	0.1515	10	3.2285	0.0118	3.2285	1.7968
No log	0.1818	12	2.4530	0.0930	2.4530	1.5662
No log	0.2121	14	2.2921	0.1538	2.2921	1.5140
No log	0.2424	16	2.2405	0.2628	2.2405	1.4968
No log	0.2727	18	2.3051	0.1497	2.3051	1.5183
No log	0.3030	20	2.3160	0.1208	2.3160	1.5219
No log	0.3333	22	2.3371	0.1208	2.3371	1.5288
No log	0.3636	24	2.3923	0.0933	2.3923	1.5467
No log	0.3939	26	2.3991	0.0933	2.3991	1.5489
No log	0.4242	28	2.4278	0.1224	2.4278	1.5581
No log	0.4545	30	2.2243	0.2464	2.2243	1.4914
No log	0.4848	32	1.9640	0.2080	1.9640	1.4014
No log	0.5152	34	1.7294	0.0708	1.7294	1.3151
No log	0.5455	36	1.6212	0.1714	1.6212	1.2732
No log	0.5758	38	1.5596	0.1887	1.5596	1.2488
No log	0.6061	40	1.5678	0.2385	1.5678	1.2521
No log	0.6364	42	1.6246	0.2385	1.6246	1.2746
No log	0.6667	44	1.7130	0.2807	1.7130	1.3088
No log	0.6970	46	1.8307	0.2185	1.8307	1.3530
No log	0.7273	48	1.8662	0.1008	1.8662	1.3661
No log	0.7576	50	2.2266	0.0167	2.2266	1.4922
No log	0.7879	52	2.3084	-0.0164	2.3084	1.5194
No log	0.8182	54	2.4142	-0.0813	2.4142	1.5538
No log	0.8485	56	1.8711	0.0536	1.8711	1.3679
No log	0.8788	58	1.4019	0.2593	1.4019	1.1840
No log	0.9091	60	1.3756	0.3361	1.3756	1.1729
No log	0.9394	62	1.3331	0.3248	1.3331	1.1546
No log	0.9697	64	1.4205	0.4071	1.4205	1.1918
No log	1.0	66	1.7671	0.2679	1.7671	1.3293
No log	1.0303	68	1.8373	0.2364	1.8373	1.3555
No log	1.0606	70	1.5523	0.3393	1.5523	1.2459
No log	1.0909	72	1.3863	0.3243	1.3863	1.1774
No log	1.1212	74	1.3750	0.3540	1.3750	1.1726
No log	1.1515	76	1.3629	0.3860	1.3629	1.1674
No log	1.1818	78	1.4439	0.3393	1.4439	1.2016
No log	1.2121	80	1.5159	0.3604	1.5159	1.2312
No log	1.2424	82	1.7802	0.2321	1.7802	1.3342
No log	1.2727	84	1.8063	0.2456	1.8063	1.3440
No log	1.3030	86	1.5623	0.3793	1.5623	1.2499
No log	1.3333	88	1.4173	0.3478	1.4173	1.1905
No log	1.3636	90	1.2854	0.3684	1.2854	1.1338
No log	1.3939	92	1.3589	0.2936	1.3589	1.1657
No log	1.4242	94	1.3796	0.3393	1.3796	1.1745
No log	1.4545	96	1.4248	0.3966	1.4248	1.1937
No log	1.4848	98	1.4145	0.4035	1.4145	1.1893
No log	1.5152	100	1.5414	0.4068	1.5414	1.2415
No log	1.5455	102	1.6869	0.3051	1.6869	1.2988
No log	1.5758	104	1.6587	0.3115	1.6587	1.2879
No log	1.6061	106	1.7339	0.2810	1.7339	1.3168
No log	1.6364	108	1.6304	0.3415	1.6304	1.2769
No log	1.6667	110	1.7599	0.2835	1.7599	1.3266
No log	1.6970	112	1.8480	0.2258	1.8480	1.3594
No log	1.7273	114	1.5999	0.3333	1.5999	1.2649
No log	1.7576	116	1.4627	0.5079	1.4627	1.2094
No log	1.7879	118	1.4149	0.4	1.4149	1.1895
No log	1.8182	120	1.5311	0.5077	1.5311	1.2374
No log	1.8485	122	1.8821	0.2609	1.8821	1.3719
No log	1.8788	124	1.9892	0.1630	1.9892	1.4104
No log	1.9091	126	1.8187	0.3088	1.8187	1.3486
No log	1.9394	128	1.4761	0.4715	1.4761	1.2149
No log	1.9697	130	1.3188	0.4068	1.3188	1.1484
No log	2.0	132	1.3135	0.5082	1.3135	1.1461
No log	2.0303	134	1.4589	0.4733	1.4589	1.2079
No log	2.0606	136	1.6805	0.3284	1.6805	1.2963
No log	2.0909	138	2.0007	0.0916	2.0007	1.4144
No log	2.1212	140	1.9180	0.1493	1.9180	1.3849
No log	2.1515	142	1.5706	0.3556	1.5706	1.2532
No log	2.1818	144	1.2024	0.5873	1.2024	1.0965
No log	2.2121	146	1.0618	0.4370	1.0618	1.0305
No log	2.2424	148	1.0357	0.5484	1.0357	1.0177
No log	2.2727	150	1.1690	0.5512	1.1690	1.0812
No log	2.3030	152	1.3789	0.4496	1.3789	1.1743
No log	2.3333	154	1.2727	0.5197	1.2727	1.1282
No log	2.3636	156	1.1478	0.5528	1.1478	1.0713
No log	2.3939	158	1.1685	0.5323	1.1685	1.0810
No log	2.4242	160	1.2396	0.5161	1.2396	1.1134
No log	2.4545	162	1.3491	0.5039	1.3491	1.1615
No log	2.4848	164	1.3579	0.5156	1.3579	1.1653
No log	2.5152	166	1.4688	0.3721	1.4688	1.2119
No log	2.5455	168	1.4561	0.4127	1.4561	1.2067
No log	2.5758	170	1.4176	0.5	1.4176	1.1906
No log	2.6061	172	1.4266	0.4754	1.4266	1.1944
No log	2.6364	174	1.6812	0.2835	1.6812	1.2966
No log	2.6667	176	1.9125	0.2114	1.9125	1.3829
No log	2.6970	178	2.0021	0.1667	2.0021	1.4150
No log	2.7273	180	1.8599	0.2131	1.8599	1.3638
No log	2.7576	182	1.5087	0.4496	1.5087	1.2283
No log	2.7879	184	1.3008	0.5385	1.3008	1.1405
No log	2.8182	186	1.2706	0.5271	1.2706	1.1272
No log	2.8485	188	1.3617	0.5116	1.3617	1.1669
No log	2.8788	190	1.3683	0.4844	1.3683	1.1697
No log	2.9091	192	1.4496	0.4361	1.4496	1.2040
No log	2.9394	194	1.4260	0.4462	1.4260	1.1942
No log	2.9697	196	1.3760	0.5197	1.3760	1.1730
No log	3.0	198	1.3927	0.5156	1.3927	1.1801
No log	3.0303	200	1.4339	0.4844	1.4339	1.1974
No log	3.0606	202	1.4469	0.4961	1.4469	1.2029
No log	3.0909	204	1.4224	0.5344	1.4224	1.1926
No log	3.1212	206	1.4897	0.4179	1.4897	1.2205
No log	3.1515	208	1.5812	0.3485	1.5812	1.2575
No log	3.1818	210	1.6296	0.3256	1.6296	1.2766
No log	3.2121	212	1.4779	0.4252	1.4779	1.2157
No log	3.2424	214	1.3430	0.496	1.3430	1.1589
No log	3.2727	216	1.2147	0.528	1.2147	1.1021
No log	3.3030	218	1.3675	0.4844	1.3675	1.1694
No log	3.3333	220	1.5121	0.4	1.5121	1.2297
No log	3.3636	222	1.3824	0.4878	1.3824	1.1757
No log	3.3939	224	1.1374	0.4957	1.1374	1.0665
No log	3.4242	226	1.1127	0.4696	1.1127	1.0548
No log	3.4545	228	1.1710	0.4522	1.1710	1.0821
No log	3.4848	230	1.3114	0.4522	1.3114	1.1452
No log	3.5152	232	1.3567	0.4667	1.3567	1.1648
No log	3.5455	234	1.3247	0.4921	1.3247	1.1510
No log	3.5758	236	1.2507	0.5312	1.2507	1.1183
No log	3.6061	238	1.1976	0.5714	1.1976	1.0944
No log	3.6364	240	1.1839	0.5736	1.1839	1.0881
No log	3.6667	242	1.3254	0.5255	1.3254	1.1513
No log	3.6970	244	1.3419	0.4889	1.3419	1.1584
No log	3.7273	246	1.4214	0.4148	1.4214	1.1922
No log	3.7576	248	1.5377	0.3704	1.5377	1.2400
No log	3.7879	250	1.5166	0.3359	1.5166	1.2315
No log	3.8182	252	1.5304	0.368	1.5304	1.2371
No log	3.8485	254	1.5101	0.4034	1.5101	1.2289
No log	3.8788	256	1.4454	0.4202	1.4454	1.2022
No log	3.9091	258	1.5006	0.4034	1.5006	1.2250
No log	3.9394	260	1.6493	0.2581	1.6493	1.2843
No log	3.9697	262	1.8253	0.1760	1.8253	1.3510
No log	4.0	264	1.8408	0.2047	1.8408	1.3568
No log	4.0303	266	1.7825	0.2308	1.7825	1.3351
No log	4.0606	268	1.6237	0.3008	1.6237	1.2742
No log	4.0909	270	1.5478	0.4211	1.5478	1.2441
No log	4.1212	272	1.4616	0.4242	1.4616	1.2089
No log	4.1515	274	1.4935	0.4361	1.4935	1.2221
No log	4.1818	276	1.6308	0.3664	1.6308	1.2770
No log	4.2121	278	1.7634	0.2462	1.7634	1.3279
No log	4.2424	280	1.8587	0.2406	1.8587	1.3633
No log	4.2727	282	1.8221	0.2836	1.8221	1.3499
No log	4.3030	284	1.5922	0.3158	1.5922	1.2618
No log	4.3333	286	1.3365	0.5039	1.3365	1.1561
No log	4.3636	288	1.3022	0.5039	1.3022	1.1411
No log	4.3939	290	1.4342	0.4444	1.4342	1.1976
No log	4.4242	292	1.6800	0.3212	1.6800	1.2961
No log	4.4545	294	1.8339	0.2482	1.8339	1.3542
No log	4.4848	296	2.0354	0.1176	2.0354	1.4267
No log	4.5152	298	2.0186	0.0746	2.0186	1.4208
No log	4.5455	300	1.7992	0.2556	1.7992	1.3413
No log	4.5758	302	1.5955	0.3411	1.5955	1.2631
No log	4.6061	304	1.4671	0.3810	1.4671	1.2113
No log	4.6364	306	1.3656	0.5041	1.3656	1.1686
No log	4.6667	308	1.3630	0.5397	1.3630	1.1675
No log	4.6970	310	1.4873	0.4296	1.4873	1.2196
No log	4.7273	312	1.7610	0.2446	1.7610	1.3270
No log	4.7576	314	2.0182	0.1460	2.0182	1.4207
No log	4.7879	316	2.1348	0.1714	2.1348	1.4611
No log	4.8182	318	2.1244	0.1831	2.1244	1.4575
No log	4.8485	320	1.9065	0.2857	1.9065	1.3808
No log	4.8788	322	1.5997	0.3597	1.5997	1.2648
No log	4.9091	324	1.4691	0.4925	1.4691	1.2121
No log	4.9394	326	1.5112	0.4328	1.5112	1.2293
No log	4.9697	328	1.6980	0.3333	1.6980	1.3031
No log	5.0	330	1.9604	0.2286	1.9604	1.4001
No log	5.0303	332	1.9863	0.1986	1.9863	1.4094
No log	5.0606	334	1.9663	0.1986	1.9663	1.4022
No log	5.0909	336	1.9781	0.1986	1.9781	1.4064
No log	5.1212	338	2.0225	0.2000	2.0225	1.4221
No log	5.1515	340	2.0287	0.2000	2.0287	1.4243
No log	5.1818	342	2.0276	0.2000	2.0276	1.4239
No log	5.2121	344	1.9562	0.1844	1.9562	1.3986
No log	5.2424	346	1.7553	0.3333	1.7553	1.3249
No log	5.2727	348	1.6211	0.4058	1.6211	1.2732
No log	5.3030	350	1.6287	0.3796	1.6287	1.2762
No log	5.3333	352	1.5323	0.3676	1.5323	1.2378
No log	5.3636	354	1.4494	0.4328	1.4494	1.2039
No log	5.3939	356	1.4895	0.4148	1.4895	1.2204
No log	5.4242	358	1.7277	0.3143	1.7277	1.3144
No log	5.4545	360	2.0436	0.2098	2.0436	1.4295
No log	5.4848	362	2.0502	0.2222	2.0502	1.4319
No log	5.5152	364	1.9849	0.2778	1.9849	1.4089
No log	5.5455	366	1.7435	0.3497	1.7435	1.3204
No log	5.5758	368	1.5414	0.3597	1.5414	1.2415
No log	5.6061	370	1.4444	0.4328	1.4444	1.2018
No log	5.6364	372	1.5102	0.4203	1.5102	1.2289
No log	5.6667	374	1.7301	0.2878	1.7301	1.3153
No log	5.6970	376	1.8386	0.2754	1.8386	1.3559
No log	5.7273	378	1.7688	0.2590	1.7688	1.3299
No log	5.7576	380	1.6764	0.3333	1.6764	1.2948
No log	5.7879	382	1.6558	0.3212	1.6558	1.2868
No log	5.8182	384	1.6592	0.3212	1.6592	1.2881
No log	5.8485	386	1.8444	0.3022	1.8444	1.3581
No log	5.8788	388	2.0224	0.2695	2.0224	1.4221
No log	5.9091	390	1.9895	0.2695	1.9895	1.4105
No log	5.9394	392	1.7949	0.3022	1.7949	1.3397
No log	5.9697	394	1.5034	0.4029	1.5034	1.2261
No log	6.0	396	1.3198	0.4672	1.3198	1.1488
No log	6.0303	398	1.2589	0.4925	1.2589	1.1220
No log	6.0606	400	1.2109	0.5231	1.2109	1.1004
No log	6.0909	402	1.2751	0.4848	1.2751	1.1292
No log	6.1212	404	1.4672	0.4088	1.4672	1.2113
No log	6.1515	406	1.7512	0.3066	1.7512	1.3233
No log	6.1818	408	1.8199	0.2899	1.8199	1.3490
No log	6.2121	410	1.8737	0.2286	1.8737	1.3688
No log	6.2424	412	1.7951	0.3022	1.7951	1.3398
No log	6.2727	414	1.6056	0.3913	1.6056	1.2671
No log	6.3030	416	1.5029	0.4234	1.5029	1.2259
No log	6.3333	418	1.4873	0.4526	1.4873	1.2196
No log	6.3636	420	1.5242	0.4444	1.5242	1.2346
No log	6.3939	422	1.5626	0.4627	1.5626	1.2501
No log	6.4242	424	1.5605	0.4122	1.5605	1.2492
No log	6.4545	426	1.5478	0.4122	1.5478	1.2441
No log	6.4848	428	1.5280	0.4122	1.5280	1.2361
No log	6.5152	430	1.5320	0.4122	1.5320	1.2378
No log	6.5455	432	1.5495	0.4122	1.5495	1.2448
No log	6.5758	434	1.6572	0.3788	1.6571	1.2873
No log	6.6061	436	1.7076	0.3382	1.7076	1.3068
No log	6.6364	438	1.6395	0.4148	1.6395	1.2804
No log	6.6667	440	1.5910	0.4148	1.5910	1.2614
No log	6.6970	442	1.5514	0.4148	1.5514	1.2456
No log	6.7273	444	1.5695	0.3971	1.5695	1.2528
No log	6.7576	446	1.6529	0.3478	1.6529	1.2856
No log	6.7879	448	1.6667	0.3478	1.6667	1.2910
No log	6.8182	450	1.5943	0.3529	1.5943	1.2626
No log	6.8485	452	1.6232	0.3358	1.6232	1.2741
No log	6.8788	454	1.7026	0.3143	1.7026	1.3048
No log	6.9091	456	1.8190	0.2553	1.8190	1.3487
No log	6.9394	458	1.8363	0.2553	1.8363	1.3551
No log	6.9697	460	1.6069	0.3478	1.6069	1.2676
No log	7.0	462	1.3671	0.4662	1.3671	1.1692
No log	7.0303	464	1.2786	0.5736	1.2786	1.1308
No log	7.0606	466	1.3161	0.5469	1.3161	1.1472
No log	7.0909	468	1.4248	0.4427	1.4248	1.1937
No log	7.1212	470	1.6490	0.3212	1.6490	1.2841
No log	7.1515	472	1.8276	0.2553	1.8276	1.3519
No log	7.1818	474	1.8325	0.2014	1.8325	1.3537
No log	7.2121	476	1.7131	0.2687	1.7131	1.3089
No log	7.2424	478	1.6029	0.3840	1.6029	1.2660
No log	7.2727	480	1.6119	0.35	1.6119	1.2696
No log	7.3030	482	1.6414	0.3802	1.6414	1.2812
No log	7.3333	484	1.7304	0.3226	1.7304	1.3154
No log	7.3636	486	1.7827	0.2370	1.7827	1.3352
No log	7.3939	488	1.6803	0.3556	1.6803	1.2963
No log	7.4242	490	1.5603	0.3609	1.5603	1.2491
No log	7.4545	492	1.4283	0.4531	1.4283	1.1951
No log	7.4848	494	1.3342	0.4160	1.3342	1.1551
No log	7.5152	496	1.3632	0.4409	1.3632	1.1675
No log	7.5455	498	1.5263	0.4091	1.5263	1.2354
0.4132	7.5758	500	1.7767	0.3066	1.7767	1.3329
0.4132	7.6061	502	1.8679	0.2899	1.8679	1.3667
0.4132	7.6364	504	1.7845	0.2899	1.7845	1.3359
0.4132	7.6667	506	1.6449	0.3759	1.6449	1.2825
0.4132	7.6970	508	1.5565	0.4091	1.5565	1.2476
0.4132	7.7273	510	1.4505	0.4462	1.4505	1.2044
0.4132	7.7576	512	1.4850	0.4462	1.4850	1.2186
0.4132	7.7879	514	1.6438	0.3529	1.6438	1.2821
0.4132	7.8182	516	1.8453	0.2734	1.8453	1.3584
0.4132	7.8485	518	1.9250	0.2128	1.9250	1.3874
0.4132	7.8788	520	1.9368	0.2254	1.9368	1.3917
0.4132	7.9091	522	1.8844	0.2571	1.8844	1.3727
0.4132	7.9394	524	1.7167	0.3022	1.7167	1.3102

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1