ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k6_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.7207
• Qwk: 0.3165
• Mse: 1.7207
• Rmse: 1.3118

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0769	2	6.7951	-0.0057	6.7951	2.6067
No log	0.1538	4	4.4769	0.0433	4.4769	2.1159
No log	0.2308	6	3.7117	-0.0426	3.7117	1.9266
No log	0.3077	8	4.1086	-0.0928	4.1086	2.0270
No log	0.3846	10	4.4629	-0.0531	4.4629	2.1126
No log	0.4615	12	2.8130	0.0145	2.8130	1.6772
No log	0.5385	14	1.8421	0.1538	1.8421	1.3572
No log	0.6154	16	1.8548	0.0784	1.8548	1.3619
No log	0.6923	18	1.9939	0.0962	1.9939	1.4121
No log	0.7692	20	2.1927	-0.0348	2.1927	1.4808
No log	0.8462	22	2.4397	-0.1168	2.4397	1.5620
No log	0.9231	24	2.3850	-0.0876	2.3850	1.5443
No log	1.0	26	2.2329	-0.0645	2.2329	1.4943
No log	1.0769	28	2.2449	-0.0159	2.2449	1.4983
No log	1.1538	30	2.2631	0.0	2.2631	1.5044
No log	1.2308	32	2.1780	0.1345	2.1780	1.4758
No log	1.3077	34	2.0550	0.2124	2.0550	1.4335
No log	1.3846	36	1.9927	0.1835	1.9927	1.4116
No log	1.4615	38	1.9631	0.1835	1.9631	1.4011
No log	1.5385	40	1.8847	0.2182	1.8847	1.3728
No log	1.6154	42	1.8011	0.2679	1.8011	1.3421
No log	1.6923	44	1.7112	0.2385	1.7112	1.3081
No log	1.7692	46	1.6358	0.2037	1.6358	1.2790
No log	1.8462	48	1.5937	0.1667	1.5937	1.2624
No log	1.9231	50	1.5798	0.1667	1.5798	1.2569
No log	2.0	52	1.4956	0.2202	1.4956	1.2229
No log	2.0769	54	1.4556	0.3063	1.4556	1.2065
No log	2.1538	56	1.4596	0.2655	1.4596	1.2081
No log	2.2308	58	1.4205	0.2759	1.4205	1.1919
No log	2.3077	60	1.3573	0.3025	1.3573	1.1650
No log	2.3846	62	1.3763	0.3248	1.3763	1.1732
No log	2.4615	64	1.8621	0.1636	1.8621	1.3646
No log	2.5385	66	1.9653	0.1468	1.9653	1.4019
No log	2.6154	68	1.7682	0.1468	1.7682	1.3298
No log	2.6923	70	1.4049	0.2609	1.4049	1.1853
No log	2.7692	72	1.4162	0.3740	1.4162	1.1900
No log	2.8462	74	1.4159	0.3740	1.4159	1.1899
No log	2.9231	76	1.3215	0.3761	1.3215	1.1496
No log	3.0	78	1.4685	0.1154	1.4685	1.2118
No log	3.0769	80	1.7251	0.1869	1.7251	1.3134
No log	3.1538	82	1.7651	0.2727	1.7651	1.3286
No log	3.2308	84	1.5141	0.2703	1.5141	1.2305
No log	3.3077	86	1.3037	0.3186	1.3037	1.1418
No log	3.3846	88	1.3035	0.3158	1.3035	1.1417
No log	3.4615	90	1.3707	0.3478	1.3707	1.1708
No log	3.5385	92	1.6799	0.2906	1.6799	1.2961
No log	3.6154	94	2.0216	0.1345	2.0216	1.4218
No log	3.6923	96	2.1826	0.0	2.1826	1.4774
No log	3.7692	98	1.9777	0.1789	1.9777	1.4063
No log	3.8462	100	1.6970	0.2720	1.6970	1.3027
No log	3.9231	102	1.4959	0.3548	1.4959	1.2231
No log	4.0	104	1.5232	0.3651	1.5232	1.2342
No log	4.0769	106	1.7344	0.2985	1.7344	1.3170
No log	4.1538	108	1.7573	0.2963	1.7573	1.3256
No log	4.2308	110	1.6000	0.3704	1.6000	1.2649
No log	4.3077	112	1.2842	0.4806	1.2842	1.1332
No log	4.3846	114	1.1684	0.4839	1.1684	1.0809
No log	4.4615	116	1.1575	0.496	1.1575	1.0759
No log	4.5385	118	1.3023	0.4923	1.3023	1.1412
No log	4.6154	120	1.5338	0.4030	1.5338	1.2385
No log	4.6923	122	1.5960	0.3704	1.5960	1.2633
No log	4.7692	124	1.5824	0.4	1.5824	1.2579
No log	4.8462	126	1.5952	0.3622	1.5952	1.2630
No log	4.9231	128	1.5358	0.4	1.5358	1.2393
No log	5.0	130	1.4859	0.3833	1.4859	1.2190
No log	5.0769	132	1.5338	0.3710	1.5338	1.2385
No log	5.1538	134	1.7542	0.2647	1.7542	1.3245
No log	5.2308	136	2.0207	0.2143	2.0207	1.4215
No log	5.3077	138	2.0904	0.2143	2.0904	1.4458
No log	5.3846	140	1.9275	0.2429	1.9275	1.3884
No log	5.4615	142	1.6620	0.352	1.6620	1.2892
No log	5.5385	144	1.4107	0.2632	1.4107	1.1877
No log	5.6154	146	1.4169	0.2301	1.4169	1.1903
No log	5.6923	148	1.4008	0.2957	1.4008	1.1835
No log	5.7692	150	1.5245	0.3390	1.5245	1.2347
No log	5.8462	152	1.8064	0.1832	1.8064	1.3440
No log	5.9231	154	1.9459	0.1818	1.9459	1.3949
No log	6.0	156	1.9912	0.1955	1.9912	1.4111
No log	6.0769	158	1.9502	0.1778	1.9502	1.3965
No log	6.1538	160	1.8532	0.2074	1.8532	1.3613
No log	6.2308	162	1.8072	0.2687	1.8072	1.3443
No log	6.3077	164	1.8532	0.2353	1.8532	1.3613
No log	6.3846	166	1.8543	0.1805	1.8543	1.3617
No log	6.4615	168	1.7415	0.2742	1.7415	1.3197
No log	6.5385	170	1.6579	0.3000	1.6579	1.2876
No log	6.6154	172	1.5659	0.3471	1.5659	1.2514
No log	6.6923	174	1.5015	0.4194	1.5015	1.2254
No log	6.7692	176	1.5471	0.4462	1.5471	1.2438
No log	6.8462	178	1.6884	0.3158	1.6884	1.2994
No log	6.9231	180	1.8473	0.2754	1.8473	1.3592
No log	7.0	182	2.0456	0.2378	2.0456	1.4302
No log	7.0769	184	2.1090	0.1857	2.1090	1.4522
No log	7.1538	186	2.0328	0.1606	2.0328	1.4258
No log	7.2308	188	1.7821	0.272	1.7821	1.3349
No log	7.3077	190	1.5096	0.3559	1.5096	1.2286
No log	7.3846	192	1.4016	0.4237	1.4016	1.1839
No log	7.4615	194	1.3605	0.3559	1.3605	1.1664
No log	7.5385	196	1.3802	0.4167	1.3802	1.1748
No log	7.6154	198	1.4510	0.4567	1.4510	1.2046
No log	7.6923	200	1.5159	0.4462	1.5159	1.2312
No log	7.7692	202	1.5902	0.4	1.5902	1.2610
No log	7.8462	204	1.5893	0.4	1.5893	1.2607
No log	7.9231	206	1.6442	0.3817	1.6442	1.2822
No log	8.0	208	1.6174	0.4	1.6174	1.2718
No log	8.0769	210	1.6300	0.4091	1.6300	1.2767
No log	8.1538	212	1.5653	0.4122	1.5653	1.2511
No log	8.2308	214	1.6822	0.3939	1.6822	1.2970
No log	8.3077	216	1.9504	0.2590	1.9504	1.3966
No log	8.3846	218	2.0896	0.2553	2.0896	1.4456
No log	8.4615	220	2.0024	0.2302	2.0024	1.4151
No log	8.5385	222	1.8530	0.2482	1.8530	1.3613
No log	8.6154	224	1.6794	0.3538	1.6794	1.2959
No log	8.6923	226	1.5367	0.4186	1.5367	1.2397
No log	8.7692	228	1.4816	0.4531	1.4816	1.2172
No log	8.8462	230	1.5195	0.4308	1.5195	1.2327
No log	8.9231	232	1.6772	0.3759	1.6772	1.2951
No log	9.0	234	1.9357	0.2817	1.9357	1.3913
No log	9.0769	236	2.0415	0.2500	2.0415	1.4288
No log	9.1538	238	1.9695	0.2676	1.9695	1.4034
No log	9.2308	240	1.8010	0.3022	1.8010	1.3420
No log	9.3077	242	1.7088	0.3188	1.7088	1.3072
No log	9.3846	244	1.6934	0.3188	1.6934	1.3013
No log	9.4615	246	1.7611	0.3022	1.7611	1.3271
No log	9.5385	248	1.7970	0.2857	1.7970	1.3405
No log	9.6154	250	1.7825	0.2857	1.7825	1.3351
No log	9.6923	252	1.6866	0.3358	1.6866	1.2987
No log	9.7692	254	1.6224	0.4060	1.6224	1.2738
No log	9.8462	256	1.5681	0.3939	1.5681	1.2522
No log	9.9231	258	1.5307	0.4060	1.5307	1.2372
No log	10.0	260	1.5546	0.4030	1.5546	1.2468
No log	10.0769	262	1.5831	0.3676	1.5831	1.2582
No log	10.1538	264	1.5270	0.4	1.5270	1.2357
No log	10.2308	266	1.4634	0.4179	1.4634	1.2097
No log	10.3077	268	1.4387	0.4394	1.4387	1.1995
No log	10.3846	270	1.5450	0.3731	1.5450	1.2430
No log	10.4615	272	1.8087	0.3358	1.8087	1.3449
No log	10.5385	274	1.8690	0.3088	1.8690	1.3671
No log	10.6154	276	1.8088	0.3259	1.8088	1.3449
No log	10.6923	278	1.6344	0.3556	1.6344	1.2784
No log	10.7692	280	1.5576	0.3636	1.5576	1.2480
No log	10.8462	282	1.4276	0.4462	1.4276	1.1948
No log	10.9231	284	1.3497	0.5	1.3497	1.1618
No log	11.0	286	1.3712	0.4688	1.3712	1.1710
No log	11.0769	288	1.4553	0.4427	1.4553	1.2064
No log	11.1538	290	1.4577	0.4427	1.4577	1.2074
No log	11.2308	292	1.4639	0.4615	1.4639	1.2099
No log	11.3077	294	1.5045	0.4394	1.5045	1.2266
No log	11.3846	296	1.4810	0.4122	1.4810	1.2170
No log	11.4615	298	1.5175	0.4122	1.5175	1.2319
No log	11.5385	300	1.5313	0.4122	1.5313	1.2374
No log	11.6154	302	1.5744	0.3810	1.5744	1.2547
No log	11.6923	304	1.5777	0.3770	1.5777	1.2561
No log	11.7692	306	1.5684	0.4062	1.5684	1.2524
No log	11.8462	308	1.5405	0.3939	1.5405	1.2412
No log	11.9231	310	1.5117	0.4	1.5117	1.2295
No log	12.0	312	1.5376	0.4088	1.5376	1.2400
No log	12.0769	314	1.5276	0.4058	1.5276	1.2360
No log	12.1538	316	1.4294	0.4444	1.4294	1.1956
No log	12.2308	318	1.3818	0.4603	1.3818	1.1755
No log	12.3077	320	1.3833	0.4194	1.3833	1.1762
No log	12.3846	322	1.4441	0.4186	1.4441	1.2017
No log	12.4615	324	1.6153	0.3504	1.6153	1.2710
No log	12.5385	326	1.8049	0.3022	1.8049	1.3435
No log	12.6154	328	1.8551	0.3022	1.8551	1.3620
No log	12.6923	330	1.7641	0.3333	1.7641	1.3282
No log	12.7692	332	1.6214	0.3817	1.6214	1.2733
No log	12.8462	334	1.5815	0.3876	1.5815	1.2576
No log	12.9231	336	1.5732	0.3876	1.5732	1.2543
No log	13.0	338	1.6407	0.3511	1.6407	1.2809
No log	13.0769	340	1.6590	0.3333	1.6590	1.2880
No log	13.1538	342	1.6521	0.3511	1.6521	1.2853
No log	13.2308	344	1.5713	0.3876	1.5713	1.2535
No log	13.3077	346	1.4851	0.4375	1.4851	1.2187
No log	13.3846	348	1.4184	0.4603	1.4184	1.1910
No log	13.4615	350	1.3683	0.4724	1.3683	1.1698
No log	13.5385	352	1.3400	0.4733	1.3400	1.1576
No log	13.6154	354	1.3224	0.5	1.3224	1.1499
No log	13.6923	356	1.2938	0.5	1.2938	1.1374
No log	13.7692	358	1.4060	0.4511	1.4060	1.1857
No log	13.8462	360	1.6478	0.3188	1.6478	1.2837
No log	13.9231	362	1.7950	0.2370	1.7950	1.3398
No log	14.0	364	1.8001	0.2090	1.8001	1.3417
No log	14.0769	366	1.6469	0.3556	1.6469	1.2833
No log	14.1538	368	1.5918	0.3731	1.5918	1.2617
No log	14.2308	370	1.5664	0.3731	1.5664	1.2516
No log	14.3077	372	1.5156	0.3906	1.5156	1.2311
No log	14.3846	374	1.5134	0.3780	1.5134	1.2302
No log	14.4615	376	1.5294	0.3780	1.5294	1.2367
No log	14.5385	378	1.5080	0.4252	1.5080	1.2280
No log	14.6154	380	1.5835	0.3359	1.5835	1.2584
No log	14.6923	382	1.6268	0.3556	1.6268	1.2755
No log	14.7692	384	1.6263	0.3333	1.6263	1.2753
No log	14.8462	386	1.7212	0.3000	1.7212	1.3119
No log	14.9231	388	1.7367	0.3000	1.7367	1.3178
No log	15.0	390	1.7626	0.2734	1.7626	1.3276
No log	15.0769	392	1.7167	0.2734	1.7167	1.3102
No log	15.1538	394	1.6410	0.3308	1.6410	1.2810
No log	15.2308	396	1.5832	0.3609	1.5832	1.2583
No log	15.3077	398	1.5133	0.3692	1.5133	1.2302
No log	15.3846	400	1.5177	0.375	1.5177	1.2320
No log	15.4615	402	1.5438	0.3664	1.5438	1.2425
No log	15.5385	404	1.6691	0.3088	1.6691	1.2919
No log	15.6154	406	1.7781	0.2286	1.7781	1.3334
No log	15.6923	408	1.8601	0.2553	1.8601	1.3639
No log	15.7692	410	1.8058	0.2553	1.8058	1.3438
No log	15.8462	412	1.7396	0.2714	1.7395	1.3189
No log	15.9231	414	1.6854	0.3066	1.6854	1.2982
No log	16.0	416	1.6903	0.3235	1.6903	1.3001
No log	16.0769	418	1.7343	0.3066	1.7343	1.3169
No log	16.1538	420	1.7627	0.3066	1.7627	1.3277
No log	16.2308	422	1.6962	0.3382	1.6962	1.3024
No log	16.3077	424	1.5890	0.4	1.5890	1.2606
No log	16.3846	426	1.5198	0.4186	1.5198	1.2328
No log	16.4615	428	1.4958	0.4186	1.4958	1.2230
No log	16.5385	430	1.5162	0.4154	1.5162	1.2313
No log	16.6154	432	1.5406	0.4211	1.5406	1.2412
No log	16.6923	434	1.5323	0.4211	1.5323	1.2379
No log	16.7692	436	1.4958	0.4394	1.4958	1.2230
No log	16.8462	438	1.4198	0.4154	1.4198	1.1916
No log	16.9231	440	1.3761	0.4154	1.3761	1.1731
No log	17.0	442	1.4076	0.4154	1.4076	1.1864
No log	17.0769	444	1.4353	0.3876	1.4353	1.1981
No log	17.1538	446	1.4714	0.375	1.4714	1.2130
No log	17.2308	448	1.4673	0.3492	1.4673	1.2113
No log	17.3077	450	1.5005	0.352	1.5005	1.2250
No log	17.3846	452	1.5246	0.4098	1.5246	1.2347
No log	17.4615	454	1.5720	0.4	1.5720	1.2538
No log	17.5385	456	1.6316	0.3876	1.6316	1.2774
No log	17.6154	458	1.6059	0.4122	1.6059	1.2672
No log	17.6923	460	1.5324	0.4275	1.5324	1.2379
No log	17.7692	462	1.4959	0.4275	1.4959	1.2231
No log	17.8462	464	1.4729	0.4275	1.4729	1.2136
No log	17.9231	466	1.5584	0.4394	1.5584	1.2484
No log	18.0	468	1.6872	0.3582	1.6872	1.2989
No log	18.0769	470	1.6779	0.3582	1.6779	1.2954
No log	18.1538	472	1.6077	0.4122	1.6077	1.2679
No log	18.2308	474	1.5076	0.4122	1.5076	1.2278
No log	18.3077	476	1.5260	0.4122	1.5260	1.2353
No log	18.3846	478	1.6072	0.3759	1.6072	1.2678
No log	18.4615	480	1.6947	0.3382	1.6947	1.3018
No log	18.5385	482	1.7472	0.3358	1.7472	1.3218
No log	18.6154	484	1.7303	0.3358	1.7303	1.3154
No log	18.6923	486	1.7003	0.3704	1.7003	1.3039
No log	18.7692	488	1.6986	0.3704	1.6986	1.3033
No log	18.8462	490	1.6898	0.3704	1.6898	1.2999
No log	18.9231	492	1.7086	0.4091	1.7086	1.3071
No log	19.0	494	1.7077	0.3969	1.7077	1.3068
No log	19.0769	496	1.6524	0.3969	1.6524	1.2855
No log	19.1538	498	1.6776	0.3910	1.6776	1.2952
0.4168	19.2308	500	1.7301	0.3212	1.7301	1.3154
0.4168	19.3077	502	1.7476	0.3212	1.7476	1.3220
0.4168	19.3846	504	1.7753	0.3188	1.7753	1.3324
0.4168	19.4615	506	1.7454	0.3358	1.7454	1.3211
0.4168	19.5385	508	1.6025	0.3939	1.6025	1.2659
0.4168	19.6154	510	1.5320	0.4122	1.5320	1.2377
0.4168	19.6923	512	1.5285	0.4122	1.5285	1.2363
0.4168	19.7692	514	1.5346	0.4091	1.5346	1.2388
0.4168	19.8462	516	1.4484	0.4122	1.4484	1.2035
0.4168	19.9231	518	1.4277	0.4122	1.4277	1.1949
0.4168	20.0	520	1.4447	0.4122	1.4447	1.2020
0.4168	20.0769	522	1.4327	0.4662	1.4327	1.1970
0.4168	20.1538	524	1.4076	0.4662	1.4076	1.1864
0.4168	20.2308	526	1.4135	0.4662	1.4135	1.1889
0.4168	20.3077	528	1.4424	0.4394	1.4424	1.2010
0.4168	20.3846	530	1.5516	0.4091	1.5516	1.2456
0.4168	20.4615	532	1.7237	0.3088	1.7237	1.3129
0.4168	20.5385	534	1.8376	0.2714	1.8376	1.3556
0.4168	20.6154	536	1.8741	0.2714	1.8741	1.3690
0.4168	20.6923	538	1.8297	0.2734	1.8297	1.3527
0.4168	20.7692	540	1.7207	0.3165	1.7207	1.3118

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1