ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k12_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 2.1699
• Qwk: 0.1986
• Mse: 2.1699
• Rmse: 1.4731

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0385	2	7.0106	0.0110	7.0106	2.6478
No log	0.0769	4	3.8273	0.0563	3.8273	1.9563
No log	0.1154	6	2.5387	0.1053	2.5387	1.5933
No log	0.1538	8	2.2145	0.2113	2.2145	1.4881
No log	0.1923	10	1.8804	0.2595	1.8804	1.3713
No log	0.2308	12	1.8987	0.2576	1.8987	1.3779
No log	0.2692	14	1.8656	0.25	1.8656	1.3659
No log	0.3077	16	1.8859	0.2222	1.8859	1.3733
No log	0.3462	18	1.5803	0.2759	1.5803	1.2571
No log	0.3846	20	1.4827	0.3063	1.4827	1.2176
No log	0.4231	22	1.7357	0.2321	1.7357	1.3174
No log	0.4615	24	1.9034	0.2063	1.9034	1.3796
No log	0.5	26	1.7106	0.3871	1.7106	1.3079
No log	0.5385	28	1.6575	0.3415	1.6575	1.2874
No log	0.5769	30	1.8172	0.3089	1.8172	1.3480
No log	0.6154	32	1.6655	0.3276	1.6655	1.2905
No log	0.6538	34	1.4711	0.1682	1.4711	1.2129
No log	0.6923	36	1.3565	0.2075	1.3565	1.1647
No log	0.7308	38	1.3373	0.375	1.3373	1.1564
No log	0.7692	40	1.3324	0.3423	1.3324	1.1543
No log	0.8077	42	1.3235	0.3929	1.3235	1.1504
No log	0.8462	44	1.3372	0.3860	1.3372	1.1564
No log	0.8846	46	1.4138	0.3036	1.4138	1.1890
No log	0.9231	48	1.4634	0.2957	1.4634	1.2097
No log	0.9615	50	1.6369	0.3000	1.6369	1.2794
No log	1.0	52	1.6389	0.3025	1.6389	1.2802
No log	1.0385	54	1.2617	0.4959	1.2617	1.1233
No log	1.0769	56	1.1732	0.4174	1.1732	1.0832
No log	1.1154	58	1.1795	0.4211	1.1795	1.0860
No log	1.1538	60	1.1749	0.4522	1.1749	1.0839
No log	1.1923	62	1.2630	0.4237	1.2630	1.1238
No log	1.2308	64	1.2066	0.4444	1.2066	1.0984
No log	1.2692	66	1.1627	0.4957	1.1627	1.0783
No log	1.3077	68	1.4266	0.3652	1.4266	1.1944
No log	1.3462	70	1.5852	0.2523	1.5852	1.2591
No log	1.3846	72	1.6459	0.2523	1.6459	1.2829
No log	1.4231	74	1.8123	0.2364	1.8123	1.3462
No log	1.4615	76	1.5848	0.2523	1.5848	1.2589
No log	1.5	78	1.2874	0.4138	1.2874	1.1347
No log	1.5385	80	1.1688	0.4706	1.1688	1.0811
No log	1.5769	82	1.0486	0.5124	1.0486	1.0240
No log	1.6154	84	1.0477	0.5410	1.0477	1.0236
No log	1.6538	86	1.0801	0.5210	1.0801	1.0393
No log	1.6923	88	1.2462	0.4746	1.2462	1.1164
No log	1.7308	90	1.3532	0.4444	1.3532	1.1633
No log	1.7692	92	1.4525	0.3826	1.4525	1.2052
No log	1.8077	94	1.3830	0.5210	1.3830	1.1760
No log	1.8462	96	1.3397	0.5124	1.3397	1.1575
No log	1.8846	98	1.3361	0.5124	1.3361	1.1559
No log	1.9231	100	1.3744	0.4959	1.3744	1.1723
No log	1.9615	102	1.3757	0.5041	1.3757	1.1729
No log	2.0	104	1.2787	0.4874	1.2787	1.1308
No log	2.0385	106	1.1971	0.4957	1.1971	1.0941
No log	2.0769	108	1.2036	0.5042	1.2036	1.0971
No log	2.1154	110	1.2938	0.5	1.2938	1.1375
No log	2.1538	112	1.5911	0.3307	1.5911	1.2614
No log	2.1923	114	1.6967	0.2927	1.6967	1.3026
No log	2.2308	116	1.5949	0.3810	1.5949	1.2629
No log	2.2692	118	1.5120	0.3876	1.5120	1.2297
No log	2.3077	120	1.4842	0.4296	1.4842	1.2183
No log	2.3462	122	1.5705	0.3650	1.5705	1.2532
No log	2.3846	124	1.6742	0.3022	1.6742	1.2939
No log	2.4231	126	1.6864	0.3188	1.6864	1.2986
No log	2.4615	128	1.6059	0.3235	1.6059	1.2672
No log	2.5	130	1.4311	0.3817	1.4311	1.1963
No log	2.5385	132	1.4580	0.3939	1.4580	1.2075
No log	2.5769	134	1.7735	0.2676	1.7735	1.3317
No log	2.6154	136	1.9811	0.2270	1.9811	1.4075
No log	2.6538	138	2.0044	0.2014	2.0044	1.4158
No log	2.6923	140	1.9034	0.2302	1.9034	1.3797
No log	2.7308	142	1.7913	0.2446	1.7913	1.3384
No log	2.7692	144	1.8269	0.2714	1.8269	1.3516
No log	2.8077	146	1.9552	0.2113	1.9552	1.3983
No log	2.8462	148	1.9938	0.2113	1.9938	1.4120
No log	2.8846	150	1.8603	0.2571	1.8603	1.3639
No log	2.9231	152	1.7587	0.2609	1.7587	1.3262
No log	2.9615	154	1.7944	0.2609	1.7944	1.3396
No log	3.0	156	1.8311	0.2336	1.8311	1.3532
No log	3.0385	158	1.8497	0.1871	1.8497	1.3600
No log	3.0769	160	1.8930	0.2000	1.8930	1.3759
No log	3.1154	162	1.7529	0.2336	1.7529	1.3240
No log	3.1538	164	1.7123	0.2920	1.7123	1.3085
No log	3.1923	166	1.7492	0.2734	1.7492	1.3226
No log	3.2308	168	1.9579	0.2429	1.9579	1.3993
No log	3.2692	170	2.0207	0.2143	2.0207	1.4215
No log	3.3077	172	1.9818	0.2609	1.9818	1.4078
No log	3.3462	174	1.9404	0.2482	1.9404	1.3930
No log	3.3846	176	1.8950	0.2609	1.8950	1.3766
No log	3.4231	178	1.7193	0.3259	1.7193	1.3112
No log	3.4615	180	1.6644	0.3485	1.6644	1.2901
No log	3.5	182	1.6966	0.3308	1.6966	1.3026
No log	3.5385	184	1.7434	0.3433	1.7434	1.3204
No log	3.5769	186	1.8357	0.3066	1.8357	1.3549
No log	3.6154	188	1.9015	0.2411	1.9015	1.3790
No log	3.6538	190	1.9849	0.2098	1.9849	1.4088
No log	3.6923	192	2.0120	0.1831	2.0120	1.4184
No log	3.7308	194	1.9805	0.2143	1.9805	1.4073
No log	3.7692	196	1.9783	0.2128	1.9783	1.4065
No log	3.8077	198	1.8793	0.2609	1.8793	1.3709
No log	3.8462	200	1.8131	0.2774	1.8131	1.3465
No log	3.8846	202	1.7349	0.2941	1.7349	1.3172
No log	3.9231	204	1.6625	0.2985	1.6625	1.2894
No log	3.9615	206	1.6809	0.2687	1.6809	1.2965
No log	4.0	208	1.7763	0.2647	1.7763	1.3328
No log	4.0385	210	1.8171	0.2647	1.8171	1.3480
No log	4.0769	212	1.7906	0.2647	1.7906	1.3381
No log	4.1154	214	1.7554	0.2815	1.7554	1.3249
No log	4.1538	216	1.7394	0.2985	1.7394	1.3189
No log	4.1923	218	1.7363	0.2794	1.7363	1.3177
No log	4.2308	220	1.7863	0.2429	1.7863	1.3365
No log	4.2692	222	1.9634	0.1986	1.9634	1.4012
No log	4.3077	224	2.0619	0.1986	2.0619	1.4359
No log	4.3462	226	2.0701	0.2206	2.0701	1.4388
No log	4.3846	228	2.0258	0.2270	2.0258	1.4233
No log	4.4231	230	1.9454	0.2143	1.9454	1.3948
No log	4.4615	232	1.9086	0.2286	1.9086	1.3815
No log	4.5	234	1.9611	0.2143	1.9611	1.4004
No log	4.5385	236	1.9628	0.2143	1.9628	1.4010
No log	4.5769	238	1.9271	0.2336	1.9271	1.3882
No log	4.6154	240	1.9074	0.2174	1.9074	1.3811
No log	4.6538	242	1.8305	0.2482	1.8306	1.3530
No log	4.6923	244	1.8184	0.2206	1.8184	1.3485
No log	4.7308	246	1.7788	0.2482	1.7788	1.3337
No log	4.7692	248	1.8828	0.2446	1.8828	1.3722
No log	4.8077	250	2.0021	0.2286	2.0021	1.4149
No log	4.8462	252	1.9045	0.2206	1.9045	1.3800
No log	4.8846	254	1.8872	0.2206	1.8872	1.3738
No log	4.9231	256	1.9712	0.2336	1.9712	1.4040
No log	4.9615	258	1.9222	0.2446	1.9222	1.3864
No log	5.0	260	1.8588	0.2446	1.8588	1.3634
No log	5.0385	262	1.8605	0.3000	1.8605	1.3640
No log	5.0769	264	1.8908	0.3000	1.8908	1.3750
No log	5.1154	266	1.8207	0.3121	1.8207	1.3493
No log	5.1538	268	1.8435	0.2429	1.8435	1.3578
No log	5.1923	270	1.7808	0.2920	1.7808	1.3345
No log	5.2308	272	1.5541	0.3846	1.5541	1.2466
No log	5.2692	274	1.5043	0.3846	1.5043	1.2265
No log	5.3077	276	1.6743	0.3910	1.6743	1.2940
No log	5.3462	278	2.0347	0.2128	2.0347	1.4264
No log	5.3846	280	2.1816	0.1831	2.1816	1.4770
No log	5.4231	282	2.1176	0.1986	2.1176	1.4552
No log	5.4615	284	2.0060	0.1986	2.0060	1.4163
No log	5.5	286	1.9175	0.2254	1.9175	1.3847
No log	5.5385	288	2.0607	0.1986	2.0607	1.4355
No log	5.5769	290	2.1332	0.2286	2.1332	1.4606
No log	5.6154	292	2.0945	0.2286	2.0945	1.4472
No log	5.6538	294	1.9801	0.2590	1.9801	1.4071
No log	5.6923	296	1.8692	0.2590	1.8692	1.3672
No log	5.7308	298	1.7779	0.2429	1.7779	1.3334
No log	5.7692	300	1.8025	0.2429	1.8025	1.3426
No log	5.8077	302	1.7735	0.2734	1.7735	1.3317
No log	5.8462	304	1.8060	0.2158	1.8060	1.3439
No log	5.8846	306	1.9705	0.1986	1.9705	1.4037
No log	5.9231	308	2.1156	0.1690	2.1156	1.4545
No log	5.9615	310	2.0885	0.1690	2.0885	1.4452
No log	6.0	312	2.0990	0.1690	2.0990	1.4488
No log	6.0385	314	1.9561	0.2286	1.9561	1.3986
No log	6.0769	316	1.8070	0.3284	1.8070	1.3443
No log	6.1154	318	1.8565	0.2628	1.8565	1.3625
No log	6.1538	320	2.0776	0.1986	2.0776	1.4414
No log	6.1923	322	2.3001	0.1538	2.3001	1.5166
No log	6.2308	324	2.3108	0.1538	2.3108	1.5201
No log	6.2692	326	2.1940	0.1831	2.1940	1.4812
No log	6.3077	328	2.0123	0.2429	2.0123	1.4185
No log	6.3462	330	1.9141	0.2590	1.9141	1.3835
No log	6.3846	332	1.9368	0.2590	1.9368	1.3917
No log	6.4231	334	2.1365	0.2128	2.1365	1.4617
No log	6.4615	336	2.1801	0.1831	2.1801	1.4765
No log	6.5	338	2.1140	0.2446	2.1140	1.4540
No log	6.5385	340	1.9350	0.2353	1.9350	1.3910
No log	6.5769	342	1.9133	0.2388	1.9133	1.3832
No log	6.6154	344	2.0282	0.2319	2.0282	1.4241
No log	6.6538	346	2.1678	0.1986	2.1678	1.4723
No log	6.6923	348	2.2251	0.1986	2.2251	1.4917
No log	6.7308	350	2.2410	0.1986	2.2410	1.4970
No log	6.7692	352	2.2236	0.1986	2.2236	1.4912
No log	6.8077	354	2.2881	0.1986	2.2881	1.5126
No log	6.8462	356	2.1662	0.1986	2.1662	1.4718
No log	6.8846	358	1.9949	0.2302	1.9949	1.4124
No log	6.9231	360	1.9865	0.2286	1.9865	1.4094
No log	6.9615	362	2.0797	0.2158	2.0797	1.4421
No log	7.0	364	2.2238	0.1986	2.2238	1.4912
No log	7.0385	366	2.1935	0.1986	2.1935	1.4811
No log	7.0769	368	2.1497	0.1986	2.1497	1.4662
No log	7.1154	370	2.2406	0.1690	2.2406	1.4969
No log	7.1538	372	2.2447	0.1690	2.2447	1.4982
No log	7.1923	374	2.1370	0.1690	2.1370	1.4618
No log	7.2308	376	2.1687	0.1690	2.1687	1.4726
No log	7.2692	378	2.2175	0.1690	2.2175	1.4891
No log	7.3077	380	2.0855	0.1857	2.0855	1.4441
No log	7.3462	382	2.0098	0.2158	2.0098	1.4177
No log	7.3846	384	1.9385	0.2628	1.9385	1.3923
No log	7.4231	386	2.0233	0.2464	2.0233	1.4224
No log	7.4615	388	2.2312	0.1857	2.2312	1.4937
No log	7.5	390	2.5518	0.1528	2.5518	1.5974
No log	7.5385	392	2.7413	0.1216	2.7413	1.6557
No log	7.5769	394	2.6588	0.1538	2.6588	1.6306
No log	7.6154	396	2.3735	0.1538	2.3735	1.5406
No log	7.6538	398	2.0793	0.2128	2.0793	1.4420
No log	7.6923	400	1.8799	0.2590	1.8799	1.3711
No log	7.7308	402	1.8458	0.2590	1.8458	1.3586
No log	7.7692	404	1.9264	0.2590	1.9264	1.3879
No log	7.8077	406	2.0177	0.2158	2.0177	1.4204
No log	7.8462	408	2.1205	0.1986	2.1205	1.4562
No log	7.8846	410	2.1876	0.1831	2.1876	1.4791
No log	7.9231	412	2.2487	0.1818	2.2487	1.4996
No log	7.9615	414	2.0567	0.2128	2.0567	1.4341
No log	8.0	416	1.8364	0.3022	1.8364	1.3551
No log	8.0385	418	1.8690	0.3022	1.8690	1.3671
No log	8.0769	420	2.1269	0.1972	2.1269	1.4584
No log	8.1154	422	2.3328	0.1678	2.3328	1.5274
No log	8.1538	424	2.2863	0.1678	2.2863	1.5120
No log	8.1923	426	2.1301	0.1986	2.1301	1.4595
No log	8.2308	428	1.8995	0.2837	1.8995	1.3782
No log	8.2692	430	1.7192	0.3188	1.7192	1.3112
No log	8.3077	432	1.7214	0.3407	1.7214	1.3120
No log	8.3462	434	1.8217	0.2353	1.8217	1.3497
No log	8.3846	436	1.9919	0.2029	1.9919	1.4113
No log	8.4231	438	2.1989	0.1831	2.1989	1.4829
No log	8.4615	440	2.3416	0.1538	2.3416	1.5302
No log	8.5	442	2.3719	0.1538	2.3719	1.5401
No log	8.5385	444	2.1923	0.1831	2.1923	1.4806
No log	8.5769	446	2.0381	0.2158	2.0381	1.4276
No log	8.6154	448	1.9033	0.2174	1.9033	1.3796
No log	8.6538	450	1.9075	0.2174	1.9075	1.3811
No log	8.6923	452	1.9876	0.2174	1.9876	1.4098
No log	8.7308	454	2.0381	0.2174	2.0381	1.4276
No log	8.7692	456	1.9313	0.2174	1.9313	1.3897
No log	8.8077	458	1.7666	0.2336	1.7666	1.3291
No log	8.8462	460	1.7371	0.2609	1.7371	1.3180
No log	8.8846	462	1.7925	0.2336	1.7925	1.3389
No log	8.9231	464	1.8024	0.2174	1.8024	1.3425
No log	8.9615	466	1.7908	0.2446	1.7908	1.3382
No log	9.0	468	1.8067	0.2714	1.8067	1.3441
No log	9.0385	470	1.9043	0.2446	1.9043	1.3800
No log	9.0769	472	1.9619	0.2429	1.9619	1.4007
No log	9.1154	474	1.8928	0.2446	1.8928	1.3758
No log	9.1538	476	1.7157	0.2837	1.7157	1.3099
No log	9.1923	478	1.5404	0.3556	1.5404	1.2411
No log	9.2308	480	1.4832	0.3852	1.4832	1.2179
No log	9.2692	482	1.5094	0.4118	1.5094	1.2286
No log	9.3077	484	1.4935	0.4118	1.4935	1.2221
No log	9.3462	486	1.4971	0.4118	1.4971	1.2235
No log	9.3846	488	1.4762	0.4593	1.4762	1.2150
No log	9.4231	490	1.5684	0.3407	1.5684	1.2523
No log	9.4615	492	1.6185	0.3504	1.6185	1.2722
No log	9.5	494	1.6003	0.3824	1.6003	1.2650
No log	9.5385	496	1.6562	0.3284	1.6562	1.2869
No log	9.5769	498	1.6810	0.3259	1.6810	1.2965
0.4083	9.6154	500	1.6824	0.3259	1.6824	1.2971
0.4083	9.6538	502	1.5954	0.3876	1.5954	1.2631
0.4083	9.6923	504	1.6016	0.4122	1.6016	1.2655
0.4083	9.7308	506	1.6833	0.3284	1.6833	1.2974
0.4083	9.7692	508	1.7513	0.2941	1.7513	1.3234
0.4083	9.8077	510	1.7431	0.3235	1.7431	1.3203
0.4083	9.8462	512	1.8102	0.2734	1.8102	1.3454
0.4083	9.8846	514	1.9838	0.2254	1.9838	1.4085
0.4083	9.9231	516	2.1699	0.1986	2.1699	1.4731

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1