README.md

metadata

library_name: transformers
base_model: aubmindlab/bert-base-arabertv02
tags:
  - generated_from_trainer
model-index:
  - name: >-
      ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k17_task1_organization
    results: []

ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k17_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.8110
• Qwk: 0.2754
• Mse: 1.8110
• Rmse: 1.3457

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0270	2	7.2082	-0.0162	7.2082	2.6848
No log	0.0541	4	4.4178	0.0833	4.4178	2.1018
No log	0.0811	6	3.6012	-0.0423	3.6012	1.8977
No log	0.1081	8	3.9013	-0.0796	3.9013	1.9752
No log	0.1351	10	2.2566	0.1194	2.2566	1.5022
No log	0.1622	12	1.8780	0.1593	1.8780	1.3704
No log	0.1892	14	2.1948	-0.0625	2.1948	1.4815
No log	0.2162	16	2.2320	-0.0472	2.2320	1.4940
No log	0.2432	18	2.2639	0.0305	2.2639	1.5046
No log	0.2703	20	2.2500	0.0606	2.2500	1.5000
No log	0.2973	22	2.1048	0.1157	2.1048	1.4508
No log	0.3243	24	2.0103	0.2018	2.0103	1.4179
No log	0.3514	26	1.9807	0.1869	1.9807	1.4074
No log	0.3784	28	1.9049	0.1698	1.9049	1.3802
No log	0.4054	30	1.8210	0.1714	1.8210	1.3494
No log	0.4324	32	1.7544	0.1714	1.7544	1.3245
No log	0.4595	34	1.6969	0.1154	1.6969	1.3027
No log	0.4865	36	1.6768	0.2569	1.6768	1.2949
No log	0.5135	38	1.8115	0.2459	1.8115	1.3459
No log	0.5405	40	1.8102	0.2459	1.8102	1.3454
No log	0.5676	42	1.8407	0.3465	1.8407	1.3567
No log	0.5946	44	1.6912	0.2735	1.6912	1.3005
No log	0.6216	46	1.5411	0.1682	1.5411	1.2414
No log	0.6486	48	1.4974	0.1524	1.4974	1.2237
No log	0.6757	50	1.5038	0.2243	1.5038	1.2263
No log	0.7027	52	1.5548	0.2202	1.5548	1.2469
No log	0.7297	54	1.5638	0.2321	1.5638	1.2505
No log	0.7568	56	1.5255	0.2301	1.5255	1.2351
No log	0.7838	58	1.4802	0.2182	1.4802	1.2166
No log	0.8108	60	1.4783	0.2056	1.4783	1.2159
No log	0.8378	62	1.5381	0.2407	1.5381	1.2402
No log	0.8649	64	1.5067	0.2545	1.5067	1.2275
No log	0.8919	66	1.4023	0.3509	1.4023	1.1842
No log	0.9189	68	1.2808	0.3966	1.2808	1.1317
No log	0.9459	70	1.1520	0.5116	1.1520	1.0733
No log	0.9730	72	1.1067	0.5238	1.1067	1.0520
No log	1.0	74	1.1387	0.5167	1.1387	1.0671
No log	1.0270	76	1.2173	0.5366	1.2173	1.1033
No log	1.0541	78	1.3335	0.4500	1.3335	1.1548
No log	1.0811	80	1.3091	0.5082	1.3091	1.1442
No log	1.1081	82	1.2611	0.5124	1.2611	1.1230
No log	1.1351	84	1.3162	0.4370	1.3162	1.1473
No log	1.1622	86	1.2898	0.4667	1.2898	1.1357
No log	1.1892	88	1.2614	0.4715	1.2614	1.1231
No log	1.2162	90	1.5039	0.3636	1.5039	1.2263
No log	1.2432	92	1.7922	0.2581	1.7922	1.3387
No log	1.2703	94	1.6562	0.2812	1.6562	1.2869
No log	1.2973	96	1.6710	0.2879	1.6710	1.2927
No log	1.3243	98	1.6769	0.2899	1.6769	1.2950
No log	1.3514	100	1.7390	0.3022	1.7390	1.3187
No log	1.3784	102	1.6659	0.3022	1.6659	1.2907
No log	1.4054	104	1.6323	0.3212	1.6323	1.2776
No log	1.4324	106	1.5980	0.3636	1.5980	1.2641
No log	1.4595	108	1.4648	0.4427	1.4648	1.2103
No log	1.4865	110	1.4642	0.5203	1.4642	1.2100
No log	1.5135	112	1.5540	0.3016	1.5540	1.2466
No log	1.5405	114	1.7152	0.2344	1.7152	1.3096
No log	1.5676	116	1.6887	0.3030	1.6887	1.2995
No log	1.5946	118	1.6345	0.3478	1.6345	1.2785
No log	1.6216	120	1.5541	0.3889	1.5541	1.2466
No log	1.6486	122	1.7321	0.3429	1.7321	1.3161
No log	1.6757	124	1.7849	0.3429	1.7849	1.3360
No log	1.7027	126	1.7942	0.3212	1.7942	1.3395
No log	1.7297	128	1.6782	0.3478	1.6782	1.2954
No log	1.7568	130	1.6333	0.2791	1.6333	1.2780
No log	1.7838	132	1.6812	0.2764	1.6812	1.2966
No log	1.8108	134	1.6148	0.2759	1.6148	1.2707
No log	1.8378	136	1.5928	0.3306	1.5928	1.2621
No log	1.8649	138	1.5961	0.3252	1.5961	1.2634
No log	1.8919	140	1.6132	0.2951	1.6132	1.2701
No log	1.9189	142	1.6740	0.3876	1.6740	1.2938
No log	1.9459	144	1.5854	0.3281	1.5854	1.2591
No log	1.9730	146	1.5721	0.3492	1.5721	1.2538
No log	2.0	148	1.5770	0.3759	1.5770	1.2558
No log	2.0270	150	1.4834	0.3360	1.4834	1.2179
No log	2.0541	152	1.3675	0.3871	1.3675	1.1694
No log	2.0811	154	1.3421	0.3577	1.3421	1.1585
No log	2.1081	156	1.5974	0.3942	1.5974	1.2639
No log	2.1351	158	1.7204	0.3597	1.7204	1.3117
No log	2.1622	160	1.5333	0.3852	1.5333	1.2382
No log	2.1892	162	1.4891	0.3622	1.4891	1.2203
No log	2.2162	164	1.6118	0.3459	1.6118	1.2696
No log	2.2432	166	1.8269	0.3358	1.8269	1.3516
No log	2.2703	168	1.6298	0.3259	1.6298	1.2766
No log	2.2973	170	1.5699	0.3134	1.5699	1.2530
No log	2.3243	172	1.5849	0.3529	1.5849	1.2589
No log	2.3514	174	1.6959	0.3478	1.6959	1.3023
No log	2.3784	176	1.8324	0.2857	1.8324	1.3537
No log	2.4054	178	1.6801	0.3741	1.6801	1.2962
No log	2.4324	180	1.6340	0.3623	1.6340	1.2783
No log	2.4595	182	1.5266	0.4427	1.5266	1.2355
No log	2.4865	184	1.4815	0.3770	1.4815	1.2172
No log	2.5135	186	1.4268	0.3130	1.4268	1.1945
No log	2.5405	188	1.3539	0.3478	1.3539	1.1636
No log	2.5676	190	1.4250	0.4545	1.4250	1.1937
No log	2.5946	192	1.6666	0.3768	1.6666	1.2910
No log	2.6216	194	1.8661	0.2878	1.8661	1.3661
No log	2.6486	196	1.8096	0.3121	1.8096	1.3452
No log	2.6757	198	1.5584	0.3942	1.5584	1.2484
No log	2.7027	200	1.3693	0.5481	1.3693	1.1702
No log	2.7297	202	1.3817	0.5185	1.3817	1.1755
No log	2.7568	204	1.4770	0.4478	1.4770	1.2153
No log	2.7838	206	1.6677	0.3597	1.6677	1.2914
No log	2.8108	208	1.7582	0.3453	1.7582	1.3260
No log	2.8378	210	1.6186	0.4060	1.6186	1.2722
No log	2.8649	212	1.4199	0.4286	1.4199	1.1916
No log	2.8919	214	1.3802	0.4567	1.3802	1.1748
No log	2.9189	216	1.5417	0.4380	1.5417	1.2416
No log	2.9459	218	2.0088	0.2207	2.0088	1.4173
No log	2.9730	220	2.2277	0.1408	2.2277	1.4925
No log	3.0	222	2.1407	0.0597	2.1407	1.4631
No log	3.0270	224	1.8514	0.1951	1.8514	1.3607
No log	3.0541	226	1.6430	0.3740	1.6430	1.2818
No log	3.0811	228	1.5615	0.4127	1.5615	1.2496
No log	3.1081	230	1.5855	0.4627	1.5855	1.2592
No log	3.1351	232	1.6564	0.3429	1.6564	1.2870
No log	3.1622	234	1.5814	0.4203	1.5814	1.2576
No log	3.1892	236	1.4123	0.4923	1.4123	1.1884
No log	3.2162	238	1.4214	0.4961	1.4214	1.1922
No log	3.2432	240	1.5848	0.3971	1.5848	1.2589
No log	3.2703	242	1.7020	0.3885	1.7020	1.3046
No log	3.2973	244	1.8595	0.2483	1.8595	1.3636
No log	3.3243	246	2.0443	0.1806	2.0443	1.4298
No log	3.3514	248	2.0324	0.1806	2.0324	1.4256
No log	3.3784	250	1.8233	0.2254	1.8233	1.3503
No log	3.4054	252	1.6159	0.3910	1.6159	1.2712
No log	3.4324	254	1.5849	0.3759	1.5849	1.2589
No log	3.4595	256	1.6667	0.3876	1.6667	1.2910
No log	3.4865	258	1.8424	0.2590	1.8424	1.3574
No log	3.5135	260	1.9403	0.1958	1.9403	1.3929
No log	3.5405	262	2.0503	0.1655	2.0502	1.4319
No log	3.5676	264	1.8608	0.2817	1.8608	1.3641
No log	3.5946	266	1.7975	0.3077	1.7975	1.3407
No log	3.6216	268	1.8322	0.2254	1.8322	1.3536
No log	3.6486	270	1.9213	0.2254	1.9213	1.3861
No log	3.6757	272	1.9880	0.2254	1.9880	1.4100
No log	3.7027	274	1.9393	0.2254	1.9393	1.3926
No log	3.7297	276	1.8321	0.2270	1.8321	1.3536
No log	3.7568	278	1.8982	0.2254	1.8982	1.3778
No log	3.7838	280	1.9421	0.2254	1.9421	1.3936
No log	3.8108	282	2.0218	0.2254	2.0218	1.4219
No log	3.8378	284	1.9314	0.2553	1.9314	1.3898
No log	3.8649	286	1.8592	0.2571	1.8592	1.3635
No log	3.8919	288	1.6958	0.2963	1.6958	1.3022
No log	3.9189	290	1.6157	0.3840	1.6157	1.2711
No log	3.9459	292	1.6598	0.3101	1.6598	1.2883
No log	3.9730	294	1.5943	0.4394	1.5943	1.2626
No log	4.0	296	1.4468	0.4615	1.4468	1.2028
No log	4.0270	298	1.3742	0.4567	1.3742	1.1723
No log	4.0541	300	1.3576	0.4531	1.3576	1.1651
No log	4.0811	302	1.5542	0.3881	1.5542	1.2467
No log	4.1081	304	1.7148	0.2979	1.7148	1.3095
No log	4.1351	306	1.7422	0.3099	1.7422	1.3199
No log	4.1622	308	1.8653	0.2817	1.8653	1.3658
No log	4.1892	310	1.8779	0.2817	1.8779	1.3704
No log	4.2162	312	1.9154	0.2517	1.9154	1.3840
No log	4.2432	314	1.8347	0.2817	1.8347	1.3545
No log	4.2703	316	1.7254	0.2937	1.7254	1.3135
No log	4.2973	318	1.7849	0.2937	1.7849	1.3360
No log	4.3243	320	2.0441	0.2207	2.0441	1.4297
No log	4.3514	322	2.0704	0.2207	2.0704	1.4389
No log	4.3784	324	2.0644	0.2222	2.0644	1.4368
No log	4.4054	326	1.8950	0.2817	1.8950	1.3766
No log	4.4324	328	1.6892	0.3088	1.6892	1.2997
No log	4.4595	330	1.6061	0.3284	1.6061	1.2673
No log	4.4865	332	1.6050	0.3284	1.6050	1.2669
No log	4.5135	334	1.6380	0.2707	1.6380	1.2798
No log	4.5405	336	1.6928	0.2628	1.6928	1.3011
No log	4.5676	338	1.6034	0.3088	1.6034	1.2662
No log	4.5946	340	1.5406	0.3704	1.5406	1.2412
No log	4.6216	342	1.6825	0.2899	1.6825	1.2971
No log	4.6486	344	1.7879	0.2553	1.7879	1.3371
No log	4.6757	346	1.7188	0.3000	1.7188	1.3110
No log	4.7027	348	1.6851	0.2794	1.6851	1.2981
No log	4.7297	350	1.7611	0.2256	1.7611	1.3271
No log	4.7568	352	1.9253	0.2090	1.9253	1.3875
No log	4.7838	354	2.0759	0.1515	2.0759	1.4408
No log	4.8108	356	2.0925	0.1571	2.0925	1.4465
No log	4.8378	358	2.0788	0.1944	2.0788	1.4418
No log	4.8649	360	1.9254	0.2553	1.9254	1.3876
No log	4.8919	362	1.6860	0.3088	1.6860	1.2985
No log	4.9189	364	1.6780	0.3459	1.6780	1.2954
No log	4.9459	366	1.6791	0.3459	1.6791	1.2958
No log	4.9730	368	1.6670	0.4242	1.6670	1.2911
No log	5.0	370	1.5885	0.4122	1.5885	1.2604
No log	5.0270	372	1.5051	0.3906	1.5051	1.2268
No log	5.0541	374	1.4867	0.3810	1.4867	1.2193
No log	5.0811	376	1.5628	0.4	1.5628	1.2501
No log	5.1081	378	1.6585	0.3731	1.6585	1.2878
No log	5.1351	380	1.8380	0.2734	1.8380	1.3557
No log	5.1622	382	1.9378	0.2270	1.9378	1.3920
No log	5.1892	384	1.9140	0.2270	1.9140	1.3835
No log	5.2162	386	1.7157	0.3066	1.7157	1.3099
No log	5.2432	388	1.5721	0.3910	1.5721	1.2538
No log	5.2703	390	1.5407	0.4375	1.5407	1.2413
No log	5.2973	392	1.4930	0.4375	1.4930	1.2219
No log	5.3243	394	1.4746	0.4375	1.4746	1.2143
No log	5.3514	396	1.4671	0.4308	1.4671	1.2113
No log	5.3784	398	1.4099	0.4341	1.4099	1.1874
No log	5.4054	400	1.4354	0.4394	1.4354	1.1981
No log	5.4324	402	1.5180	0.3881	1.5180	1.2321
No log	5.4595	404	1.6601	0.3433	1.6601	1.2885
No log	5.4865	406	1.7180	0.3043	1.7180	1.3107
No log	5.5135	408	1.6135	0.3556	1.6135	1.2702
No log	5.5405	410	1.5487	0.4328	1.5487	1.2445
No log	5.5676	412	1.6277	0.3731	1.6277	1.2758
No log	5.5946	414	1.7122	0.3235	1.7122	1.3085
No log	5.6216	416	1.8522	0.2734	1.8522	1.3610
No log	5.6486	418	1.9405	0.2553	1.9405	1.3930
No log	5.6757	420	1.9563	0.2553	1.9563	1.3987
No log	5.7027	422	1.8105	0.2734	1.8105	1.3455
No log	5.7297	424	1.6032	0.4242	1.6032	1.2662
No log	5.7568	426	1.4874	0.3968	1.4874	1.2196
No log	5.7838	428	1.5161	0.368	1.5161	1.2313
No log	5.8108	430	1.7124	0.4091	1.7124	1.3086
No log	5.8378	432	1.8787	0.2734	1.8787	1.3706
No log	5.8649	434	1.9319	0.2553	1.9319	1.3899
No log	5.8919	436	1.8562	0.2734	1.8562	1.3624
No log	5.9189	438	1.7858	0.2899	1.7858	1.3363
No log	5.9459	440	1.9567	0.2254	1.9567	1.3988
No log	5.9730	442	2.0003	0.2254	2.0003	1.4143
No log	6.0	444	1.9405	0.2254	1.9405	1.3930
No log	6.0270	446	1.7613	0.2899	1.7613	1.3271
No log	6.0541	448	1.6111	0.4242	1.6111	1.2693
No log	6.0811	450	1.6096	0.3731	1.6096	1.2687
No log	6.1081	452	1.8084	0.2734	1.8084	1.3447
No log	6.1351	454	2.0332	0.2254	2.0332	1.4259
No log	6.1622	456	2.0020	0.2254	2.0020	1.4149
No log	6.1892	458	1.8074	0.2734	1.8074	1.3444
No log	6.2162	460	1.5295	0.4265	1.5295	1.2367
No log	6.2432	462	1.4173	0.5191	1.4173	1.1905
No log	6.2703	464	1.4113	0.4882	1.4113	1.1880
No log	6.2973	466	1.5022	0.4580	1.5022	1.2256
No log	6.3243	468	1.6681	0.3731	1.6681	1.2915
No log	6.3514	470	1.7982	0.3407	1.7982	1.3410
No log	6.3784	472	1.7536	0.3284	1.7536	1.3242
No log	6.4054	474	1.5888	0.4179	1.5888	1.2605
No log	6.4324	476	1.4139	0.5303	1.4139	1.1891
No log	6.4595	478	1.4145	0.4962	1.4145	1.1893
No log	6.4865	480	1.5579	0.4242	1.5579	1.2481
No log	6.5135	482	1.7630	0.2754	1.7630	1.3278
No log	6.5405	484	1.8474	0.2411	1.8474	1.3592
No log	6.5676	486	1.7922	0.2446	1.7922	1.3387
No log	6.5946	488	1.6658	0.4242	1.6658	1.2907
No log	6.6216	490	1.5592	0.4098	1.5592	1.2487
No log	6.6486	492	1.5511	0.3761	1.5511	1.2454
No log	6.6757	494	1.5523	0.4500	1.5523	1.2459
No log	6.7027	496	1.6037	0.4031	1.6037	1.2664
No log	6.7297	498	1.6611	0.3731	1.6611	1.2888
0.3936	6.7568	500	1.6958	0.3235	1.6958	1.3022
0.3936	6.7838	502	1.6762	0.3235	1.6762	1.2947
0.3936	6.8108	504	1.6236	0.3852	1.6236	1.2742
0.3936	6.8378	506	1.5538	0.3852	1.5538	1.2465
0.3936	6.8649	508	1.5990	0.3852	1.5990	1.2645
0.3936	6.8919	510	1.6781	0.3407	1.6781	1.2954
0.3936	6.9189	512	1.7600	0.2920	1.7600	1.3267
0.3936	6.9459	514	1.7322	0.2920	1.7322	1.3161
0.3936	6.9730	516	1.6869	0.3556	1.6869	1.2988
0.3936	7.0	518	1.6151	0.3609	1.6151	1.2709
0.3936	7.0270	520	1.5323	0.4478	1.5323	1.2378
0.3936	7.0541	522	1.4406	0.4603	1.4406	1.2003
0.3936	7.0811	524	1.4687	0.4662	1.4687	1.2119
0.3936	7.1081	526	1.5421	0.4179	1.5421	1.2418
0.3936	7.1351	528	1.6858	0.2920	1.6858	1.2984
0.3936	7.1622	530	1.8141	0.2754	1.8141	1.3469
0.3936	7.1892	532	2.0164	0.1690	2.0164	1.4200
0.3936	7.2162	534	2.0350	0.1690	2.0350	1.4265
0.3936	7.2432	536	1.8110	0.2754	1.8110	1.3457

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1