AfnanTS commited on
Commit
7ce8a18
·
verified ·
1 Parent(s): e3cbfcc

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +44 -1
README.md CHANGED
@@ -5,4 +5,47 @@ language:
5
  - ar
6
  base_model:
7
  - UBC-NLP/ARBERTv2
8
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
5
  - ar
6
  base_model:
7
  - UBC-NLP/ARBERTv2
8
+ pipeline_tag: fill-mask
9
+ ---
10
+
11
+ <img src="https://huggingface.co/AfnanTS/ARBERTv2EL/blob/main/Arab_BERT2.jpeg" alt="drawing" width="30%" height="30%" align="right"/>
12
+
13
+
14
+ The **ArBERTV2_EL** model is a transformer-based Arabic language model fine-tuned using the Entity Linking (EL) task. This model leverages Knowledge Graphs (KGs) for intrinsic evaluation of Masked Language Modeling (MLM) models without directly evaluating the EL model. The EL task ensures that the model benefits from the incorporation of structured knowledge during pre-training.
15
+
16
+
17
+ ## Uses
18
+
19
+ <!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
20
+
21
+ ### Direct Use
22
+
23
+
24
+ Filling masked tokens in Arabic text, particularly in contexts enriched with knowledge from KGs.
25
+
26
+
27
+ ### Downstream Use
28
+
29
+ Can be further fine-tuned for Arabic NLP tasks that require semantic understanding, such as text classification or question answering.
30
+
31
+
32
+
33
+ ## How to Get Started with the Model
34
+
35
+ from transformers import pipeline
36
+ fill_mask = pipeline("fill-mask", model="AfnanTS/ArBERTV1_EL")
37
+ fill_mask("اللغة [MASK] مهمة جدا.")
38
+
39
+
40
+
41
+ ## Training Details
42
+
43
+ ### Training Data
44
+
45
+ Trained on the ArLAMA dataset, which is designed to represent Knowledge Graphs in natural language.
46
+
47
+
48
+
49
+ ### Training Procedure
50
+
51
+ Continued pre-training of the ArBERTv2 model using Entity Linking (EL) task.