Update README.md
Browse files
README.md
CHANGED
@@ -119,10 +119,26 @@ NVIDIA H100 80GB * 8EA์ ํ์ฉํ์ฌ ๋ชจ๋ธ ์ฌ์ ํ์ต์ ์งํํ์์ต๋
|
|
119 |
|
120 |
### Tokenizer
|
121 |
Llama-3-Tokenizer๋ฅผ ํ๊ตญ์ด ํนํํ๊ธฐ ์ํด ํ๊ตญ์ด ํ ํฐ 17,536๊ฐ๋ฅผ ์ถ๊ฐํ๊ณ ํ์ฉํ์์ต๋๋ค.
|
122 |
-
|
123 |
-
|
124 |
-
|
125 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
126 |
|
127 |
#### Tokenizer Result
|
128 |
<table>
|
|
|
119 |
|
120 |
### Tokenizer
|
121 |
Llama-3-Tokenizer๋ฅผ ํ๊ตญ์ด ํนํํ๊ธฐ ์ํด ํ๊ตญ์ด ํ ํฐ 17,536๊ฐ๋ฅผ ์ถ๊ฐํ๊ณ ํ์ฉํ์์ต๋๋ค.
|
122 |
+
<table>
|
123 |
+
<tr>
|
124 |
+
<td><strong>Model</strong>
|
125 |
+
</td>
|
126 |
+
<td><strong>Vocab Size</strong>
|
127 |
+
</td>
|
128 |
+
</tr>
|
129 |
+
<tr>
|
130 |
+
<td>Llama-3
|
131 |
+
</td>
|
132 |
+
<td>128,256
|
133 |
+
</td>
|
134 |
+
</tr>
|
135 |
+
<tr>
|
136 |
+
<td>Llama-3-Luxia-Ko
|
137 |
+
</td>
|
138 |
+
<td>145,792
|
139 |
+
</td>
|
140 |
+
</tr>
|
141 |
+
</table>
|
142 |
|
143 |
#### Tokenizer Result
|
144 |
<table>
|