mpasila commited on
Commit
13a79e6
·
verified ·
1 Parent(s): 020c57a

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +7 -8
README.md CHANGED
@@ -24,14 +24,13 @@ So it does have some issues but I could try training it on Gemma 2 2B and see if
24
 
25
  ## Evaluation
26
 
27
- (Will add the Llama 3.2 base model as well later)
28
-
29
- | Model | Size | Type | FIN-bench (score) |
30
- |-------|------|------|-------|
31
- | **mpasila/Llama-3.2-Finnish-Wikipedia-1B** | 1B | Base | 0.3170 |
32
- | [Finnish-NLP/llama-7b-finnish](https://huggingface.co/Finnish-NLP/llama-7b-finnish) | 7B | Base | 0.2350 |
33
- | [LumiOpen/Viking-7B (1000B)](https://huggingface.co/LumiOpen/Viking-7B) | 7B | Base | **0.3721** |
34
- | [HPLT/gpt-7b-nordic-prerelease](https://huggingface.co/HPLT/gpt-7b-nordic-prerelease) | 7B | Base | 0.3169 |
35
 
36
  [Source](https://docs.google.com/spreadsheets/d/1rqJb9dQVihg-Z1_Ras1L_-wuzPg9xNzpdmM2x5HueeY/edit?usp=sharing)
37
 
 
24
 
25
  ## Evaluation
26
 
27
+ | Model | Size | Type | FIN-bench (score) | Without math |
28
+ |-------|------|------|-------|-------|
29
+ | **mpasila/Llama-3.2-Finnish-Wikipedia-1B** | 1B | Base | 0.3170 | 0.4062 |
30
+ | [unsloth/Llama-3.2-1B](https://huggingface.co/unsloth/Llama-3.2-1B) | 1B | Base | **0.4029** | 0.3881 |
31
+ | [Finnish-NLP/llama-7b-finnish](https://huggingface.co/Finnish-NLP/llama-7b-finnish) | 7B | Base | 0.2350 | 0.4203 |
32
+ | [LumiOpen/Viking-7B (1000B)](https://huggingface.co/LumiOpen/Viking-7B) | 7B | Base | 0.3721 | 0.4453 |
33
+ | [HPLT/gpt-7b-nordic-prerelease](https://huggingface.co/HPLT/gpt-7b-nordic-prerelease) | 7B | Base | 0.3169 | **0.4524** |
 
34
 
35
  [Source](https://docs.google.com/spreadsheets/d/1rqJb9dQVihg-Z1_Ras1L_-wuzPg9xNzpdmM2x5HueeY/edit?usp=sharing)
36