empirischtech
/

Meta-Llama-3.1-8B-Instruct-gptq-4bit

4-bit precision

Model card Files Files and versions Community

rwmasood commited on 18 days ago

Commit

92de51f

·

verified ·

1 Parent(s): 1f864fb

Update README.md

Files changed (1) hide show

README.md +6 -6

README.md CHANGED Viewed

@@ -18,12 +18,12 @@ This document presents the evaluation results of `Llama-3.1-8B-Instruct-gptq-4bi
 ## 📊 Evaluation Summary
-| **Metric**            | **Value**  | **Description**  |
-|----------------------|-----------|-----------------|
-| **Accuracy (acc,none)** | `47.1%`  | Raw accuracy - percentage of correct answers. |
-| **Standard Error (acc_stderr,none)** | `1.46%` | Uncertainty in the accuracy estimate. |
-| **Normalized Accuracy (acc_norm,none)** | `49.9%`  | Accuracy after dataset-specific normalization. |
-| **Standard Error (acc_norm_stderr,none)** | `1.46%` | Uncertainty for normalized accuracy. |
 📌 **Interpretation:**
 - The model correctly answered **47.1% of the questions**.

 ## 📊 Evaluation Summary
+| **Metric**            | **Value**  | **Description**  | **Llama-3.1-8B-Instruct**  |
+|----------------------|-----------|-----------------|-----------|
+| **Accuracy (acc,none)** | `47.1%`  | Raw accuracy - percentage of correct answers. | `53.1%` |
+| **Standard Error (acc_stderr,none)** | `1.46%` | Uncertainty in the accuracy estimate. | `1.45%` |
+| **Normalized Accuracy (acc_norm,none)** | `49.9%`  | Accuracy after dataset-specific normalization. | `56.8%` |
+| **Standard Error (acc_norm_stderr,none)** | `1.46%` | Uncertainty for normalized accuracy. | `1.45%` |
 📌 **Interpretation:**
 - The model correctly answered **47.1% of the questions**.