nvidia
/

Llama-3.1-405B-Instruct-FP8

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

omrialmog commited on 17 days ago

Commit

d93f80d

·

verified ·

1 Parent(s): 9090e14

Update README.md

Files changed (1) hide show

README.md +3 -3

README.md CHANGED Viewed

@@ -104,13 +104,13 @@ Please refer to the [TensorRT-LLM benchmarking documentation](https://github.com
   <tr>
    <td>BF16
    </td>
-   <td>87.6
    </td>
-   <td>96.3
    </td>
    <td>96.9
    </td>
-   <td>90.3
    </td>
    <td>275.0
    </td>

   <tr>
    <td>BF16
    </td>
+   <td>87.3
    </td>
+   <td>96.8
    </td>
    <td>96.9
    </td>
+   <td>88.6
    </td>
    <td>275.0
    </td>