gstaff
/

TensorRT-LLM-engine-Mistral-7B-instruct-v0.2

Inference Endpoints

Model card Files Files and versions Community

TensorRT-LLM-engine-Mistral-7B-instruct-v0.2

1 contributor

History: 3 commits

gstaff's picture

Create README.md

185d660 verified 11 months ago

.gitattributes

1.59 kB

Add TensorRT-LLM engine files for Mistral-7B-instruct-v0.2 compiled on Windows 11 NVIDIA GeForce RTX 3080Ti for single GPU mode. 11 months ago
README.md

193 Bytes

Create README.md 11 months ago
config.json

1.54 kB

Add TensorRT-LLM engine files for Mistral-7B-instruct-v0.2 compiled on Windows 11 NVIDIA GeForce RTX 3080Ti for single GPU mode. 11 months ago
llama_float16_tp1_rank0.engine

4.2 GB
LFS

Add TensorRT-LLM engine files for Mistral-7B-instruct-v0.2 compiled on Windows 11 NVIDIA GeForce RTX 3080Ti for single GPU mode. 11 months ago
model.cache

227 kB

Add TensorRT-LLM engine files for Mistral-7B-instruct-v0.2 compiled on Windows 11 NVIDIA GeForce RTX 3080Ti for single GPU mode. 11 months ago