Llama-3.x
Collection
Gaia compatible quants for Llama 3.1, 3.2 and 3.3 Instruct models.
•
4 items
•
Updated
Llama-3.2-3B-Instruct-GGUF
Original Model
meta-llama/Llama-3.2-3B-Instruct
Run with Gaianet
Prompt template
prompt template: llama-3-chat
Context size
chat_ctx_size: 128000
Run with GaiaNet
Quick start: https://docs.gaianet.ai/node-guide/quick-start
Customize your node: https://docs.gaianet.ai/node-guide/customize
Quantized with llama.cpp b3807
- Downloads last month
- 127
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social
visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.
Model tree for gaianet/Llama-3.2-3B-Instruct-GGUF
Base model
meta-llama/Llama-3.2-3B-Instruct