Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
RichardErkhov
/
LoftQ_-_phi-2-4bit-64rank-gguf
like
0
GGUF
Inference Endpoints
arxiv:
2310.08659
Model card
Files
Files and versions
Community
Deploy
Use this model
main
LoftQ_-_phi-2-4bit-64rank-gguf
1 contributor
History:
21 commits
RichardErkhov
uploaded readme
3b20b9f
verified
4 months ago
.gitattributes
Safe
2.75 kB
uploaded model
4 months ago
README.md
Safe
6.92 kB
uploaded readme
4 months ago
phi-2-4bit-64rank.IQ4_NL.gguf
1.62 GB
LFS
uploaded model
4 months ago
phi-2-4bit-64rank.IQ4_XS.gguf
1.54 GB
LFS
uploaded model
4 months ago
phi-2-4bit-64rank.Q2_K.gguf
1.11 GB
LFS
uploaded model
4 months ago
phi-2-4bit-64rank.Q3_K.gguf
1.43 GB
LFS
uploaded model
4 months ago
phi-2-4bit-64rank.Q3_K_L.gguf
1.58 GB
LFS
uploaded model
4 months ago
phi-2-4bit-64rank.Q3_K_M.gguf
1.43 GB
LFS
uploaded model
4 months ago
phi-2-4bit-64rank.Q3_K_S.gguf
1.25 GB
LFS
uploaded model
4 months ago
phi-2-4bit-64rank.Q4_0.gguf
1.6 GB
LFS
uploaded model
4 months ago
phi-2-4bit-64rank.Q4_1.gguf
1.77 GB
LFS
uploaded model
4 months ago
phi-2-4bit-64rank.Q4_K.gguf
1.74 GB
LFS
uploaded model
4 months ago
phi-2-4bit-64rank.Q4_K_M.gguf
1.74 GB
LFS
uploaded model
4 months ago
phi-2-4bit-64rank.Q4_K_S.gguf
1.62 GB
LFS
uploaded model
4 months ago
phi-2-4bit-64rank.Q5_0.gguf
1.93 GB
LFS
uploaded model
4 months ago
phi-2-4bit-64rank.Q5_1.gguf
2.1 GB
LFS
uploaded model
4 months ago
phi-2-4bit-64rank.Q5_K.gguf
2 GB
LFS
uploaded model
4 months ago
phi-2-4bit-64rank.Q5_K_M.gguf
2 GB
LFS
uploaded model
4 months ago
phi-2-4bit-64rank.Q5_K_S.gguf
1.93 GB
LFS
uploaded model
4 months ago
phi-2-4bit-64rank.Q6_K.gguf
2.29 GB
LFS
uploaded model
4 months ago
phi-2-4bit-64rank.Q8_0.gguf
2.96 GB
LFS
uploaded model
4 months ago