failed to load model of UD-Q2_K_XL

#41
by liougehooa - opened

tried run this model on Tesla V100 with this error:

srv    load_model: failed to load model, 'DeepSeek-R1-UD-Q2_K_XL/DeepSeek-R1-UD-Q2_K_XL-00001-of-00005.gguf'

But I tried UD-IQ1_M successfully on Tesla V100.

Does this model support Tesla architecture?

liougehooa changed discussion status to closed
Your need to confirm your account before you can post a new comment.

Sign up or log in to comment