Local execution issue

#13
by binzhango - opened

Does anyone help me figure it out?

Suddenly I got this error. Is this library version incompatible?

/transformers/models/qwen2_vl/modeling_qwen2_vl.py", line 420, in forward
    attn_output = F.scaled_dot_product_attention(q, k, v, attention_mask, dropout_p=0.0)

IndexError: Dimension out of range (expected to be in range of [-3, 2], but got 3)

Hey @binzhango , can you provide more details? And in the mean time can you manually try to update the transformers version and try it again?

@amanrangapur

I have to downgrade my torch from 2.6.0 to 2.5.0. Now it's working.

Pytorch: 2.5.0
Torchvision: 0.20.0
Transformers: 4.49.0

Thanks.

Sign up or log in to comment