Will 2*1080Ti Nvidia Card each of 11 GB support vLLM ? #8992
Unanswered
thomasjv799
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
I have two 1080Ti Card and each card has 11 GB VRAM. However the compute capability is 6.1 while in vLLM it is said we require compute capability of 7. I haven't tried installing it but wanted to know if its possible serve vLLM in this cards.
Beta Was this translation helpful? Give feedback.
All reactions