Inquiry About CUDA 118 Support in Version 0.6.2 Release

[KLOSYX]

I recently noticed that the 0.6.2 version release does not include a Python package that supports CUDA 118. I went through the release notes but couldn't find any mention of this. Could someone please clarify if the new version does not support CUDA 118?

[tarekabouzeid]

I think the release pipeline failed, that's why the CUDA 118 built was not generated, you can check here

[Hsun1128]

Is there a chance that version v0.6.2 could be released with CUDA 11.8 or 12.1 support? Versions above v0.6 have fixed many issues with the "tools".

[tarekabouzeid]

Yesterday @simon-mo ran the pipeline for CU 11.8.

you can download that artifact from here

[simon-mo]

Here's the URL, the version number is a bit messed up sorry:

https://vllm-wheels.s3.us-west-2.amazonaws.com/7193774b1ff8603ad5bf4598e5efba0d9a39b436/vllm-0.6.3.dev0%2Bg7193774b.d20241008.cu118-cp38-abi3-manylinux1_x86_64.whl

[s0h3yl]

Referencing this open ticket.

Thank you, @simon-mo - much appreciated!

Are there plans to fix the CI or re-release them for 0.6.2, as 0.6.3 wasn't released yet?