0.2.4
Highlights
- Compatibility with vLLM v0.5.4
- Bump minimum vLLM requirement to v0.5.4
What's Changed
- remove dead code (vllm<=0.5.0.post1) by @dtrifiro in #65
- build(deps): bump ruff from 0.5.4 to 0.5.5 by @dependabot in #72
- pyproject: fix broken URLs by @dtrifiro in #76
- gha: add missing build dependencies by @dtrifiro in #68
- noxfile: make overridden vllm version install verbose by @dtrifiro in #78
- updates for vLLM==0.5.4 by @dtrifiro in #82
- fix merge_async_iterators usage for vLLM>0.5.4 by @dtrifiro in #86
- build(deps): bump hf-transfer from 0.1.6 to 0.1.8 by @dependabot in #73
- build(deps): bump flash-attn from 2.6.1 to 2.6.3 by @dependabot in #71
- pre-commit: bump deps by @dtrifiro in #67
- Extract request's trace context in
GenerateStream()
by @ronensc in #64 - Make ADD_SPECIAL_TOKENS true by default by @maxdebayser in #66
- build(deps): bump pytest from 8.2.2 to 8.3.2 by @dependabot in #70
- Fix
stop_reason
for secondary eos tokens by @njhill in #75 - ♻️ refactor LoRARequest based on upstream by @prashantgupta24 in #74
- build(deps): bump mypy from 1.10.1 to 1.11.1 by @dependabot in #77
- Fix length penalty logit processor getting NaN by @wallashss in #85
- Re-enable seed for pipeline parallel by @njhill in #69
- 🥅 Kill servers on engine death by @joerunde in #63
New Contributors
- @ronensc made their first contribution in #64
- @maxdebayser made their first contribution in #66
- @wallashss made their first contribution in #85
Full Changelog: 0.2.3...0.2.4