This repository has been archived by the owner on May 10, 2024. It is now read-only.
v0.1.2
Pre-release
Pre-release
Features
- Vicuna Finetuning (Llama base)
- Serving from HuggingFace or
llm-atc
finetuned models
Patch notes:
- fixed bug in serving with
vLLM==0.1.3
by downgrading toray==2.5.1