co-serving

Here are 2 public repositories matching this topic...

Deferred Continuous Batching in Resource-Efficient Large Language Model Serving (EuroMLSys 2024)

inference pytorch lora fine-tuning peft llm co-serving

Resource Multiplexing in Tuning and Serving Large Language Models (USENIX ATC 2025)

inference pytorch lora fine-tuning peft llm co-serving

To associate your repository with the co-serving topic, visit your repo's landing page and select "manage topics."