Skip to content
@gpustack

GPUStack

Open-source GPU cluster manager for running large language models(LLMs)

Pinned Loading

  1. gpustack gpustack Public

    Manage GPU clusters for running LLMs

    Python 448 38

  2. gguf-parser-go gguf-parser-go Public

    Review/Check GGUF files and estimate the memory usage and maximum tokens per second.

    Go 36 4

  3. llama-box llama-box Public

    LLM inference server implementation based on llama.cpp.

    C++ 15 1

Repositories

Showing 8 of 8 repositories
  • llama-box Public

    LLM inference server implementation based on llama.cpp.

    gpustack/llama-box’s past year of commit activity
    C++ 15 MIT 1 0 0 Updated Oct 26, 2024
  • gpustack Public

    Manage GPU clusters for running LLMs

    gpustack/gpustack’s past year of commit activity
    Python 448 Apache-2.0 38 59 (1 issue needs help) 2 Updated Oct 26, 2024
  • gpustack.github.io Public
    gpustack/gpustack.github.io’s past year of commit activity
    HTML 0 0 0 0 Updated Oct 26, 2024
  • gpustack-ui Public
    gpustack/gpustack-ui’s past year of commit activity
    TypeScript 1 5 0 0 Updated Oct 25, 2024
  • fastfetch Public Forked from fastfetch-cli/fastfetch

    Like neofetch, but much faster because written mostly in C.

    gpustack/fastfetch’s past year of commit activity
    C 0 MIT 412 0 0 Updated Oct 24, 2024
  • gguf-parser-go Public

    Review/Check GGUF files and estimate the memory usage and maximum tokens per second.

    gpustack/gguf-parser-go’s past year of commit activity
    Go 36 MIT 4 0 0 Updated Oct 24, 2024
  • gguf-packer-go Public

    Deliver LLMs of GGUF format via Dockerfile.

    gpustack/gguf-packer-go’s past year of commit activity
    Go 4 MIT 1 0 0 Updated Oct 24, 2024
  • .github Public

    Meta-Github repository for all GPUStack repositories.

    gpustack/.github’s past year of commit activity
    0 Apache-2.0 0 0 0 Updated Oct 24, 2024

People

This organization has no public members. You must be a member to see who’s a part of this organization.

Most used topics

gguf llama go