Skip to content

Issues: triton-inference-server/server

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

568 Open 3,206 Closed
568 Open 3,206 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

PyTorch model with Dictionary[Key,Tensor] output
#7765 opened Nov 5, 2024 by cesumilo
Do I need to warm up the model again after reloading it?
#7762 opened Nov 4, 2024 by soulseen
How to deploy ensemble models of different versions more elegantly?
#7761 opened Nov 4, 2024 by lzcchl
1
StatusCode.UNAVAILABLE] Received http2 header with status: 502
#7760 opened Nov 3, 2024 by furkanc
Unable to simultaneously load TensorRT model.plan on different GPUs in Triton Inference Server in the same instance
#7755 opened Oct 30, 2024 by AntnvSergey
ensemble logic control
#7749 opened Oct 28, 2024 by xiazi-yu
@rmccorm4
1
Build AMD64 Triton from ARM64 machine generate ARM64 architecture executable file
#7745 opened Oct 26, 2024 by ti1uan
Handle raw binary request in python
#7741 opened Oct 24, 2024 by remiruzn
SeamlessM4T on triton
#7740 opened Oct 24, 2024 by Interwebart
Expensive & Volatile Triton Server latency performance A possible performance tune-up
#7739 opened Oct 24, 2024 by jadhosn
1
Running multi-gpu and replicating models question Further information is requested
#7737 opened Oct 24, 2024 by JoJoLev
@rmccorm4
1
Custom Image build doesn't detect Debian system
#7733 opened Oct 23, 2024 by VishDev12
Error building Triton Docker image in CPU-Only mode with TensorFlow2 backend
#7732 opened Oct 23, 2024 by PierreCarceller
Failing CPU Build question Further information is requested
#7731 opened Oct 23, 2024 by coder-2014
@KrishnanPrash
1
Triton is stopping, unexpectedly and without logging, when using a large model, s3 and periodical checks to ready and live endpoints
#7728 opened Oct 22, 2024 by smcbn
Memory Leak in NVIDIA Triton Server (v24.09-py3) with model-control-mode=explicit memory Related to memory usage, memory growth, and memory leaks
#7727 opened Oct 22, 2024 by Mustafiz48
@rmccorm4
6
Caught signal 11 (Segmentation fault: address not mapped to object at address 0x1c0)
#7723 opened Oct 21, 2024 by wxk-cmd
1
Facing import error in python backend on Apple M2/M3 chips module: platforms Issues related to platforms, hardware, and support matrix
#7722 opened Oct 20, 2024 by TheMightyRaider
2
ONNX CUDA session not working in python backend
#7719 opened Oct 18, 2024 by jsoto-gladia
3
[Bug] Error when serving Torch-TensorRT JIT model to Nvidia-Triton
#7718 opened Oct 18, 2024 by zmy1116
Does Nvidia Triton Inference Server Support AutoML framework?
#7714 opened Oct 17, 2024 by IamExperimenting
nv_inference_request_failure metric does not increase
#7713 opened Oct 17, 2024 by vpvpvpvp
How to maximize single-model inference performance
#7706 opened Oct 15, 2024 by lei1liu
Implementing Model Deployments at Scale Using Kubernetes with Triton Server and MLflow Pipelines
#7702 opened Oct 15, 2024 by haridassaiprakash
Does Triton support multiple TensorFlow backends simultaneously?
#7698 opened Oct 14, 2024 by ragavendrams
ProTip! Add no:assignee to see everything that’s not assigned.