Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

请问单gpu如何提高并发量 #68885

Open
tendzzss opened this issue Oct 22, 2024 · 1 comment
Open

请问单gpu如何提高并发量 #68885

tendzzss opened this issue Oct 22, 2024 · 1 comment
Assignees
@ronny1996
Labels
status/new-issue 新建 type/question 用户提问

Comments

@tendzzss
Copy link

请提出你的问题 Please ask your question

我将飞桨部署在多个docker中进行图片ocr识别，只有一个gpu，并发量很小，请问如何提高并发量
@ronny1996
Copy link
Contributor

你好，并发量和模型有关，需要profiling分析，一般可以通过调大batchsize，更换高性能的api，或者MIG提高并发量

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@ronny1996 ronny1996

Labels
status/new-issue 新建 type/question 用户提问
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@tendzzss @ronny1996