New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

推理速度很慢，有什么解决的办法吗 #165

Open

luyao-cv opened this issue Jan 7, 2024 · 1 comment

luyao-cv commented Jan 7, 2024

V100 测试
总共推理要经过四个模型，

ppg编码， whisper ppg模型，模型比较大。这块占比比较大，推理速度要40s。
hubert编码，推理速度要15s。
pitch音高编码，推理速度要15s。
svc_infer，推理速度15s。一首歌的推理，速度有点慢。有什么可以加快的方式吗

xwang0415 commented Jan 8, 2024

你这个推理速度看起来更像是使用的CPU，确认下是否成功调用了GPU

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment