We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
使用ollama运行minicpm-v模型,调用过程中发现,单独调用llm文字部分,正常运行到igpu。 但是同时使用图片和文字,会出先LLM运行到CPU上。
ollama run minicpm-v:latest
Test prompt { "model": "minicpm-v:latest", "prompt": "图片讲了什么内容?", "images":["C:\Users\MTL\Pictures\test.jpg"]}
The text was updated successfully, but these errors were encountered:
Hi @juan-OY , we have reproduced your issue and we are looking for a solution currently.
Sorry, something went wrong.
No branches or pull requests
使用ollama运行minicpm-v模型,调用过程中发现,单独调用llm文字部分,正常运行到igpu。
但是同时使用图片和文字,会出先LLM运行到CPU上。
ollama run minicpm-v:latest
Test prompt
{
"model": "minicpm-v:latest",
"prompt": "图片讲了什么内容?",
"images":["C:\Users\MTL\Pictures\test.jpg"]}
The text was updated successfully, but these errors were encountered: