Text Generation w/o repeating the prompt #1322
Unanswered
wildmanwong
asked this question in
Q&A
Replies: 1 comment
-
You should modify this line probably. vllm/vllm/entrypoints/api_server.py Line 61 in 7b895c5 Or on the client side take len(prompt) and remove then from the response. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Is there a parameter to specify if we do NOT want the prompt repeated when generating text?
Beta Was this translation helpful? Give feedback.
All reactions