Multi round memory optimization. #668
tanyo520
started this conversation in
2. Feature requests
Replies: 1 comment
-
When building chat bots with SK/LC or other frameworks, during a conversation messages are stored in RAM in the chat history array, which we consider short term memory. The best approach is passing all the last N messages to the LLM, who can decide how to move forward, e.g. using function calling, whether to generate an answer, or some other action. Once a conversation is complete, whether the chat should be saved or not is app specific, e.g. one can call |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Is there any optimization plan for short-term historical memory in multi round conversations, such as whether the previous question is related to the new question being asked now.
Beta Was this translation helpful? Give feedback.
All reactions