AI-assisted issue triage — shadow mode, feedback welcome #6700
Closed
Harshal19t
started this conversation in
Show and tell
Replies: 1 comment
|
👎 |
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Hey there! I've been working on building an AI-driven triage tool for Textual as part of my personal development – duplication detection with retrieved draft response generation. It's currently in shadow mode, reading issues, making suggestions and posting nothing.
Just two things that seemed worth sharing: when testing the model against your closed as duplicates, it correctly detected #5433 being duplicate of #4900 with high confidence and grounded reasoning, and avoided flagging some other RichLog issues, which were topically similar but different from those issues. And another limitation that it has discovered itself – it has failed to detect #5225 being duplicate of #4955 since it needed to consider context which was not available in any of those issues.
This code is all open source: https://github.com/Harshal19t/AI-Triage-Copilot. Would you be okay with my eventually posting some of these recommendations as issue comments? No problem if not -- I'm perfectly happy running it privately and only writing up results periodically.
All reactions