Skip to content
This repository has been archived by the owner on Oct 2, 2024. It is now read-only.

Llamaguard returns is_safe logprob in annotation #476

Open
bkorycki opened this issue Jul 17, 2024 · 5 comments
Open

Llamaguard returns is_safe logprob in annotation #476

bkorycki opened this issue Jul 17, 2024 · 5 comments

Comments

@bkorycki
Copy link
Contributor

No description provided.

@bkorycki bkorycki changed the title Add --logprobs options to run-annotators Llamaguard returns is_safe logprob in annotation Jul 18, 2024
@HuaizhengZhang
Copy link
Contributor

@bkorycki do you have a plan to close these done tasks?

so we can check and help those todo tasks more clearly

@wpietri
Copy link
Contributor

wpietri commented Jul 31, 2024

Hi, @HuaizhengZhang! We are managing our work through a Github project, not through the issues. I would like it if GitHub automatically closed issues when they were marked Done in the project, but I couldn't find a way to do that. We're also working energetically on this and related code as a full-time team that talks a lot via video call and discord, so GitHub issues is very much secondary to that.

If you're looking to get involved, maybe tell us a bit about what you're interested in and what motivates you? We could find some things related to that. And if you'd like, get you into the AI Safety Working Group Discord.

@HuaizhengZhang
Copy link
Contributor

Hi @wpietri , I am interested in the project and want to contribute something.

I am a founding engineer from an AI eval and safety company. This project is tremendous and super related to my current work. I hope I can join the development to exchange some ideas/designs / etc to better serve customers/community / etc

@wpietri
Copy link
Contributor

wpietri commented Aug 1, 2024

That sounds great, @HuaizhengZhang. How about you join our discord here: https://mlcommons.org/working-groups/ai-safety/ai-safety/

Then we can book a call with the team so we can all discuss the best ways for you to get involved.

@HuaizhengZhang
Copy link
Contributor

@wpietri
image
Joined but could only see this

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants