Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

add examples of batch evaluation in Dynalab #125

Open
yilingchung opened this issue Nov 7, 2022 · 0 comments
Open

add examples of batch evaluation in Dynalab #125

yilingchung opened this issue Nov 7, 2022 · 0 comments
Assignees
@Ciroye @remg1997
Labels
bug Something isn't working good first issue Good for newcomers

Comments

@yilingchung
Copy link

Hi!

I have been trying to upload a model to Dynabench using Dynalab 2.0. I am able to pass the single_evaluation test endpoint, following your examples. But for batch_evaluation I always got 500 error code. Could you upload/update in readme on how to implement the batch evaluation? I believe it will help others who are facing the same problem! Thank you.
@Ciroye Ciroye self-assigned this Nov 17, 2022
@ashishthaker ashishthaker added bug Something isn't working good first issue Good for newcomers labels Nov 22, 2022
@remg1997 remg1997 self-assigned this Nov 29, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@Ciroye Ciroye

@remg1997 remg1997

Labels
bug Something isn't working good first issue Good for newcomers
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@yilingchung @Ciroye @remg1997 @ashishthaker