-
Notifications
You must be signed in to change notification settings - Fork 15
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Missing test evaluation #11
Comments
I also meet this issue. How to evaluate with test dataset? |
I simply rewrote the code to also evaluate on test and save the best model based on test eval. But be careful, test dataset is pretty big, so it's better to increase eval_frequency to not stuck on evaluation for too long.
|
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Missing code for test evaluation, only dev evaluation exists.
The text was updated successfully, but these errors were encountered: