Skip to content

This repository distributes full model outputs for the BabyLM 2023 evaluation pipeline as well as scores per task and subtask for a subset of the submissions to the 2023 BabyLM Challenge. All outputs and scores are scraped from DynaBench. We additionally include links to published models.

Notifications You must be signed in to change notification settings

babylm/submissions2023

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

3 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

submissions2023

This repository distributes full model outputs for the BabyLM 2023 evaluation pipeline as well as scores per task and subtask for a subset of the submissions to the 2023 BabyLM Challenge. All outputs and scores are scraped from DynaBench. We additionally include links to published models.

Currently, we have uploaded the following content:

  • paper_summary.csv: Metadata about all papers submitted to the challenge.
  • model_summary.csv: Metadata and aggregate task scores from all models submitted to dynabench.
  • model_summary.xlsx: The above 2 datasets in excel format (best viewed in Google Sheets).
  • dynabench_results.zip: The results for each subtask for each model submitted to dynabench. This .zip contains one file for each track.

** Remaining contents in progress **

About

This repository distributes full model outputs for the BabyLM 2023 evaluation pipeline as well as scores per task and subtask for a subset of the submissions to the 2023 BabyLM Challenge. All outputs and scores are scraped from DynaBench. We additionally include links to published models.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published