This repository contains the source code to reproduce the results from "On the Limitations of Reference-Free Evaluations of Generated Text," published at EMNLP 2022.
Running the code requires access to a Slurm cluster with worker nodes that have access to Docker.
See the mt
directory for the machine translation experiments and summarization
for the summarization experiments.