Human Annotation Analysis

[292725651]

The annotations with prompt, classification, overall_rating, image_text_alignment_rating, fidelity_rating are released. Will the annotations of image issues (i.e. repeated generation, body problems, fuzzy images, toxic, pornographic, violent, or violating protected groups in your papers) be released? Thank you!

[xujz18]

Thanks for your attention! Please refer to #75 to find other annotation results.

[292725651]

Thanks for your reply. However, I found that 'problem_data.json' contains only prompts. Does it contains the detail classifaction of problem (e.g. 'xxxxxx.webp' has body problems, 'xxxxxx.webp' has pornographic problems)?

[crisnvg]

+1, I also couldn't find overall_rating, image_text_alignment_rating, fidelity_rating