Skip to content

Bug in score plotting entry point: meta data extraction #237

Description

@lllAlexanderlll

Currently in: src/ml_filter/analysis/utils.py:

    for file_path in input_file_paths:
        # Extract relevant metadata from the filename
        # TODO: This is a bit fragile, consider using a more robust method to extract metadata
        prompt, prompt_lang, annotator = file_path.stem.split("__")[1:4]

We should instead fix the prompt_lang meta data and use e.g. the first data point for setting the above fields.
Example sample:

... "meta_information": {"prompt_name": "pii_content_filter", "prompt_lang": "deu", "model_name": "google/gemma-3-27b-it",

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions