Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

update timeframe evaluate.py #44

Closed
keighrim opened this issue Feb 6, 2024 · 0 comments · Fixed by #45
Closed

update timeframe evaluate.py #44

keighrim opened this issue Feb 6, 2024 · 0 comments · Fixed by #45
Assignees

Comments

@keighrim
Copy link
Member

keighrim commented Feb 6, 2024

Because

Related to #43 , we want to update now outdated evaluate.py under TF_eval directory. However, since the time when the script is written, there has been some changes regarding gold data organization. So we need to updated the script to cope with those changes.

Done when

This should include

  1. updating to use goldretreiver.py instead of manual download of gold files

    • example of usage of the goldretriver
      ref_dir = goldretriever.download_golds(GOLD_URL) if args.gold_dir is None else args.gold_dir
    • should copy or symlink the goldretriver.py first
    $ cd timeframe-eval 
    $ ln -sf ../goldretriever.py
  2. merging following two functions

    def load_slate_gold_standard(tsv_file_list, test_dir):

    def load_chyron_gold_standard(csv_file_list, test_dir):

  3. Update start and end properties access with newly added helper methods via adding helpers for getting anchor points mmif-python#254

Additional context

No response

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Archived in project
Development

Successfully merging a pull request may close this issue.

2 participants