Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

use local unitxt if it exits for evaluation #11

Merged

Conversation

yhwang
Copy link

@yhwang yhwang commented Nov 22, 2024

Description

detect local installed unitxt before fetching
unitxt/metric from HF

How Has This Been Tested?

Merge criteria:

  • The commits are squashed in a cohesive manner and have meaningful messages.
  • Testing instructions have been added in the PR body (for PRs involving changes that are not immediately obvious).
  • The developer has manually tested the changes and verified that the changes work

@yhwang
Copy link
Author

yhwang commented Nov 22, 2024

the original idea and code snippet are from @yoavkatz
And I updated the code based on the 0.4.5 code base. Just for reference. I am sure @yoavkatz will create a PR on the LMEH upstream soon, but that will be against the main branch

@ruivieira ruivieira added the kind/enhancement New feature or request label Nov 27, 2024
detect local installed unitxt before fetching
`unitxt/metric` from HF

Signed-off-by: Yihong Wang <[email protected]>
@yhwang yhwang force-pushed the detect-unitxt-in-evaluate branch from 5cdc40e to a240b7d Compare November 27, 2024 14:04
@ruivieira ruivieira merged commit 509ef85 into opendatahub-io:release-0.4.5 Nov 27, 2024
1 of 3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
kind/enhancement New feature or request
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants