Skip to content

Commit f7f6d95

Browse files
committed
get_length_controlled_winrate only for AE2
1 parent b30f8f8 commit f7f6d95

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

src/alpaca_eval/main.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -25,7 +25,7 @@ def evaluate(
2525
leaderboard_mode_to_print: Optional[Union[str, Sequence[str]]] = "minimal",
2626
current_leaderboard_mode: str = "community",
2727
is_return_instead_of_print: bool = False,
28-
fn_metric: Union[str, callable] = "get_length_controlled_winrate",
28+
fn_metric: Union[str, callable] = "get_length_controlled_winrate" if constants.IS_ALPACA_EVAL_2 else "get_winrate",
2929
metric_kwargs: Optional[dict[str, Any]] = None,
3030
is_recompute_metrics_only: bool = False,
3131
sort_by: str = "length_controlled_winrate",

0 commit comments

Comments
 (0)