Skip to content

Commit 0dd9229

Browse files
committed
improve the evaluator prompt
1 parent 6348b39 commit 0dd9229

File tree

1 file changed

+3
-5
lines changed

1 file changed

+3
-5
lines changed

automation-api/yival_experiments/custom_configuration/evaluator_common.py

Lines changed: 3 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -12,12 +12,10 @@
1212
logger = logging.getLogger(__name__)
1313

1414
CLASSIFY_STR = """
15-
First, write out in a step by step manner your reasoning to be sure that your
16-
conclusion is correct.
15+
First, write out in a step by step manner your reasoning to be sure that your conclusion is correct.
1716
Avoid simply stating the correct answer at the outset.
18-
Then print only a single choice from {choices} (without quotes or punctuation)
19-
on its own line corresponding to the correct answer.
20-
At the end, repeat just the answer by itself on a new line.
17+
Then print only a single choice from {choices} (including letter and option text) on its own line corresponding to the correct answer of your task.
18+
At the end, repeat just the choice (one letter, without quotes or punctuation) by itself on a new line.
2119
Reasoning:
2220
"""
2321

0 commit comments

Comments
 (0)