Skip to content

Commit 3eb13cc

Browse files
authored
LLM: fix input length condition in deepspeed all-in-one benchmark. (#11185)
1 parent 401013a commit 3eb13cc

File tree

1 file changed

+1
-1
lines changed
  • python/llm/dev/benchmark/all-in-one

1 file changed

+1
-1
lines changed

Diff for: python/llm/dev/benchmark/all-in-one/run.py

+1-1
Original file line numberDiff line numberDiff line change
@@ -1518,7 +1518,7 @@ def get_int_from_env(env_keys, default):
15181518
# in_len.txt maybe shorter than we need,
15191519
# use much longer context to make sure input length
15201520
test_length = min(in_len*2, 8192)
1521-
while test_length not in [32, 256, 1024, 2048, 8192]:
1521+
while test_length not in [32, 256, 1024, 2048, 8192] and test_length < 8192:
15221522
test_length = test_length * 2
15231523
input_str = open(f"prompt/{test_length}.txt", 'r').read()
15241524
# As different tokenizer has different encodings,

0 commit comments

Comments
 (0)