Skip to content

Commit 020bd35

Browse files
authored
Fix sporadic issue in async_engine/test_api_server tests (#794)
Fix the sporadic issue with not enough time to update statistics data in test_api_server test. The requests are always canceled succesfully, but given time to update statistics was too short to work reliable.
1 parent 4dd96bb commit 020bd35

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

tests/async_engine/test_api_server.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -98,7 +98,7 @@ def test_api_server(api_server, tokenizer_pool_size: int,
9898

9999
# check cancellation stats
100100
# give it some times to update the stats
101-
time.sleep(1)
101+
time.sleep(3)
102102

103103
num_aborted_requests = requests.get(
104104
"http://localhost:8000/stats").json()["num_aborted_requests"]

0 commit comments

Comments
 (0)