Skip to content

Commit

Permalink
Fix sporadic issue in async_engine/test_api_server tests (#794)
Browse files Browse the repository at this point in the history
Fix the sporadic issue with not enough time to update statistics data in
test_api_server test.

The requests are always canceled succesfully, but given time to update
statistics was too short to work reliable.
  • Loading branch information
akarnows authored Feb 25, 2025
1 parent 4dd96bb commit 020bd35
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion tests/async_engine/test_api_server.py
Original file line number Diff line number Diff line change
Expand Up @@ -98,7 +98,7 @@ def test_api_server(api_server, tokenizer_pool_size: int,

# check cancellation stats
# give it some times to update the stats
time.sleep(1)
time.sleep(3)

num_aborted_requests = requests.get(
"http://localhost:8000/stats").json()["num_aborted_requests"]
Expand Down

0 comments on commit 020bd35

Please sign in to comment.