Skip to content

Commit

Permalink
(shortfin) Increase loop queue/wait limit for workers. (#561)
Browse files Browse the repository at this point in the history
This is a relatively arbitrary limit that we increase to allow more
traffic on server at a given time.
  • Loading branch information
monorimet authored Nov 18, 2024
1 parent 99c5279 commit c2ee7fa
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions shortfin/src/shortfin/local/worker.cc
Original file line number Diff line number Diff line change
Expand Up @@ -46,8 +46,8 @@ Worker::Worker(const Options options)
iree_status_ignore(status);
};
// TODO: We need a way to dynamically resize this vs having a hard limit.
iree_loop_sync_options_t loop_options = {.max_queue_depth = 256,
.max_wait_count = 256};
iree_loop_sync_options_t loop_options = {.max_queue_depth = 2048,
.max_wait_count = 2048};
SHORTFIN_THROW_IF_ERROR(
iree_loop_sync_allocate(loop_options, options_.allocator, &loop_sync_));
iree_loop_sync_scope_initialize(loop_sync_, OnError, this, &loop_scope_);
Expand Down

0 comments on commit c2ee7fa

Please sign in to comment.