Skip to content

Commit

Permalink
Add generator change
Browse files Browse the repository at this point in the history
  • Loading branch information
RushiT0122 committed Mar 21, 2024
1 parent 6d6ae66 commit 162e542
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion tap_mambu/tap_generators/multithreaded_offset_generator.py
Original file line number Diff line number Diff line change
Expand Up @@ -132,7 +132,7 @@ def _all_fetch_batch_steps(self):
final_buffer = []
while start < end:
# Limit the buffer size by holding generators from creating new batches
while len(self.buffer) > 100000:
while len(self.buffer) > self.max_buffer_size:
time.sleep(1)
self.modify_request_params(start, temp)
final_buffer, stop_iteration = self.collect_batches(self.queue_batches())
Expand Down

0 comments on commit 162e542

Please sign in to comment.