[TheSafo]

What does this PR do?

Adds flush_every duration config to traditional and logrotate generators. This ensures that blocks get flushed periodically not just when the bufffer is full.

Motivation

BufWriter generally only writes out to disk once its capacity is full (or on log rotate). For standard usage of lading, this works fine since the capacity is set at the maximum throttler capacity (in bytes), which lading trires its best to run at, so it flushes ~every second. However, for block-based throttling (and varying block sizes) it's less likely that 1 second of blocks fills the maximum possible bytes capacity for those blocks (blocks per second times max block size), so having a config option to flush periodically ensures regular flush intervals.

Related issues

Follow up of #1675

[TheSafo]

• Add StaticTimestamped generator that uses timestamps from a file to send logs #1687
• Add flush_every config option to BufWriter generators #1683 👈 (View in Graphite)
• Update generator throttler to support block-based strategy #1675
• Add deserialization tests for BytesThrottleConfig and LoadProfile #1684
• Modify throttle errors to not assume capacity issue #1679
• Resize block buffer after allocation if significant wasted space #1674
• main

This stack of pull requests is managed by Graphite. Learn more about stacking.