Fix: Handle non-UTF-8 headers in Kafka/Confluent message parsing#2459

Draft

Bazarovinc wants to merge 11 commits into

Bazarovinc:fix/non-utf8-kafka-message-headers

Commits on Apr 21, 2026

fix: add replacing non-utf-8 bytes on decoding headers
Nikita Veselenko
committed
draft: add support for binary Kafka headers (confluent only)
Nikita Veselenko
committed
refactor: Bytes decoding has been changed to 'replace' undecodable characters to avoid errors
Nikita Veselenko
committed
draft: remove headers decoding for confluent
Nikita Veselenko
committed
feat: refactored the decoding of key headers
Nikita Veselenko
committed
fix: replace broken decoded_headers with _decode_header helper, remove unused _HeadersInput
Bazarovinc
committed
fix: add errors='replace' in AioKafkaBatchParser to handle non-UTF-8 headers
Bazarovinc
committed
revert: restore dict[str, Any] for headers in StreamMessage (avoids breaking other brokers)
Bazarovinc
committed
test: add unit tests for non-UTF-8 header handling in confluent parser
Bazarovinc
committed
test: add unit tests for non-UTF-8 header handling in aiokafka parser
Bazarovinc
committed
refactor: simplify _decode_header to one-liner
Bazarovinc
committed