Apache Stateful Functions 3.4.0 Finally Adds Kafka Record Header Support
Apache Stateful Functions has lacked the ability to read or set Kafka record headers since its inception, a limitation that persisted for five years. The newly released StateFun Actors 3.4.0-KZM-3.4 closes this gap, allowing functions to both read incoming headers and attach headers to outgoing Kafka messages. The implementation handles edge cases carefully, preserving the distinction between null and empty header values and returning null instead of throwing exceptions for missing or undecodable headers. Header forwarding is opt-in per topic via a module.yaml flag, ensuring no performance overhead for pipelines that do not use headers. The update is backward-compatible, allowing older SDKs and newer runtimes to interoperate without requiring lockstep upgrades or savepoint changes.
This is an AI-generated summary. ShortSingh links to the original source for the complete article.
Discussion (0)
Log in to join the discussion and vote.
Log in