Understanding Kafka Poison Pills
Imagine publishing a message to Kafka topic A. Suddenly, your consumer crashes. It hit a deserialization error. Because the client never successfully processes the record, it never commits the offset. Upon restarting, it reads the exact same record again, failing repeatedly in an infinite loop. This bad record is called a poison pill...
Continue reading →
kafka
java
reactive
Kafka Consumers with Reactive OAuth2 in Non-HTTP Contexts
When integrating Kafka consumers with reactive OAuth2 for securing outbound HTTP calls, a common pitfall arises: Kafka processing typically operates in a background, non-HTTP context. This means there's no `ServerWebExchange` available, which is a core component of the reactive web stack that exposes the current HTTP request/response and request-scoped attributes...
Continue reading →
kafka
spring
reactive
oauth2
Publish / Subscribe to Kafka locally
Apache Kafka is a distributed streaming platform designed for building real-time data pipelines and streaming applications. Originally developed by LinkedIn, Kafka excels at handling high-throughput, fault-tolerant publish-subscribe messaging between systems...
Continue reading →
kafka
kcat
docker
