
The ingest service sends and moves on, so when the broker is unreachable records silently vanish. Build a producer that confirms every record through the client's delivery confirmation, fails visibly within the delivery timeout when the broker is gone, and flushes everything still in flight on close.
Records arrive as anonymous byte blobs: no trace id, no origin, and a meaningless timestamp. Send records with keys, headers and explicit timestamps, and prove each arrives byte-exact and is honoured by the topic's timestamp type.
Every service builds its producer differently: one per request, some never closed, settings copied from a blog. Configure the producer to spec and prove the lifecycle rules: one shared instance safe under concurrent sends, a bounded wait when the buffer fills, a timed close, and an invalid setting rejected when the producer is built.
An ingest gateway must forward events to Kafka and answer callers honestly: acknowledged means written. Build its shared producer to forward events with keys, tracing headers and timestamps, acknowledge a caller only after the broker confirms, and report the defined failure when delivery times out.