Here is a collection of Benthos configuration examples showing a range of common or interesting use cases.
Create a pipeline that mutates JSON documents from a Kafka stream.
Create a processing pipeline where if the processor fails the data is redirected to a second pipeline for retries. The second pipeline delays the next attempt based on a timestamp within the document.
Create a pipeline that consumes a continuous HTTP stream (in this case the Twitter firehose) and writes the data to a Kafka topic.
Create a pipeline that continuously consumes .tar.gz archives from an S3
bucket, decompresses and unarchives the data, and then writes the data to a
Kafka topic.