Kafka proxy with NiFi

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

Kafka proxy with NiFi

Laurens Vets
Hi List,

Is it possible to build a Kafka proxy with NiFi such that NiFi will
expose a Kafka endpoint and proxy all Kafka messages to another Kafka
endpoint?
Reply | Threaded
Open this post in threaded view
|

Re: Kafka proxy with NiFi

Andre
Hi, 

I assume by endpoint you suggest to expose the broker side of the kafka API? As far as I know it is not possible. 

However you could use the site2site API or other supported reliable protocols (http, beats, relp, etc) to feed data to NiFi and from there feed kafka. 

How this fits into your environment will largely depend on data volumes and kafka acknowledgement strategy. 

On 9 Jun 2017 07:15, "Laurens Vets" <[hidden email]> wrote:
Hi List,

Is it possible to build a Kafka proxy with NiFi such that NiFi will expose a Kafka endpoint and proxy all Kafka messages to another Kafka endpoint?