mongo
Kafka_ex producers with connection pooling
Using Kafka_ex, I see reference in their docs on how to setup connection pooling with poolboy, but the example is super sparse and assumes a lot of knowledge on how poolboy and kafka_ex interact.
In my case, I have an application that needs to write to a kafka topic, and could use multiple processes to write across partitions. However, Kafka_ex out of the box uses one process to write.
My question is this: does someone have an example using connection pooling that shows the full setup?
Thank you,
-Steve
First Post!
aenglisc
I believe you will need to implement a worker with the KafkaEx.Server behaviour and then just pass it to your poolboy child spec config, something along the lines of:
[
{:name, {:local, @name}},
{:worker_module, App.KafkaWorker},
{:size, @size},
{:max_overflow, @max_overflow}
]
Popular in Questions
Other popular topics
Latest on Elixir Forum
Sponsor Spotlight
Practical resources that improve the lives of professional developers. By developers, for developers.
Categories:
Sub Categories:
Forums
Our Sponsors
Build Elixir applications with speed and confidence.
Supporting innovation across the BEAM ecosystem.
We build reliable cloud platforms for business-critical systems.
Catch errors, track performance, monitor hosts and more.
Develop your skills with books, videos, and courses.
Enabling companies to succeed by building software people love.
The deployment platform built for Elixir: PaaS ease, VPS control.
Courses that'll move you from confusion to "Aha, now I get it!"