Fl4m3Ph03n1x

Fl4m3Ph03n1x

Books about GenStage?

GenStage and Flow resources?

I have been hearing about GenStage and Flow, a tool built upon it, for quite some time. I understand it allows us to program in a paradigm that uses stages and flows and has back-pressure included.

However I have a few issues when it comes to adopting them (or even considering it).

There is only the documentation

That’s it. Documentation alone is not enough for me, I don’t learn how to use a technology by simply glossing over the docs. It’s like learning Java by reading only the JavaDocs. Sure someone will be able to do it. I am not that someone. I am dumb as a brick :smiley:

Conferences

You may say there are some conferences, but they are completely biased towards using GenStage or Flow and how great they are. I want the complete picture. I want to know when it is a good idea to use it and when it’s not. Like Agents. I know when to use them and when not to use them.

Books

In all the books I have seen, there are no GenState chapters. Only GenServer. I get it that GenServer is a major building block, but when none of the books out there has a chapter about it, it really makes me wonder if we need GenStage at all.

Even today I asked about GenStage to @ElixirCasts and they didn’t reply - it makes me think this is not an interesting topic at all.


Do you guy know of any unbiased GenStage books or resources?

Most Liked

outlog

outlog

I only know of the talks

btw José is announcing Broadway tmrw

Announcing Broadway

Broadway is a new open source project by Plataformatec that aims to streamline data processing pipelines. It allows developers to consume data efficiently and concurrently from many systems, such as Amazon SQS, RabbitMQ, Google Cloud PubSub and others.

In this talk, we will discuss how the Broadway architecture connects multiple stages and producers, how it leverages GenStage to provide back-pressure, how we rely on OTP for fault-tolerance, and other features such as batching, rate-limiting, partitioning and more.

outlog

outlog

You may also be interested in Flow by Plataformatec. Both Broadway and Flow are built on top of GenStage. Flow is a more general and powerful abstraction than Broadway that focuses on data as a whole, providing features like aggregation, joins, windows, etc. Broadway aims to streamline data pipelines and focuses more on operational features, such as metrics, rate-limiting, and so on.
GitHub - dashbitco/broadway: Concurrent and multi-stage data ingestion and data processing with Elixir

LostKobrakai

LostKobrakai

I don’t think you can compare coverage of GenServer and GenStage. One is a integral part of the language’s stdlib, while the other is a third-party package, which happens to be quite good for processing pipelines. It’s a common, but certainly not universal problem to face.

kokolegorille

kokolegorille

The chapter 5 (Demand-Driven Processing) of this book is a good example.

shanesveller

shanesveller

Flow isn’t a successor, it’s a tool built on top of the primitives of GenStage. It says so at the top of the repository.

Did this actually need to be a new thread off of your process-mailbox post?

Where Next?

Popular in Chat/Questions Top

wolfiton
Question: Can someone recommend me some good resources on learning performance for phoenix elixir applications and a design pattern I sh...
New
roshan
Hi everyone, I’m looking for a book on Phoenix server hosting / deployment like the following books for Rails, Docker for Rails Develop...
New
wallyfoo
Long story short, I have a real world need to create a view for hooking up a shipping terminal to live data, but because of some early ar...
New
sadcad
I love the Phoenix and Elixir docs, but I always tend to learn faster when I watch a video of someone explaining things and then I implem...
New
ca1989
Hi all, is there any up to date resource out there (blog, talk, video, book…) about deploying elixir applications using releases? In pa...
New
New
makeitrein
More Ecto questions! More madness! The context: there’s a list of books that I want to filter with a dropdown… The dropdown: looks some...
New
Nopp
Hello there, i have a lot to read and to learn, but are there some books, that are focussing on how i “should” plan the architecture of ...
New
Kielo
Hi, I run a language learning blog and would like to learn how to code so I can create an app to help English speakers learn French. I ...
New
Allyedge
So, I want to get an Elixir book, but don’t know which one to get. Both Programming Elixir 1.6 and Elixir in Action looks interesting, b...
New

Other popular topics Top

josevalim
Hi everyone, One of the features added to Elixir early on to help integration with Erlang code was the idea of overridable function defi...
New
vrod
I am using the Starship cross-shell prompt – it seems pretty nice, but I get some errors: [WARN] - (starship::utils): Executing command ...
New
albydarned
Hello all! I am typing this post from my new MacBook Pro with the M1 chip. I’m loving it so far, and will probably use it as my daily dr...
New
joaquinalcerro
Hi there, I am working with Ecto-Postgresql and I need to call all of the records from a specific table but the table has 40,000 record...
New
dokuzbir
Hello, I am trying to convert my lists to string without losing brackets.For start i have 3 map. They look like these buyer = %{ id: ...
New
script
If I have a string “1000 cfu/ml” . I want to remove the characters and / and space . So the string is like this "1000" What is the ...
New
vac
Hi, I'm quite new in Elixir and I'm trying to format a string to a PEM format. I have the certificate value like MIIDBTCCAe2...... and ...
New
qwerescape
Is there a way to get the call stack or stack trace at any point in the code? Not from exceptions, but an expression that returns how the...
New
shahryarjb
Hello, I have map which I want to convert it to string like this: the map: %{last_name: "tavakkoli", name: "shahryar"} the string I ne...
New
siddhant3030
Hi, I have to write a raw query for one of my project. But till now I have used ecto queries and don’t have much experience writing raw ...
New

We're in Beta

About us Mission Statement