bentanweihao

bentanweihao

Author of The Little Elixir and OTP Guidebook

Implementing Parallel Comprehension with Elixir Macro Goodness

I wrote a new post detailing how to implement parallel comprehension using macros. Would love any comments and improvements!

http://benjamintan.io/blog/2016/07/13/implementing-parallel-comprehension-with-elixir-macro-goodness/

Most Liked

Qqwy

Qqwy

TypeCheck Core Team

Ooh! This is a lot of fun!

Awesome idea! :smiley:

bentanweihao

bentanweihao

Author of The Little Elixir and OTP Guidebook

Yes it was! And very mind-bending in a very good way.

OvermindDL1

OvermindDL1

Probably would be good to give the para an argument to specify the number of processes to run in, defaulting to the cpu count (*2?) or so? As it is it is going to create a lot of processes, and will probably cause a speed hit in almost every case as the do: body is generally very simple (like {a, b, c} in your example) and all the work happens in the iteration and filters?

Very nice article though, shows how macros work and how to use them. :slight_smile:

bentanweihao

bentanweihao

Author of The Little Elixir and OTP Guidebook

Thanks! You are right, it would be good to have an upperbound on the number of processes. Another thing is that it doesn’t support :into. But that should be an easy fix. :smiley:

Where Next?

Popular in Questions Top

JDanielMartinez
Hi! May someone helps me, please! I have two apps into an umbrella project: the first one is Database, which manages queries, and the se...
New
openscript
Hello! Sorry for this astonishing simple question, but I’m really stuck. I try to set up the intellij-elixir plugin, but I don’t know ho...
New
ycv005
I have followed this StackOverflow post to install the specific version of Erlang. And When I am running mix ecto.setup then getting fol...
New
tduccuong
Hi, is there any work on GUI with Elixir, that is similar to Electron/Javascript? My idea is to bundle Phoenix and BEAM into a single se...
New
mcarvalho
What is the difference between System.get_env and Application.get_env? For example, what are best practices to use one versus another.
New
aadeshere1
I have a another noob question about loop. Since elixir is immutable, while loop is not directly possible. total = 10 while total != 0 ...
New
rms.mrcs
Hi, I need to transform a list of numbers into a map where the keys are the indexes and the values are the original values of the list....
New
fireproofsocks
Forgive me if this is obvious, but how does one delete a database record WITHOUT selecting it first? https://hexdocs.pm/ecto/Ecto.Repo.h...
New
Qqwy
Original source of discussion: This topic on the Pragmatic Programmers' Functional Web Development with Elixir, OTP, and Phoenix forum. ...
New
idi527
I’ve been re-reading swift book again and noticed that multiline strings there don’t have a trailing line break, unlike in elixir iex(2)...
New

Other popular topics Top

sorentwo
Hello! tl;dr Announcing Oban, an Ecto based job processing library with a focus on reliability and historical observability. After spen...
977 41022 311
New
vonH
In asking this question I am more interested about the expressiveness of the language itself and less concerned about the availability of...
New
jerry
Good day to you all. I have been struggling to get a query involving like and ilike to work. Can anyone assist me on this, please? pro...
New
KronicDeth
Elixir plugin for JetBrain’s IntelliJ Platform (including Rubymine) This is a plugin that adds support for Elixir to JetBrains IntelliJ...
289 35421 110
New
danschultzer
None of the current solutions worked well for me, so I went ahead and built a user management system from scratch. This project took far...
548 27727 240
New
rms.mrcs
Hi, I need to transform a list of numbers into a map where the keys are the indexes and the values are the original values of the list....
New
vonH
When I run the Plug and I recompile I wind up having to use Ctrl C to quit iex and start again. Witht the help of rlwrap I can use the cu...
New
baxterw3b
Hi guys, i’m new in the Elixir world, and i have to say, that i love it! i’m having some problem to understand anonymous functions with ...
New
Qqwy
Original source of discussion: This topic on the Pragmatic Programmers' Functional Web Development with Elixir, OTP, and Phoenix forum. ...
New
joeerl
Hello again - after a longish gap I’ve decided I really must dig into Elixir and see what’s been happening here - so I have a few questio...
New

We're in Beta

About us Mission Statement