mekusigjinn

mekusigjinn

Polling: via "use Task" and recursive poll() under Supervisor, versus GenServer + Process.send_after()

I have a question regarding polling strategies.

I generally like doing GenServer + Process.send_after because it’s more intuitive for me.

Lately I came across two Internet sources that do this:

defmodule Example.BitcoinPriceUpdater do
  use Task
  def start_link(_arg) do
    Task.start_link(&poll/0)
  end
  def poll() do
    receive do
    after
      60_000 ->
        get_price()
        poll()
    end
  end
  defp get_price() do
    # Call API & Persist
    IO.puts "To the moon!"
  end
end

(excerpt: Periodic tasks with Elixir. No more Googling for Cron syntax | by Ville | Medium)

And also the same usage in JokenJwks library:

      use Task, restart: :transient
...
      @doc false
      def poll(opts) do
        interval = opts[:time_interval]

        receive do
        after
          interval ->
            _ = check_fetch(opts)
            poll(opts)
        end
      end

Is there any "gotcha"s when you use Task-based polling under Supervisor?

Specifically, at work I had the JokenJwks.DefaultStrategyTemplate used (via use) in my Phoenix application, but I was able to crash the module based Task when I ran a custom Mix Task, while the app was running.

The custom Mix Task did not even remotely use the same code base.
Setting :logger config to:

config :logger,
  level: :debug,
  handle_sasl_reports: true

Allowed me to see that when the process crashed, resources were:

  • Heap Size: 29_000
  • Reduction was around 440_000. Isn’t that pretty high? I still don’t know how to guage reduction units…

When I do a Process.monitor() + receive, I get instantaneous DOWN messages, so I am even more puzzled.

Frankly, I can’t quite grasp how a recursing poll() in a use Task, under Supervisor would be running - so is this like a long-running process?

Now if we talk about doing a GenServer + polling via recursive Process.send_after, I totally get that right off the bat - I know what’s happening.

So I wanted to ask - is there a case where one would want to use receive + after polling with use Task? Besides the fact that it might look “simpler”, especially when the intention is for a long-running poll?

Thanks in advance.

Marked As Solved

ityonemo

ityonemo

I’m not convinced that using a task just because it gives you :$callers is the right move. Something that responds to a fixed-time recurring event is a much better fit for a GenServer responding to :timer.send_interval. part of the point of the videos is to show you how to make it so that if you do something like that sort of GenServer, how to get it to respect Mox or Ecto.checkouts :wink: hint: pass caller information in start_link

Also Liked

RudManusachi

RudManusachi

One advantage of using Task over GenServer comes to mind is the fact that Tasks have built in support for Ancestor and Caller Tracking which allows to easily test them with async: true.

Especially for your scenario API call can be easily mocked with Mox:

if you’re running on Elixir 1.8.0 or greater and your concurrency comes from a Task then you don’t need to add explicit allowances. Instead $callers is used to determine the process that actually defined the expectations.

source: Mox # Explicit allowances

And similarly Ecto Sandbox uses DBConnection that does callers lookup which again allows to run tests asynchronously.

To learn more in deep about the subject I highly recommend to take a look at the video series The Process by @ityonemo and particularly Tests with Mox and Ecto

benwilson512

benwilson512

Author of Craft GraphQL APIs in Elixir with Absinthe

GenServers also have ancestors so I’m not really sure that this is a relevant bit here.

@mekusigjinn it is much more idiomatic to use a GenServer for polling than a task. A GenServer with send_after will also let you inspect it with :sys.get_state and so on because it isn’t blocking while waiting.

Where Next?

Popular in Questions Top

lessless
I believe there are people here who are dealing with CSV files import on the daily basis, and since Excel is a really popular tool there ...
New
openscript
Hello! Sorry for this astonishing simple question, but I’m really stuck. I try to set up the intellij-elixir plugin, but I don’t know ho...
New
_russellb
I want to try my hand at web scraping. What tools/libraries do I need to use. I’m hoping to turn this into something professional so don’...
New
fireproofsocks
I’m working on defining a simple Ecto schema for a table (in PostGres), but I don’t see where I can define a column as NOT NULL. Conside...
New
polypush135
As many of you may have realized by now (sorry for all the posts here) I’ve been working on a db problem where I’m trying to aggregate a ...
New
mcarvalho
What is the difference between System.get_env and Application.get_env? For example, what are best practices to use one versus another.
New
hpopp
To simplify some tasks at work, I wrote and published this package yesterday. It’s a simple macro that enables Access behaviour on struct...
New
Fl4m3Ph03n1x
About me? ( if you have nothing better to do than reading about some random guy in the internet :stuck_out_tongue: ) Hello all, this is ...
New
lucidguppy
I have a super simple question about elixir - how would I take a file like this foo bar baz and output a new file that enumerates th...
New
lanycrost
Hi everyone! I need implement if…else if…else condition from my elixir code, and anymore of this control flow structures not work proper...
New

Other popular topics Top

senggen
Erlang/OTP 25 [erts-13.2.2] [source] [64-bit] [smp:8:8] [ds:8:8:10] [async-threads:1] 15:22:35.803 [error] gen_event {lager_file_backend...
New
dotdotdotPaul
Okay, I'm having a heck of a time trying to figure out how to best handle the validation of belongs_to associations in Ecto. I'm sure I'...
New
JorisKok
I have a server on AWS, and was running a load test using artillery. When looking at the Phoenix dashboard I see the Ports going to 100% ...
New
axelson
This post is a wiki (feel free to hit the edit button near the bottom right of this post to add your own changes!) This post collects co...
239 45766 226
New
New
lastday4you
I wanted to check elixir version in phoenix because i found that my elixir is 1.5 but when i use Enum.chunk_by it said the function is un...
New
vac
Hi, I'm quite new in Elixir and I'm trying to format a string to a PEM format. I have the certificate value like MIIDBTCCAe2...... and ...
New
shahryarjb
Hello, I have map which I want to convert it to string like this: the map: %{last_name: "tavakkoli", name: "shahryar"} the string I ne...
New
beno
I will often find my self writing things similar to: case some_value do nil -> something() "" -> something() _ -> someth...
New
skosch
To my knowledge, put_in, Map.update etc. all have the one limitation of not automatically creating intermediate keys when needed (for exa...
New

We're in Beta

About us Mission Statement