silviurosu

silviurosu

Downtime of Elixir app

I have an Elixir production app deployed with Coolify on a big Hetzner server.
Most of the time the app works fine but there are a few minutes of downtime that happen almost daily (1-2 times a day only) when my app becomes unresponsive, most of the time the downtime is around 2 minutes.
The server CPU and memory never goes more than 25-30% so it’s not because of not enough resources.
As you can see in this Grafana snapshot there are some gaps where prometheus is not able to reach the app to collect metrics.

I tried to watch for server restarts, read Coolify logs but I could not find any clue. Did you guys have any similar issue? How would you debug this further?
I would not want to switch to a cluster deployment and complicate things.

Most Liked

NobbZ

NobbZ

Network switch daily reboot?

If you ssh into the hosting machine or even the docker container, will that connection persist or go down? Can you trace during that time? Are other services in the same datacenter also affected?

Hermanverschooten

Hermanverschooten

I had something like that a couple of years back, turned out to be backups freezing my instance.

bgr11n

bgr11n

You sure there was a downtime?

To be honest looks like there is no datapoints on graph for that time.

silviurosu

silviurosu

There are no datapoints since the server is not responding.
Neither the app is not accessible during this time, all the endpoints are down.

For more details the app deployed as a docker image with Traefik in front for domain and htts certificate.

I am excluding Erlang VM as the culprint so the only things I can think of are:

  • server restarts
  • networking issue
  • traefik proxy not being able to forward the requests

What else can it be?

Where Next?

Popular in Questions Top

gshaw
What is the idiomatic way of matching for not nil in Elixir? E.g., First way: defp halt_if_not_signed_in(conn, signed_in_account) when...
New
albydarned
Hello all! I am typing this post from my new MacBook Pro with the M1 chip. I’m loving it so far, and will probably use it as my daily dr...
New
Werner
Hi, I’m using Ubuntu 18.04 and after updating to OTP-24.0 yesterday i have this warning when I run “mix local.hex”: 14:57:30.512 [warn] ...
New
sacepums
Hey guys. I'm new to elixir and im really stocked about it. But I ran into a bit of problem - I need to convert a date sting, for examp...
New
script
If I have a string “1000 cfu/ml” . I want to remove the characters and / and space . So the string is like this "1000" What is the ...
New
vonH
When I run the Plug and I recompile I wind up having to use Ctrl C to quit iex and start again. Witht the help of rlwrap I can use the cu...
New
ovidiubadita
Hey all, I discovered Elixir and I love it. I always wanted to learn a functional programming and I intended to go for Haskell, but afte...
New
electic
Hi, I am new to Elixir. I am trying to use the DateTime component to insert a date into MySQL however the there seems to be no way to fo...
New
Patoshizzle
After calling mix ecto.create I get this error: 17:00:32.162 [error] GenServer #PID<0.412.0> terminating ** (Postgrex.Error) FATAL...
New
skosch
To my knowledge, put_in, Map.update etc. all have the one limitation of not automatically creating intermediate keys when needed (for exa...
New

Other popular topics Top

Brian
What is the proper way to load a module from a file in to IEX? In the python world, doing something like this pretty standard: from ....
New
srinivasu
How to handle excepions in elixir? Suppose i have A, B, C ,D, E modules. and each module has get() function. A.get() method will call th...
New
vonH
In asking this question I am more interested about the expressiveness of the language itself and less concerned about the availability of...
New
AstonJ
You’re a programmer, so you don’t need spoon feeding with the conventional drivel about “this is an integer.” No. You need to know what’s...
New
vac
Hi, I'm quite new in Elixir and I'm trying to format a string to a PEM format. I have the certificate value like MIIDBTCCAe2...... and ...
New
danschultzer
None of the current solutions worked well for me, so I went ahead and built a user management system from scratch. This project took far...
548 27727 240
New
aadeshere1
I have a another noob question about loop. Since elixir is immutable, while loop is not directly possible. total = 10 while total != 0 ...
New
fireproofsocks
Forgive me if this is obvious, but how does one delete a database record WITHOUT selecting it first? https://hexdocs.pm/ecto/Ecto.Repo.h...
New
chrisalley
ExUnit now has describe blocks which is a welcome addition coming from RSpec. In the docs, it states that nested hierarchies of describe ...
New
siddhant3030
Hi, I have to write a raw query for one of my project. But till now I have used ecto queries and don’t have much experience writing raw ...
New

We're in Beta

About us Mission Statement