ourway

ourway

** WARNING ** Mnesia is overloaded: {:dump_log, :write_threshold}

What is this and what to do about it? (For dummies please)

Most Liked

ConnorRigby

ConnorRigby

Nerves Core Team

Without seeing any code my Google searches are as good as anyone else’s but I found this Which seems to cover most cases of those error happening.

Seems to me like too many writes from too many processes. (More than 100 specifically if the defaults haven’t changed since 2008)

cmkarlsson

cmkarlsson

You can (and probably should) use sync transactions as mentioned in the linked blog post. And it may be worth playing around with the dump threshold settings but in general the overload event means your system is doing more than it is capable of. If these events keep coming you need to have more resources. If the overload is just temporary it is fine. (I.e a short burst of writes coming in).

That said, one thing that helps with performance is to limit the number of concurrent writers. In my experience having 1 writer per scheduler seems to work pretty well. I think I picked this up from a talk from WhatsApp but can’t remember

You can also subscribe to the overloaded event and try to be proactive by using a circuit breaker of some sort (https://github.com/jlouis/fuse for example). If you run mnesia in a distributed setting this may be a bit harder.

One talk that that briefly mentions this is Mnesia for the CAPper (http://www.erlang-factory.com/conference/London2010/speakers/ulfwiger) (I’m sure there is a video somewhere as well). This talk also contains a few other things that is good to know about mnesia.

Where Next?

Popular in Questions Top

gshaw
What is the idiomatic way of matching for not nil in Elixir? E.g., First way: defp halt_if_not_signed_in(conn, signed_in_account) when...
New
LegitStack
I’m hoping you guys can give me some general advice and perhaps code examples if you’re feeling up to it. I’m very interested in Elixir,...
New
pgiesin
This should be a simple problem but I just can’t seem to figure it out. I have a standalone Elixir app that won’t find the database. Dep...
New
fireproofsocks
I’m working on defining a simple Ecto schema for a table (in PostGres), but I don’t see where I can define a column as NOT NULL. Conside...
New
nsuchy
Hi. I’ve noticed that Windows Powershell has it’s own IEX command and you cannot access Elixir’s IEX due to the conflict. This isn’t a cr...
New
mcarvalho
What is the difference between System.get_env and Application.get_env? For example, what are best practices to use one versus another.
New
electic
Hi, I am new to Elixir. I am trying to use the DateTime component to insert a date into MySQL however the there seems to be no way to fo...
New
baxterw3b
Hi guys, i’m new in the Elixir world, and i have to say, that i love it! i’m having some problem to understand anonymous functions with ...
New
kostonstyle
Hi all I want to have a unix time, from the current time plus 1 hour. DateTime.now + 1 hour How to get it in elixir? Thanks
New
chrisalley
ExUnit now has describe blocks which is a welcome addition coming from RSpec. In the docs, it states that nested hierarchies of describe ...
New

Other popular topics Top

gshaw
What is the idiomatic way of matching for not nil in Elixir? E.g., First way: defp halt_if_not_signed_in(conn, signed_in_account) when...
New
joaquinalcerro
Hi there, I am working with Ecto-Postgresql and I need to call all of the records from a specific table but the table has 40,000 record...
New
AstonJ
You’re a programmer, so you don’t need spoon feeding with the conventional drivel about “this is an integer.” No. You need to know what’s...
New
_russellb
I want to try my hand at web scraping. What tools/libraries do I need to use. I’m hoping to turn this into something professional so don’...
New
New
Harrisonl
We have an ECS cluster with 4 services, where each task joins a single cluster, via discovery ECS discovery service. Currently when I de...
New
quazar
How to set Jason to encode all fields in ecto schema, I don’t care about security and implementing only is taking long list of attributes...
New
stefanchrobot
What’s the safe way to decode a JSON string into a struct? I want to avoid calling String.to_atom. Jason.decode can give me a map with st...
New
chrisalley
ExUnit now has describe blocks which is a welcome addition coming from RSpec. In the docs, it states that nested hierarchies of describe ...
New
9mm
I am constructing a JSON object (map) and I need to conditionally set a field. I’m trying to write proper elixir-way code… and I’m at a l...
New

We're in Beta

About us Mission Statement