Qqwy

Qqwy

TypeCheck Core Team

Does using a large ETS table make app restart take longer?

I was talking with someone about possibly using an in-memory database to make searching through the (±1.5 gigabyte of) data more efficient.

He asked me if I knew what impact the use of an in-memory database such as ETS would have on the startup (and therefore also restart) time of the application. I have not been able to find any information about this so far. Could someone explain to me what ETS does at startup and how much longer it will take your application to be fully started when you use it?

Most Liked

benwilson512

benwilson512

Author of Craft GraphQL APIs in Elixir with Absinthe

I’m a bit confused by the question. ETS tables don’t survive application restart, so the size it is on shutdown doesn’t affect its size when you restart.

If you have some process for initializing the table then that is gonna be the relevant bit as I see it. You can do it sync or aync to your application boot process depending on whether it makes any sense to have stuff running on a partially initialized table.

Qqwy

Qqwy

TypeCheck Core Team

Ah, I see. I did not realize that ETS tables are ephemeral (which of course makes a lot of sense).
So: Yes, the ETS table would need to be filled with data before the application could provide most of its functionalities, so it makes sense to do this during the boot process.

Maybe this whole question is somewhat nonsensical, as startup time is obviously something that only happens once, and therefore is much less important than per-request efficiency.

dom

dom

2GB is the limit for DETS, not ETS. ETS tables are essentially as large as you want on a 64-bit system.

Neurofunk

Neurofunk

woops, indeed :smiley:

Nicd

Nicd

Just starting ETS and creating (reasonable amounts of) tables shouldn’t take any meaningful amount of time as far as I know. If you are importing lots of data to them at startup, you need to measure how long that takes.

Where Next?

Popular in Questions Top

dotdotdotPaul
Okay, I'm having a heck of a time trying to figure out how to best handle the validation of belongs_to associations in Ecto. I'm sure I'...
New
pmjoe
I have a relationship of love and hate with Elixir. Lots of things are just absolutely right, but there are some things that are kind of ...
New
JorisKok
I have a server on AWS, and was running a load test using artillery. When looking at the Phoenix dashboard I see the Ports going to 100% ...
New
aalberti333
As the title describes, I’m trying to run Enum.map() over a list of key/value pairs, where the value is a map. My data looks like this: ...
New
jononomo
I am trying to figure out how Mix knows whether the environment is test, dev, or prod -- where is this set? Thanks.
New
polypush135
As many of you may have realized by now (sorry for all the posts here) I’ve been working on a db problem where I’m trying to aggregate a ...
New
myronmarston
The Elixir Typespec docs show the following syntax for keyword lists in typespecs: # ... | [key: type] # keyword lis...
New
Mooodi
Given a string, how can I get access to its character by index? Enum.at("my_string", 2) doesn't work. Or rather, not char, but a substr...
New
romenigld
I am trying to run a deploy with docker and I successfully runned with this command: docker build -t romenigld/blog-prod . but when I t...
New
lanycrost
Hi everyone! I need implement if…else if…else condition from my elixir code, and anymore of this control flow structures not work proper...
New

Other popular topics Top

chrismccord
Phoenix 1.4.0 released Phoenix 1.4 is out! This release ships with exciting new features, most notably with HTTP2 support, improved deve...
688 30048 115
New
sergio
In Ruby, I can go: User.find_by(email: "foobar@email.com").update(email: "hello@email.com") How can I do something similar in Elixir? ...
New
aalberti333
As the title describes, I’m trying to run Enum.map() over a list of key/value pairs, where the value is a map. My data looks like this: ...
New
_russellb
I want to try my hand at web scraping. What tools/libraries do I need to use. I’m hoping to turn this into something professional so don’...
New
New
jononomo
I am trying to figure out how Mix knows whether the environment is test, dev, or prod -- where is this set? Thanks.
New
Jim
As a follow up to my earlier question: I have the code compiling and running but not getting a successful login from the rest server. ...
New
nsuchy
Hi. I’ve noticed that Windows Powershell has it’s own IEX command and you cannot access Elixir’s IEX due to the conflict. This isn’t a cr...
New
minhajuddin
I have seen a lot of code which picks the first element from a list using Enum.at(0) instead of List.first. Is there a reason why people ...
New
lucidguppy
I have a super simple question about elixir - how would I take a file like this foo bar baz and output a new file that enumerates th...
New

We're in Beta

About us Mission Statement