sturmer

sturmer

How to configure Elixir Mix project with Ecto SQLite3?

Hi all,

I am trying to set up an Elixir project using Mix. It’s a CLI application. I want to connect it to a local SQLite3 database. Note that for now this is not a Web application, and as such no Phoenix is involved. I build the project using mix escript.build.

I can figure out how to structure the application, including making it work with a test database (MIX_ENV=test). What I don’t manage to do is to have it working in MIX_ENV=dev, i.e., when actually issuing the commands from the shell.

A command looks like:

./eelarve add -a -13.50 -x "something" -r Rimi

where eelarve is my executable, add is a command, and the rest is switches (sorry if all of this is obvious).

I define my main function in a module called Eelarve.CLI, where I call as first statement Application.ensure_all_started(:eelarve) in the belief that it will start the DB.

My application is pretty run-of-the-mill:

application.ex:

use Application

  @impl true
  def start(_type, _args) do
    children = [
      # Start the Ecto repository
      Eelarve.Repo
    ]

    # See https://hexdocs.pm/elixir/Supervisor.html
    # for other strategies and supported options
    opts = [strategy: :one_for_one, name: Eelarve.Supervisor]
    Supervisor.start_link(children, opts)
  end

(notice I don’t know how Eelarve.Supervisor is implemented, I assume that by use Application something defines it for me).

Now my configuration:

config.exs:

...
config :eelarve,
  ecto_repos: [Eelarve.Repo]

...

dev.exs:

import Config

# Configure your database
config :eelarve, Eelarve.Repo,
  database: Path.expand("../eelarve_dev.db", Path.dirname(__ENV__.file)),
  pool_size: 5,
  stacktrace: true,
  show_sensitive_data_on_connection_error: true

mix.exs:

...
 def application do
    [
      extra_applications: [:logger, :ecto_sqlite3],
      mod: {Eelarve.Application, []}
    ]
  end
...

The problem, as you may have guessed, is that when I issue my command, the SQLite application is not running. Here’s the error:

** (exit) exited in: DBConnection.Holder.checkout(#PID<0.126.0>, [log: #Function<13.38471488/1 in Ecto.Adapters.SQL.with_log/3>, source: "transactions", cache_statement: "ecto_insert_all_transactions", cast_params: ["-13.50", "Uncategorized", :EUR, ~U[2024-06-12 15:45:13.021862Z], "varie", "Rimi"], stacktrace: [{Ecto.Repo.Supervisor, :tuplet, 2, [file: ~c"lib/ecto/repo/supervisor.ex", line: 163]}, {Eelarve.Repo, :insert_all, 3, [file: ~c"lib/eelarve/repo.ex", line: 2]}, {Eelarve.Add, :call, 1, [file: ~c"lib/eelarve/add.ex", line: 31]}, {Kernel.CLI, :"-exec_fun/2-fun-0-", 3, [file: ~c"lib/kernel/cli.ex", line: 136]}], repo: Eelarve.Repo, timeout: 15000, pool_size: 5, pool: DBConnection.ConnectionPool])
    ** (EXIT) no process: the process is not alive or there's no process currently associated with the given name, possibly because its application isn't started
    (db_connection 2.6.0) lib/db_connection/holder.ex:97: DBConnection.Holder.checkout/3
    (db_connection 2.6.0) lib/db_connection.ex:1280: DBConnection.checkout/3
    (db_connection 2.6.0) lib/db_connection.ex:1605: DBConnection.run/6
    (db_connection 2.6.0) lib/db_connection.ex:800: DBConnection.execute/4
    (ecto_sqlite3 0.16.0) lib/ecto/adapters/sqlite3/connection.ex:89: Ecto.Adapters.SQLite3.Connection.query/4
    (ecto_sql 3.11.2) lib/ecto/adapters/sql.ex:519: Ecto.Adapters.SQL.query!/4
    (ecto_sql 3.11.2) lib/ecto/adapters/sql.ex:925: Ecto.Adapters.SQL.insert_all/9
    (ecto 3.11.2) lib/ecto/repo/schema.ex:59: Ecto.Repo.Schema.do_insert_all/7

What am I missing?

Marked As Solved

joelpaulkoch

joelpaulkoch

I followed your error message, in particular this part:

(FunctionClauseError) no function clause matching in :filename.join/2
    (stdlib 5.2) filename.erl:454: :filename.join({:error, :bad_name}, ~c"sqlite3_nif")
    (exqlite 0.23.0) lib/exqlite/sqlite3_nif.ex:16: Exqlite.Sqlite3NIF.load_nif/0

So in exqlite lib/exqlite/sqlite3_nix.ex line 16 is this:

path = :filename.join(:code.priv_dir(:exqlite), ~c"sqlite3_nif")

and apparently :code.priv_dir(:exqlite) gives you an error.

Looking at the documentation of escript, it says:

priv directory support
escripts do not support projects and dependencies that need to store or read artifacts from the priv directory.

So I believe what’s happening is that exqlite wants to load the nif library from its priv directory, but that’s somehow not supported when using escript.

As a sidenote, if you just want to store some data for you CLI application and can’t make it work with SQLite, you could try cubdb.
Never used it myself but given that it doesn’t need any NIFs I guess it should work in escript.
Or, the other way around, use burrito to build your CLI application.

Also Liked

joelpaulkoch

joelpaulkoch

Alright, that’s good. What’s the rest of your mix.exs file (and why do you have :ecto_sqlite3 as extra_application?

And do you have Eelarve.Repo defined somewhere?

E.g. taken from this guide

defmodule Eelarve.Repo do
  use Ecto.Repo,
    otp_app: :eelarve,
    adapter: Ecto.Adapters.SQLite3
end
arcanemachine

arcanemachine

You may not be making a Phoenix project, but the Phoenix generators may be helpful for your case.

In these situations, I will commonly spin up a Phoenix project with the correct flags (see the mix phx.new docs for examples) just to see what the generators spit out. It’s surprisingly barebones if you disable all the unneeded stuff, so it shouldn’t be too difficult to check for the relevant snippets from the generated files.

https://hexdocs.pm/phoenix/Mix.Tasks.Phx.New.html

sturmer

sturmer

Oh, that bit of docs is quite the revelation. Thanks a lot for digging it up!

Never heard of cubdb but I’ll consider it, whereas burrito was definitely on my radar – just wanted to get there by stages, but maybe there’s no easy way to do that without reinventing the wheel.

Where Next?

Popular in Questions Top

LegitStack
I’m hoping you guys can give me some general advice and perhaps code examples if you’re feeling up to it. I’m very interested in Elixir,...
New
JorisKok
I have a server on AWS, and was running a load test using artillery. When looking at the Phoenix dashboard I see the Ports going to 100% ...
New
joaquinalcerro
Hi there, I am working with Ecto-Postgresql and I need to call all of the records from a specific table but the table has 40,000 record...
New
itssasanka
Hi all, Trying to get some more clarity over utc_datetime and naive_datetime for Ecto: https://hexdocs.pm/ecto/Ecto.Schema.html#module-...
New
_russellb
I want to try my hand at web scraping. What tools/libraries do I need to use. I’m hoping to turn this into something professional so don’...
New
logicmason
Hi there, I'm working through my first release with elixir/phoenix. I've built a release with distillery and found that it crashes when I...
New
Kagamiiiii
Student &amp; New to elixir. Nice language. I want to convert a english character, e.g. “a”, which is stored in a variable, to it’s asci...
New
mgjohns61585
Could someone help me? I'm making my first elixir program, number guessing game. I can't figure out how to convert the user's guess from ...
New
aadeshere1
I have a another noob question about loop. Since elixir is immutable, while loop is not directly possible. total = 10 while total != 0 ...
New
electic
Hi, I am new to Elixir. I am trying to use the DateTime component to insert a date into MySQL however the there seems to be no way to fo...
New

Other popular topics Top

bsollish-terakeet
Credo is smart enough to check for (something like) this: assert length(the_list) == 0 with this response: Checking if an enum is empt...
New
AstonJ
You’re a programmer, so you don’t need spoon feeding with the conventional drivel about “this is an integer.” No. You need to know what’s...
New
_russellb
I want to try my hand at web scraping. What tools/libraries do I need to use. I’m hoping to turn this into something professional so don’...
New
quazar
How to set Jason to encode all fields in ecto schema, I don’t care about security and implementing only is taking long list of attributes...
New
jononomo
I am trying to figure out how Mix knows whether the environment is test, dev, or prod -- where is this set? Thanks.
New
fireproofsocks
I’m working on defining a simple Ecto schema for a table (in PostGres), but I don’t see where I can define a column as NOT NULL. Conside...
New
hariharasudhan94
I would like to know what is the best IDE for elixir development?
New
vertexbuffer
Hello, can anybody help here..? I have a list of players and I what to delete an element, but every for loop the list is reverting to ori...
New
chrisalley
ExUnit now has describe blocks which is a welcome addition coming from RSpec. In the docs, it states that nested hierarchies of describe ...
New
lanycrost
Hi everyone! I need implement if…else if…else condition from my elixir code, and anymore of this control flow structures not work proper...
New

We're in Beta

About us Mission Statement