wilkinson4
Ecto Postgres select ARRAY constructor
Hello,
We recently did some optimizations on a slow query in our system, and found the following article from dba exchange that has a nice syntax for selecting an array of items per row
This ended up being a more performant solution from what we were using previously. Below is a simple example of what we’re trying to do in raw postgresql
select *
from calls c
left join lateral (
select array (
select cr.id
from call_recordings cr
where cr.call_id = c.id
and cr.s3_key is not null) as call_recording_ids) as call_recordings on true
limit 10;
As far as I can tell there isn’t an easy way to do this in Ecto. The closest translation to Ecto I’ve got so far is this
def test_select_array do
call_recordings_query =
from cr in Recording,
select: %{
call_recording_ids:
fragment(
"(SELECT ARRAY(SELECT cr.id FROM call_recordings cr WHERE cr.call_id = ? AND cr.s3_key IS NOT NULL))",
parent_as(:call).id
)
}
from(c in Call,
as: :call,
left_lateral_join: cr in subquery(call_recordings_query),
limit: 10,
select: %{
call_id: c.id,
call_recording_ids: cr
}
)
end
But even that isn’t quite right, and it’s janky. Looking for any ideas/guidance on this. Maybe this is something Ecto supports without a fragment and I’m not aware of it, or could support?
– Will
Marked As Solved
LostKobrakai
import Ecto.Query
array_query =
from cr in "call_recordings",
where: cr.call_id == parent_as(:call).id,
where: not is_nil(cr.s3_key),
select: %{
id: cr.id
}
call_recordings_query =
from cr in subquery(array_query),
select: %{
call_recording_ids: fragment("array_agg(?)", cr.id)
}
query =
from(c in "calls",
as: :call,
left_lateral_join: cr in subquery(call_recordings_query), on: true,
limit: 10,
select: %{
call_id: c.id,
call_recording_ids: cr
}
)
{sql, _} = Repo.to_sql(:all, query)
IO.puts(sql)
# SELECT c0."id", s1."call_recording_ids"
# FROM "calls" AS c0
# LEFT OUTER JOIN LATERAL (
# SELECT array_agg(ss0."id") AS "call_recording_ids"
# FROM (
# SELECT ssc0."id" AS "id"
# FROM "call_recordings" AS ssc0
# WHERE (ssc0."call_id" = c0."id") AND (NOT (ssc0."s3_key" IS NULL))
# ) AS ss0
# ) AS s1 ON TRUE
# LIMIT 10
Functionally this should yield the same result as the requested query
Also Liked
D4no0
You could move the fragment to a macro to make the query cleaner, here is an example on how that looks like:
defmacro st_transform(wkt, srid) do
quote do: fragment("ST_Transform(?, ?)", unquote(wkt), unquote(srid))
end
Schultzer
This is where Ecto start to show it’s brittleness, as one of the best ORM I have ever worked with, it still falls short in a lot of real world cases and especially on a enterprise level where you usually have dedicated DBAs that don’t know Elixir, GitHub - elixir-dbvisor/sql: Brings an extensible SQL parser and sigil to Elixir, confidently write SQL with automatic parameterized queries. could help you out here, still fresh but the idea is simple, lower the barrier between Elixir and SQL.







