thiagomajesk
Ecto transaction rolling back with no exceptions? Weird behavior or not missing docs!?
Hi everyone, it seems I can’t get out of this forum this week
(you guys are awesome btw).
So, I got surprised by this behavior while using Ecto and I’m still banging my head against the wall with some conflicting information.
A coworker opened this issue: Updating a record in a Repo transaction failure · Issue #3944 · elixir-ecto/ecto · GitHub yesterday where he describes something unexpected we found with how transactions work.
The context of the whole thing is in the issue, but to summarize… The docs about transaction/2 say:
If an unhandled error occurs the transaction will be rolled back and the error will bubble up from the transaction function. If no error occurred the transaction will be committed when the function returns. A transaction can be explicitly rolled back by calling
rollback/1, this will immediately leave the function and return the value given torollbackas{:error, value}
This is what we are trying to do… We always have a “tag” persisted after trying to save a “post”. If we are unable to persist the “tag”, we also don’t care about saving the “post”:
Repo.transaction(fn repo ->
case repo.insert(changeset) do
{:ok, post} ->
# Great! Please also save the tag confirming it
# If we can't just explode and rollback...
tag
|> Ecto.Changeset.change(%{name: "success"})
|> repo.update!()
{:error, changeset} ->
# Oh noes! Please save some information about it
# If we can't save just explode and rollback...
tag
|> Ecto.Changeset.change(%{name: "failure"})
|> repo.update!()
end
end)
What surprised us that is that this operation fails, even though we are handling the errors in the first insert. This is the exception raised when the code gets to the repo.update! (this is from the adapter, so it also happens with the safe alternative repo.update):
** (Postgrex.Error) ERROR 25P02 (in_failed_sql_transaction) current transaction is aborted, commands ignored until end of transaction block
Ok, apparently there’s something preventing the transaction from succeeding. After conducting some tests it seems that repo.insert is putting the transaction in a bad state and repo.update! can’t succeed because of it. We had that confirmed by jose and as it seems, this error is happening because an operation already failed inside the transaction. He also seems to agree that the docs are talking about exceptions and not just “errors”. So, what exactly are we missing here?
If the docs are right about the transaction rolling back on exceptions, why can’t this code succeed? If not, and we agree that there’s something to be improved in the docs, what should the correct behavior be?
I’m certain that there’s some important information I’m missing, but I’m feeling a bit misguided by the docs and we want to improve it for posterity.
Most Liked
al2o3cr
For whatever it’s worth, this issue has been confounding people for a long time (note the date!):
trisolaran
Yeah that’s what I meant. unique_constraint doesn’t prevent the DB error, it works by waiting for the DB error to happen on insert, catching it and putting it into the changeset. What you’re seeing is expected. When you’re calling insert here you’re triggering a DB error. unique_constraint is simply catching the error for you and turning it into a nice human friendly error for your changeset, but the DB transaction is still in an error state.
joey_the_snake
You could do an insert with on_conflict: :nothing. This will not cause an error.
thiagomajesk
Yes, this is absolutely required!
This flow would work, but I’d have to clean all “tags” not referencing “posts” in the DB at the end, which is an operation that could fail on its own and leave us with loose “tags”. Remember that the “tag” in this case, can only exist on two occasions: if a “post” is persisted and if a “post” has errors. It’s almost like a logging mechanism, if I create the log before and there’s nothing worth logging I have to remove it somehow.
BTW, It seems someone else already had this exact same problem: How to not rollback transaction on failed insert because of unique constraint - #8 by benwilson512. I conducted some tests using one of the post’s suggestions and the savepoint feature seems to work without much effort. The only difference is that no additional match on the case was required:
Repo.transaction(fn repo ->
case repo.insert(changeset, mode: :savepoint) do
{:ok, post} ->
IO.inspect(post, label: "POST")
tag
|> Ecto.Changeset.change(%{name: "success"})
|> repo.update!()
{:error, changeset} ->
IO.inspect(changeset, label: "CHANGESET")
tag
|> Ecto.Changeset.change(%{name: "failed"})
|> repo.update!()
end
end)
This returns the tuple with the changeset containing the constraint errors and commits the transaction as expected:
12:31:46.616 [debug] QUERY OK db=1.6ms queue=0.2ms
INSERT INTO "tags" VALUES (DEFAULT) RETURNING "id" []
12:31:46.620 [debug] QUERY OK db=1.5ms queue=0.1ms
INSERT INTO "posts" ("title") VALUES ($1) RETURNING "id" ["123"]
12:31:46.620 [debug] QUERY OK db=0.1ms
begin []
12:31:46.622 [debug] QUERY ERROR db=1.5ms
INSERT INTO "posts" ("title") VALUES ($1) RETURNING "id" ["123"]
CHANGESET: #Ecto.Changeset<
action: :insert,
changes: %{title: "123"},
errors: [
title: {"has already been taken",
[constraint: :unique, constraint_name: "posts_title_index"]}
],
data: #Post<>,
valid?: false
>
12:31:46.624 [debug] QUERY OK db=0.2ms
UPDATE "tags" SET "name" = $1 WHERE "id" = $2 ["failed", 1]
12:31:46.626 [debug] QUERY OK db=1.8ms
commit []
Alvinkariuki
Intuitive I like it







