senconscious

senconscious

Embeds in schemaless changesets

Hello everyone. I want to use schemaless changesets to validate external data. And I wonder how to properly use embeds with them.

Let’s assume I want to validate the nested map under the user key in my params payload. And I want my data to be a map in the end. So to get this work I managed to write this “hack”:

defmodule Params do
  import Ecto.Changeset

  @user_types %{id: :integer}

  @user_fields Map.keys(@user_types)

  @types %{
    name: :string,
    page: :integer,
    page_size: :integer,
    ages: {:array, :integer},
    user:
      {:embed,
       elem(
         Ecto.ParameterizedType.init(Ecto.Embedded,
           cardinality: :one,
           related: __MODULE__,
           field: :user
         ),
         2
       )}
  }

  @default %{
    page: 1,
    page_size: 10
  }

  @fields Map.keys(@types) -- [:user]

  def build(entity \\ @default, attrs \\ %{}) do
    entity
    |> changeset(attrs)
    |> apply_action(:insert)
  end

  def changeset(entity, attrs) do
    {entity, @types}
    |> cast(attrs, @fields)
    |> cast_embed(:user, with: &user_changeset/2)
  end

  def user_changeset(entity, attrs) do
    {entity, @user_types}
    |> cast(attrs, @user_fields)
  end

  def __schema__(:primary_key), do: []
  def __struct__, do: %{}
end

Although it’s kinda working doesn’t seems good. As I need to define __schema__/1 and __struct__/0 functons with custom behavior while setting related key to not being relation module, but parent module.

I want to know better approaches to how to validate nested data using schemaless changesets. Or maybe that’s not proper usage of schemaless changeset. And I need to use schema/embedded_schema to avoid “hacking” ?

Most Liked

jswanner

jswanner

When wanting to validate external data with Ecto like this and it’s a nested data structure, I prefer using embedded_schema over schemaless changesets (which I use when validating flat data structures). I’ve also used Goal, which is a wrapper around Ecto.

I’ve also been wanting to try the aforementioned Drops library, but have not yet done so.

sodapopcan

sodapopcan

You should check out Drops which seems like it would be more suited to what you’re looking for. Sorry I don’t have a direct answer. I do use Ecto for non-database-backed validation but always with a(n embedded) schema. I’m actually not sure how it would work without one as the casting functions are looking at the schema definition for the types. But again, no experience with schemaless, so I’m not saying there is not a way for sure, just recommending Drops :slight_smile:

senconscious

senconscious

The reasons why I’m looking for a solution using schemaless changesets (instead of an easy solution with embedded schemas) are:

  1. I want my success payload to be a map. So I don’t need to invoke Map.from_struct/1 function recursively or define implementation of protocols (like Enumarable);
  2. I want my success payload to contain only those keys that were sent by a user. In some scenarios it’s important whether the key was explicitly set to nil or it wasn’t included in the payload;

There’re plenty of libraries that solves this problems with building schemas under the hood. But I look for more simpler solution that doesn’t require any external deps.

One more idea that I’ve got is define key with :map type. And writing in changeset custom function to put value after applying changes. The code for this solution:

defmodule NewParams do
    import Ecto.Changeset

    @user_types %{id: :integer}

    @user_fields Map.keys(@user_types)

    @types %{
      name: :string,
      page: :integer,
      page_size: :integer,
      ages: {:array, :integer},
      user: :map
    }

    @default %{
      page: 1,
      page_size: 10
    }

    @fields Map.keys(@types)

    def build(entity \\ @default, attrs \\ %{}) do
      @default
      |> Map.merge(entity)
      |> changeset(attrs)
      |> apply_action(:insert)
    end

    def changeset(entity, attrs) do
      {entity, @types}
      |> cast(attrs, @fields)
      |> cast_user()
    end

    def cast_user(%{changes: %{user: changes_user}} = changeset) do
      data_user = changeset.data[:user] || %{}

      case build_user(data_user, changes_user) do
        {:ok, user} ->
          put_change(changeset, :user, user)

        {:error, user_changeset} ->
          changeset
          |> put_change(:user, user_changeset)
          |> Map.put(:valid?, false)
      end
    end

    def cast_user(changeset), do: changeset

    def build_user(entity, attrs) do
      entity
      |> user_changeset(attrs)
      |> apply_action(:validate)
    end

    def user_changeset(entity, attrs) do
      {entity, @user_types}
      |> cast(attrs, @user_fields)
    end
  end

But not sure whether it’s better than using schemaless embed type. Still looking for solution

rhcarvalho

rhcarvalho

This thread sparkled my curiosity, was it possible to use schemaless changesets with nested data?

It could simplify a form I’m writing that edits multiple entities at once (and they could be expressed as a multi-level map).

senconscious

senconscious

should be hackable according to the first message

Where Next?

Popular in Questions Top

Brian
What is the proper way to load a module from a file in to IEX? In the python world, doing something like this pretty standard: from ....
New
ycv005
I have followed this StackOverflow post to install the specific version of Erlang. And When I am running mix ecto.setup then getting fol...
New
fireproofsocks
I’m working on defining a simple Ecto schema for a table (in PostGres), but I don’t see where I can define a column as NOT NULL. Conside...
New
mgjohns61585
Could someone help me? I'm making my first elixir program, number guessing game. I can't figure out how to convert the user's guess from ...
New
LegitStack
I’m trying to make a websocket server in Phoenix or raw Elixir. I heard about gun, I think I could use cowboy, but since I’m not that sma...
New
electic
Hi, I am new to Elixir. I am trying to use the DateTime component to insert a date into MySQL however the there seems to be no way to fo...
New
WestKeys
Currently suffering from paralysis by [HTTP client] analysis. This is rather unusual in Elixirland as there tends to be consensus on the ...
New
beno
I will often find my self writing things similar to: case some_value do nil -> something() "" -> something() _ -> someth...
New
sabri
Can someone explain the settings of pool_size of Ecto in config file? and what is the recommend size? Thanks
New
jc00ke
Expanding on this topic: https://forum.elixirforum.net/t/map-typespec-question/19217 Let’s say I have a map with required and optional k...
New

Other popular topics Top

JDanielMartinez
Hi! May someone helps me, please! I have two apps into an umbrella project: the first one is Database, which manages queries, and the se...
New
Brian
What is the proper way to load a module from a file in to IEX? In the python world, doing something like this pretty standard: from ....
New
bsollish-terakeet
Credo is smart enough to check for (something like) this: assert length(the_list) == 0 with this response: Checking if an enum is empt...
New
JorisKok
I have a server on AWS, and was running a load test using artillery. When looking at the Phoenix dashboard I see the Ports going to 100% ...
New
jerry
Good day to you all. I have been struggling to get a query involving like and ilike to work. Can anyone assist me on this, please? pro...
New
grych
Hi folks, Few months ago I have announced the proof-of-concept of the library to manipulate the browsers DOM objects directly from Elixi...
639 49522 488
New
Harrisonl
We have an ECS cluster with 4 services, where each task joins a single cluster, via discovery ECS discovery service. Currently when I de...
New
chensan
I have a User schema with a :from_id field set to type :string: defmodule TweetBot.Repo.Migrations.CreateUsers do use Ecto.Migration ...
New
ashish173
I am using Ecto timestamps with postgres, I can see the timestamps() use the :naive_dateime but for my use case I wanted to store the ti...
New
qwerescape
Is there a way to get the call stack or stack trace at any point in the code? Not from exceptions, but an expression that returns how the...
New

We're in Beta

About us Mission Statement