gmile

gmile

Cross-platform specific error when installing latest hex

It seems like downloading latest hex when building for a non-native platform is broken :thinking:

I have the following Dockerfile:

FROM hexpm/elixir:1.16.2-erlang-26.2.3-alpine-3.19.1
RUN apk add git
RUN mix archive.install github hexpm/hex branch latest --force

Using M-series MacBook if I build it for amd64 architecture, I get an error:

docker buildx build --platform linux/amd64 --file ./Dockerfile --no-cache --progress plain .
# ...
3.067 ==> hex
3.069 Error while loading project :"new package" at /tmp/mix-local-installer-fetcher-3T_JSQ/deps/new package
3.080 ** (ArgumentError) could not call Module.put_attribute/3 because the module Hex.MixProject is already compiled
3.080     (elixir 1.16.2) lib/module.ex:2360: Module.assert_not_readonly!/2
3.080     (elixir 1.16.2) lib/module.ex:2041: Module.__put_attribute__/5
3.080     /tmp/mix-local-installer-fetcher-3T_JSQ/deps/new package/mix.exs:172: (module)
3.080     (stdlib 5.2.1) lists.erl:1599: :lists.foldl_1/3
Full output
#0 building with "mybuilder" instance using docker-container driver

#1 [internal] load build definition from Dockerfile
#1 transferring dockerfile: 171B done
#1 DONE 0.0s

#2 [internal] load metadata for docker.io/hexpm/elixir:1.16.2-erlang-26.2.3-alpine-3.19.1
#2 DONE 0.4s

#3 [internal] load .dockerignore
#3 transferring context: 2B done
#3 DONE 0.0s

#4 [1/3] FROM docker.io/hexpm/elixir:1.16.2-erlang-26.2.3-alpine-3.19.1@sha256:aed90d87c95d2cb41b2fc589b781ceca11d5faf6e533b89587e741943274a4e7
#4 resolve docker.io/hexpm/elixir:1.16.2-erlang-26.2.3-alpine-3.19.1@sha256:aed90d87c95d2cb41b2fc589b781ceca11d5faf6e533b89587e741943274a4e7 done
#4 CACHED

#5 [2/3] RUN apk add git
#5 0.046 fetch https://dl-cdn.alpinelinux.org/alpine/v3.19/main/x86_64/APKINDEX.tar.gz
#5 0.240 fetch https://dl-cdn.alpinelinux.org/alpine/v3.19/community/x86_64/APKINDEX.tar.gz
#5 0.428 (1/9) Installing brotli-libs (1.1.0-r1)
#5 0.455 (2/9) Installing c-ares (1.27.0-r0)
#5 0.474 (3/9) Installing libunistring (1.1-r2)
#5 0.503 (4/9) Installing libidn2 (2.3.4-r4)
#5 0.523 (5/9) Installing nghttp2-libs (1.58.0-r0)
#5 0.545 (6/9) Installing libcurl (8.5.0-r0)
#5 0.570 (7/9) Installing libexpat (2.6.2-r0)
#5 0.593 (8/9) Installing pcre2 (10.42-r2)
#5 0.619 (9/9) Installing git (2.43.0-r0)
#5 0.690 Executing busybox-1.36.1-r15.trigger
#5 0.699 OK: 24 MiB in 35 packages
#5 DONE 0.7s

#6 [3/3] RUN mix archive.install github hexpm/hex branch latest --force
#6 0.720 * Getting new package (https://github.com/hexpm/hex.git - origin/latest)
#6 1.340 remote: Enumerating objects: 13806, done.
remote: Counting objects: 100% (1261/1261), done.
remote: Compressing objects: 100% (661/661), done.
#6 1.756 remote: Total 13806 (delta 757), reused 966 (delta 542), pack-reused 12545
#6 2.124 ==> hex
#6 2.125 Error while loading project :"new package" at /tmp/mix-local-installer-fetcher-jW0twA/deps/new package
#6 2.141 ** (ArgumentError) could not call Module.put_attribute/3 because the module Hex.MixProject is already compiled
#6 2.141     (elixir 1.16.2) lib/module.ex:2360: Module.assert_not_readonly!/2
#6 2.141     (elixir 1.16.2) lib/module.ex:2041: Module.__put_attribute__/5
#6 2.141     /tmp/mix-local-installer-fetcher-jW0twA/deps/new package/mix.exs:172: (module)
#6 2.141     (stdlib 5.2.1) lists.erl:1599: :lists.foldl_1/3
#6 ERROR: process "/bin/sh -c mix archive.install github hexpm/hex branch latest --force" did not complete successfully: exit code: 1
------
 > [3/3] RUN mix archive.install github hexpm/hex branch latest --force:
remote: Counting objects: 100% (1261/1261), done.
remote: Compressing objects: 100% (661/661), done.
1.756 remote: Total 13806 (delta 757), reused 966 (delta 542), pack-reused 12545
2.124 ==> hex
2.125 Error while loading project :"new package" at /tmp/mix-local-installer-fetcher-jW0twA/deps/new package
2.141 ** (ArgumentError) could not call Module.put_attribute/3 because the module Hex.MixProject is already compiled
2.141     (elixir 1.16.2) lib/module.ex:2360: Module.assert_not_readonly!/2
2.141     (elixir 1.16.2) lib/module.ex:2041: Module.__put_attribute__/5
2.141     /tmp/mix-local-installer-fetcher-jW0twA/deps/new package/mix.exs:172: (module)
2.141     (stdlib 5.2.1) lists.erl:1599: :lists.foldl_1/3
------
WARNING: No output specified with docker-container driver. Build result will only remain in the build cache. To push result image into registry use --push or to load image into docker use --load
Dockerfile:3
--------------------
   1 |     FROM hexpm/elixir:1.16.2-erlang-26.2.3-alpine-3.19.1
   2 |     RUN apk add git
   3 | >>> RUN mix archive.install github hexpm/hex branch latest --force
   4 |
--------------------
ERROR: failed to solve: process "/bin/sh -c mix archive.install github hexpm/hex branch latest --force" did not complete successfully: exit code: 1
docker system info
docker system info
Client:
 Version:    25.0.5
 Context:    orbstack
 Debug Mode: false
 Plugins:
  buildx: Docker Buildx (Docker Inc.)
    Version:  v0.13.1
    Path:     /Users/eugene/.docker/cli-plugins/docker-buildx
  compose: Docker Compose (Docker Inc.)
    Version:  v2.24.5
    Path:     /Users/eugene/.docker/cli-plugins/docker-compose

Server:
 Containers: 46
  Running: 11
  Paused: 0
  Stopped: 35
 Images: 94
 Server Version: 25.0.5
 Storage Driver: overlay2
  Backing Filesystem: btrfs
  Supports d_type: true
  Using metacopy: false
  Native Overlay Diff: true
  userxattr: false
 Logging Driver: json-file
 Cgroup Driver: cgroupfs
 Cgroup Version: 2
 Plugins:
  Volume: local
  Network: bridge host ipvlan macvlan null overlay
  Log: awslogs fluentd gcplogs gelf journald json-file local splunk syslog
 Swarm: inactive
 Runtimes: runc io.containerd.runc.v2
 Default Runtime: runc
 Init Binary: docker-init
 containerd version: 7c3aca7a610df76212171d200ca3811ff6096eb8
 runc version: 51d5e94601ceffbbd85688df1c928ecccbfa4685
 init version: de40ad0
 Security Options:
  seccomp
   Profile: builtin
  cgroupns
 Kernel Version: 6.7.11-orbstack-00143-ge6b82e26cd22
 Operating System: OrbStack
 OSType: linux
 Architecture: aarch64
 CPUs: 16
 Total Memory: 7.747GiB
 Name: orbstack
 ID: 6930304f-aa9c-4f94-ab8f-65e34ab70164
 Docker Root Dir: /var/lib/docker
 Debug Mode: false
 Experimental: false
 Insecure Registries:
  127.0.0.0/8
 Live Restore Enabled: false
 Product License: Community Engine
 Default Address Pools:
   Base: 192.168.215.0/24, Size: 24
   Base: 192.168.228.0/24, Size: 24
   Base: 192.168.247.0/24, Size: 24
   Base: 192.168.207.0/24, Size: 24
   Base: 192.168.167.0/24, Size: 24
   Base: 192.168.107.0/24, Size: 24
   Base: 192.168.237.0/24, Size: 24
   Base: 192.168.148.0/24, Size: 24
   Base: 192.168.214.0/24, Size: 24
   Base: 192.168.165.0/24, Size: 24
   Base: 192.168.227.0/24, Size: 24
   Base: 192.168.181.0/24, Size: 24
   Base: 192.168.158.0/24, Size: 24
   Base: 192.168.117.0/24, Size: 24
   Base: 192.168.155.0/24, Size: 24
   Base: 192.168.147.0/24, Size: 24
   Base: 192.168.229.0/24, Size: 24
   Base: 192.168.183.0/24, Size: 24
   Base: 192.168.156.0/24, Size: 24
   Base: 192.168.97.0/24, Size: 24
   Base: 192.168.171.0/24, Size: 24
   Base: 192.168.186.0/24, Size: 24
   Base: 192.168.216.0/24, Size: 24
   Base: 192.168.242.0/24, Size: 24
   Base: 192.168.166.0/24, Size: 24
   Base: 192.168.239.0/24, Size: 24
   Base: 192.168.223.0/24, Size: 24
   Base: 192.168.164.0/24, Size: 24
   Base: 192.168.163.0/24, Size: 24
   Base: 192.168.172.0/24, Size: 24
   Base: 172.17.0.0/16, Size: 16
   Base: 172.18.0.0/16, Size: 16
   Base: 172.19.0.0/16, Size: 16
   Base: 172.20.0.0/14, Size: 16
   Base: 172.24.0.0/14, Size: 16
   Base: 172.28.0.0/14, Size: 16

I get a similar error if I attempt to build an image for arm64 using my amd64 linux box:

docker buildx build --platform linux/arm64 --file ./Dockerfile --no-cache --progress plain .
# ...
7.858 ==> hex
7.860 Error while loading project :"new package" at /tmp/mix-local-installer-fetcher-Zs6laA/deps/new package
7.920 ** (ArgumentError) could not call Module.put_attribute/3 because the module Hex.MixProject is already compiled
7.920     (elixir 1.16.2) lib/module.ex:2360: Module.assert_not_readonly!/2
7.920     (elixir 1.16.2) lib/module.ex:2041: Module.__put_attribute__/5
7.920     /tmp/mix-local-installer-fetcher-Zs6laA/deps/new package/mix.exs:171: (module)
7.920     (stdlib 5.2.1) lists.erl:1599: :lists.foldl_1/3
------
WARNING: No output specified with docker-container driver. Build result will only remain in the build cache. To push result image into registry use --push or to load image into docker use --load
Dockerfile:3
--------------------
   1 |     FROM hexpm/elixir:1.16.2-erlang-26.2.3-alpine-3.19.1
   2 |     RUN apk add git
   3 | >>> RUN mix archive.install github hexpm/hex branch latest --force
   4 |
--------------------
ERROR: failed to solve: process "/dev/.buildkit_qemu_emulator /bin/sh -c mix archive.install github hexpm/hex branch latest --force" did not complete successfully: exit code: 1
Full output
docker buildx build --platform linux/arm64 --file ./Dockerfile --no-cache --progress plain .
#0 building with "nice_pare" instance using docker-container driver

#1 [internal] load build definition from Dockerfile
#1 transferring dockerfile: 171B done
#1 DONE 0.0s

#2 [internal] load metadata for docker.io/hexpm/elixir:1.16.2-erlang-26.2.3-alpine-3.19.1
#2 DONE 1.1s

#3 [internal] load .dockerignore
#3 transferring context: 2B done
#3 DONE 0.0s

#4 [1/3] FROM docker.io/hexpm/elixir:1.16.2-erlang-26.2.3-alpine-3.19.1@sha256:aed90d87c95d2cb41b2fc589b781ceca11d5faf6e533b89587e741943274a4e7
#4 resolve docker.io/hexpm/elixir:1.16.2-erlang-26.2.3-alpine-3.19.1@sha256:aed90d87c95d2cb41b2fc589b781ceca11d5faf6e533b89587e741943274a4e7 done
#4 CACHED

#5 [2/3] RUN apk add git
#5 0.083 fetch https://dl-cdn.alpinelinux.org/alpine/v3.19/main/aarch64/APKINDEX.tar.gz
#5 0.930 fetch https://dl-cdn.alpinelinux.org/alpine/v3.19/community/aarch64/APKINDEX.tar.gz
#5 2.010 (1/9) Installing brotli-libs (1.1.0-r1)
#5 2.179 (2/9) Installing c-ares (1.27.0-r0)
#5 2.328 (3/9) Installing libunistring (1.1-r2)
#5 2.499 (4/9) Installing libidn2 (2.3.4-r4)
#5 2.592 (5/9) Installing nghttp2-libs (1.58.0-r0)
#5 2.678 (6/9) Installing libcurl (8.5.0-r0)
#5 2.818 (7/9) Installing libexpat (2.6.2-r0)
#5 2.903 (8/9) Installing pcre2 (10.42-r2)
#5 3.032 (9/9) Installing git (2.43.0-r0)
#5 3.500 Executing busybox-1.36.1-r15.trigger
#5 3.560 OK: 26 MiB in 35 packages
#5 DONE 3.7s

#6 [3/3] RUN mix archive.install github hexpm/hex branch latest --force
#6 3.672 * Getting new package (https://github.com/hexpm/hex.git - origin/latest)
#6 5.031 remote: Enumerating objects: 13806, done.
remote: Counting objects: 100% (1261/1261), done.
remote: Compressing objects: 100% (641/641), done.
#6 5.986 remote: Total 13806 (delta 759), reused 993 (delta 562), pack-reused 12545
#6 8.020 ==> hex
#6 8.027 Error while loading project :"new package" at /tmp/mix-local-installer-fetcher-XN3HMA/deps/new package
#6 8.142 ** (ArgumentError) could not call Module.put_attribute/3 because the module Hex.MixProject is already compiled
#6 8.142     (elixir 1.16.2) lib/module.ex:2360: Module.assert_not_readonly!/2
#6 8.142     (elixir 1.16.2) lib/module.ex:2041: Module.__put_attribute__/5
#6 8.142     /tmp/mix-local-installer-fetcher-XN3HMA/deps/new package/mix.exs:171: (module)
#6 8.142     (stdlib 5.2.1) lists.erl:1599: :lists.foldl_1/3
#6 ERROR: process "/dev/.buildkit_qemu_emulator /bin/sh -c mix archive.install github hexpm/hex branch latest --force" did not complete successfully: exit code: 1
------
 > [3/3] RUN mix archive.install github hexpm/hex branch latest --force:
remote: Counting objects: 100% (1261/1261), done.
remote: Compressing objects: 100% (641/641), done.
5.986 remote: Total 13806 (delta 759), reused 993 (delta 562), pack-reused 12545
8.020 ==> hex
8.027 Error while loading project :"new package" at /tmp/mix-local-installer-fetcher-XN3HMA/deps/new package
8.142 ** (ArgumentError) could not call Module.put_attribute/3 because the module Hex.MixProject is already compiled
8.142     (elixir 1.16.2) lib/module.ex:2360: Module.assert_not_readonly!/2
8.142     (elixir 1.16.2) lib/module.ex:2041: Module.__put_attribute__/5
8.142     /tmp/mix-local-installer-fetcher-XN3HMA/deps/new package/mix.exs:171: (module)
8.142     (stdlib 5.2.1) lists.erl:1599: :lists.foldl_1/3
------
WARNING: No output specified with docker-container driver. Build result will only remain in the build cache. To push result image into registry use --push or to load image into docker use --load
Dockerfile:3
--------------------
   1 |     FROM hexpm/elixir:1.16.2-erlang-26.2.3-alpine-3.19.1
   2 |     RUN apk add git
   3 | >>> RUN mix archive.install github hexpm/hex branch latest --force
   4 |
--------------------
ERROR: failed to solve: process "/dev/.buildkit_qemu_emulator /bin/sh -c mix archive.install github hexpm/hex branch latest --force" did not complete successfully: exit code: 1
docker system info
Client: Docker Engine - Community
 Version:    25.0.0
 Context:    default
 Debug Mode: false
 Plugins:
  buildx: Docker Buildx (Docker Inc.)
    Version:  v0.12.1
    Path:     /usr/libexec/docker/cli-plugins/docker-buildx
  compose: Docker Compose (Docker Inc.)
    Version:  v2.24.1
    Path:     /usr/libexec/docker/cli-plugins/docker-compose

Server:
 Containers: 15
  Running: 3
  Paused: 0
  Stopped: 12
 Images: 41
 Server Version: 25.0.0
 Storage Driver: overlay2
  Backing Filesystem: extfs
  Supports d_type: true
  Using metacopy: false
  Native Overlay Diff: true
  userxattr: false
 Logging Driver: json-file
 Cgroup Driver: systemd
 Cgroup Version: 2
 Plugins:
  Volume: local
  Network: bridge host ipvlan macvlan null overlay
  Log: awslogs fluentd gcplogs gelf journald json-file local splunk syslog
 Swarm: error
  NodeID:
  Error: error while loading TLS certificate in /var/lib/docker/swarm/certificates/swarm-node.crt: certificate (1 - iuqe6aimrunn6atv7y4ldcftn) not valid after Sun, 04 Feb 2024 09:18:00 UTC, and it is currently Wed, 14 Feb 2024 16:37:01 CET: x509: certificate has expired or is not yet valid:
  Is Manager: false
  Node Address: 100.126.118.102
 Runtimes: io.containerd.runc.v2 runc
 Default Runtime: runc
 Init Binary: docker-init
 containerd version: a1496014c916f9e62104b33d1bb5bd03b0858e59
 runc version: v1.1.11-0-g4bccb38
 init version: de40ad0
 Security Options:
  apparmor
  seccomp
   Profile: builtin
  cgroupns
 Kernel Version: 5.15.0-94-generic
 Operating System: Ubuntu 22.04.3 LTS
 OSType: linux
 Architecture: x86_64
 CPUs: 16
 Total Memory: 15GiB
 Name: eugene-pc
 ID: 48396c2d-4102-4b10-aa73-6744cad10683
 Docker Root Dir: /var/lib/docker
 Debug Mode: false
 Experimental: false
 Insecure Registries:
  127.0.0.0/8
 Live Restore Enabled:

Any ideas what might be happening here? :thinking:

Most Liked

gmile

gmile

After encountering this problem, I decided to document everything I discovered, but chose not to dig further at the moment… So no, didn’t manage to solve this.

I’ll speculate that the problem here is at the intersection of Erlang / qemu, since qemu is typically used by docker buildx to build images across platforms. And if so, it wouldn’t be the first time specific version of Erlang / qemu is affected by this… See: [arm64+otp 25+qemu] `mix local.hex --force` hangs - although there, the problem is even worse, e.g. a segmentation fault. But I am not 100% sure if the two issues are related

Where Next?

Popular in Questions Top

9mm
I am constructing a JSON object (map) and I need to conditionally set a field. I’m trying to write proper elixir-way code… and I’m at a l...
New
Harrisonl
We have an ECS cluster with 4 services, where each task joins a single cluster, via discovery ECS discovery service. Currently when I de...
New
jononomo
I am trying to figure out how Mix knows whether the environment is test, dev, or prod -- where is this set? Thanks.
New
sergio
In Ruby, I can go: User.find_by(email: "foobar@email.com").update(email: "hello@email.com") How can I do something similar in Elixir? ...
New
aadeshere1
I have a another noob question about loop. Since elixir is immutable, while loop is not directly possible. total = 10 while total != 0 ...
New
alice
Hey, Just curious what are the main benefits of Elixir compared to Clojure? When is Elixir more useful than Clojure and vice versa? Th...
New
mathew4509
I have a list say x = ["23gh", "56kh", "97mh"] I would like to pass each element to Val in each iteration. Say, in iteration 1 -------...
New
electic
Hi, I am new to Elixir. I am trying to use the DateTime component to insert a date into MySQL however the there seems to be no way to fo...
New
hpopp
To simplify some tasks at work, I wrote and published this package yesterday. It’s a simple macro that enables Access behaviour on struct...
New
Fl4m3Ph03n1x
About me? ( if you have nothing better to do than reading about some random guy in the internet :stuck_out_tongue: ) Hello all, this is ...
New

Other popular topics Top

shahryarjb
Hello, I get Persian date from my client and convert it to normal calendar like this: def jalali_string_to_miladi_english_number(persi...
New
sergio_101
I am VERY much an elixir newbie. I have taken one elixir course and one phoenix course on Udemy. During that course, I saw the instructor...
New
_russellb
I want to try my hand at web scraping. What tools/libraries do I need to use. I’m hoping to turn this into something professional so don’...
New
ycv005
I have followed this StackOverflow post to install the specific version of Erlang. And When I am running mix ecto.setup then getting fol...
New
malloryerik
Hi, this is for people who, like me, have had some friction using .html.heex templates in VSCode. The solution seems to be, in a hyphena...
New
ashish173
I am using Ecto timestamps with postgres, I can see the timestamps() use the :naive_dateime but for my use case I wanted to store the ti...
New
Fl4m3Ph03n1x
About me? ( if you have nothing better to do than reading about some random guy in the internet :stuck_out_tongue: ) Hello all, this is ...
New
AstonJ
We’ve put together this wiki for Phoenix LiveView - please feel free to add any info you feel is worth including. What is Phoenix LiveV...
New
joeerl
Hello again - after a longish gap I’ve decided I really must dig into Elixir and see what’s been happening here - so I have a few questio...
New
magnetic
Hey :wave:t3: Elixir community, I’ve been learning Elixir, and working on some side projects. My editor of choice is VSCode, and althoug...
New

We're in Beta

About us Mission Statement