julismz

julismz

Creating a cluster with libcluster and Kubernetes

I’m having problems creating a cluster with libcluster and K8S…

The error I’m having is:

`[warning] [libcluster:k8s] unable to connect to :"foo@10.244.2.106": not part of network

These are my kubernetes configs:

apiVersion: apps/v1
kind: Deployment
metadata:
  name: foo
spec:
  replicas: 4
  selector:
    matchLabels:
      app: foo
  template:
    metadata:
      labels:
        app: foo
    spec:
      serviceAccountName: foo-account
      containers:
        - name: foo
          image: full_node:latest
          args: ["--name", "foo@$(MY_POD_IP)", "--cookie", "foo-cookie"]
          imagePullPolicy: IfNotPresent
          ports:
            - containerPort: 4000
          env:
            - name: MY_POD_IP
              valueFrom:
                fieldRef:
                  fieldPath: status.podIP

---

apiVersion: v1
kind: Service
metadata:
  name: foo-service
  namespace: default
spec:
  selector:
    app: foo
  ports:
    - protocol: TCP
      name: api
      port: 4000
      targetPort: 4000
    - protocol: TCP
      name: web
      port: 4001
      targetPort: 4001
  type: LoadBalancer

---
apiVersion: v1
kind: Service
metadata:
  name: foo-nodes
  namespace: default
spec:
  type: ClusterIP
  clusterIP: None
  selector:
    app: foo
  ports:
    - name: epmd
      port: 4369

---

kind: Role
apiVersion: rbac.authorization.k8s.io/v1
metadata:
  namespace: default
  name: pod-reader
rules:
  - apiGroups: [""]
    resources: ["pods", "endpoints"]
    verbs: ["get", "watch", "list"]

---
kind: RoleBinding
apiVersion: rbac.authorization.k8s.io/v1
metadata:
  name: read-pods
  namespace: default
subjects:
  - kind: ServiceAccount
    name: foo-account
    namespace: default
roleRef:
  kind: Role
  name: pod-reader
  apiGroup: rbac.authorization.k8s.io

---

apiVersion: v1
kind: ServiceAccount
metadata:
  name: foo-account
  namespace: default

The libcluster config:

topologies = [
      k8s: [
        strategy: Cluster.Strategy.Kubernetes.DNS,
        config: [
          service: "foo-nodes",
          application_name: "foo"
        ]
      ]
    ]

Communication between pods are fine. Endpoints

kubectl get endpoints
NAME           ENDPOINTS                                                           AGE
foo-nodes     10.244.2.100:4369,10.244.2.101:4369,10.244.2.102:4369 + 1 more...   15m

Services

kubectl get services
NAME           TYPE           CLUSTER-IP      EXTERNAL-IP   PORT(S)                         AGE
foo-nodes     ClusterIP      None            <none>        4369/TCP                        37m
foo-service   LoadBalancer   10.101.190.19   <pending>     4000:31343/TCP,4001:32461/TCP   4h53m

I followed several tutorials like this: Connecting Elixir Nodes with libcluster, locally and on Kubernetes Read the docu: Cluster.Strategy.Kubernetes.DNS — libcluster v3.3.3 I don’t know what else I can try…

Any though?

Marked As Solved

mruoss

mruoss

What is the command that is executed in the container? --name and --cookie are arguments to the elixir or iex command. If you built a release try working with env vars instead of args:

          env:
            - name: MY_POD_IP
              valueFrom:
                fieldRef:
                  fieldPath: status.podIP
            - name: RELEASE_DISTRIBUTION
              value: name
            - name: RELEASE_NODE
              value: foo@$(MY_POD_IP)
            - name: RELEASE_COOKIE
              value: foo-cookie

Where Next?

Popular in Questions Top

shahryarjb
Hello, I get Persian date from my client and convert it to normal calendar like this: def jalali_string_to_miladi_english_number(persi...
New
srinivasu
How to handle excepions in elixir? Suppose i have A, B, C ,D, E modules. and each module has get() function. A.get() method will call th...
New
vonH
In asking this question I am more interested about the expressiveness of the language itself and less concerned about the availability of...
New
lessless
I believe there are people here who are dealing with CSV files import on the daily basis, and since Excel is a really popular tool there ...
New
bsollish-terakeet
Credo is smart enough to check for (something like) this: assert length(the_list) == 0 with this response: Checking if an enum is empt...
New
openscript
Hello! Sorry for this astonishing simple question, but I’m really stuck. I try to set up the intellij-elixir plugin, but I don’t know ho...
New
jerry
Good day to you all. I have been struggling to get a query involving like and ilike to work. Can anyone assist me on this, please? pro...
New
stefanluptak
Hello everybody, usually, I use a 29" ultra-wide monitor for VSCode which can easily accomodate explorer (files panel) + file with code ...
New
Codball
Mix format works fine if run from the cmd. I’ve followed this to facilitate the implementation into VSC which involves downloading an ext...
New
joeerl
Hello again - after a longish gap I’ve decided I really must dig into Elixir and see what’s been happening here - so I have a few questio...
New

Other popular topics Top

bsollish-terakeet
Credo is smart enough to check for (something like) this: assert length(the_list) == 0 with this response: Checking if an enum is empt...
New
malloryerik
Hi, this is for people who, like me, have had some friction using .html.heex templates in VSCode. The solution seems to be, in a hyphena...
New
KronicDeth
Elixir plugin for JetBrain’s IntelliJ Platform (including Rubymine) This is a plugin that adds support for Elixir to JetBrains IntelliJ...
289 35421 110
New
mcarvalho
What is the difference between System.get_env and Application.get_env? For example, what are best practices to use one versus another.
New
ashish173
I am using Ecto timestamps with postgres, I can see the timestamps() use the :naive_dateime but for my use case I wanted to store the ti...
New
alice
Hey, Just curious what are the main benefits of Elixir compared to Clojure? When is Elixir more useful than Clojure and vice versa? Th...
New
fayddelight
I tried installing elixir 1.11.2 erlang 23.3.4 via asdf in my zsh shell. Enabled the versions locally and globally. When I list them ...
New
msaraiva
Surface is an experimental library built on top of Phoenix LiveView and its new LiveComponent API that aims to provide a more declarative...
564 42633 214
New
ovidiubadita
Hey all, I discovered Elixir and I love it. I always wanted to learn a functional programming and I intended to go for Haskell, but afte...
New
josevalim
Hi everyone, One of the features added to Elixir early on to help integration with Erlang code was the idea of overridable function defi...
New

We're in Beta

About us Mission Statement