sashaafm

sashaafm

Nomad - Create cloud portable Elixir and Phoenix apps. Write once, use everywhere!

Hello everyone, this is a project I’ve been working for my Master’s Thesis for the last few months (since December roughly). It’s an SDK for the cloud that also has deployment capabilites. The project can be seen here Nomad at GitHub

Nomad

Create cloud portable Elixir and Phoenix apps. Write once, use everywhere!

What is the Nomad Project?

Nomad is an Open-Source API for Elixir that enables developer to use the most popular cloud providers interchangeabily at will without having to change any of their code. Nomad provides generic API’s for cloud services (mainly Virtual Machines, Storage, SQL and JSON datastores). These API’s offer the most useful features and functionalities that are common across the same kind of service between cloud providers. They are meant to be simple and user friendly. This enables applications to be portable and allows the migration of applications from one provider to the next.

Moreso Nomad offers Mix Tasks for automatic management of cloud resources for your application. Need a SQL database in the Cloud for your application? Create it and automatically configure your app to use the one you just created. Want to host your Phoenix app in the Cloud? Launch a Virtual Machine through Nomad Mix Tasks and let it automatically deploy a production release of your app in said VM.

This project is my subject for my Master’s Thesis but once it’s delivered it will be a pure Open Source application.

Disclaimer: Nomad is under heavy development and is prone to changes

What are the use cases for Nomad?

The main goal of the Nomad project is to defeat Cloud Vendor Lock-in in the Elixir ecosystem. With the rise in popularity of cloud services Elixir users should not be restricted to one provider and should be able to make the most out of Cloud Computing. Some of the identified use cases are the following (but there are many more):

  1. You’re using S3 storage for a Phoenix application but a few months later Google has better pricing? Just let Nomad automatically copy your whole S3 bucket to a Google Storage bucket and relaunch the app with Google configurations.
  2. Recently got a new userbase in a remote region? Launch a new Virtual Machine with your application in the closest available region.
  3. Need a powerful SQL database but you’re not really knowledgeable in Cloud related affairs? Just use Nomad’s user friendly API and it will get done in a jiffy!

How is this achieved?

Nomad takes a lot of inspiration from Ecto and uses adapters in a similar fashion. First and foremost the needed API functions are identified based on what the cloud providers’ APIs have to offer and on what are the most recurring use cases and used functionalities. From this a general Elixir Behaviour is defined. These Behaviours must be implemented by each provider’s adapter.

Each adapter will implement the APIs for each cloud service (Virtual Machines, SQL, Storage and Datastore). Upon starting up an application a simple config in the desired environment config is needed - mainly cloud account credentials and a key to identify the chosen provider.

Finally through macros and metaprogramming, the adapters logic will be generated for the Nomad main modules (VirtualMachines, SQL, Storage and Datastore modules).

Roadmap

SDK

  • [x] Storage API
  • [x] SQL API
  • [ ] Virtual Machines API
  • [ ] Datastore API
  • [ ] Friendly Mode and Full Control Mode (return parsed response vs. complete HTTP response)

Mix Tasks/Deployment Tool

  • [x] Database Listing
  • [x] Database Creation
  • [x] Database Deletion
  • [x] Database Reboot
  • [ ] Automatic Deployment
  • [ ] Virtual Machine Creation
  • [ ] Virtual Machine Reboot
  • [ ] Virtual Machine Deletion
  • [ ] Storage Creation
  • [ ] Storage Deletion

Most Liked

sashaafm

sashaafm

Nomad has just been updated with the Virtual Machines API. You can now interact with Google Compute Engine and Amazon EC2 interchangeably!

Qqwy

Qqwy

TypeCheck Core Team

This looks so amazing.

Once my application becomes deploy-ready I’ll definitely try it out.

What a wonderful idea!

:slight_smile:

sashaafm

sashaafm

I’ve updated the README with better descriptions and with links for tutorials.

The tutorials can be found here.

greyhwndz

greyhwndz

Hmm. This looks interesting @sashaafm

sashaafm

sashaafm

@greyhwndz Hi! I’ve been working really hard on it. It’s my baby right now ahah. Could you please give me some insight on why you find it interesting? I’ve been looking for feedback from other developers.

Right now I’m doing the API for virtual machines. It’s been a bit more difficult than the other APIs but it’s doable. After that I’ll work on one for datastorage (JSON).

Ultimately my goal for my demo at university will be to apply it to a web app I’m working on in my internship and show how I can migrate from AWS to Google and back without code changing. Even for people not interested in migrating this library will be useful for regular cloud interaction since it leverages the most relevant use cases from the cloud services.

I’m also thinking about building Mix Tasks like for automatic deploying prod releases on cloud VM’s created on the fly and other things like creating a database in the cloud for usage with Ecto, etc… (I’ve actually built some of these but they still need to be better tested).

It’s been quite interesting. Specially since 6 months ago I barely knew how the Cloud worked. I’ve been learning a ton.

Where Next?

Popular in Libraries Top

hpopp
After just over two years in development, this latest version of Pigeon is what I finally consider done in regards to my original vision ...
New
tompave
Hello there, I would like to share a feature toggles library (AKA feature flags) I’ve been working on. The main package is FunWithFlags...
New
sasajuric
I’d like to announce a small library called boundaries. This is an experimental project which explores the idea of enforcing boundaries ...
New
mbuhot
Leverage Open Api 3.0 (Swagger) to document, test, validate and explore your Plug and Phoenix APIs. Generate and serve a JSON Open API ...
New
michalmuskala
Hello everybody. I have just released Jason - a new JSON library. You might be wondering, why do we need a new library? The primary foc...
New
Jskalc
Hi! Today, after a couple weeks of development I’ve released v0.1 of LiveVue. It’s a seamless integration of Vue and Phoenix LiveView, i...
New
zorbash
I created Kitto a framework for dashboards inspired by Dashing. [demo] The distributed characteristics of Elixir and the low memory foo...
New
tmbb
PhoenixWS - Websockets over Phoenix Channels Source code on Github here: https://github.com/tmbb/phoenix_ws Phoenix channels are a great...
New
vic
Expat is a tiny experiment I did for extracting patterns and being able to reuse them (compose and share patterns between elixir librarie...
New
mischov
import Meeseeks.CSS html = HTTPoison.get!("https://news.ycombinator.com/").body for story <- Meeseeks.all(html, css("tr.athing")) do...
New

Other popular topics Top

senggen
Erlang/OTP 25 [erts-13.2.2] [source] [64-bit] [smp:8:8] [ds:8:8:10] [async-threads:1] 15:22:35.803 [error] gen_event {lager_file_backend...
New
dotdotdotPaul
Okay, I'm having a heck of a time trying to figure out how to best handle the validation of belongs_to associations in Ecto. I'm sure I'...
New
JorisKok
I have a server on AWS, and was running a load test using artillery. When looking at the Phoenix dashboard I see the Ports going to 100% ...
New
axelson
This post is a wiki (feel free to hit the edit button near the bottom right of this post to add your own changes!) This post collects co...
239 45766 226
New
New
lastday4you
I wanted to check elixir version in phoenix because i found that my elixir is 1.5 but when i use Enum.chunk_by it said the function is un...
New
vac
Hi, I'm quite new in Elixir and I'm trying to format a string to a PEM format. I have the certificate value like MIIDBTCCAe2...... and ...
New
shahryarjb
Hello, I have map which I want to convert it to string like this: the map: %{last_name: "tavakkoli", name: "shahryar"} the string I ne...
New
beno
I will often find my self writing things similar to: case some_value do nil -> something() "" -> something() _ -> someth...
New
skosch
To my knowledge, put_in, Map.update etc. all have the one limitation of not automatically creating intermediate keys when needed (for exa...
New

Sub Categories:

We're in Beta

About us Mission Statement