uranther
Scalable Web Architecture and Distributed Systems - General Discussion, Blog Posts, Wiki
Distributed Systems
What distributed systems theory should a distributed systems engineer know?
- Distributed systems theory for the distributed systems engineer
- Scalable Web Architecture and Distributed Systems
- What We Talk about When We Talk about Distributed Systems (video/presentation) – from a core developer of RabbitMQ
- Design Patterns for Container-based Distributed Systems - Brendan Burns and David Oppenheimer, Google
Research Papers
Reactive Programming
Scalable Web Architecture
Data Pipeline
- Using logs to build a solid data infrastructure (or: why dual writes are a bad idea)
- The Log: What every software engineer should know about real-time data’s unifying abstraction
A system that assumes an external log is present allows the individual systems to relinquish a lot of their own complexity and rely on the shared log. Here are the things I think a log can do:
- Handle data consistency (whether eventual or immediate) by sequencing concurrent updates to nodes
- Provide data replication between nodes
- Provide “commit” semantics to the writer (i.e. acknowledging only when your write guaranteed not to be lost)
- Provide the external data subscription feed from the system
- Provide the capability to restore failed replicas that lost their data or bootstrap new replicas
- Handle rebalancing of data between nodes.
- Making Sense of Stream Processing
- Questioning the Lambda Architecture
- Netflix’s Data Pipeline with Steven Wu [podcast]
- Designing for Massive Scalability at Backtype [slide deck]
Resilient services
Most Liked
mkunikow
- reactivemanifesto
-
reactive streams -> this is something related to Java VM but the main idea is the you have producer and consumer over network with back pressure (the speed can adapt during time to producer and consumer). This help eliminate big buffer or loosing data if buffer is full -> Assume you could add something like this to phoenix channel
http://softwareengineeringdaily.com/2016/05/18/netflixs-data-pipeline-steven-wu/
####Key Requirements for Streaming Platforms: A Micro-Services Advantage - Whiteboard Walkthrough
3
Popular in Wikis
This post is a wiki (feel free to hit the edit button near the bottom right of this post to add your own changes!)
This post collects co...
New
Hi people, since the new year is coming, I’d like to plan my travels for events in 2017.
So, what events (Elixir or FP related) that you...
New
It was stated at https://github.com/elixir-lang/elixir/issues/6172 that Mirrors of the primary Elixir website would be useful since Cloud...
New
Wonder if we can compile a list of learning resources, blog posts, talks, threads etc to help those who are just learning about Contexts....
New
Popular Elixir Packages
List of popular Atom.io Elixir Packages. These can be installed via atom’s package center or a command line with ...
New
This is a wiki - anyone at Trust Level 1 or higher can help keep it updated.
Elixir Pocket Syntax
Uncommon Logical stuff of Elixir modul...
New
A wiki for Doom Emacs
Doom is a configuration framework for GNU Emacs. It focuses on performance and customizability. It can be a founda...
New
Guide
Using an iPad for web development can be easily split into two main parts:
Setting up the iPad as a thin client
Working in a remo...
New
Introduction
Now that the language is picking up support and maturing nicely, I’d like to start a collection of common and recurring Elix...
New
Hi and Hello Every Elixirian.
After Learning the Elixir basics, I struck then. I have no idea of how to put my Elixir Knowledge in pract...
New
Other popular topics
Update:
How to use the Blogs & Podcasts section
You can post links to your blog posts or podcasts either in one of the Official Blog...
New
As the title describes, I’m trying to run Enum.map() over a list of key/value pairs, where the value is a map. My data looks like this:
...
New
How to set Jason to encode all fields in ecto schema, I don’t care about security and implementing only is taking long list of attributes...
New
Hi,
I'm quite new in Elixir and I'm trying to format a string to a PEM format. I have the certificate value like MIIDBTCCAe2...... and ...
New
The Elixir Typespec docs show the following syntax for keyword lists in typespecs:
# ...
| [key: type] # keyword lis...
New
ExUnit now has describe blocks which is a welcome addition coming from RSpec. In the docs, it states that nested hierarchies of describe ...
New
After calling mix ecto.create I get this error:
17:00:32.162 [error] GenServer #PID<0.412.0> terminating
** (Postgrex.Error) FATAL...
New
I am constructing a JSON object (map) and I need to conditionally set a field. I’m trying to write proper elixir-way code… and I’m at a l...
New
Elixir appears to be a superior language to Python. I don’t see any advantage of Python over Elixir. Are there any?
New
Why is it that the mnesia database isn’t the most preferred database for use in Elixir/Phoenix?
New
Latest on Elixir Forum
Sponsor Spotlight
Supporting innovation across the BEAM ecosystem.
Categories:
Sub Categories:
Forums
Our Sponsors
Build Elixir applications with speed and confidence.
Supporting innovation across the BEAM ecosystem.
We build reliable cloud platforms for business-critical systems.
Catch errors, track performance, monitor hosts and more.
Develop your skills with books, videos, and courses.
Producing high quality Elixir screencasts since 2017.
Enabling companies to succeed by building software people love.
Courses that'll move you from confusion to "Aha, now I get it!"