matreyes

matreyes

LLM Coding Benchmark by language

I haven’t seen this paper being discussed by the community, but I think this makes Elixir more relevant than ever.

TLDR;

The paper was written by Tencent’s AI team.

Most Liked

vkryukov

vkryukov

Feels right to me. I don’t code much in other languages, but here are two recent anecdotes:

  1. Needed to build a simple utility to package certain files in my project with repomix, to upload it with GPT-5 Pro. Asked Claude Code Opus 4.1 to write a simple bash script. After a few iterations that were going nowhere (and produced an ever growing unreadable pile of bash), asked it to write it in Elixir - with the idea that at least I can read/understand it. It got it right from the first try, the code was much cleaner and easier to read.

  2. Needed to write a small utility to automate a workflow for image creation with Google’s Nano Banana. Since Google already has a Python library, decided to ask Codex to write it in Python. It made it work at the end, but after too many iterations, and the generated code is some unreadable mess. Decided to rewrite it in Elixir (and asked Codex to create a simple library to work with Google’s API in a process) - boom, much faster development cycle, and again, a cleaner code that I can actually maintain.

That was enough to convince me that even for small utilities, I should just reach straight for Elixir - somehow modern LLMs just write it better.

matreyes

matreyes

Additionally, I believe the reasons why Elixir enables LLMs to solve problems more effectively compared to other languages are the same reasons we appreciate Elixir for humans; it’s just more challenging to illustrate.

Where Next?

Popular in Discussions Top

rump13
Hi everyone, I’ve been following Elixir since around 2016 and tinkering with it on and off, but I haven’t had the opportunity to use it ...
New
jeramyRR
Is it really necessary for the compiler to spit out a warning about using @doc with private functions? I don’t want to have to document ...
New
NKTgLaw
Hello fellow BEAM enthusiasts, I’d like to introduce a conceptual idea I’ve been developing, which I call NKTg Law. It’s a physics-inspi...
New
Sergiusz
Hello everyone, I don’t know if my post is appropriate. If it isn’t, you can delete it. After a year of designing and defining the requ...
New
dogweather
I realized I could really use something like this in my Phoenix project: I asked Claude 4 Sonnet if a port exists - it said no, and ga...
New
Crowdhailer
It is rare to use direct calls to send in elixir. The call is normally wrapped in a function which is responsible for sending the correct...
New
AstonJ
A remark @Garrison made… ..has already inspired a thread for the technical side of reclaiming our internet, but there is of course anot...
New
ronindev
Hey everyone! :waving_hand: I just wanted to recommend https://seenode.com/ for deploying Phoenix apps. I’ve been using it recently and ...
New
gushonorato
Hey everyone, I’ve been working with Elixir for over 5 years and I’m a big enthusiast of the language. However, when starting new projec...
New
darkmarmot
At HCA Healthcare (500k employees and contractors), we’re currently experimenting with Elixir for both data integration (to handle parsin...
New

Other popular topics Top

William
I would like to know that is there any online source for learning Phoenix Framework for building E-Commerce Store? Any advantage on build...
New
sergio
I couldn’t find any guides that worked well with Phoenix 1.6.0 and esbuild. I hope this helps people test the waters and eases you into t...
New
jononomo
I am trying to figure out how Mix knows whether the environment is test, dev, or prod -- where is this set? Thanks.
New
stefanchrobot
What’s the safe way to decode a JSON string into a struct? I want to avoid calling String.to_atom. Jason.decode can give me a map with st...
New
freewebwithme
Using vs code and installed ElixirLS: support and debugger. And I got an error popped up on start up says Failed to run ‘elixir’ comma...
New
mcarvalho
What is the difference between System.get_env and Application.get_env? For example, what are best practices to use one versus another.
New
ashish173
I am using Ecto timestamps with postgres, I can see the timestamps() use the :naive_dateime but for my use case I wanted to store the ti...
New
qwerescape
Is there a way to get the call stack or stack trace at any point in the code? Not from exceptions, but an expression that returns how the...
New
lucidguppy
I have a super simple question about elixir - how would I take a file like this foo bar baz and output a new file that enumerates th...
New
TunkShif
This post is an instruction guide to help you setup your Neovim for Elixir development from scratch. It includes general information on h...
273 38985 115
New

We're in Beta

About us Mission Statement