calebjosue
How is the LLM scene with Elixir/Phoenix?
What sort of libraries are available to integrate LLMs into your Phoenix Web Framework applications? e.g. Mistral, since these guys have available these endpoints, I was thinking to just consume those within the app. But I rather post my question, I know one or two things of LangChain, but there is only support for Python and JavaScript.
Thanks!
Most Liked
jam
There seem to be a number of libraries. I haven’t explored them in depth but here’s a sampling:
Depends on your needs. Some advocate for just using Req and a GenServer.
olivermt
100% reqllm best option imo.
Simply because it is dead simple to alter yourself.
mikehostetler
Each of these libraries tackles the problem in slightly different ways.
I’m the author of ReqLLM, so I’m a bit biased - but I built it because the more advanced use cases I started building with LLMs, I needed lower-level control.
That said, Langchain is focused on higher level use cases such as chaining - which ReqLLM will not be implementing.
mindreader
I started rolling my own. But reqllm is exactly what I I was shooting for but way better in every way, so I guess I’ll just start using that instead.
Popular in Dev Env & Tools
Other popular topics
Latest Phoenix Threads
Latest on Elixir Forum
Sponsor Spotlight
Enabling companies to succeed by building software people love.
Categories:
Sub Categories:
Forums
Our Sponsors
Build Elixir applications with speed and confidence.
Supporting innovation across the BEAM ecosystem.
We build reliable cloud platforms for business-critical systems.
Catch errors, track performance, monitor hosts and more.
Producing high quality Elixir screencasts since 2017.
Enabling companies to succeed by building software people love.
The deployment platform built for Elixir: PaaS ease, VPS control.
Courses that'll move you from confusion to "Aha, now I get it!"