martosaur
InstructorLite – structured outputs for LLMs, a tinkering-friendly fork of Instructor
Hello,
I’m excited to introduce InstructorLite – a fork of the Instructor package.
Instructor brought the very idea of structured LLM prompting to the Elixir ecosystem. InstructorLite is aimed to distill it into a composable set of simple tools that people can build upon.
What’s new in InstructorLite 0.1.0 compared to Instructor 0.0.5?
- More granular API for more flexibility
- Anthropic adapter
- Reduced source code complexity
- All streaming capabilities removed
- BYO json schema as an official policy. Schema converter is still there, but it’s best-effort
- Llamacpp adapter now uses JSON schema instead of GBNF grammar
- OpenAI adapter is reimplemented using brand new structured outputs instead of JSON mode (Introduction to Structured Outputs)
- Fixed Ecto 3.12 compatibility
It’s not a drop-in replacement, but it’s very close. Feel free to report any issues you run into if you decide to give it a try!
Hex: instructor_lite | Hex
Migration guide: Migrating from Instructor — instructor_lite v1.1.2
Repo:
Most Liked
martosaur
InstructorLite v1.0.0
- OpenAI adapter was changed to use Responses API.
- New ChatCompletionsCompatible adapter was added for people who want to continue using OpenAI Chat Completions endpoint or, as the name suggests, other chat completions compatible providers like Grok.
- Jason dependency is now optional. InstructorLite will use built-in JSON module if it’s available
- Some general housekeeping: more tests, revamped docs and cookbooks, standardized prompts across adapters, etc. All adapters were tested against reasoning models to verify reasoning tokens in output do not surprise them.
A very short migration guide: Changelog — instructor_lite v1.0.0
martosaur
Version 0.3.0 released featuring Gemini adapter 
igorb
Appreciate your work! I just returned to a project using Instructor today and bumped into the compatibility issue with Ecto 3.12. Tried the fork that attempted to fix it but it didn’t work (bummer that instructor doesn’t seem to be maintained anymore!). But migrating to instructor_lite was a breeze and everything works great now.
martosaur
martosaur
I looked into Ollama and the implementation would depend heavily on the underlying open source model, so I don’t believe it makes sense implementing a universal adapter. However, I went ahead and created an example cookbook on how to implement your own Ollama adapter. It pretty much includes a functional adapter for llama3.1 model
Popular in Announcing
Other popular topics
Latest on Elixir Forum
Sponsor Spotlight
Practical resources that improve the lives of professional developers. By developers, for developers.
Categories:
Sub Categories:
Forums
Our Sponsors
Build Elixir applications with speed and confidence.
Supporting innovation across the BEAM ecosystem.
We build reliable cloud platforms for business-critical systems.
Catch errors, track performance, monitor hosts and more.
Producing high quality Elixir screencasts since 2017.
Enabling companies to succeed by building software people love.
The deployment platform built for Elixir: PaaS ease, VPS control.
Courses that'll move you from confusion to "Aha, now I get it!"