News>RFCs

GenAI and LLamaCPP nif - request for feedback

#ai#llamacpp
noizu

noizu

GenAI and LLamaCPP nif - request for feedback

Hello,

I wrote a more comprehensive llama_cpp nif wrapper noizu-labs-ml/ex_llama: (github.com) inspired by the unfortunately doa jeregrine/llama_cpp_ex (github.com) project.

So far its working pretty well and, fulfilled my temporarily dashed (due to issues with the llama_cpp_rs client the other project used) dream of loading local models into my multi provider/endpoint noizu-labs-ml/genai:(github.com) client wrapper.

This is my first time writting a nif and rust code though and if any experts have and constructive feedback i’d appreciate it. And if anyone has any thoughts/change/feature requests for the GenAI library.

I’ve been working with Elixir a long time but I’ve done to much lone wolf dev and my code isn’t as idiomatic as i’d like.

2024-04-12_182804
2024-04-12_1828041200×992 65.8 KB

2024-04-12_185023
2024-04-12_1850231647×591 53.6 KB

View thread on forum
#ai#llamacpp
4 292 0

Where Next?

View thread on forum
ai
llamacpp
Home News>RFCs
#ai#llamacpp
4 293 0
Last post

Popular in RFCs Top

christhekeele
News>RFCs

Library for runtime application configuration—interested?
TL;DR: I’m planning on building a library, inspired by Vapor, to make configuring Elixir applications more straight-forward; in an approa...
#library#deployment#configuration#runtime
56 2314 38
New
pepicrft
News>RFCs

Feedback on my first macro-based library - Modulex
Hey folks :wave: I implemented a library that uses macros extensively, and I’d appreciate feedback from people that are more versed at w...
#macros
11 493 2
New
tiagodavi
News>RFCs

Ex4j - Ecto with the Bolt protocol + an elegant DSL for Neo4J databases
I’ve just created and published my first Elixir library! Ex4j combines the power of Ecto schema with the Bolt protocol + an elegant DSL ...
#graphs
16 724 2
New
wingyplus
News>RFCs

Redoc_ui_plug - A plug module to generate open api spec with Redoc
I just publish a library called redoc_ui_plug | Hex. The library renders Redoc UI from the openapi specification url. I used this library...
#openapi
5 966 0
New
dergraf
News>RFCs

Seeking thoughts on ProxyConf—An Elixir-Powered Control Plane for Envoyproxy
Hey everyone! :waving_hand: I’ve been working on a side project for the last 4 months that I’m excited to share—it’s called ProxyConf! P...
#api#devops#envoy
3 142 2
New
miolini
News>RFCs

Seeking feedback for 2D drawing library CanvasCraft
Hi :waving_hand: I’ve been working on CanvasCraft, a 2D drawing library for Elixir built on top of Skia via Rustler. It provides a decla...
#graphics#2d-graphics
11 107 0
New
zachallaun
News>RFCs

Working on lib_elixir - Elixir core modules as a library
Note: There are a few folks I’d really love to hear from, time permitting. Pinging in case the title isn’t catchy enough :slight_smile: @...
#metaprogramming#standard-library
40 1092 23
New
zachallaun
News>RFCs

Feedback wanted: Authorization library with composable Ecto queries
Hi friends, I wanted an authorization utility for an existing project I’m working on where I have a fair amount of permissions logic dup...
/phoenix#ecto#authorization
7 1167 11
New
laibulle
News>RFCs

Quant - a library to play with quantitative finance
Hello, I am playing with quantitative finance with Elixir. This library is more a way for me to explore and learn in this area and especi...
/nx#library#fintech#kino-explorer
9 234 3
New
benlime
News>RFCs

A library for high performance LiveView animations
In the last couple of days I was playing around with LiveView, function components and animations. I ended up with a little prototype whi...
#liveview#animation
103 4329 16
New

Other popular topics Top

9mm
Questions & Help>Questions

Elixir way to conditionally update a map
I am constructing a JSON object (map) and I need to conditionally set a field. I’m trying to write proper elixir-way code… and I’m at a l...
#maps
55 19905 29
New
freewebwithme
Questions & Help>Questions

Failed to run 'elixir' command error in vs code
Using vs code and installed ElixirLS: support and debugger. And I got an error popped up on start up says Failed to run ‘elixir’ comma...
#vscode#elixir-ls
48 15871 39
New
minhajuddin
Questions & Help>Questions

Using List.first instead of Enum.at(0)
I have seen a lot of code which picks the first element from a list using Enum.at(0) instead of List.first. Is there a reason why people ...
#code-style
76 33273 14
New
chrismccord
News>Phoenix News

Phoenix 1.4.0 released!
Phoenix 1.4.0 released Phoenix 1.4 is out! This release ships with exciting new features, most notably with HTTP2 support, improved deve...
/phoenix#phoenix-release
688 30048 115
New
pmjoe
Questions & Help>Questions

What do you think of Gleam compared to Elixir?
I have a relationship of love and hate with Elixir. Lots of things are just absolutely right, but there are some things that are kind of ...
#programminguages#gleam
24 16555 10
New
vonH
Questions & Help>Questions

Why would I choose Elixir as a general purpose programming language?
In asking this question I am more interested about the expressiveness of the language itself and less concerned about the availability of...
#functional-programming#use-cases
65 34758 13
New
sergio_101
Questions & Help>Questions

Pattern matching against a string
I am VERY much an elixir newbie. I have taken one elixir course and one phoenix course on Udemy. During that course, I saw the instructor...
#pattern-matching
27 26685 14
New
myronmarston
Questions & Help>Questions

Typespecs - best way to spec keyword lists?
The Elixir Typespec docs show the following syntax for keyword lists in typespecs: # ... | [key: type] # keyword lis...
#dialyzer
52 14258 3
New
mcarvalho
Questions & Help>Questions

System.get_env vs. Application.get_env
What is the difference between System.get_env and Application.get_env? For example, what are best practices to use one versus another.
#environment
13 17021 6
New
fireproofsocks
Questions & Help>Questions

Ecto delete a record WITHOUT selecting first
Forgive me if this is obvious, but how does one delete a database record WITHOUT selecting it first? https://hexdocs.pm/ecto/Ecto.Repo.h...
#ecto#optimization#delete-method
22 16810 8
New
Back to top

News>RFCs

News RFCs ❯

Latest on Elixir Forum

Elixir Forum ❯

Sponsor Spotlight

Pragmatic Bookshelf

Practical resources that improve the lives of professional developers. By developers, for developers.

Our Sponsors

Dashbit

Build Elixir applications with speed and confidence.

EEF

Supporting innovation across the BEAM ecosystem.

Coders51

We build reliable cloud platforms for business-critical systems.

AppSignal

Catch errors, track performance, monitor hosts and more.

Manning

Develop your skills with books, videos, and courses.

ElixirCasts

Producing high quality Elixir screencasts since 2017.

WyewWorks

Enabling companies to succeed by building software people love.

Pragmatic Studio

Courses that'll move you from confusion to "Aha, now I get it!"

View all our sponsors ❯

Categories:

Sub Categories:

Forums

Our Sponsors

Dashbit

Build Elixir applications with speed and confidence.

EEF

Supporting innovation across the BEAM ecosystem.

Coders51

We build reliable cloud platforms for business-critical systems.

AppSignal

Catch errors, track performance, monitor hosts and more.

Manning

Develop your skills with books, videos, and courses.

ElixirCasts

Producing high quality Elixir screencasts since 2017.

WyewWorks

Enabling companies to succeed by building software people love.

Pragmatic Studio

Courses that'll move you from confusion to "Aha, now I get it!"

View all our sponsors ❯

We're in Beta

About us Mission Statement