News>RFCs

GenAI and LLamaCPP nif - request for feedback

#ai#llamacpp
noizu

noizu

GenAI and LLamaCPP nif - request for feedback

Hello,

I wrote a more comprehensive llama_cpp nif wrapper noizu-labs-ml/ex_llama: (github.com) inspired by the unfortunately doa jeregrine/llama_cpp_ex (github.com) project.

So far its working pretty well and, fulfilled my temporarily dashed (due to issues with the llama_cpp_rs client the other project used) dream of loading local models into my multi provider/endpoint noizu-labs-ml/genai:(github.com) client wrapper.

This is my first time writting a nif and rust code though and if any experts have and constructive feedback i’d appreciate it. And if anyone has any thoughts/change/feature requests for the GenAI library.

I’ve been working with Elixir a long time but I’ve done to much lone wolf dev and my code isn’t as idiomatic as i’d like.

2024-04-12_182804
2024-04-12_1828041200×992 65.8 KB

2024-04-12_185023
2024-04-12_1850231647×591 53.6 KB

View thread on forum
#ai#llamacpp
4 292 0

Where Next?

View thread on forum
ai
llamacpp
Home News>RFCs
#ai#llamacpp
4 293 0
Last post

Popular in RFCs Top

dergraf
News>RFCs

Seeking thoughts on ProxyConf—An Elixir-Powered Control Plane for Envoyproxy
Hey everyone! :waving_hand: I’ve been working on a side project for the last 4 months that I’m excited to share—it’s called ProxyConf! P...
#api#devops#envoy
3 142 2
New
pepicrft
News>RFCs

Feedback on my first macro-based library - Modulex
Hey folks :wave: I implemented a library that uses macros extensively, and I’d appreciate feedback from people that are more versed at w...
#macros
11 493 2
New
wingyplus
News>RFCs

Redoc_ui_plug - A plug module to generate open api spec with Redoc
I just publish a library called redoc_ui_plug | Hex. The library renders Redoc UI from the openapi specification url. I used this library...
#openapi
5 966 0
New
felix-starman
News>RFCs

Library for parsing and building RFC-compliant* Content-Disposition headers
I’ve noticed that often when I find myself needing to manually set content-disposition - [MDN] the advice is usually to use URI.encode_ww...
/phoenix#plug#file-uploading#download#plugupload#file-downloading#multipart#uploads
2 711 2
New
noizu
News>RFCs

GenAI and LLamaCPP nif - request for feedback
Hello, I wrote a more comprehensive llama_cpp nif wrapper noizu-labs-ml/ex_llama: (github.com) inspired by the unfortunately doa jereg...
#ai#llamacpp
4 291 0
New
puemos
News>RFCs

Side-project: Overbooked is a self-hosted flexible workplace platform for indie coworking owners
Hey everyone :waving_hand: Code: GitHub - puemos/overbooked: Overbooked is a self-hosted flexible workplace platform for indie co-wor...
/phoenix#feedback#liveview#self-hosted
11 1161 6
New
ca1989
News>RFCs

Elmex - Phoenix and Elm proof of concept
Hi all, this week I played a bit with Phoenix and Elm. I ended up with this POC: https://github.com/carlotm/elmex The repository cont...
/phoenix#elm
5 544 3
New
Hedgehog-ai
News>RFCs

Bardo - neuroevolution (a powerful and underrated type of AI) through Elixir
Hello I would like feedback on an experimental neuroevolution (including substrate encoding) library called Bardo based on the amazing wo...
#neuroevolution
51 934 19
New
KristerV
News>RFCs

Hexdocs search engine for devs
How I currently use Hexdocs I use hexdocs all day every day, but finding the right module and function takes too long even with my bookma...
#search#hexdocs
140 4348 57
New
benlime
News>RFCs

A library for high performance LiveView animations
In the last couple of days I was playing around with LiveView, function components and animations. I ended up with a little prototype whi...
#liveview#animation
103 4329 16
New

Other popular topics Top

JDanielMartinez
Questions & Help>Questions

** (RuntimeError) could not lookup Ecto repo Repo because it was not started or it does not exist
Hi! May someone helps me, please! I have two apps into an umbrella project: the first one is Database, which manages queries, and the se...
#umbrella#testing#repo#runtimeerror
11 15040 14
New
peerreynders
Learning Resources>Chat/questions

Elixir Book & Learning Resources Sales / Discounts Thread
Manning 2016 Halloween weekend sale via Deal of the Day Friday, October 28 - Half off all MEAPs - code WM102816LT Saturday, October 29 ...
#discounts
326 29600 154
New
sergio
Questions & Help>Questions

Updating a field using Ecto one-liner?
In Ruby, I can go: User.find_by(email: "foobar@email.com").update(email: "hello@email.com") How can I do something similar in Elixir? ...
15 14579 3
New
vonH
Questions & Help>Questions

Why would I choose Elixir as a general purpose programming language?
In asking this question I am more interested about the expressiveness of the language itself and less concerned about the availability of...
#functional-programming#use-cases
65 34758 13
New
axelson
Chat & Discussions>Wikis

Emacs - Elixir Setup Configuration Wiki
This post is a wiki (feel free to hit the edit button near the bottom right of this post to add your own changes!) This post collects co...
#spacemacs#wiki#emacs#code-editors#language-server-protocol
239 45766 226
New
_russellb
Questions & Help>Questions

Web scraping tools
I want to try my hand at web scraping. What tools/libraries do I need to use. I’m hoping to turn this into something professional so don’...
#web-scraping
123 19127 45
New
Harrisonl
Questions & Help>Questions

Deploying Elixir into ECS causing many "'global' at node :"xxxxx@10.0.X.X" requested disconnect from node :"xxxx@10.0.X.X" in order to prevent overlapping partitions"
We have an ECS cluster with 4 services, where each task joins a single cluster, via discovery ECS discovery service. Currently when I de...
#deployment
2 85219 3
New
SoCreat
Questions & Help>Questions

What's the best ide/editor for elixir in 2021?
i’m a new one to elixir which editor can i use vs code? or atom? Thanks! :smiley:
#ide
68 37349 27
New
beno
Questions & Help>Questions

Pattern match with multiple match options
I will often find my self writing things similar to: case some_value do nil -> something() "" -> something() _ -> someth...
#pattern-matching#how-to-question
29 15490 6
New
romenigld
Questions & Help>Questions

Docker run Error loading shared library libstdc++.so.6 and libgcc_s.so.1
I am trying to run a deploy with docker and I successfully runned with this command: docker build -t romenigld/blog-prod . but when I t...
/phoenix#deployment#docker-compose
30 19932 15
New
Back to top

News>RFCs

News RFCs ❯

Latest on Elixir Forum

Elixir Forum ❯

Sponsor Spotlight

AppSignal

Catch errors, track performance, monitor hosts and more.

Our Sponsors

Dashbit

Build Elixir applications with speed and confidence.

EEF

Supporting innovation across the BEAM ecosystem.

Coders51

We build reliable cloud platforms for business-critical systems.

AppSignal

Catch errors, track performance, monitor hosts and more.

Pragmatic Bookshelf

Practical resources that improve the lives of professional developers.

ElixirCasts

Producing high quality Elixir screencasts since 2017.

Potions

The deployment platform built for Elixir: PaaS ease, VPS control.

Pragmatic Studio

Courses that'll move you from confusion to "Aha, now I get it!"

View all our sponsors ❯

Categories:

Sub Categories:

Forums

Our Sponsors

Dashbit

Build Elixir applications with speed and confidence.

EEF

Supporting innovation across the BEAM ecosystem.

Coders51

We build reliable cloud platforms for business-critical systems.

AppSignal

Catch errors, track performance, monitor hosts and more.

Pragmatic Bookshelf

Practical resources that improve the lives of professional developers.

ElixirCasts

Producing high quality Elixir screencasts since 2017.

Potions

The deployment platform built for Elixir: PaaS ease, VPS control.

Pragmatic Studio

Courses that'll move you from confusion to "Aha, now I get it!"

View all our sponsors ❯

We're in Beta

About us Mission Statement