Libraries & Projects>Libraries

Ex_confusables - an Unicode tr39 confusable detection and skeleton implementation

#unicode#confusable#skeleton
ColaCheng

ColaCheng

Ex_confusables - an Unicode tr39 confusable detection and skeleton implementation

Hi all,

I have made an unicode tr39 confusable detection and skeleton implementation, ex_confusables

This library is able to compare two strings if they are visually confusable as described in Unicode® Technical Standard #39: Both strings get transformed into a skeleton format before comparing them. The skeleton is generated by normalizing the string (NFD), replacing confusable characters, and normalizing the string again.

Also did some profiling between char list and binary string implementation. The interesting part is char list is faster than binary. The result is here.

Feel free to open any issues you encounter in the Github repo and try it!

Thank you!

7 comments
#unicode
8 981 7

Most Liked

ColaCheng

ColaCheng

I don’t know this rule. I just came out this name because it implement in Elixir. Good to know this convention! Thank you!

1
Post #3
AstonJ

AstonJ

I am not aware of such a convention (and the Hex or Elixir core teams may be better people to ask) however I do have some ideas about naming (related to another topic). Hopefully I will get a chance to post about it at some point :lol:

1
Post #7
Exadra37

Exadra37

I have not found a reference to my assumption in the forum yet, but I know that I read something about the use of “ex_” for library names and I think it was from Jose Valim itself, but probably I am mistaken in saying that was from him and on my affirmation, because I found this article:

https://medium.com/@toddresudek/hex-power-user-deb608e60935

When porting a library from another ecosystem, the tradition is to use the existing name, and prepend it with “ex_”, or less commonly, append “_ex”.

Sorry for my confusion in saying:

1
Post #8

Where Next?

View thread on forum (has 7 responses!)
unicode
confusable
skeleton
Home Libraries & Projects>Libraries
#unicode#confusable#skeleton
8 982 7
Last post

Popular in Libraries Top

tompave
Libraries & Projects>Libraries

FunWithFlags: a feature toggle library plus its web GUI as a Plug
Hello there, I would like to share a feature toggles library (AKA feature flags) I’ve been working on. The main package is FunWithFlags...
#funwithflags
47 4962 16
New
Crowdhailer
News>Announcing

Ace: HTTP/2 webserver
The latest release of Ace (0.10.0) includes serving content over HTTP/2. I have started writing a webserver to teach my self more about...
#erlang#web-frameworks#library#ace
60 7988 32
New
sasajuric
Libraries & Projects>Libraries

Boundary - enforcing boundaries in Elixir projects
I’d like to announce a small library called boundaries. This is an experimental project which explores the idea of enforcing boundaries ...
#boundaries
230 8813 49
New
praveenperera
Libraries & Projects>Libraries

FastRSS - A very quick RSS feed parser
FastRSS Parse RSS feeds very quickly: This is rust NIF built using rustler Uses the RSS rust crate to do the actual RSS parsing Speed...
#rust#rss#serde_rustler#rustler
43 4294 20
New
pkrawat1
Libraries & Projects>Libraries

Presenting Aviacommerce, open source e-commerce in Elixir
Presenting Aviacommerce, open source e-commerce platform in Elixir Aviacommerce is an open source e-commerce platform in Elixir. We at...
#aviacommerce#e-commerce
51 5792 11
New
aditya7iyengar
Libraries & Projects>Libraries

Rummage.Ecto - Searching, Sorting and Pagination in Ecto & Phoenix
Rummage.Ecto and Rummage.Phoenix provide ways to perform Searching, Sorting and Pagination over Ecto queries and Phoenix collections. Fo...
/phoenix#ecto#hex#library
34 5425 9
New
alisinabh
Libraries & Projects>Libraries

Jalaali (Shamsi) calendar for elixir (Persian calendar)
Hey everyone i’ve developed a library for Jalaali calendar for elixir which supports converting Gregorian dates to Jalaali and vice vers...
#jalaali
72 8178 39
New
msaraiva
Your Libraries & Projects>Libraries

Surface - A component-based library for Phoenix LiveView
Surface is an experimental library built on top of Phoenix LiveView and its new LiveComponent API that aims to provide a more declarative...
/phoenix#liveview#livecomponents#surface
564 42633 214
New
wojtekmach
Libraries & Projects>Libraries

Req — A batteries-included HTTP client for Elixir
Hey everyone! Req is an HTTP client for Elixir that I’ve been working on for quite some time. There is already a lot of HTTP clients out...
#http_client
196 10637 57
New
bluzky
Your Libraries & Projects>Libraries

SaladUI - Phoenix liveview components inspired by shadui
You may know https://ui.shadcn.com/, a UI component library for React. I really love it’s design style and components. I’ve built some co...
/phoenix#liveview#phoenix-live-view#phoenix_live_view#live-view#phoenix-liveview
381 12391 119
New

Other popular topics Top

lastday4you
Questions & Help>Questions

How to check Elixir version
I wanted to check elixir version in phoenix because i found that my elixir is 1.5 but when i use Enum.chunk_by it said the function is un...
#how-to-question
11 18647 3
New
stefanchrobot
Questions & Help>Questions

How to decode a JSON into a struct safely?
What’s the safe way to decode a JSON string into a struct? I want to avoid calling String.to_atom. Jason.decode can give me a map with st...
#structs#json
29 20780 26
New
chrismccord
News>Phoenix News

Phoenix v1.3.0-rc.0 released
As promised, the first release candidate of Phoenix 1.3.0 is out! This release focuses on code generators with improved project structure...
/phoenix#phoenix-release
434 29347 97
New
mgjohns61585
Questions & Help>Questions

Convert a string to an integer?
Could someone help me? I'm making my first elixir program, number guessing game. I can't figure out how to convert the user's guess from ...
#how-to-question
3 14200 6
New
chrisalley
Questions & Help>Questions

How to describe many contexts in ExUnit without a hierarchy
ExUnit now has describe blocks which is a welcome addition coming from RSpec. In the docs, it states that nested hierarchies of describe ...
#testing#exunit
66 16773 4
New
beno
Questions & Help>Questions

Pattern match with multiple match options
I will often find my self writing things similar to: case some_value do nil -> something() "" -> something() _ -> someth...
#pattern-matching#how-to-question
29 15490 6
New
Fl4m3Ph03n1x
Questions & Help>Questions

Learning Elixir, frst impressions ( plz don't kill me ! )
About me? ( if you have nothing better to do than reading about some random guy in the internet :stuck_out_tongue: ) Hello all, this is ...
#learning-elixir
371 25801 61
New
AstonJ
Learning Resources>Books

Functional Web Development with Elixir, OTP, and Phoenix (Pragprog)
by Lance Halvorsen Elixir and Phoenix are generating tremendous excitement as an unbeatable platform for building modern web application...
#book-functional-web-development-with-elixir-otp-and-phoenix#pragprog
460 27162 124
New
romenigld
Questions & Help>Questions

Docker run Error loading shared library libstdc++.so.6 and libgcc_s.so.1
I am trying to run a deploy with docker and I successfully runned with this command: docker build -t romenigld/blog-prod . but when I t...
/phoenix#deployment#docker-compose
30 19932 15
New
joeerl
Questions & Help>Questions

Upgrading Elixir - how to check versions, delete, and upgrade?
Hello again - after a longish gap I’ve decided I really must dig into Elixir and see what’s been happening here - so I have a few questio...
#upgrade
63 40940 13
New
Back to top

Libraries & Projects>Libraries

Libs/Projects Libraries ❯

Latest on Elixir Forum

Elixir Forum ❯

Sponsor Spotlight

ElixirCasts

Producing high quality Elixir screencasts since 2017.

Our Sponsors

Dashbit

Build Elixir applications with speed and confidence.

EEF

Supporting innovation across the BEAM ecosystem.

Coders51

We build reliable cloud platforms for business-critical systems.

AppSignal

Catch errors, track performance, monitor hosts and more.

Pragmatic Bookshelf

Practical resources that improve the lives of professional developers.

Manning

Develop your skills with books, videos, and courses.

WyewWorks

Enabling companies to succeed by building software people love.

Pragmatic Studio

Courses that'll move you from confusion to "Aha, now I get it!"

View all our sponsors ❯

Categories:

Sub Categories:

Forums

Our Sponsors

Dashbit

Build Elixir applications with speed and confidence.

EEF

Supporting innovation across the BEAM ecosystem.

Coders51

We build reliable cloud platforms for business-critical systems.

AppSignal

Catch errors, track performance, monitor hosts and more.

Pragmatic Bookshelf

Practical resources that improve the lives of professional developers.

Manning

Develop your skills with books, videos, and courses.

WyewWorks

Enabling companies to succeed by building software people love.

Pragmatic Studio

Courses that'll move you from confusion to "Aha, now I get it!"

View all our sponsors ❯

We're in Beta

About us Mission Statement