I think I’m going to have to listen to this a couple of times to distill all the info about ML+Elixir

The first 5 minutes has some really good info about some of the AI/ML stuff in the news right now too, specifically, how ChatGPT and Dalli aren’t open source even though they are from a company called ‘OpenAI’!!

Ha! I know! Ironic isn’t it. I found it Jose’s statement interesting about complex/advanced models potentially becoming so large that individuals couldn’t create, run or test them on the hardware we have.

It’s an interesting time for ML!

I wonder if someone has started a petition asking them to change it, or reported them to some standards authority as misleading… because it definitely is When I first visited their website my immediate thought was that it sounds cool because it appears to be open source. If you look at their charter it follows the same theme; they are trying very hard to come across as an ‘open’ (/open source) organisation. It makes me super suspicious

It is! And I was curious as well after I reached that part of the podcast.. so googled ‘best GPU for deep learning’, and it seems to be…

The NVIDIA A100

It has 80GB of RAM!

NVIDIA A100 is the world’s most advanced deep learning accelerator. It delivers the performance and flexibility you need to build intelligent machines that can see, hear, speak, and understand your world. Powered by the latest NVIDIA Ampere architecture, the A100 delivers up to 5x more training performance than previous-generation GPUs.

Not cheap at $13,999

How much for a full spec’d system?

$187K

_{(Disclaimer: nobody buy that system! I just added things to get an idea of cost, some of those items may not be necessary/ideal)}