markmark206
How do I test Livebooks in CI/CD?
I put together a Livebook that illustrates using a package. The Livebook has been a great addition to all the usual documentation, and great for showing folks how to use the package, and for making it easy to start playing with the package.
Just like with any code, I want to make sure to catch “regressions” in my Livebook, as early and as inexpensively as possible. Of course, I can always just execute my Livebook by hand, step by step, but that is an expensive and error-prone proposition (times the # of commits, times the # of Livebooks), and it would be great if my CI/CD system could do that for me automatically, doctest-style.
Which brings me to my question: are there patterns (or ideas for patterns) for testing Livebooks in CI/CD?
Thank you (and thank you for the great tool, Jonatan and José!),
Mark.
Marked As Solved
josevalim
There is no such option right now. Our goal is to have an export to Elixir script option, so you can get only the code out, and we can make it available via the command line. Then you can invoke it, execute it, and match on the result.
You should also be able to replicate this by getting the .livemd file and extracting the Elixir snippets. It shouldn’t be hard. 
Also Liked
mat-hek
Any progress on that? 
josevalim
Not yet but if someone wants to work on this, please let us know. 
thbar
Sharing a bit of feedback on this: I’m faced with an increasing number of situations where I have multiple livebooks in one repository, so brainstorming a bit how to ensure consistency at the PR, CI/CD level.
Typical needs I’m facing at the moment:
- ensuring that file paths are not broken (quite easy by parsing the
.livemd, but indeed a “–check” CLI option would be lovely) - ensuring that the code (some being shared between livebooks when it’s generic enough, some being specific) does not break (for this I currently extract livebooks code into proper components, and reduce the code present in the livebooks themselves to the minimum)
Happy to bounce ideas with others here!
Popular in Questions
Other popular topics
Latest Livebook Threads
Latest on Elixir Forum
Sponsor Spotlight
We build reliable cloud platforms for business-critical systems.
Categories:
Sub Categories:
Forums
Our Sponsors
Build Elixir applications with speed and confidence.
Supporting innovation across the BEAM ecosystem.
We build reliable cloud platforms for business-critical systems.
Catch errors, track performance, monitor hosts and more.
Develop your skills with books, videos, and courses.
Producing high quality Elixir screencasts since 2017.
Enabling companies to succeed by building software people love.
Courses that'll move you from confusion to "Aha, now I get it!"