elikim
How to measure execution time for Oban Chunks?
Hi!
I’m running some benchmarks and trying to see how long it takes a job to complete in chunked jobs. I’m running this query
select AVG(completed_at - attempted_at) AS average_duration, PERCENTILE_CONT(0.5) WITHIN GROUP (ORDER BY completed_at - attempted_at) AS median_duration
from oban_jobs
where worker = 'MyWorker'
which I think would accurately show the execution time of a single job but it’s showing some surprising results (55s - 62s when the expectation is around a second). Do you have any suggestions on how to find the execution time of a single job in a chunk?
Thanks!
Eli
Marked As Solved
sorenone
Hello,
Measuring the time for a single job won’t be meaningful for a chunk. Instead, we group by chunk.
Each chunk has a leader and that’s recorded in the attempted_by column. So, here is how you could do it based on the query you sent:
with chunk_durations as (
select max(completed_at) - min(attempted_at) as duration, attempted_by as chunk
from oban_jobs
where state = 'completed' and worker = 'MyWorker'
group by attempted_by
)
select avg(duration) from chunk_durations;
The state is set to completed to prevent measuring the in-progress chunks.
Hope this helps!
Popular in Questions
Other popular topics
Latest on Elixir Forum
Sponsor Spotlight
Producing high quality Elixir screencasts since 2017.
Categories:
Sub Categories:
Forums
Our Sponsors
Build Elixir applications with speed and confidence.
Supporting innovation across the BEAM ecosystem.
We build reliable cloud platforms for business-critical systems.
Catch errors, track performance, monitor hosts and more.
Practical resources that improve the lives of professional developers.
Develop your skills with books, videos, and courses.
The deployment platform built for Elixir: PaaS ease, VPS control.
Courses that'll move you from confusion to "Aha, now I get it!"