Being able to compare two (or more) Check runs within Checkly would be nice to troubleshoot certain things.
F.e.:
We have someone whos checkruntimes got higher. E.g. before it took 10s to run, now it needs 20s, without any change within the playwright test itself or the infrastructure around the application.
Right now he has to put the two runs into two browser windows and compare them step by step to see which step took longer.
Having a kind of comparison window, where you could select the two different runs from the same check and see the difference between them would be nice to quickly catch the differences.
Maybe select one as the “baseline” and the other as the “to compare” run and have it write the difference on the “to compare” run with most interested metrics. For example have the “to compare” show on first step +2s runtime, second step +0.5s runtime, etc. pp.
If its also possible to compare drilldown metrics, like show network errors on the “to compare” run that were not found on the “baseline” run or the other way around, would obviously be very nice as well.
Very low priority though, just a quality of life feature request.
If you need some more insights and maybe talk to the one that channeld the Feature Request through me, see the checks, etc. hit me up on google chat :)
Please authenticate to join the conversation.
In Review
💡 Feature Request
7 months ago

Joshua Bitterberg
Get notified by email when there are changes.
In Review
💡 Feature Request
7 months ago

Joshua Bitterberg
Get notified by email when there are changes.