devops: balance Playwright shards by duration#79479
Conversation
Right now, one of the shards takes ~25 minutes to complete, whereas others take 10-15 minutes. https://github.com/WordPress/gutenberg/actions/runs/28085764857?attempt=1&check_suite_focus=true This patch will shard tests by their historic duration, which should even out shards.
|
The following accounts have interacted with this PR and/or linked issues. I will continue to update these lists as activity occurs. You can also manually ask me to refresh this list by adding the If you're merging code through a pull request on GitHub, copy and paste the following into the bottom of the merge commit message. To understand the WordPress project's expectations around crediting contributors, please review the Contributor Attribution page in the Core Handbook. |
|
@Mamaduka The shard balancing algorithm works very well on our tests, and I'm eager to see how it'll perform for your suite. Could you please take a look? |
|
Oops, for the prs-from-forks, we can't authorize at the flakiness.io service to fetch historical durations. As a result, all bots fail. That's a bummer! We'll discuss how to accomodate this usecase with the team. @Mamaduka I've converted this to draft while we're figuring this out. |
Right now, one of the shards takes ~25 minutes to complete, whereas
others take 10-15 minutes.
https://github.com/WordPress/gutenberg/actions/runs/28085764857?attempt=1&check_suite_focus=true
This patch will shard tests by their historic duration, which should
even out shards.
Balanced sharding documentation: https://github.com/flakiness/playwright#balanced-sharding