Skip to content

[Phase 6] Report E2E results to GitHub#363

Merged
kieran-osgood-shopify merged 1 commit into
mainfrom
kieran-osgood/e2e-browserstack/phase-6-github-reporting
Jul 10, 2026
Merged

[Phase 6] Report E2E results to GitHub#363
kieran-osgood-shopify merged 1 commit into
mainfrom
kieran-osgood/e2e-browserstack/phase-6-github-reporting

Conversation

@kieran-osgood-shopify

@kieran-osgood-shopify kieran-osgood-shopify commented Jun 29, 2026

Copy link
Copy Markdown
Contributor

Stack Context

This is Phase 6 of the BrowserStack Maestro E2E stack for Checkout Kit, stacked on BrowserStack Maestro execution.

Parent issue: https://github.com/shop/issues-checkout-kit/issues/1100
Epic: https://github.com/shop/issues-checkout-kit/issues/1084

Why?

Developers should not need to search BrowserStack manually to understand a failed E2E run. Failures should link directly to the actionable artifacts, while green runs should avoid comment noise.

What?

Adds GitHub reporting for E2E results:

  • sticky PR failure comment with a marker
  • failure-only PR comment behavior
  • actionable failure markdown with device selector, resolved device, suite path, BrowserStack build URL, video, screenshots, Maestro commands/logs, device logs, and network logs
  • Bitrise report workflow wiring

Results

When one suite is failing
image

image

After fixing all the tests you'll see the workflow update the comment

image.png

@kieran-osgood-shopify kieran-osgood-shopify force-pushed the kieran-osgood/e2e-browserstack/phase-5-browserstack-maestro branch from 1646c03 to d99cf73 Compare June 29, 2026 16:04
@kieran-osgood-shopify kieran-osgood-shopify force-pushed the kieran-osgood/e2e-browserstack/phase-6-github-reporting branch from 33b81d9 to dc1c907 Compare June 29, 2026 16:04
@kieran-osgood-shopify kieran-osgood-shopify force-pushed the kieran-osgood/e2e-browserstack/phase-5-browserstack-maestro branch from d99cf73 to eebe02d Compare June 29, 2026 16:38
@kieran-osgood-shopify kieran-osgood-shopify force-pushed the kieran-osgood/e2e-browserstack/phase-6-github-reporting branch 2 times, most recently from ea86286 to e791f00 Compare June 29, 2026 17:01
@kieran-osgood-shopify kieran-osgood-shopify force-pushed the kieran-osgood/e2e-browserstack/phase-5-browserstack-maestro branch 2 times, most recently from 8bc166b to 07c670c Compare June 29, 2026 17:33
@kieran-osgood-shopify kieran-osgood-shopify force-pushed the kieran-osgood/e2e-browserstack/phase-6-github-reporting branch from e791f00 to 3545355 Compare June 29, 2026 17:33
@kieran-osgood-shopify kieran-osgood-shopify force-pushed the kieran-osgood/e2e-browserstack/phase-5-browserstack-maestro branch from 07c670c to ffa1eee Compare June 29, 2026 17:53
@kieran-osgood-shopify kieran-osgood-shopify force-pushed the kieran-osgood/e2e-browserstack/phase-6-github-reporting branch 2 times, most recently from 9bcd74d to 64cf7a4 Compare July 1, 2026 09:54
@kieran-osgood-shopify kieran-osgood-shopify force-pushed the kieran-osgood/e2e-browserstack/phase-5-browserstack-maestro branch 2 times, most recently from 31464ab to e3e8eba Compare July 1, 2026 10:07
@kieran-osgood-shopify kieran-osgood-shopify force-pushed the kieran-osgood/e2e-browserstack/phase-6-github-reporting branch 2 times, most recently from 3895dbe to 9a25f02 Compare July 1, 2026 10:40
@kieran-osgood-shopify kieran-osgood-shopify force-pushed the kieran-osgood/e2e-browserstack/phase-5-browserstack-maestro branch from e3e8eba to 69ba295 Compare July 1, 2026 10:40
@kieran-osgood-shopify kieran-osgood-shopify force-pushed the kieran-osgood/e2e-browserstack/phase-6-github-reporting branch from 9a25f02 to 8477810 Compare July 1, 2026 11:26
@kieran-osgood-shopify kieran-osgood-shopify force-pushed the kieran-osgood/e2e-browserstack/phase-5-browserstack-maestro branch 2 times, most recently from 6484336 to 05c783c Compare July 1, 2026 11:43
@kieran-osgood-shopify kieran-osgood-shopify force-pushed the kieran-osgood/e2e-browserstack/phase-6-github-reporting branch from 8477810 to 3399b8d Compare July 1, 2026 11:43
@kieran-osgood-shopify kieran-osgood-shopify force-pushed the kieran-osgood/e2e-browserstack/phase-5-browserstack-maestro branch from 05c783c to 5153e7b Compare July 1, 2026 13:41
@kieran-osgood-shopify kieran-osgood-shopify force-pushed the kieran-osgood/e2e-browserstack/phase-6-github-reporting branch from 3399b8d to 9bdcf35 Compare July 1, 2026 13:41
@kieran-osgood-shopify kieran-osgood-shopify force-pushed the kieran-osgood/e2e-browserstack/phase-5-browserstack-maestro branch from 94b3cbf to 99235c3 Compare July 2, 2026 14:26
@kieran-osgood-shopify kieran-osgood-shopify force-pushed the kieran-osgood/e2e-browserstack/phase-6-github-reporting branch 2 times, most recently from 5b48786 to 7942882 Compare July 2, 2026 15:18
@kieran-osgood-shopify kieran-osgood-shopify force-pushed the kieran-osgood/e2e-browserstack/phase-5-browserstack-maestro branch 2 times, most recently from 7575385 to f3c8201 Compare July 2, 2026 15:35
@kieran-osgood-shopify kieran-osgood-shopify force-pushed the kieran-osgood/e2e-browserstack/phase-6-github-reporting branch from 7942882 to 7d6f887 Compare July 2, 2026 15:35
@kieran-osgood-shopify kieran-osgood-shopify force-pushed the kieran-osgood/e2e-browserstack/phase-5-browserstack-maestro branch from f3c8201 to 7df9c1f Compare July 3, 2026 09:53
@kieran-osgood-shopify kieran-osgood-shopify force-pushed the kieran-osgood/e2e-browserstack/phase-6-github-reporting branch from 7d6f887 to 06005bc Compare July 3, 2026 09:53
@kieran-osgood-shopify kieran-osgood-shopify force-pushed the kieran-osgood/e2e-browserstack/phase-6-github-reporting branch from 06005bc to 8e949ef Compare July 6, 2026 08:33
@kieran-osgood-shopify kieran-osgood-shopify force-pushed the kieran-osgood/e2e-browserstack/phase-5-browserstack-maestro branch from 7df9c1f to 007ea6b Compare July 6, 2026 08:33
@kieran-osgood-shopify kieran-osgood-shopify force-pushed the kieran-osgood/e2e-browserstack/phase-6-github-reporting branch from 8e949ef to df9ceff Compare July 6, 2026 11:18
@kieran-osgood-shopify kieran-osgood-shopify force-pushed the kieran-osgood/e2e-browserstack/phase-5-browserstack-maestro branch from 239477f to a1e5157 Compare July 6, 2026 12:33
@kieran-osgood-shopify kieran-osgood-shopify force-pushed the kieran-osgood/e2e-browserstack/phase-6-github-reporting branch from df9ceff to d2d5b3e Compare July 6, 2026 12:33
@kieran-osgood-shopify kieran-osgood-shopify force-pushed the kieran-osgood/e2e-browserstack/phase-5-browserstack-maestro branch from a1e5157 to 4b0a6f1 Compare July 6, 2026 15:16
@kieran-osgood-shopify kieran-osgood-shopify force-pushed the kieran-osgood/e2e-browserstack/phase-6-github-reporting branch 2 times, most recently from 3d9c51f to ced0bde Compare July 6, 2026 16:27
@kieran-osgood-shopify kieran-osgood-shopify force-pushed the kieran-osgood/e2e-browserstack/phase-5-browserstack-maestro branch 2 times, most recently from 786333e to e01f683 Compare July 6, 2026 16:36
@kieran-osgood-shopify kieran-osgood-shopify force-pushed the kieran-osgood/e2e-browserstack/phase-6-github-reporting branch 2 times, most recently from 20fbcee to 391817a Compare July 6, 2026 17:01
@kieran-osgood-shopify kieran-osgood-shopify force-pushed the kieran-osgood/e2e-browserstack/phase-5-browserstack-maestro branch 2 times, most recently from 54beae2 to a49ee89 Compare July 7, 2026 09:53
@kieran-osgood-shopify kieran-osgood-shopify force-pushed the kieran-osgood/e2e-browserstack/phase-6-github-reporting branch from 391817a to 2431a70 Compare July 7, 2026 09:53
Assisted-By: devx/9ae89f69-61a5-46e3-8faf-006d105b0cdd
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

#gsd:50662 Rebase Checkout Kit on UCP

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants