Skip to content

feat: add E2E_TEST_UTILS_GIT_REF support to run-e2e.sh#2390

Merged
PatAKnight merged 2 commits into
redhat-developer:mainfrom
subhashkhileri:feat/nightly-inherit-dpdy-e2e
May 8, 2026
Merged

feat: add E2E_TEST_UTILS_GIT_REF support to run-e2e.sh#2390
PatAKnight merged 2 commits into
redhat-developer:mainfrom
subhashkhileri:feat/nightly-inherit-dpdy-e2e

Conversation

@subhashkhileri
Copy link
Copy Markdown
Member

@subhashkhileri subhashkhileri commented May 5, 2026

Summary

Adds `E2E_TEST_UTILS_GIT_REF` support to `run-e2e.sh` — enables cloning and building `e2e-test-utils` from an unpublished git branch without needing an npm release first.

Motivation

When developing `rhdh-e2e-test-utils` changes that require overlay-side validation (e.g. new nightly mode behaviour, new fixtures), there was no way to wire a pre-release branch into the overlay test runner without a workaround. This fills that gap as a permanent, general-purpose escape hatch.

Usage

# Use an unpublished branch from a fork
E2E_TEST_UTILS_GIT_REF=owner/rhdh-e2e-test-utils#my-branch ./run-e2e.sh -w tech-radar

# Pin a released npm version (existing mechanism, unchanged)
E2E_TEST_UTILS_VERSION=1.2.0 ./run-e2e.sh -w tech-radar

# Use a local build (existing mechanism, unchanged)
E2E_TEST_UTILS_PATH=/path/to/rhdh-e2e-test-utils ./run-e2e.sh -w tech-radar

Related

Test plan

  • `./run-e2e.sh --list` works without `E2E_TEST_UTILS_GIT_REF` set (no regression)
  • Setting `E2E_TEST_UTILS_GIT_REF` clones the branch, builds, and resolves correctly

Assisted-by: Claude Code

@subhashkhileri subhashkhileri requested review from a team, gashcrumb and kadel as code owners May 5, 2026 11:34
@subhashkhileri subhashkhileri changed the title feat: add E2E_TEST_UTILS_GIT_REF support to run-e2e.sh feat: add E2E_TEST_UTILS_GIT_REF to run-e2e.sh and validate {{inherit}} nightly mode May 5, 2026
@subhashkhileri subhashkhileri force-pushed the feat/nightly-inherit-dpdy-e2e branch from 0cf18ae to d918933 Compare May 5, 2026 11:42
@github-actions github-actions Bot added the non-workspace-changes PR changes files outside workspace directories label May 5, 2026
@subhashkhileri
Copy link
Copy Markdown
Member Author

/test ?

@subhashkhileri
Copy link
Copy Markdown
Member Author

/test e2e-ocp-helm-nightly

@rhdh-test-bot
Copy link
Copy Markdown

❌ Failed Nightly E2E Tests

Platform: ocp 4.18 | RHDH Version: 1.10 | Duration: 31m 27s
Passed: 102 | Failed: 7 | Flaky: 0 | Skipped: 11
Playwright Report | Build Log | Logs | Artifacts

@subhashkhileri subhashkhileri force-pushed the feat/nightly-inherit-dpdy-e2e branch from d918933 to dc25df6 Compare May 8, 2026 07:13
Assisted-by: Claude Code
Co-Authored-By: Claude Code <noreply@anthropic.com>
@subhashkhileri subhashkhileri force-pushed the feat/nightly-inherit-dpdy-e2e branch from dc25df6 to 40efe82 Compare May 8, 2026 07:15
@subhashkhileri subhashkhileri changed the title feat: add E2E_TEST_UTILS_GIT_REF to run-e2e.sh and validate {{inherit}} nightly mode feat: add E2E_TEST_UTILS_GIT_REF support to run-e2e.sh May 8, 2026
@subhashkhileri subhashkhileri mentioned this pull request May 8, 2026
@subhashkhileri
Copy link
Copy Markdown
Member Author

/test e2e-ocp-helm-nightly

@sonarqubecloud
Copy link
Copy Markdown

sonarqubecloud Bot commented May 8, 2026

@rhdh-test-bot
Copy link
Copy Markdown

✅ Passed Nightly E2E Tests

Platform: ocp 4.18 | RHDH Version: 1.10 | Duration: 30m 37s
Passed: 111 | Failed: 0 | Flaky: 0 | Skipped: 9
Playwright Report | Build Log | Logs | Artifacts

@subhashkhileri
Copy link
Copy Markdown
Member Author

/publish

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 8, 2026

Publish workflow has completed with success.

Publishing process

✅ Finished successfully.

  • Published container images:
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-api-docs:pr_2390__0.13.5
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-auth-backend-module-atlassian-provider:pr_2390__0.4.13
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-auth-backend-module-auth0-provider:pr_2390__0.3.1
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-auth-backend-module-aws-alb-provider:pr_2390__0.4.14
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-auth-backend-module-azure-easyauth-provider:pr_2390__0.2.18
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-auth-backend-module-bitbucket-provider:pr_2390__0.3.13
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-auth-backend-module-bitbucket-server-provider:pr_2390__0.2.13
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-auth-backend-module-cloudflare-access-provider:pr_2390__0.4.13
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-auth-backend-module-gcp-iap-provider:pr_2390__0.4.13
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-auth-backend-module-github-provider:pr_2390__0.5.1
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-auth-backend-module-gitlab-provider:pr_2390__0.4.1
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-auth-backend-module-google-provider:pr_2390__0.3.13
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-auth-backend-module-guest-provider:pr_2390__0.2.17
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-auth-backend-module-microsoft-provider:pr_2390__0.3.13
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-auth-backend-module-oauth2-provider:pr_2390__0.4.13
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-auth-backend-module-oauth2-proxy-provider:pr_2390__0.2.18
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-auth-backend-module-oidc-provider:pr_2390__0.4.14
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-auth-backend-module-okta-provider:pr_2390__0.2.13
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-auth-backend-module-onelogin-provider:pr_2390__0.3.13
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-auth-backend-module-openshift-provider:pr_2390__0.1.5
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-auth-backend-module-pinniped-provider:pr_2390__0.3.12
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-auth-backend-module-vmware-cloud-provider:pr_2390__0.5.12
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-auth-backend:pr_2390__0.27.3
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-auth:pr_2390__0.1.6
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-catalog-backend-module-aws:pr_2390__0.4.21
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-catalog-backend-module-azure:pr_2390__0.3.15
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-catalog-backend-module-backstage-openapi:pr_2390__0.5.12
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-catalog-backend-module-bitbucket-cloud:pr_2390__0.5.9
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-catalog-backend-module-bitbucket-server:pr_2390__0.5.9
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-catalog-backend-module-gcp:pr_2390__0.3.17
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-catalog-backend-module-gerrit:pr_2390__0.3.12
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-catalog-backend-module-gitea:pr_2390__0.1.10
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-catalog-backend-module-github-org:pr_2390__0.3.20
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-catalog-backend-module-github:pr_2390__0.13.0
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-catalog-backend-module-gitlab:pr_2390__0.8.1
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-catalog-backend-module-gitlab-org:pr_2390__0.2.19
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-catalog-backend-module-incremental-ingestion:pr_2390__0.7.10
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-catalog-backend-module-ldap:pr_2390__0.12.3
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-catalog-backend-module-logs:pr_2390__0.1.20
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-catalog-backend-module-msgraph:pr_2390__0.9.1
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-catalog-backend-module-openapi:pr_2390__0.2.20
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-catalog-backend-module-puppetdb:pr_2390__0.2.20
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-catalog-backend-module-scaffolder-entity-model:pr_2390__0.2.18
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-catalog-backend-module-unprocessed:pr_2390__0.6.9
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-catalog-graph:pr_2390__0.6.0
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-catalog-import:pr_2390__0.13.11
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-catalog-unprocessed-entities:pr_2390__0.2.28
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-config-schema:pr_2390__0.1.78
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-devtools:pr_2390__0.1.37
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-devtools-backend:pr_2390__0.5.15
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-events-backend-module-aws-sqs:pr_2390__0.4.20
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-events-backend-module-azure:pr_2390__0.2.29
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-events-backend-module-bitbucket-cloud:pr_2390__0.2.29
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-events-backend-module-bitbucket-server:pr_2390__0.1.10
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-events-backend-module-gerrit:pr_2390__0.2.29
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-events-backend-module-github:pr_2390__0.4.10
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-events-backend-module-gitlab:pr_2390__0.3.10
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-events-backend-module-google-pubsub:pr_2390__0.2.1
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-events-backend-module-kafka:pr_2390__0.3.2
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-gateway-backend:pr_2390__1.1.3
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-home:pr_2390__0.9.3
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-kubernetes:pr_2390__0.12.17
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-kubernetes-backend:pr_2390__0.21.2
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-kubernetes-cluster:pr_2390__0.0.35
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-mcp-actions-backend:pr_2390__0.1.11
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-mui-to-bui:pr_2390__0.2.5
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-notifications:pr_2390__0.5.15
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-notifications-backend:pr_2390__0.6.3
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-notifications-backend-module-email:pr_2390__0.3.19
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-notifications-backend-module-slack:pr_2390__0.4.0
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-org:pr_2390__0.7.0
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-proxy-backend:pr_2390__0.6.11
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-scaffolder-backend-module-azure:pr_2390__0.2.19
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-scaffolder-backend-module-bitbucket-cloud:pr_2390__0.3.4
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-scaffolder-backend-module-bitbucket-server:pr_2390__0.2.19
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-scaffolder-backend-module-confluence-to-markdown:pr_2390__0.3.19
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-scaffolder-backend-module-cookiecutter:pr_2390__0.3.21
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-scaffolder-backend-module-gcp:pr_2390__0.2.19
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-scaffolder-backend-module-gerrit:pr_2390__0.2.19
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-scaffolder-backend-module-gitea:pr_2390__0.2.19
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-scaffolder-backend-module-github:pr_2390__0.9.7
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-scaffolder-backend-module-gitlab:pr_2390__0.11.4
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-scaffolder-backend-module-notifications:pr_2390__0.1.20
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-scaffolder-backend-module-rails:pr_2390__0.5.19
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-scaffolder-backend-module-sentry:pr_2390__0.3.2
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-scaffolder-backend-module-yeoman:pr_2390__0.4.20
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-search-backend-module-elasticsearch:pr_2390__1.8.1
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-search-backend-module-explore:pr_2390__0.3.12
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-search-backend-module-pg:pr_2390__0.5.53
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-search-backend-module-stack-overflow-collator:pr_2390__0.3.18
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-search-backend-module-techdocs:pr_2390__0.4.12
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-signals:pr_2390__0.0.29
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-signals-backend:pr_2390__0.3.13
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-techdocs:pr_2390__1.17.2
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-techdocs-backend:pr_2390__2.1.6
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-techdocs-module-addons-contrib:pr_2390__1.1.34
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-user-settings-backend:pr_2390__0.4.1
    • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-plugin-user-settings:pr_2390__0.9.1

Backstage Compatibility Check

✅ All workspaces are compatible with the target Backstage version (1.49.4).

No action required.

Metadata Validation

✅ All metadata files validated successfully.

Running e2e tests
/test e2e-ocp-helm

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 8, 2026

⚠️
Smoke test workflow skipped: missing plugin metadata files (<workspace>/metadata/*.yaml).

@rhdh-test-bot
Copy link
Copy Markdown

✅ Passed E2E Tests - backstage

Platform: ocp 4.18 | RHDH Version: 1.10 | Duration: 9m 25s
Passed: 24 | Failed: 0 | Flaky: 0 | Skipped: 5
Playwright Report | Build Log | Logs | Artifacts

Copy link
Copy Markdown
Member

@PatAKnight PatAKnight left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

}

test.describe("TechDocs", () => {
test.describe.skip("TechDocs", () => {
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just for reference in case anyone else comes looking, there is a PR opened here to fix these tests: #2378. Skipping for now as they are continuously failing on nightly and the PR is still being actively worked on

@openshift-ci openshift-ci Bot added the lgtm label May 8, 2026
@PatAKnight PatAKnight merged commit f398b5e into redhat-developer:main May 8, 2026
7 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

lgtm non-workspace-changes PR changes files outside workspace directories

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants