Skip to content

Abridged tests on PRs#9216

Draft
stephanos wants to merge 2 commits intotemporalio:mainfrom
stephanos:slim-jobs
Draft

Abridged tests on PRs#9216
stephanos wants to merge 2 commits intotemporalio:mainfrom
stephanos:slim-jobs

Conversation

@stephanos
Copy link
Contributor

@stephanos stephanos commented Feb 4, 2026

What changed?

Running an abridged database coverage (unless on main/release branch or touching persistence)

Why?

Reduce PR failure rate by not running tests for every database setup.

Note that an earlier version of this PR also merged xdc and ndc with the other tests across shards but there were a couple of issues (e.g. xdc and ndc are not shard aware) that we'll address later.

How did you test it?

  • built
  • run locally and tested manually
  • covered by existing tests
  • added new unit test(s)
  • added new functional test(s)

@stephanos stephanos force-pushed the slim-jobs branch 2 times, most recently from 9c9f362 to 07ba05d Compare February 4, 2026 21:38
path: ~/.cache/go-build
key: go-${{ runner.os }}${{ runner.arch }}-build-${{ env.COMMIT }}

- name: Run functional test xdc
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

merged into functional-test


# NDC matrix job. Include `${{ matrix.name }}` in the display name so each
# matrix variant has a unique name for the job-id lookup.
functional-test-ndc:
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

merged into functional-test


# XDC matrix job. Include `${{ matrix.name }}` in the display name so each
# matrix variant has a unique name for the job-id lookup.
functional-test-xdc:
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

merged into functional-test

@stephanos stephanos force-pushed the slim-jobs branch 3 times, most recently from 1a5f710 to ea0720a Compare February 4, 2026 23:06
}
s.T().Logf("Running %s in test shard %d/%d", s.T().Name(), index+1, total)
}

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

drive-by cleanup: not used!

@stephanos stephanos force-pushed the slim-jobs branch 3 times, most recently from 6bb6773 to 49192f8 Compare February 4, 2026 23:39
Makefile Outdated
FUNCTIONAL_TEST_ROOT := ./tests
FUNCTIONAL_TEST_XDC_ROOT := ./tests/xdc
FUNCTIONAL_TEST_NDC_ROOT := ./tests/ndc
FUNCTIONAL_TEST_ALL_ROOTS := $(FUNCTIONAL_TEST_ROOT) $(FUNCTIONAL_TEST_XDC_ROOT) $(FUNCTIONAL_TEST_NDC_ROOT)
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Running all 3 together now.

@stephanos stephanos force-pushed the slim-jobs branch 8 times, most recently from 44f55e2 to 00a67f3 Compare February 5, 2026 00:21
done
echo "job_matrix=$MATRIX" >> "$GITHUB_OUTPUT"
echo "Generated $(jq length <<< "$MATRIX") jobs"
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

^ I didn't think there's much of a benefit of having this a script.

@stephanos stephanos force-pushed the slim-jobs branch 7 times, most recently from 73bd85a to 0bd6218 Compare February 5, 2026 01:11
@stephanos stephanos force-pushed the slim-jobs branch 3 times, most recently from 84f7ef3 to 41349da Compare February 5, 2026 18:57
name: Test setup
runs-on: ubuntu-latest
outputs:
shard_indices: ${{ steps.generate_output.outputs.shard_indices }}
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Some of these are now in compute_matrix

@stephanos stephanos force-pushed the slim-jobs branch 6 times, most recently from 607f6c8 to 43b31f1 Compare February 5, 2026 19:53
@stephanos stephanos changed the title Reduce database coverage in PRs Abridged test on PRs Feb 5, 2026
@stephanos stephanos changed the title Abridged test on PRs Abridged tests on PRs Feb 5, 2026
# smoke tests run specific suites via TEST_ARGS
TEST_TOTAL_SHARDS: ${{ matrix.total_shards || '' }}
TEST_SHARD_INDEX: ${{ matrix.shard_index || '' }}
TEMPORAL_TEST_TOTAL_SHARDS: ${{ matrix.total_shards || '' }}
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Using prefix TEMPORAL_ to be consistent with other Temporal env vars.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

They were chosen to be consistent with Bazel's test sharding protocol, but we're not using that so 🤷

@stephanos stephanos force-pushed the slim-jobs branch 11 times, most recently from a2733fd to 5c8ab11 Compare February 5, 2026 20:51
@stephanos stephanos force-pushed the slim-jobs branch 3 times, most recently from 721d440 to 151e888 Compare February 5, 2026 23:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants