SRE-3874 ci: optimized docker images size#18606
Conversation
![github-advanced-security[bot]](https://avatars.githubusercontent.com/in/57789?s=60&v=4){kind=small}
|
Errors are Unable to load ticket data |
|
Test stage Test RPMs on EL 9.6 completed with status FAILURE. https://jenkins-3.daos.hpc.amslabs.hpecorp.net/job/daos-stack/job/daos/job/PR-18606/1/display/redirect |
|
Test stage Test RPMs on Leap 15.5 completed with status FAILURE. https://jenkins-3.daos.hpc.amslabs.hpecorp.net/job/daos-stack/job/daos/job/PR-18606/1/display/redirect |
|
Test stage Test RPMs on Leap 15.5 completed with status FAILURE. https://jenkins-3.daos.hpc.amslabs.hpecorp.net/job/daos-stack/job/daos/job/PR-18606/2/display/redirect |
|
Test stage Test RPMs on EL 9.6 completed with status FAILURE. https://jenkins-3.daos.hpc.amslabs.hpecorp.net/job/daos-stack/job/daos/job/PR-18606/2/display/redirect |
grom72
force-pushed
the
grom72/sre3874-docker-images-optimization
branch
from
ce52b18 to
9a9d75a
Compare
grom72
force-pushed
the
grom72/sre3874-docker-images-optimization
branch
from
9a9d75a to
61565fe
Compare
grom72
force-pushed
the
grom72/sre3874-docker-images-optimization
branch
from
9d0a5e6 to
9fe742b
Compare
|
Test stage Functional on EL 9 completed with status FAILURE. https://jenkins-3.daos.hpc.amslabs.hpecorp.net//job/daos-stack/job/daos/view/change-requests/job/PR-18606/7/execution/node/914/log |
grom72
force-pushed
the
grom72/sre3874-docker-images-optimization
branch
from
eed625a to
42fe91f
Compare
grom72
force-pushed
the
grom72/sre3874-docker-images-optimization
branch
from
7ec95b9 to
ecc5247
Compare
|
Test stage Functional Hardware Medium Verbs Provider MD on SSD completed with status FAILURE. https://jenkins-3.daos.hpc.amslabs.hpecorp.net//job/daos-stack/job/daos/view/change-requests/job/PR-18606/18/execution/node/1640/log |
grom72
force-pushed
the
grom72/sre3874-docker-images-optimization
branch
from
e8a482b to
266c2df
Compare
grom72
force-pushed
the
grom72/sre3874-docker-images-optimization
branch
3 times, most recently
from
d610cd4 to
a02519e
Compare
|
Test stage Functional on EL 9 completed with status FAILURE. https://jenkins-3.daos.hpc.amslabs.hpecorp.net//job/daos-stack/job/daos/view/change-requests/job/PR-18606/22/execution/node/935/log |
grom72
force-pushed
the
grom72/sre3874-docker-images-optimization
branch
3 times, most recently
from
0b81505 to
db8e57f
Compare
Reduce CI Docker image footprint with new minimal build-ci stage and make image build process faster. Summary This PR introduces a new minimal Docker image variant for CI, called build-ci, to reduce image size, startup cost, and infrastructure pressure across Jenkins and GitHub Actions. Key outcomes Adds a minimal build-ci image profile optimized for CI compilation and packaging workflows. Keeps full image flow available for broader/local build use cases. Reduces build-ci image footprint from about 12 GiB to about 2 GiB. Improves Docker image setup time by reducing package/install scope in CI paths. Lowers memory/storage consumption in Jenkins pipelines. Reduces cache and runner resource pressure in GitHub Actions workflows. Adds a new helper script to simplify and standardize DAOS RPM build execution in Docker. Why this matters CI runners spend less time pulling/building heavy images. More jobs can run reliably within existing storage/memory budgets. Pipeline behavior becomes more predictable by separating CI-minimal and full-build concerns. RPM build flow is easier to run and reproduce locally and in automation. Scope of changes Docker stage restructuring to support dedicated build-ci and build-local/full paths. Workflow updates to explicitly target lighter Docker stages where appropriate. Package installation split to keep optional/heavier dependencies out of build-ci. New Docker-driven RPM build helper script for repeatable artifact generation. Signed-off-by: Tomasz Gromadzki <tomasz.gromadzki@hpe.com>
Signed-off-by: Tomasz Gromadzki <tomasz.gromadzki@hpe.com> Cancel-prev-build: false Skip-func-hw-test: true
grom72
force-pushed
the
grom72/sre3874-docker-images-optimization
branch
from
db8e57f to
85c060b
Compare
4 participants
Reduce CI Docker image footprint with new minimal
build-cistage and make image build process faster.Summary
This PR introduces a new minimal Docker image variant for CI, called
build-ci, to reduce image size, startup cost, and infrastructure pressure across Jenkins and GitHub Actions.Key outcomes
Adds a minimal
build-ciimage profile optimized for CI compilation and packaging workflows.Keeps full image flow available for broader/local build use cases.
Reduces
build-ciimage footprint from about 8 GiB to about 2 GiB.Improves Docker image setup time by reducing package/install scope in CI paths.
Lowers memory/storage consumption in Jenkins pipelines.
Reduces cache and runner resource pressure in GitHub Actions workflows.
Why this matters
CI runners spend less time pulling/building heavy images.
More jobs can run reliably within existing storage/memory budgets.
Pipeline behavior becomes more predictable by separating CI-minimal and full-build concerns.
RPM build flow is easier to run and reproduce locally and in automation.
Scope of changes
Docker stage restructuring to support dedicated
build-ci,build-localandfullpaths.Workflow updates to explicitly target lighter Docker stages where appropriate.
Package installation split to keep optional/heavier dependencies out of
build-ci.Harmonization of Docker EL9 and Leap15 files.
Steps for the author:
After all prior steps are complete: