Skip to content

feat: Add single-container package image#2300

Draft
junhaoliao wants to merge 1 commit into
y-scope:mainfrom
junhaoliao:codex/package-single-image
Draft

feat: Add single-container package image#2300
junhaoliao wants to merge 1 commit into
y-scope:mainfrom
junhaoliao:codex/package-single-image

Conversation

@junhaoliao
Copy link
Copy Markdown
Member

@junhaoliao junhaoliao commented May 29, 2026

Description

Adds a single-container package image build path for local validation and demo deployments:

  • adds task package-single-image, docker-images:package-single, and tools/deployment/package/build-single-image.sh.
  • adds tools/deployment/package/Dockerfile.single and run-single-container.sh.
  • runs MariaDB, RabbitMQ, Redis, MongoDB, CLP workers/schedulers, API server, log ingestor, reducer, and WebUI under supervisord.
  • keeps startup close to the existing Docker Compose flow: MariaDB/RabbitMQ/Redis/Mongo use the same env/config shape where possible, CLP DB/schema creation uses python3 -m clp_py_utils.create-db-tables, and results-cache setup uses python3 -m clp_py_utils.initialize-results-cache.
  • removes the custom post-start MariaDB/RabbitMQ init scripts; Redis has no init step, matching Compose.

The only remaining entrypoint DB bootstrap is the minimum first-run MariaDB database/user setup that the upstream MariaDB container entrypoint normally performs before the CLP Python DB initialization modules can connect.

Checklist

  • The PR satisfies the contribution guidelines.
  • This is a breaking change and that has been indicated in the PR title, OR this isn't a breaking change.
  • Necessary docs have been updated, OR no docs need to be updated.

Validation performed

  • bash -n tools/deployment/package/single-container/entrypoint.sh tools/deployment/package/single-container/wait-for-files.sh tools/deployment/package/single-container/wait-for-tcp.sh tools/deployment/package/build-single-image.sh tools/deployment/package/run-single-container.sh tools/docker-images/clp-package/build.sh
  • git diff --check
  • Parsed tools/deployment/package/single-container/supervisord.conf with Python configparser.
  • Built clp-package-single:latest with tools/deployment/package/build-single-image.sh.
  • Launched a fresh single-container deployment using the image and a bind-mounted package config plus ~/samples/big mounted at /mnt/logs.
  • Verified supervisorctl status: all long-running services were RUNNING; db-table-creator and results-cache-indices-creator exited successfully.
  • Verified API/WebUI health: GET /health returned API server is running; WebUI returned HTTP 200.
  • Verified backing services: MariaDB CLP table present, RabbitMQ authenticate_user clp-user pass succeeded, Redis PING returned PONG.
  • Compressed /spark-event-logs-1 through the WebUI/API flow into dataset spark_validation3: compression job 3 completed with 8/8 tasks, 2,126,027,157 uncompressed bytes and 37,785,117 compressed bytes.
  • Searched the compressed dataset through the WebUI: SparkListenerLogStart returned 6,512 results and SparkListenerTaskEnd returned 293,947 results.

@junhaoliao junhaoliao requested a review from a team as a code owner May 29, 2026 22:17
@junhaoliao junhaoliao marked this pull request as draft May 29, 2026 22:17
@junhaoliao junhaoliao requested a review from kirkrodrigues May 29, 2026 22:18
@coderabbitai
Copy link
Copy Markdown
Contributor

coderabbitai Bot commented May 29, 2026

Important

Review skipped

Draft detected.

Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

⚙️ Run configuration

Configuration used: Organization UI

Review profile: ASSERTIVE

Plan: Pro

Run ID: f7163fdd-5541-42ea-b3a5-f4d35920c70e

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

Use the checkbox below for a quick retry:

  • 🔍 Trigger review
✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands and usage tips.

@junhaoliao junhaoliao requested a review from Bill-hbrhbr May 29, 2026 22:33
@coderabbitai
Copy link
Copy Markdown
Contributor

coderabbitai Bot commented May 29, 2026

Note

Unit test generation is a public access feature. Expect some limitations and changes as we gather feedback and continue to improve it.


Generating unit tests... This may take up to 20 minutes.

@coderabbitai
Copy link
Copy Markdown
Contributor

coderabbitai Bot commented May 29, 2026

Request timed out after 900000ms (requestId=ed71da14-2acd-4d60-a334-e72ad8bd9706)

@junhaoliao junhaoliao force-pushed the codex/package-single-image branch from df63036 to 00d3eac Compare May 29, 2026 23:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant