Skip to content

Spark 4.1: Add runtime-deps.txt#15860

Merged
danielcweeks merged 1 commit intoapache:mainfrom
rdblue:add-spark-4.1-runtime-deps
Apr 10, 2026
Merged

Spark 4.1: Add runtime-deps.txt#15860
danielcweeks merged 1 commit intoapache:mainfrom
rdblue:add-spark-4.1-runtime-deps

Conversation

@rdblue
Copy link
Copy Markdown
Contributor

@rdblue rdblue commented Apr 1, 2026

This is a follow up to #15855 that adds a runtime-deps.txt file for the runtime Jar for Spark 4.1. This is to demonstrate the checks in order to validate #15858. We will need to add more deps files, but should also verify LICENSE and NOTICE at the same time.

@github-actions github-actions bot added the spark label Apr 1, 2026
org.jetbrains.kotlin:kotlin-stdlib-common:1.9.10
org.jetbrains.kotlin:kotlin-stdlib-jdk7:1.9.10
org.jetbrains.kotlin:kotlin-stdlib-jdk8:1.9.10
org.jetbrains.kotlin:kotlin-stdlib:1.9.10
Copy link
Copy Markdown
Contributor Author

@rdblue rdblue Apr 1, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

These are deps that leaked and will be removed in #15858. I'll rebase that PR when this is in.

@rdblue rdblue added this to the Iceberg 1.11.0 milestone Apr 1, 2026
@rdblue rdblue changed the title Spark 4.1: Add runtime-deps.txt. Spark 4.1: Add runtime-deps.txt Apr 1, 2026
@kevinjqliu
Copy link
Copy Markdown
Contributor

do we want to check this in?

@kevinjqliu
Copy link
Copy Markdown
Contributor

i generated these runtime-deps files
heres a comparison for iceberg-spark-runtime-4.0_2.13 for 1.10.1 vs main
https://github.com/kevinjqliu/iceberg-deps/pull/1/files#diff-54a1f23a4319d816f4eac44d22239f32270e58c36520f2f7c1633741d49fb401L1

Comment on lines +49 to +50
org.projectnessie.nessie:nessie-client:0.107.4
org.projectnessie.nessie:nessie-model:0.107.4
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this stood out to me, why do we include nessie in the spark runtime?

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It's been for a long time. Fair to question, but not relevant to this PR.

@danielcweeks danielcweeks merged commit 6687084 into apache:main Apr 10, 2026
26 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants