Skip to content

[bug] unnecessary calls to resolve_s3_region #1708

@kevinjqliu

Description

@kevinjqliu

Apache Iceberg version

main (development)

Please describe the bug 🐞

We created a 0.9.0rc1 for the upcoming release. While verifying, I found the integration tests to be very slow. Digging into the issue, it looks like the resolve_s3_region is called on every test due to _initialize_fs, even in integration test environment where we spin up docker.

I think we should not automatically call resolve_s3_region to resolve s3 region. Maybe we can hide this behind a config.

Similarly, we should reconsider the warning log. See #1705

I think this is a release blocker for 0.9.0

cc @geruh / @Fokko

Willingness to contribute

  • I can contribute a fix for this bug independently
  • I would be willing to contribute a fix for this bug with guidance from the Iceberg community
  • I cannot contribute a fix for this bug at this time

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions