Skip to content

Do not re-create Hive tables on rerun, only when schema has changed #724

@yruslan

Description

@yruslan

Background

Currently, metastore attached Hive tables are always re-created when the pipeline runs in 'rerun' mode. This can create a big stress on HMS.

Feature

Do not re-create Hive tables on rerun, only when schema has changed.

Example [Optional]

--

Proposed Solution [Optional]

--

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions