Skip to content

[feature][PES][datasource] add support for Oscar database (神通数据库) in metadata query service #1069

Description

@v-kkhuang

Search before asking

  • I had searched in the issues and found no similar feature requirement.

Problem Description

Is your feature request related to a problem? Please describe.

Currently, the Linkis metadata query service does not support Oscar database (神通数据库), which is a widely-used domestic database in China. Users who need to query Oscar database metadata through Linkis cannot do so, limiting the system's applicability in domestic enterprise environments.

Description

A short description of your feature

Add full support for Oscar database in the Linkis metadata query service, including database connection, database listing, table listing, and column querying capabilities. This PR introduces OscarMetaService and Oscar-specific SqlConnection implementation to handle Oscar database connections and metadata retrieval.

Additionally, this PR includes optimizations for ElasticSearch and Hive metadata query services:

  • For ES: Recursively flatten nested object fields in mappings
  • For Hive: Use placeholder table name to trigger database properties query when table name is empty

Use case

Describe the use case of your feature request and the solution you'd like.

Enterprise users who have deployed Oscar database can now:

  1. Configure Oscar datasource in Linkis datasource management
  2. Query Oscar database metadata (databases, tables, columns) through Linkis metadata query service
  3. Integrate Oscar database with Linkis-based data development platforms

Solutions

Describe alternatives you've considered.

  • Alternative 1: Continue without Oscar support - Users would need to migrate to other databases or use external tools, which is not practical for existing Oscar deployments.
  • Alternative 2: Add Oscar support (chosen) - Direct integration provides the best user experience and system consistency.

Anything else

Additional context or screenshots about the feature request.

The implementation follows the same pattern as other JDBC-based metadata services (MySQL, Oracle, PostgreSQL, etc.), ensuring consistency and maintainability.

Changes included in this PR:

  • Add OscarMetaService and SqlConnection implementation
  • Add Oscar datasource type and parameters in database DDL
  • Update MYSQL_RELATIONSHIP_LIST to include oscar
  • Optimize ES metadata query to recursively flatten nested object fields
  • Optimize Hive metadata query to support placeholder table name for database properties query

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions