Skip to content

V1.5.14#725

Merged
flarco merged 13 commits intomainfrom
v1.5.14
Apr 6, 2026
Merged

V1.5.14#725
flarco merged 13 commits intomainfrom
v1.5.14

Conversation

@flarco
Copy link
Copy Markdown
Collaborator

@flarco flarco commented Apr 6, 2026

New Features

  • SQL Server BCP with Entra ID authentication: BCP bulk loading now supports Entra ID token-based auth and Azure CLI integration for passwordless authentication.
  • DuckDB Arrow IPC streaming: Implement Arrow IPC streaming for DuckDB connections, improving read/write performance.
  • CDC full-refresh mode: Added support for full-refresh mode with CDC options, clearing state before running an initial snapshot.
  • CDC UUID primary key support: CDC initial snapshots now handle string/UUID primary keys with offset-based chunking, in addition to integer PKs.
  • length() function supports scalar types: The length() function now safely handles integers, floats, booleans, and dates by converting to string representation, allowing use in wildcard transforms with ternary guards.
  • sling project jobs run --wait flag: New --wait / -w flag polls execution status every 5 seconds until the job reaches a terminal state, then reports rows, bytes, and duration.
  • OAuth2 custom credentials and spec URL: Enhanced OAuth2 initialization to support custom client credentials and spec URL for flexible token management.

Bug Fixes

  • Oracle sqlldr column sizing: Fixed sqlldr control file generation to use target column precision instead of hardcoding char(400000), preventing excessive memory allocation during Oracle bulk imports.
  • TINYINT type handling: Corrected data type mapping for tinyint in metadata queries across MariaDB, MySQL, and StarRocks templates.
  • Cross-platform path handling: Replaced path package with filepath across the codebase for correct behavior on Windows.
  • Token save in agent mode: Allow local SaveToken to proceed even when running in agent mode.

flarco added 13 commits March 26, 2026 09:06
- extract YAML marshaling logic into a new internal method `marshalEnvFileBytes`
- introduce new public method `MarshalBody` to return formatted YAML as a string
- update `WriteEnvFile` to utilize the new marshaling helper
- improve code organization and reusability for YAML content generation
  - prevent sqlldr control file from hardcoding char(400000) for strings
  - use target column's DbPrecision or MaxLen for sqlldr char sizing
  - avoid excessive memory allocation during Oracle bulk imports
  - add test p.25 to verify sqlldr ctl content and table column sizing
@flarco flarco merged commit c0491aa into main Apr 6, 2026
1 check passed
@flarco flarco deleted the v1.5.14 branch April 6, 2026 15:05
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant