Skip to content

Conversation

@kounelisagis
Copy link
Member

@kounelisagis kounelisagis commented Feb 5, 2026

This PR adds Pandas 3 support while maintaining Pandas 2 compatibility. The main change is handling the new StringDtype that Pandas 3 uses by default for strings.

Also, added a CI step to continue on running tests using Pandas 2.

Closes CORE-487

@kounelisagis kounelisagis marked this pull request as ready for review February 5, 2026 16:38
@kounelisagis kounelisagis requested a review from ihnorton February 5, 2026 16:55
Copy link
Member

@ihnorton ihnorton left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM overall but I'm nervous about the changes around string types (see inline) based on past experience.


if col_dtypes:
df = df.astype(col_dtypes, copy=False)
# Use str instead of '<U0' so pandas uses its native string type
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is our type-mapping wrong now? I don't quite follow why we need this change

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Added a comment in code.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants