-
Notifications
You must be signed in to change notification settings - Fork 36
Add support for Pandas 3 #2295
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Add support for Pandas 3 #2295
Conversation
ihnorton
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM overall but I'm nervous about the changes around string types (see inline) based on past experience.
tiledb/multirange_indexing.py
Outdated
|
|
||
| if col_dtypes: | ||
| df = df.astype(col_dtypes, copy=False) | ||
| # Use str instead of '<U0' so pandas uses its native string type |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Is our type-mapping wrong now? I don't quite follow why we need this change
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Added a comment in code.
This PR adds Pandas 3 support while maintaining Pandas 2 compatibility. The main change is handling the new
StringDtypethat Pandas 3 uses by default for strings.Also, added a CI step to continue on running tests using Pandas 2.
Closes CORE-487