Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

Appearance settings

Conversation

@Fokko
Copy link
Contributor

@Fokko Fokko commented Oct 30, 2024

With Arrow 18.0.0 numpy is not a dependency anymore: apache/arrow#44148

I think it would be good to remove it from PyIceberg.

Closes #1259
Closes #1198

With Arrow 18.0.0 numpy is not a dependency anymore:
apache/arrow#44148

I think it would be good to also remove it from PyIceberg
@Fokko Fokko requested a review from kevinjqliu October 30, 2024 09:31
Copy link
Contributor

@kevinjqliu kevinjqliu left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the PR, LGTM!
I've opened #1271 for tracking the performance regression and backporting the pyarrow range function when it becomes available. Do you mind adding it as a comment to the function?

pyiceberg/io/pyarrow.py Show resolved Hide resolved
@Fokko
Copy link
Contributor Author

Fokko commented Oct 30, 2024

@kevinjqliu That's an excellent suggestion, I only created one on the Arrow side, thanks!

Copy link
Contributor

@kevinjqliu kevinjqliu left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM! bye numpy

@kevinjqliu kevinjqliu requested review from HonahX and sungwy October 30, 2024 18:49
@kevinjqliu kevinjqliu added this to the PyIceberg 0.8.0 release milestone Oct 30, 2024
@Fokko Fokko merged commit 7f959a2 into apache:main Oct 30, 2024
@Fokko Fokko deleted the fd-remove-numpy branch October 30, 2024 20:30
@corleyma
Copy link

@kevinjqliu curious what y'all think of my comment here: #1259 (comment)

sungwy pushed a commit to sungwy/iceberg-python that referenced this pull request Dec 7, 2024
* Remove numpy as a hard dependency

With Arrow 18.0.0 numpy is not a dependency anymore:
apache/arrow#44148

I think it would be good to also remove it from PyIceberg

* Add link to issue
sungwy pushed a commit to sungwy/iceberg-python that referenced this pull request Dec 7, 2024
* Remove numpy as a hard dependency

With Arrow 18.0.0 numpy is not a dependency anymore:
apache/arrow#44148

I think it would be good to also remove it from PyIceberg

* Add link to issue
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Remove numpy as a dependency NumPy Hardpin 1.26 issue

3 participants

Morty Proxy This is a proxified and sanitized view of the page, visit original site.