The Wayback Machine - https://web.archive.org/web/20210808174701/https://github.com/pandas-dev/pandas/pull/42304
Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DEPS: update setuptools min version #42304

Merged
merged 23 commits into from Aug 3, 2021

Conversation

@fangchenli
Copy link
Member

@fangchenli fangchenli commented Jun 29, 2021

According to https://setuptools.readthedocs.io/en/latest/userguide/declarative_config.html, the min version of setuptools that support entry_points in setup.cfg is 51.0.0.

@jreback jreback added this to the 1.3 milestone Jun 29, 2021
@jreback
Copy link
Contributor

@jreback jreback commented Jun 29, 2021

@simonjayhawkins
Copy link
Member

@simonjayhawkins simonjayhawkins commented Jun 29, 2021

are we not testing with the minimum setuptools?

@fangchenli
Copy link
Member Author

@fangchenli fangchenli commented Jun 29, 2021

are we not testing with the minimum setuptools?

No, we are not.

@simonjayhawkins
Copy link
Member

@simonjayhawkins simonjayhawkins commented Jun 29, 2021

in doc/source/development/contributing_environment.rst

Creating a Python environment (pip)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

If you aren't using conda for your development environment, follow these instructions.
You'll need to have at least the :ref:`minimum Python version <install.version>` that pandas supports. If your Python version
is 3.8.0 (or later), you might need to update your ``setuptools`` to version 42.0.0 (or later)
in your development environment before installing the build dependencies::

can be updated.

@jreback
Copy link
Contributor

@jreback jreback commented Jun 29, 2021

can you update the min pin in environment.yaml (and other places if needed)?

@jreback
Copy link
Contributor

@jreback jreback commented Jun 29, 2021

also this should be added to the wheel recipe @simonjayhawkins (practically this already works, but should add)

@simonjayhawkins
Copy link
Member

@simonjayhawkins simonjayhawkins commented Jun 29, 2021

test failure unrelated

E           AssertionError: Caused unexpected warning(s): [('ResourceWarning', ResourceWarning("unclosed <ssl.SSLSocket fd=8, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=6, laddr=('10.1.1.54', 48258), raddr=('52.217.136.144', 443)>"), '/home/runner/work/pandas/pandas/pandas/io/sas/sas7bdat.py', 381)]
@simonjayhawkins
Copy link
Member

@simonjayhawkins simonjayhawkins commented Jun 29, 2021

can you update the min pin in environment.yaml (and other places if needed)?

@fangchenli can you address this

@simonjayhawkins
Copy link
Member

@simonjayhawkins simonjayhawkins commented Jun 29, 2021

also this should be added to the wheel recipe @simonjayhawkins (practically this already works, but should add)

pandas-feedstock or MacPython or both?

@fangchenli
Copy link
Member Author

@fangchenli fangchenli commented Jun 29, 2021

can you update the min pin in environment.yaml (and other places if needed)?

We don't list setuptools in environment.yaml.

@simonjayhawkins
Copy link
Member

@simonjayhawkins simonjayhawkins commented Jun 29, 2021

labelled as blocker as we won't be changing min versions of dependencies in patch releases?

@jreback
Copy link
Contributor

@jreback jreback commented Jun 29, 2021

yeah i think we should just add this to environment.yaml. it is technically only needed if we use matplotlib so its not a required dep (so only add it where we have matplotlib, which is most places).

@simonjayhawkins
Copy link
Member

@simonjayhawkins simonjayhawkins commented Jun 30, 2021

conda-incubator/setup-miniconda@v2 does not seem to like the setuptools pin, although I think there have been conda-incubator/setup-miniconda@v2 timeouts on other PRs

@simonjayhawkins
Copy link
Member

@simonjayhawkins simonjayhawkins commented Jun 30, 2021

The version in pandas-dev on CI / Checks for master (https://github.com/pandas-dev/pandas/runs/2950514145) is

2021-06-30T09:08:01.2373051Z setuptools                49.6.0           py38h578d9bd_3    conda-forge

and creating dev env locally

my backport env (1.3.x)

(pandas-backport) simon@ProDesk:~/pandas (backport-of-pr-42318-on-1.3.x)$ conda list setuptools
# packages in environment at /home/simon/miniconda3/envs/pandas-backport:
#
# Name                    Version                   Build  Channel
setuptools                49.6.0           py38h578d9bd_3    conda-forge

my master env

(pandas-dev) simon@P340:~/pandas (master)$ conda list setuptools
# packages in environment at /home/simon/miniconda3/envs/pandas-dev:
#
# Name                    Version                   Build  Channel
setuptools                49.6.0           py38h578d9bd_3    conda-forge

According to https://setuptools.readthedocs.io/en/latest/userguide/declarative_config.html, the min version of setuptools that support entry_points in setup.cfg is 51.0.0.

hmm? our tests pass locally?

@simonjayhawkins
Copy link
Member

@simonjayhawkins simonjayhawkins commented Jun 30, 2021

@jreback ok to release without this PR, or delay release to allow time for others to look at this? @pandas-dev/pandas-core

@jreback
Copy link
Contributor

@jreback jreback commented Jun 30, 2021

should
include this

@simonjayhawkins
Copy link
Member

@simonjayhawkins simonjayhawkins commented Jun 30, 2021

should
include this

it appears can't create a dev env with conda with this pin

@bashtage
Copy link
Contributor

@bashtage bashtage commented Jun 30, 2021

Could leave it out of the yml file and then do a pip install -r requirements-dev.txt (assuming it is in requirements-dev.txt). This will no op everything that is installed, but upgrade setuptools if below.

@simonjayhawkins
Copy link
Member

@simonjayhawkins simonjayhawkins commented Jun 30, 2021

should
include this

it appears can't create a dev env with conda with this pin

can create a dev env locally from scratch using this pin. so maybe something related to conda-incubator/setup-miniconda@v2

creating a dev env from scratch without this pin, the only diff is

< setuptools=49.6.0=py38h578d9bd_3
---
> setuptools=52.0.0=py38h06a4308_0

so it's a mystery to me how conda chooses the version.

@jreback
Copy link
Contributor

@jreback jreback commented Jun 30, 2021

hmm yeah this should just work.

pyproject.toml Show resolved Hide resolved
@simonjayhawkins
Copy link
Member

@simonjayhawkins simonjayhawkins commented Jul 2, 2021

not yet triaged the pypy failures on conda-forge https://dev.azure.com/conda-forge/feedstock-builds/_build/results?buildId=345935&view=results, but did notice setuptools was pre 0.51

@lithomas1 lithomas1 removed the Blocker label Jul 5, 2021
@simonjayhawkins simonjayhawkins modified the milestones: 1.3.1, 1.3.2 Jul 24, 2021
@simonjayhawkins
Copy link
Member

@simonjayhawkins simonjayhawkins commented Jul 24, 2021

moving to 1.3.2

@jreback jreback merged commit 9ed9a65 into pandas-dev:master Aug 3, 2021
25 checks passed
25 checks passed
@github-actions
Checks
Details
@github-actions
Linux_py38_IO (ci/deps/actions-38-db-min.yaml)
Details
@github-actions
pytest (actions-38-minimum_versions.yaml, not slow and not network and not clipboard)
Details
@github-actions
actions-310-dev actions-310-dev
Details
@github-actions
pre-commit
Details
@github-actions
build (3.8)
Details
@github-actions
Linux_py38_IO (ci/deps/actions-38-db.yaml)
Details
@github-actions
pytest (actions-38-locale_slow.yaml, slow, language-pack-it xsel, it_IT.utf8, it_IT.utf8)
Details
@github-actions
build (3.9)
Details
@github-actions
pytest (actions-38.yaml, not slow and not network and not clipboard)
Details
@github-actions
pytest (actions-38-slow.yaml, slow)
Details
@github-actions
pytest (actions-38-locale.yaml, not slow and not network, language-pack-zh-hans xsel, zh_CN.utf8,...
Details
@github-actions
pytest (actions-39-slow.yaml, slow)
Details
@github-actions
pytest (actions-39-numpydev.yaml, not slow and not network, xsel, deprecate, -W error)
Details
@github-actions
pytest (actions-39.yaml, not slow and not network and not clipboard)
Details
@github-actions
Web and docs
Details
@github-actions
Test experimental data manager (not slow and not network and not clipboard)
Details
@github-actions
Test experimental data manager (slow)
Details
@codecov
codecov/patch Coverage not affected when comparing 331e150...fe7b039
Details
@codecov
codecov/project 93.23% (target 82.00%)
Details
@azure-pipelines
pandas-dev.pandas Build #20210802.23 succeeded
Details
@azure-pipelines
pandas-dev.pandas (Windows py38_np18) Windows py38_np18 succeeded
Details
@azure-pipelines
pandas-dev.pandas (Windows py39) Windows py39 succeeded
Details
@azure-pipelines
pandas-dev.pandas (macOS py38_macos) macOS py38_macos succeeded
Details
@azure-pipelines
pandas-dev.pandas (py38_32bit) py38_32bit succeeded
Details
@meeseeksdev

This comment has been hidden.

@jreback
Copy link
Contributor

@jreback jreback commented Aug 3, 2021

thanks @fangchenli this is essentially a doc update at this point so backporting ok.

@jreback
Copy link
Contributor

@jreback jreback commented Aug 3, 2021

@meeseeksdev backport 1.3.x

@meeseeksdev

This comment has been hidden.

simonjayhawkins added a commit to simonjayhawkins/pandas that referenced this pull request Aug 5, 2021
simonjayhawkins added a commit that referenced this pull request Aug 5, 2021
Co-authored-by: Fangchen Li <fangchen.li@outlook.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Linked issues

Successfully merging this pull request may close these issues.

None yet

6 participants
Morty Proxy This is a proxified and sanitized view of the page, visit original site.