gh-74028: `concurrent.futures.Executor.map`: introduce `buffersize` param for lazier behavior#125663

Merged

picnixz merged 45 commits intopython:mainfrom

ebonnal:fix-issue-29842

Mar 13, 2025

Commits on Jan 12, 2025

bpo-29842: concurrent.futures.Executor.map: add buffersize param for lazy behavior
ebonnal
committed
45c3ec5
Copy full SHA for 45c3ec5
test_map_buffersize: 1s sleep
ebonnal
committed
bfb2c5c
Copy full SHA for bfb2c5c
mention chunksize in ProcessPoolExecutor's buffersize docstring
ebonnal
committed
8539663
Copy full SHA for 8539663
merge unittest into ExecutorTest
ebonnal
committed
022b8c6
Copy full SHA for 022b8c6
fix versionchanged
ebonnal
committed
7ced787
Copy full SHA for 7ced787
📜🤖 Added by blurb_it.

blurb-it[bot]
authored and
ebonnal
committed
cb5f26e
Copy full SHA for cb5f26e
fix tests determinism
ebonnal
committed
f46ebe6
Copy full SHA for f46ebe6
add test_map_with_buffersize_on_empty_iterable
ebonnal
committed
eb26e86
Copy full SHA for eb26e86
allow timeout + buffersize
ebonnal
committed
0821f95
Copy full SHA for 0821f95
lint import
ebonnal
committed
d95c55b
Copy full SHA for d95c55b
tests: polish
ebonnal
committed
c80f466
Copy full SHA for c80f466
rephrase docstring
ebonnal
committed
90e6d7c
Copy full SHA for 90e6d7c
fix Doc/library/concurrent.futures.rst
Show description for ab91694

ebonnal
and
picnixz
committed
ab91694
Copy full SHA for ab91694
reorder imports
Show description for 01b8adf

ebonnal
and
picnixz
committed
01b8adf
Copy full SHA for 01b8adf
rephrase buffersize's ValueError
ebonnal
committed
2f8a63f
Copy full SHA for 2f8a63f
update 3.14.rst
ebonnal
committed
1fb53a5
Copy full SHA for 1fb53a5
edit docstring
ebonnal
committed
365c85d
Copy full SHA for 365c85d
lint
ebonnal
committed
bf5f838
Copy full SHA for bf5f838
lint
ebonnal
committed
a0057f1
Copy full SHA for a0057f1
comment on weakref
ebonnal
committed
1aa1275
Copy full SHA for 1aa1275
lint
ebonnal
committed
e0a9a9e
Copy full SHA for e0a9a9e
test_map_with_buffersize_when_buffer_becomes_full: avoid using multiprocessing.Manager().list() to work for InterpreterPoolExecutor too
ebonnal
committed
8d6ea97
Copy full SHA for 8d6ea97
lint
ebonnal
committed
6124868
Copy full SHA for 6124868
test_map_with_buffersize_and_timeout: avoid sleeping 0 seconds for win32
ebonnal
committed
c11276f
Copy full SHA for c11276f
remove test_map_with_buffersize_and_timeoutthat does not improve coverage in any way and is not deterministic on windows
ebonnal
committed
ebb5337
Copy full SHA for ebb5337
extend unittesting to no and multiple input iterables
ebonnal
committed
602968c
Copy full SHA for 602968c
Update Lib/concurrent/futures/_base.py
Show description for b14e368

ebonnal
and
picnixz
committed
b14e368
Copy full SHA for b14e368
rename args_iter -> zipped_iterables
ebonnal
committed
d37ce09
Copy full SHA for d37ce09
remove period at end of error message
ebonnal
committed
cdf239c
Copy full SHA for cdf239c
unit tests: merge into a single test method with test messages
ebonnal
committed
0a49784
Copy full SHA for 0a49784
apply review on tests format
ebonnal
committed
178d6fe
Copy full SHA for 178d6fe
Update Misc/NEWS.d/next/Library/2024-10-18-10-27-54.gh-issue-74028.4d4vVD.rst
Show description for 516a94b

ebonnal
and
picnixz
committed
516a94b
Copy full SHA for 516a94b
Update Doc/whatsnew/3.14.rst
Show description for ba4ac81

ebonnal
and
picnixz
committed
ba4ac81
Copy full SHA for ba4ac81
use assertListEqual
ebonnal
committed
9588059
Copy full SHA for 9588059
test_map_buffersize_validation: test negative buffersize
ebonnal
committed
0427bf1
Copy full SHA for 0427bf1
explicitly checks buffersize's type and add test_map_buffersize_type_validation
ebonnal
committed
af88fdf
Copy full SHA for af88fdf
test_map_buffersize_on_infinite_iterable: fetch the first 4 elements
ebonnal
committed
1fcf3fe
Copy full SHA for 1fcf3fe
add `test_map_buffersize_on_multiple_infinite_iterables`
ebonnal
committed
0892b2b
Copy full SHA for 0892b2b
doc: specify that it is the size of a buffer of tasks and not results
ebonnal
committed
579ba31
Copy full SHA for 579ba31

Commits on Feb 24, 2025

Merge remote-tracking branch 'cpython/main' into fix-issue-29842
ebonnal
committed
332826a
Copy full SHA for 332826a
Update Doc/whatsnew/3.14.rst
Show description for ef814e5

ebonnal
and
picnixz
authored
ef814e5
Copy full SHA for ef814e5

Commits on Mar 3, 2025

Merge branch 'main' into fix-issue-29842
encukou
authored
26c8d8d
Copy full SHA for 26c8d8d
remove redundant `iter`
ebonnal
committed
7b1d5f6
Copy full SHA for 7b1d5f6

Commits on Mar 10, 2025

Merge remote-tracking branch 'cpython/main' into fix-issue-29842
ebonnal
committed
8dac531
Copy full SHA for 8dac531

Commits on Mar 12, 2025

add new line in 3.14.rst
Show description for bb756f4

ebonnal
and
picnixz
authored
bb756f4
Copy full SHA for bb756f4