gh-134939: Add the interpreters Module #133958

ericsnowcurrently · May 13, 2025

This is in case PEP-734 is accepted.

Issue: Add the interpreters Module, Implementing PEP 734 #134939

bedevere-bot · May 27, 2025

🤖 New build scheduled with the buildbot fleet by @ericsnowcurrently for commit 5c8545a 🤖

Results will be shown at:

https://buildbot.python.org/all/#/grid?branch=refs%2Fpull%2F133958%2Fmerge

If you want to schedule another build, you need to add the 🔨 test-with-buildbots label again.

bedevere-bot · May 29, 2025

🤖 New build scheduled with the buildbot fleet by @ericsnowcurrently for commit c63b6bc 🤖

Results will be shown at:

https://buildbot.python.org/all/#/grid?branch=refs%2Fpull%2F133958%2Fmerge

If you want to schedule another build, you need to add the 🔨 test-with-buildbots label again.

ericsnowcurrently · May 30, 2025

FTR, I ran this against the buildbots and there were two failures:

aarch64 RHEL8 Refleaks - https://buildbot.python.org/#/builders/802/builds/1730
wasm32-wasi Non-Debug - https://buildbot.python.org/#/builders/1373/builds/503

Neither looks related, but I'll rerun them just to be sure.

ericsnowcurrently · May 30, 2025

!buildbot aarch64 RHEL8 Refleaks

bedevere-bot · May 30, 2025

🤖 New build scheduled with the buildbot fleet by @ericsnowcurrently for commit 0a5d0e4 🤖

Results will be shown at:

https://buildbot.python.org/all/#/grid?branch=refs%2Fpull%2F133958%2Fmerge

The command will test the builders whose names match following regular expression: aarch64 RHEL8 Refleaks

The builders matched are:

aarch64 RHEL8 Refleaks PR

ericsnowcurrently · May 30, 2025

!buildbot wasm32-wasi Non-Debug

bedevere-bot · May 30, 2025

🤖 New build scheduled with the buildbot fleet by @ericsnowcurrently for commit 0a5d0e4 🤖

Results will be shown at:

https://buildbot.python.org/all/#/grid?branch=refs%2Fpull%2F133958%2Fmerge

The command will test the builders whose names match following regular expression: wasm32-wasi Non-Debug

The builders matched are:

wasm32-wasi Non-Debug PR

ericsnowcurrently · May 30, 2025

!buildbot wasm32-wasi Non-Debug

bedevere-bot · May 30, 2025

🤖 New build scheduled with the buildbot fleet by @ericsnowcurrently for commit 0a5d0e4 🤖

Results will be shown at:

https://buildbot.python.org/all/#/grid?branch=refs%2Fpull%2F133958%2Fmerge

The command will test the builders whose names match following regular expression: wasm32-wasi Non-Debug

The builders matched are:

wasm32-wasi Non-Debug PR

Doc/library/interpreters.rst

ezio-melotti · May 30, 2025

Doc/library/interpreters.rst

+| InterpreterError         | Exception        | An interpreter-related error happened.            |
+--------------------------+------------------+---------------------------------------------------+
+| InterpreterNotFoundError | InterpreterError | The targeted interpreter no longer exists.        |
+--------------------------+------------------+---------------------------------------------------+
+| ExecutionFailed          | InterpreterError | The running code raised an uncaught exception.    |
+--------------------------+------------------+---------------------------------------------------+
+| NotShareableError        | TypeError        | The object cannot be sent to another interpreter. |


It would be better to add some markup to these exceptions.

Agreed. I'll be changing this table to the correct directive as soon as I can.

Doc/whatsnew/3.14.rst

Doc/library/interpreters.rst

picnixz · May 31, 2025

Doc/library/interpreters.rst

+Creating an interpreter and running code in it:
+
+::


Suggested change

Creating an interpreter and running code in it:

::

Creating an interpreter and running code in it::

picnixz · May 31, 2025

Doc/library/interpreters.rst

+      Is the interpreter currently executing code in its
+      :mod:`!__main__` module?


Suggested change

Is the interpreter currently executing code in its

:mod:`!__main__` module?

Return True if the interpreter is currently executing code in

its :mod:`!__main__` module and False otherwise.

I don't remember whether we use "Return True if X and False otherwise" for other boolean functions but I don't think I've ever seen a documentation entry with a question.

Suggested change

Is the interpreter currently executing code in its

:mod:`!__main__` module?

Return ``True`` if the interpreter is currently executing

code in its :mod:`!__main__` module, ``False`` otherwise.

Doc/whatsnew/3.14.rst

picnixz · May 31, 2025

Doc/whatsnew/3.14.rst

+support for multiple interpreters.
+
+Also added in 3.14: :ref:`concurrent.futures.InterpreterPoolExecutor
+<whatsnew314-concurrent-futures-interp-pool>`.


I'd recommend adding a ".. seealso: :pep:XXX" at the end of the section as for other PEPs

Misc/NEWS.d/next/Library/2025-05-30-09-46-21.gh-issue-134939.Pu3nnm.rst

neonene · May 31, 2025

Doc/whatsnew/3.14.rst

+libraries on PyPI for high-level abstractions on top of interpreters.
+
+Regarding extension modules, work is in progress to update some PyPI
+projects, as well as tools like Cython, PyBind11, Nanobind, and Py03.


typo: Py03 (zero-three) -> PyO3

Suggested change

projects, as well as tools like Cython, PyBind11, Nanobind, and Py03.

projects, as well as tools like Cython, PyBind11, Nanobind, and PyO3.

AA-Turner · May 31, 2025

Doc/library/interpreters.rst

+Before we dive into examples, there are a small number of details
+to keep in mind about using multiple interpreters:
+
+* isolated, by default


This deserves more elaboration, or a link, given it is the first mention of isolation & in the 'key details' block.

Doc/whatsnew/3.14.rst

AA-Turner · May 31, 2025

Doc/whatsnew/3.14.rst

+libraries on PyPI for high-level abstractions on top of interpreters.
+
+Regarding extension modules, work is in progress to update some PyPI
+projects, as well as tools like Cython, PyBind11, Nanobind, and Py03.


Suggested change

projects, as well as tools like Cython, PyBind11, Nanobind, and Py03.

projects, as well as tools like Cython, PyBind11, Nanobind, and PyO3.

AA-Turner · May 31, 2025

Lib/interpreters/channels.py

PEP 734 doesn't include channels, should this module be private for now?

Misc/NEWS.d/next/Library/2025-05-30-09-46-21.gh-issue-134939.Pu3nnm.rst

ZeroIntensity · May 31, 2025

Doc/library/interpreters.rst

+
+.. function:: list_all()
+
+   Return a :class:`list` of :class:`Interpreter`,


Suggested change

Return a :class:`list` of :class:`Interpreter`,

Return a :class:`list` of :class:`Interpreter` objects,

ZeroIntensity · May 31, 2025

Doc/library/interpreters.rst

+
+      (read-only)
+
+      Where the interpreter came from.


What type is whence?

str. My understanding is that this is mainly for introspection?

Ok, it'd be good to note that here.

ZeroIntensity · May 31, 2025

Doc/library/interpreters.rst

+
+   .. method:: prepare_main(ns=None, **kwargs)
+
+      Bind "shareable" objects in the interpreter's


I think it'd be good to have a small section that included all the shareable objects. We could link to it here.

ZeroIntensity · May 31, 2025

Doc/library/interpreters.rst

+
+   .. method:: call(callable, /, *args, **kwargs)
+
+      Run the given function in the interpreter (in the current thread).


Which functions can be shared?

ericsnowcurrently added the needs backport to 3.14 bugs and security fixes label May 13, 2025

ericsnowcurrently force-pushed the pep-734-accepted branch 4 times, most recently from 7ddfb50 to 5c8545a Compare May 27, 2025 17:59

ericsnowcurrently added the 🔨 test-with-buildbots Test PR w/ buildbots; report in status section label May 27, 2025

bedevere-bot removed the 🔨 test-with-buildbots Test PR w/ buildbots; report in status section label May 27, 2025

ericsnowcurrently force-pushed the pep-734-accepted branch 2 times, most recently from 1e34abd to c63b6bc Compare May 29, 2025 20:56

ericsnowcurrently added the 🔨 test-with-buildbots Test PR w/ buildbots; report in status section label May 29, 2025

bedevere-bot removed the 🔨 test-with-buildbots Test PR w/ buildbots; report in status section label May 29, 2025

ericsnowcurrently force-pushed the pep-734-accepted branch from c63b6bc to ea9041c Compare May 30, 2025 15:30

ericsnowcurrently changed the title ~~Add the interpreters Module~~ gh-134939: Add the interpreters Module May 30, 2025

bedevere-app bot mentioned this pull request May 30, 2025

Add the interpreters Module, Implementing PEP 734 #134939

Open

4 tasks

ericsnowcurrently added 4 commits May 30, 2025 12:15

Move the interpreters module to the official stdlib.

e3aa50b

Add a NEWS entry.

88e47fb

Add a whatsnew entry.

ce3505b

Add initial docs.

0a5d0e4

ericsnowcurrently force-pushed the pep-734-accepted branch from ea9041c to 0a5d0e4 Compare May 30, 2025 18:16

ericsnowcurrently marked this pull request as ready for review May 30, 2025 19:30

ericsnowcurrently requested review from erlend-aasland, ezio-melotti and hugovk as code owners May 30, 2025 19:30

ericsnowcurrently requested a review from AA-Turner as a code owner May 30, 2025 19:30

bedevere-app bot added the awaiting core review label May 30, 2025

ezio-melotti reviewed May 30, 2025

View reviewed changes

ericsnowcurrently added 2 commits May 30, 2025 15:25

Fix formatting and typos.

fe86353

Fix doc lint.

382cff2

ericsnowcurrently added the DO-NOT-MERGE label May 30, 2025

bedevere-app bot added awaiting changes and removed awaiting core review labels May 31, 2025

python deleted a comment from bedevere-app bot May 31, 2025

picnixz added awaiting review awaiting core review and removed awaiting changes awaiting review labels May 31, 2025

picnixz reviewed May 31, 2025

View reviewed changes

neonene reviewed May 31, 2025

View reviewed changes

AA-Turner reviewed May 31, 2025

View reviewed changes

ZeroIntensity reviewed May 31, 2025

View reviewed changes

mostafaammer added this to lavitaconnect@MOSTAFAAMMER May 31, 2025

		Is the interpreter currently executing code in its
		:mod:`!__main__` module?

	projects, as well as tools like Cython, PyBind11, Nanobind, and Py03.
	projects, as well as tools like Cython, PyBind11, Nanobind, and PyO3.


		.. function:: list_all()

		Return a :class:`list` of :class:`Interpreter`,


		.. method:: prepare_main(ns=None, **kwargs)

		Bind "shareable" objects in the interpreter's


		.. method:: call(callable, /, args, *kwargs)

		Run the given function in the interpreter (in the current thread).

Search code, repositories, users, issues, pull requests...

Uh oh!

gh-134939: Add the interpreters Module #133958

Are you sure you want to change the base?

gh-134939: Add the interpreters Module #133958

Conversation

ericsnowcurrently commented May 13, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

bedevere-bot commented May 27, 2025

Uh oh!

bedevere-bot commented May 29, 2025

Uh oh!

ericsnowcurrently commented May 30, 2025

Uh oh!

ericsnowcurrently commented May 30, 2025

Uh oh!

bedevere-bot commented May 30, 2025

Uh oh!

ericsnowcurrently commented May 30, 2025

Uh oh!

bedevere-bot commented May 30, 2025

Uh oh!

ericsnowcurrently commented May 30, 2025

Uh oh!

bedevere-bot commented May 30, 2025

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Uh oh!

ericsnowcurrently commented May 13, 2025 •

edited

Loading