Commits
User selector
Commit history
Commits on Jul 30, 2026
[SPARK-58159][PYTHON] Support `with` statement for connect session
Show description for 6c37fe3committed[SPARK-58037][PYTHON][TEST][FOLLOWUP] Keep DataFrame golden tests internal
Show description for 0c1fd8fauthored andcommitted
Commits on Jul 29, 2026
[SPARK-58417][PS] Remove stale Python 2 reference in DataFrame.to_latex docstring
Show description for 7692b9fcommitted[SPARK-57271][PYTHON] Propagate traceback locals to Python planner runner
Show description for 87dbc24authored andcommitted
Commits on Jul 28, 2026
[SPARK-58312][PYTHON] Remove unnecessary type: ignore comments in pyspark.sql.group
Show description for b7d304fauthored andcommitted[SPARK-58402][PYTHON] Consolidate UNKNOWN_EXPLAIN_MODE into VALUE_NOT_ALLOWED
Show description for 2df516ccommitted[SPARK-55749][SQL][DOC] Clarify `array_contains` null-handling in the docs and example
Show description for 9ccb1ddauthored andcommitted
[SPARK-58332][PYTHON][TEST] Move compare_or_generate_golden_matrix into GoldenFileTestMixin
Show description for 8636942authored andcommitted[SPARK-58249][PS][FOLLOWUP] Use native function for NumPy invert
Show description for f1a7058committed
Commits on Jul 27, 2026
[SPARK-58346][PYTHON] Remove unnecessary type: ignore[union-attr] comments in PySpark
Show description for 149ba07authored andcommitted[SPARK-58354][PYTHON] Remove unused ArrowStreamPandasSerializer base class
Show description for e8d5e4acommitted
Commits on Jul 26, 2026
[MINOR][CONNECT] Remove redundant user_context.user_id assignment in execute_command methods
Show description for 12f4f9bauthored andcommitted[SPARK-58314][PYTHON] Remove ArrowStreamUDFSerializer
Show description for c7b2f1acommitted[SPARK-58192][CORE] Support fractional spark.task.cpus
Show description for f8c6dedcommitted
Commits on Jul 24, 2026
[SPARK-54946][PYTHON][TEST] Add tests for pa.Array.to_pandas with coerce_temporal_nanoseconds
Show description for 5a97929authored andcommitted[SPARK-58221][SQL] Add `try_variant_set` expression
Show description for 759fbd9authored andcommitted[SPARK-58298][PYTHON] Reduce the expected progress for streaming data source tests
Show description for c579dabauthored andcommitted[SPARK-58276][PYTHON] Consolidate serializer selection branches in worker.py
Show description for 2f47c1fcommitted[SPARK-58297][PYTHON] Remove TransformWithStateInPySparkRowSerializer
Show description for fd3d03ccommitted[SPARK-58249][SPARK-58234][PS][TEST][FOLLOWUP] Test native NumPy ufuncs with special values
Show description for 94d4715committed
Commits on Jul 23, 2026
[SPARK-58262][PYTHON] Remove ArrowStreamPandasUDFSerializer
Show description for d44c1eacommitted[SPARK-58157][PYTHON] Remove TransformWithStateInPySparkRowInitStateSerializer
Show description for 93c3367authored andcommitted[SPARK-58258][PYTHON][SQL] Gate the columnar Arrow Python UDF passthrough on the vector shape matching the declared schema
Show description for b0e8bf2committed[SPARK-58247][CONNECT][SDP] Support SCD Type 2 in the Auto CDC Python and Spark Connect APIs
Show description for 3d59361authored andcommitted
Commits on Jul 22, 2026
[SPARK-58244][PYTHON] Remove type: ignore[name-defined] for DataFrame.plot and streaming _test() in pyspark.sql
Show description for 7d8a190authored andcommitted[SPARK-58268][PYTHON] Disable GC for Config gRPC to avoid deadlock
Show description for 377a00ecommitted[SPARK-57160][CONNECT][FOLLOWUP] Use signed nanos timestamp fields
Show description for 4a1d0a7authored andcommitted[SPARK-58243][PYTHON] Remove unused ApplyInPandasWithStateSerializer
Show description for 600e361committed[SPARK-58191][PYTHON] Refactor SQL_TRANSFORM_WITH_STATE_PYTHON_ROW_UDF and SQL_TRANSFORM_WITH_STATE_PYTHON_ROW_INIT_STATE_UDF
Show description for 64a30fdcommitted[MINOR][PYTHON][DOC] Add example to Column.outer docstring
Show description for 54f21fbauthored andcommitted[SPARK-53154][SQL][PYTHON] Add `hmac` SQL function
Show description for 2bb0b35authored andcommitted[SPARK-58249][PS] Use native functions for NumPy math ufuncs
Show description for 31f58dacommittedRevert "[MINOR][PYTHON][DOC] Fixed some links in documentation."
Show description for dccff55committed[SPARK-58241][PYTHON] Fix the columnar Arrow Python UDF runner writing the input schema in the legacy protocol position
Show description for e6d66abcommitted
Commits on Jul 21, 2026
[MINOR][PYTHON][DOC] Fixed some links in documentation.
Show description for c198adcauthored andcommitted