Commits

Breadcrumbs

History for

onmaster

User selector

All users

All time

Commit History

Commits on Apr 3, 2026

• [SPARK-56341][PYTHON][DOCS] Fix outdated PyArrow minimum version in arrow_pandas.rst

  Show description for cba5705
  

  Yicong-Huang

  authored and

  zhengruifeng

  committed
  cba5705

  Copy full SHA for cba5705

Commits on Mar 24, 2026

• [SPARK-56186][PYTHON] Retire pypy

  Show description for d51b39b
  

  gaogaotiantian

  authored and

  HyukjinKwon

  committed
  d51b39b

  Copy full SHA for d51b39b

Commits on Jan 20, 2026

• [SPARK-55096][PYTHON] Update pandas minimum version in `connect/setup.py`

  Show description for 5f925fd
  zhengruifeng

  committed
  5f925fd

  Copy full SHA for 5f925fd

• [SPARK-54849][PYTHON][FOLLOW-UP] Update minimum version of pyarrow in `setup.py` and `pyspark_upgrade.rst`

  Show description for 4d3b45d
  zhengruifeng

  committed
  4d3b45d

  Copy full SHA for 4d3b45d

Commits on Nov 11, 2025

• [SPARK-54194][CONNECT] Spark Connect Proto Plan Compression

  Show description for 0ccaacf
  

  xi-db

  authored and

  hvanhovell

  committed
  0ccaacf

  Copy full SHA for 0ccaacf

Commits on Nov 10, 2025

• [SPARK-54287][PYTHON] Add Python 3.14 support in `pyspark-client` and `pyspark-connect`

  Show description for 67547ef
  dongjoon-hyun

  committed
  67547ef

  Copy full SHA for 67547ef

Commits on Nov 6, 2025

• [SPARK-54213][PYTHON][CONNECT] Remove Python 3.9 from Spark Connect

  Show description for 4ba1189
  dongjoon-hyun

  committed
  4ba1189

  Copy full SHA for 4ba1189

Commits on Nov 5, 2025

• [SPARK-54177][BUILD] Upgrade gRPC to 1.76 and protobuf to 6.33

  Show description for 83e49b7
  

  pan3793

  authored and

  dongjoon-hyun

  committed
  83e49b7

  Copy full SHA for 83e49b7

Commits on Nov 4, 2025

• Revert "[SPARK-54177][BUILD] Upgrade gRPC to 1.76 and protobuf to 6.33"

  Show description for 4a1b7b2
  dongjoon-hyun

  committed
  4a1b7b2

  Copy full SHA for 4a1b7b2

• [SPARK-54177][BUILD] Upgrade gRPC to 1.76 and protobuf to 6.33

  Show description for e55333c
  

  pan3793

  authored and

  dongjoon-hyun

  committed
  e55333c

  Copy full SHA for e55333c

Commits on Oct 24, 2025

• [SPARK-54015][PYTHON] Relax Py4J requirement to py4j>=0.10.9.7,<0.10.9.10

  Show description for c9db279
  

  HyukjinKwon

  authored and

  dongjoon-hyun

  committed
  c9db279

  Copy full SHA for c9db279

Commits on Oct 9, 2025

• [SPARK-51169][PYTHON] Add Python 3.14 support in Spark Classic

  Show description for 05a1ffb
  

  zhengruifeng

  authored and

  dongjoon-hyun

  committed
  05a1ffb

  Copy full SHA for 05a1ffb

Commits on Sep 12, 2025

• [SPARK-53498][SDP] Correctly Reference `pyspark/pipelines/cli.py` from `spark-pipelines` Binary

  Show description for faa1aaa
  

  anishm-db

  authored and

  dongjoon-hyun

  committed
  faa1aaa

  Copy full SHA for faa1aaa

Commits on Sep 2, 2025

• [SPARK-53443][PYTHON] Update python to `SPDX-license`

  Show description for 8c8c966
  

  bjornjorgensen

  authored and

  dongjoon-hyun

  committed
  8c8c966

  Copy full SHA for 8c8c966

Commits on Jul 25, 2025

• [SPARK-52840][PYTHON][DOCS][FOLLOW-UP] Increase Pandas minimum version to 2.2.0

  Show description for 8c53892
  zhengruifeng

  committed
  8c53892

  Copy full SHA for 8c53892

• [SPARK-52928][PYTHON][INFRA] Upgrade the minimum version of pyarrow to 15.0.0

  Show description for e8015e9
  zhengruifeng

  committed
  e8015e9

  Copy full SHA for e8015e9

Commits on Jul 10, 2025

• [SPARK-52561][PYTHON][DOC][FOLLOW-UP] Further upgrade the minimum python version

  Show description for b0ea3e5
  zhengruifeng

  committed
  b0ea3e5

  Copy full SHA for b0ea3e5

Commits on Jun 11, 2025

• [SPARK-52440][DECLARATIVE PIPELINES] Add python install extra for declarative pipelines

  Show description for 8052660
  sryza

  committed
  8052660

  Copy full SHA for 8052660

Commits on May 30, 2025

• [SPARK-52238][PYTHON] Python client for Declarative Pipelines

  Show description for e3321aa
  sryza

  committed
  e3321aa

  Copy full SHA for e3321aa

Commits on May 22, 2025

• [SPARK-52224][CONNECT][PYTHON] Introduce pyyaml as a dependency for the Python client

  Show description for 7fee291
  sryza

  committed
  7fee291

  Copy full SHA for 7fee291

Commits on Apr 21, 2025

• [SPARK-51814][SS][PYTHON][FOLLOW-UP] Add pyspark.sql.tests.pandas.helper for testing pyspark-client

  Show description for 8fef8ea
  HyukjinKwon

  committed
  8fef8ea

  Copy full SHA for 8fef8ea

Commits on Mar 27, 2025

• [SPARK-51566][PYTHON] Python UDF traceback improvement

  Show description for 52dfa3d
  

  wengh

  authored and

  allisonwang-db

  committed
  52dfa3d

  Copy full SHA for 52dfa3d

Commits on Mar 3, 2025

• [SPARK-50578][PYTHON][SS][FOLLOW-UP] Add the Python new package into setup.py

  Show description for 4b2ae48
  

  HyukjinKwon

  authored and

  dongjoon-hyun

  committed
  4b2ae48

  Copy full SHA for 4b2ae48

Commits on Feb 24, 2025

• [SPARK-50015][PYTHON][FOLLOW-UP] Update _minimum_grpc_version in setup.py for pyspark-client

  Show description for ee8e10f
  HyukjinKwon

  committed
  ee8e10f

  Copy full SHA for ee8e10f

• [SPARK-50098][PYTHON][FOLLOW-UP] Update _minimum_googleapis_common_protos_version in setup.py for pyspark-client

  Show description for a084d64
  HyukjinKwon

  committed
  a084d64

  Copy full SHA for a084d64

Commits on Feb 17, 2025

• [SPARK-51212][PYTHON] Add a separated PySpark package for Spark Connect by default

  Show description for f798e7a
  

  ueshin

  authored and

  cloud-fan

  committed
  f798e7a

  Copy full SHA for f798e7a

Commits on Feb 16, 2025

• [SPARK-51227][PYTHON][CONNECT] Fix PySpark Connect `_minimum_grpc_version` to 1.67.0

  Show description for 3f4ba72
  dongjoon-hyun

  committed
  3f4ba72

  Copy full SHA for 3f4ba72

• [SPARK-50098][PYTHON][CONNECT][FOLLOWUP] Fix PySpark Connect `_minimum_googleapis_common_protos_version` to 1.65.0

  Show description for b8d395e
  dongjoon-hyun

  committed
  b8d395e

  Copy full SHA for b8d395e

Commits on Jan 16, 2025

• [SPARK-49907][ML][CONNECT][FOLLOW-UP] Move pyspark.ml.remote to pyspark.ml.connect

  Show description for 97241eb
  

  HyukjinKwon

  and

  wbo4958

  committed
  97241eb

  Copy full SHA for 97241eb

• [SPARK-49907][ML][CONNECT][FOLLOW-UP] Add ml connect related packages into PyPI packages

  Show description for dff46cf
  HyukjinKwon

  committed
  dff46cf

  Copy full SHA for dff46cf

Commits on Jan 15, 2025

• [SPARK-50821][PYTHON] Upgrade Py4J from 0.10.9.8 to 0.10.9.9

  Show description for d792865
  HyukjinKwon

  committed
  d792865

  Copy full SHA for d792865

Commits on Dec 25, 2024

• [SPARK-50657][PYTHON] Upgrade the minimum version of `pyarrow` to 11.0.0

  Show description for 9c9bdab
  

  zhengruifeng

  authored and

  dongjoon-hyun

  committed
  9c9bdab

  Copy full SHA for 9c9bdab

Commits on Dec 18, 2024

• [SPARK-50596][PYTHON] Upgrade Py4J from 0.10.9.7 to 0.10.9.8

  Show description for cb84939
  HyukjinKwon

  committed
  cb84939

  Copy full SHA for cb84939

Commits on Dec 12, 2024

• [SPARK-50517][PYTHON][TESTS][FOLLOW-UP] Add refactored package into pure Python test

  Show description for bfc5c22
  HyukjinKwon

  committed
  bfc5c22

  Copy full SHA for bfc5c22

Commits on Dec 11, 2024

• [SPARK-50517][PYTHON][TESTS][FOLLOW-UP] Add refactored package into pure Python test

  Show description for 6cdc96f
  HyukjinKwon

  committed
  6cdc96f

  Copy full SHA for 6cdc96f