Commits

Breadcrumbs

History for

onmaster

User selector

All users

All time

Commit History

Commits on Mar 19, 2026

• [SPARK-56018][PYTHON] Use ruff as formatter

  Show description for eac3fe3
  

  gaogaotiantian

  authored and

  HyukjinKwon

  committed
  eac3fe3

  Copy full SHA for eac3fe3

Commits on Feb 18, 2026

• [SPARK-55488][PYTHON][TESTS] Add all dangling test files to modules

  Show description for 20d0c2a
  

  gaogaotiantian

  authored and

  zhengruifeng

  committed
  20d0c2a

  Copy full SHA for 20d0c2a

Commits on Dec 7, 2025

• [SPARK-54628][PYTHON] Remove all unnecessary explicit super() arguments

  Show description for 7e89a63
  

  gaogaotiantian

  authored and

  HyukjinKwon

  committed
  7e89a63

  Copy full SHA for 7e89a63

Commits on Apr 23, 2025

• [SPARK-51876][PYTHON][TESTS] Add configuration for `log4j.configurationFile` in the PySpark submission args of `run_individual_python_test`

  Show description for a9128a0
  LuciferYang

  committed
  a9128a0

  Copy full SHA for a9128a0

Commits on Jun 12, 2024

• [SPARK-48411][SS][PYTHON] Add E2E test for DropDuplicateWithinWatermark

  Show description for 334816a
  

  eason-yuchen-liu

  authored and

  HeartSaVioR

  committed
  334816a

  Copy full SHA for 334816a

Commits on Jan 21, 2023

• [SPARK-41777][PYSPARK][ML] Integration testing for TorchDistributor

  Show description for e0b09a1
  

  rithwik-db

  authored and

  HyukjinKwon

  committed
  e0b09a1

  Copy full SHA for e0b09a1

Commits on Aug 19, 2022

• [SPARK-40120][PYTHON][SQL][DOCS] Make pyspark.sql.readwriter examples self-contained

  Show description for 9d67ec3
  HyukjinKwon

  committed
  9d67ec3

  Copy full SHA for 9d67ec3

Commits on Dec 16, 2021

• [SPARK-37632][PYTHON] Drop code that targets Python < 3.7

  Show description for 6fb417e
  

  zero323

  authored and

  HyukjinKwon

  committed
  6fb417e

  Copy full SHA for 6fb417e

Commits on Nov 27, 2020

• Spelling r common dev mlib external project streaming resource managers python

  Show description for 13fd272
  

  jsoref

  authored and

  srowen

  committed
  13fd272

  Copy full SHA for 13fd272

Commits on Apr 29, 2018

• [SPARK-23094][SPARK-23723][SPARK-23724][SQL] Support custom encoding for json files

  Show description for bd14da6
  

  MaxGekk

  authored and

  HyukjinKwon

  committed
  bd14da6

  Copy full SHA for bd14da6

Commits on Feb 28, 2017

• [SPARK-19610][SQL] Support parsing multiline CSV files

  Show description for 7e5359b
  

  HyukjinKwon

  authored and

  cloud-fan

  committed
  7e5359b

  Copy full SHA for 7e5359b

Commits on Feb 17, 2017

• [SPARK-18352][SQL] Support parsing multiline json files

  Show description for 21fde57
  

  Nathan Howell

  authored and

  cloud-fan

  committed
  21fde57

  Copy full SHA for 21fde57

Commits on Sep 21, 2016

• [SPARK-17585][PYSPARK][CORE] PySpark SparkContext.addFile supports adding files recursively

  Show description for d3b8869
  yanboliang

  committed
  d3b8869

  Copy full SHA for d3b8869

Commits on Apr 20, 2016

• [SPARK-14555] First cut of Python API for Structured Streaming

  Show description for 80bf48f
  

  brkyvz

  authored and

  marmbrus

  committed
  80bf48f

  Copy full SHA for 80bf48f

Commits on Feb 29, 2016

• [SPARK-13509][SPARK-13507][SQL] Support for writing CSV with a single function call

  Show description for 02aa499
  

  HyukjinKwon

  authored and

  rxin

  committed
  02aa499

  Copy full SHA for 02aa499

Commits on Oct 28, 2015

• [SPARK-11292] [SQL] Python API for text data source

  Show description for 5aa0521
  

  rxin

  authored and

  yhuai

  committed
  5aa0521

  Copy full SHA for 5aa0521

Commits on Oct 17, 2015

• [SPARK-10185] [SQL] Feat sql comma separated paths

  Show description for 57f83e3
  

  koertkuipers

  authored and

  davies

  committed
  57f83e3

  Copy full SHA for 57f83e3

Commits on Sep 22, 2015

• [SPARK-10716] [BUILD] spark-1.5.0-bin-hadoop2.6.tgz file doesn't uncompress on OS X due to hidden file

  Show description for bf20d6c
  

  srowen

  authored and

  rxin

  committed
  bf20d6c

  Copy full SHA for bf20d6c

Commits on Jul 21, 2015

• [SPARK-9100] [SQL] Adds DataFrame reader/writer shortcut methods for ORC

  Show description for d38c502
  liancheng

  committed
  d38c502

  Copy full SHA for d38c502

Commits on Jun 3, 2015

• [SPARK-8060] Improve DataFrame Python test coverage and documentation.

  Show description for ce320cb
  rxin

  committed
  ce320cb

  Copy full SHA for ce320cb

Commits on Apr 16, 2015

• [SPARK-4897] [PySpark] Python 3 support

  Show description for 04e44b3
  

  Davies Liu

  authored and

  JoshRosen

  committed
  04e44b3

  Copy full SHA for 04e44b3

Commits on Sep 24, 2014

• [SPARK-3634] [PySpark] User's module should take precedence over system modules

  Show description for c854b9f
  

  davies

  authored and

  JoshRosen

  committed
  c854b9f

  Copy full SHA for c854b9f

Commits on Aug 6, 2014

• [SPARK-2627] [PySpark] have the build enforce PEP 8 automatically

  Show description for d614967
  

  nchammas

  authored and

  rxin

  committed
  d614967

  Copy full SHA for d614967

Commits on Dec 10, 2013

• License headers

  pwendell

  committed
  5b74609

  Copy full SHA for 5b74609

Commits on Aug 16, 2013

• Implementing SPARK-878 for PySpark: adding zip and egg files to context and passing it down to workers which add these to their sys.path

  

  Andre Schumacher

  committed
  c7e348f

  Copy full SHA for c7e348f

Commits on Jan 23, 2013

• Allow PySpark's SparkFiles to be used from driver

  Show description for ae2ed29
  JoshRosen

  committed
  ae2ed29

  Copy full SHA for ae2ed29

• Fix sys.path bug in PySpark SparkContext.addPyFile

  JoshRosen

  committed
  35168d9

  Copy full SHA for 35168d9

Loading