Commits

Breadcrumbs

History for

onmaster

User selector

All users

Datepicker

All time

Commit history

Commits on Jan 4, 2018

• [SPARK-21475][CORE][2ND ATTEMPT] Change to use NIO's Files API for external shuffle service

  Show description for 93f92c0
  

  jerryshao

  authored and

  zsxwing

  committed
  93f92c0View commit details

  Copy full SHA for 93f92c0

  View code at this pointBrowse repository at this point

Commits on Jan 1, 2018

• [MINOR] Fix a bunch of typos

  

  srowen

  authored and

  HyukjinKwon

  committed
  c284c4eView commit details

  Copy full SHA for c284c4e

  View code at this pointBrowse repository at this point

Commits on Dec 30, 2017

• [SPARK-21475][Core]Revert "[SPARK-21475][CORE] Use NIO's Files API to replace FileInputStream/FileOutputStream in some critical paths"

  Show description for 14c4a62
  zsxwing

  committed
  14c4a62View commit details

  Copy full SHA for 14c4a62

  View code at this pointBrowse repository at this point

• [SPARK-22771][SQL] Concatenate binary inputs into a binary output

  Show description for f2b3525
  

  maropu

  authored and

  gatorsmile

  committed
  f2b3525View commit details

  Copy full SHA for f2b3525

  View code at this pointBrowse repository at this point

Commits on Dec 21, 2017

• [SPARK-22324][SQL][PYTHON] Upgrade Arrow to 0.8.0

  Show description for 59d5263
  

  BryanCutler

  authored and

  HyukjinKwon

  committed
  59d5263View commit details

  Copy full SHA for 59d5263

  View code at this pointBrowse repository at this point

Commits on Nov 7, 2017

• [SPARK-22454][CORE] ExternalShuffleClient.close() should check clientFactory null

  Show description for 9df08e2
  

  wangyum

  authored and

  srowen

  committed
  9df08e2View commit details

  Copy full SHA for 9df08e2

  View code at this pointBrowse repository at this point

Commits on Oct 26, 2017

• [SPARK-20643][CORE] Add listener implementation to collect app state.

  Show description for 0e9a750
  

  Marcelo Vanzin

  authored and

  squito

  committed
  0e9a750View commit details

  Copy full SHA for 0e9a750

  View code at this pointBrowse repository at this point

Commits on Oct 25, 2017

• [SPARK-22349] In on-heap mode, when allocating memory from pool,we should fill memory with `MEMORY_DEBUG_FILL_CLEAN_VALUE`

  Show description for 3d43a9f
  

  10110346

  authored and

  Sameer Agarwal

  committed
  3d43a9fView commit details

  Copy full SHA for 3d43a9f

  View code at this pointBrowse repository at this point

Commits on Oct 17, 2017

• [SPARK-22062][CORE] Spill large block to disk in BlockManager's remote fetch to avoid OOM

  Show description for e1960c3
  

  jerryshao

  authored and

  cloud-fan

  committed
  e1960c3View commit details

  Copy full SHA for e1960c3

  View code at this pointBrowse repository at this point

Commits on Oct 10, 2017

• [SPARK-22222][CORE] Fix the ARRAY_MAX in BufferHolder and add a test

  Show description for bebd2e1
  

  Feng Liu

  authored and

  gatorsmile

  committed
  bebd2e1View commit details

  Copy full SHA for bebd2e1

  View code at this pointBrowse repository at this point

Commits on Oct 9, 2017

• [SPARK-22218] spark shuffle services fails to update secret on app re-attempts

  Show description for a74ec6d
  

  Thomas Graves

  authored and

  Marcelo Vanzin

  committed
  a74ec6dView commit details

  Copy full SHA for a74ec6d

  View code at this pointBrowse repository at this point

Commits on Sep 27, 2017

• [SPARK-22130][CORE] UTF8String.trim() scans " " twice

  Show description for 12e740b
  

  kiszk

  authored and

  HyukjinKwon

  committed
  12e740bView commit details

  Copy full SHA for 12e740b

  View code at this pointBrowse repository at this point

• [SPARK-20642][CORE] Store FsHistoryProvider listing data in a KVStore.

  Show description for 74daf62
  

  Marcelo Vanzin

  authored and

  cloud-fan

  committed
  74daf62View commit details

  Copy full SHA for 74daf62

  View code at this pointBrowse repository at this point

Commits on Sep 23, 2017

• [SPARK-22033][CORE] BufferHolder, other size checks should account for the specific VM array size limitations

  Show description for 50ada2a
  srowen

  committed
  50ada2aView commit details

  Copy full SHA for 50ada2a

  View code at this pointBrowse repository at this point

Commits on Sep 21, 2017

• [SPARK-21934][CORE] Expose Shuffle Netty memory usage to MetricsSystem

  Show description for 1da5822
  jerryshao

  committed
  1da5822View commit details

  Copy full SHA for 1da5822

  View code at this pointBrowse repository at this point

Commits on Sep 20, 2017

• [SPARK-22066][BUILD] Update checkstyle to 8.2, enable it, fix violations

  Show description for 3d4dd14
  srowen

  committed
  3d4dd14View commit details

  Copy full SHA for 3d4dd14

  View code at this pointBrowse repository at this point

Commits on Sep 18, 2017

• [SPARK-14878][SQL] Trim characters string function support

  Show description for c66d64b
  

  kevinyu98

  authored and

  gatorsmile

  committed
  c66d64bView commit details

  Copy full SHA for c66d64b

  View code at this pointBrowse repository at this point

Commits on Sep 16, 2017

• [SPARK-21967][CORE] org.apache.spark.unsafe.types.UTF8String#compareTo Should Compare 8 Bytes at a Time for Better Performance

  Show description for 73d9067
  

  original-brownbear

  authored and

  srowen

  committed
  73d9067View commit details

  Copy full SHA for 73d9067

  View code at this pointBrowse repository at this point

Commits on Sep 13, 2017

• [SPARK-21970][CORE] Fix Redundant Throws Declarations in Java Codebase

  Show description for b6ef1f5
  

  original-brownbear

  authored and

  srowen

  committed
  b6ef1f5View commit details

  Copy full SHA for b6ef1f5

  View code at this pointBrowse repository at this point

Commits on Sep 6, 2017

• [SPARK-9104][CORE] Expose Netty memory metrics in Spark

  Show description for 445f179
  

  jerryshao

  authored and

  zsxwing

  committed
  445f179View commit details

  Copy full SHA for 445f179

  View code at this pointBrowse repository at this point

Commits on Aug 31, 2017

• [SPARK-17321][YARN] Avoid writing shuffle metadata to disk if NM recovery is disabled

  Show description for 4482ff2
  jerryshao

  committed
  4482ff2View commit details

  Copy full SHA for 4482ff2

  View code at this pointBrowse repository at this point

Commits on Aug 30, 2017

• [MINOR][TEST] Off -heap memory leaks for unit tests

  Show description for d4895c9
  

  10110346

  authored and

  srowen

  committed
  d4895c9View commit details

  Copy full SHA for d4895c9

  View code at this pointBrowse repository at this point

Commits on Aug 25, 2017

• [MINOR][BUILD] Fix build warnings and Java lint errors

  Show description for de7af29
  srowen

  committed
  de7af29View commit details

  Copy full SHA for de7af29

  View code at this pointBrowse repository at this point

Commits on Aug 24, 2017

• [SPARK-21701][CORE] Enable RPC client to use ` SO_RCVBUF` and ` SO_SNDBUF` in SparkConf.

  Show description for 763b83e
  

  xu.zhang

  authored and

  zsxwing

  committed
  763b83eView commit details

  Copy full SHA for 763b83e

  View code at this pointBrowse repository at this point

Commits on Aug 23, 2017

• [SPARK-21501] Change CacheLoader to limit entries based on memory footprint

  Show description for 1662e93
  

  Sanket Chintapalli

  authored and

  Tom Graves

  committed
  1662e93View commit details

  Copy full SHA for 1662e93

  View code at this pointBrowse repository at this point

Commits on Aug 8, 2017

• [SPARK-21671][CORE] Move kvstore to "util" sub-package, add private annotation.

  Show description for 2c1bfb4
  

  Marcelo Vanzin

  committed
  2c1bfb4View commit details

  Copy full SHA for 2c1bfb4

  View code at this pointBrowse repository at this point

• [SPARK-20655][CORE] In-memory KVStore implementation.

  Show description for 979bf94
  

  Marcelo Vanzin

  committed
  979bf94View commit details

  Copy full SHA for 979bf94

  View code at this pointBrowse repository at this point

Commits on Aug 7, 2017

• [SPARK-21544][DEPLOY][TEST-MAVEN] Tests jar of some module should not upload twice

  Show description for 8b69b17
  

  caneGuy

  authored and

  srowen

  committed
  8b69b17View commit details

  Copy full SHA for 8b69b17

  View code at this pointBrowse repository at this point

Commits on Aug 1, 2017

• [SPARK-21592][BUILD] Skip maven-compiler-plugin main and test compilations in Maven build

  Show description for 74cda94
  

  gslowikowski

  authored and

  srowen

  committed
  74cda94View commit details

  Copy full SHA for 74cda94

  View code at this pointBrowse repository at this point

• [SPARK-21475][CORE] Use NIO's Files API to replace FileInputStream/FileOutputStream in some critical paths

  Show description for 5fd0294
  

  jerryshao

  authored and

  srowen

  committed
  5fd0294View commit details

  Copy full SHA for 5fd0294

  View code at this pointBrowse repository at this point

Commits on Jul 28, 2017

• [MINOR][BUILD] Fix current lint-java failures

  Show description for 63d168c
  srowen

  committed
  63d168cView commit details

  Copy full SHA for 63d168c

  View code at this pointBrowse repository at this point

Commits on Jul 27, 2017

• [SPARK-21530] Update description of spark.shuffle.maxChunksBeingTransferred.

  Show description for cfb25b2
  

  jinxing

  authored and

  cloud-fan

  committed
  cfb25b2View commit details

  Copy full SHA for cfb25b2

  View code at this pointBrowse repository at this point

Commits on Jul 26, 2017

• [SPARK-21494][NETWORK] Use correct app id when authenticating to external service.

  Show description for 300807c
  

  Marcelo Vanzin

  committed
  300807cView commit details

  Copy full SHA for 300807c

  View code at this pointBrowse repository at this point

Commits on Jul 25, 2017

• [SPARK-21175] Reject OpenBlocks when memory shortage on shuffle service.

  Show description for 799e131
  

  jinxing

  authored and

  cloud-fan

  committed
  799e131View commit details

  Copy full SHA for 799e131

  View code at this pointBrowse repository at this point

Commits on Jul 18, 2017

• [SPARK-21445] Make IntWrapper and LongWrapper in UTF8String Serializable

  Show description for 26cd2ca
  

  brkyvz

  authored and

  cloud-fan

  committed
  26cd2caView commit details

  Copy full SHA for 26cd2ca

  View code at this pointBrowse repository at this point