All pull requests

Pull requests

• [WIP][POC][GRAPHFRAMES] Add GraphFrames documentation to the Spark docs

  #59525·SemyonSinchenko opened Oct 15, 2026Member·

  ·

• [WIP][CORE] Reject repeated consumption of pipelined shuffle partitions

  #59524·jerrypeng opened Oct 15, 2026Contributor·

  ·

• [WIP][CORE] Reject persisted native pipelined shuffle consumers

  #59523·jerrypeng opened Oct 15, 2026Contributor·

  ·

• [SPARK-60265][SQL] Allow optional grouping of V2 scan splits below shuffles

  #59522·rekbun opened Oct 15, 2026·

  ·

• [SPARK-XXXXX][SS] Fix state data source change feed dropping list state values after the first

  #59521·kavpreetgrewal opened Oct 15, 2026Contributor·

  ·

• [WIP][SQL] Add a Rust SDK for native data sources over the C ABI

  #59520·gengliangwang opened Oct 15, 2026Member·

  ·

• [SPARK-60252][SDP] SCD1 Ignore-null support; Field Reconciliation Data Classes

  #59519·AnishMahto opened Oct 15, 2026Contributor·

  ·

• [SPARK-60264][SS] Propagate close() failures in AbortableStreamBasedCheckpointFileManager

  #59518·snmvaughan opened Oct 15, 2026·

  ·
  3

• [SPARK-54733][SQL] Desc As Json GeographyType

  #59517·ashutosh-jindal opened Oct 15, 2026Contributor·

  ·

• [SPARK-60244][SQL] Align XML CHAR/VARCHAR map key error message with JSON

  #59516·ykisana opened Oct 15, 2026Contributor·

  ·

• [SPARK-60119][SQL][4.0] Skip rescaling in Decimal.changePrecision when the result is known from the magnitude

  #59515·viirya opened Oct 15, 2026Member·

  ·

• [SPARK-60119][SQL][4.1] Skip rescaling in Decimal.changePrecision when the result is known from the magnitude

  #59514·viirya opened Oct 15, 2026Member·

  ·

• [SPARK-60119][SQL][4.2] Skip rescaling in Decimal.changePrecision when the result is known from the magnitude

  #59513·viirya opened Oct 15, 2026Member·

  ·

• [SPARK-60119][SQL][4.3] Skip rescaling in Decimal.changePrecision when the result is known from the magnitude

  #59512·viirya opened Oct 15, 2026Member·

  ·

• [SPARK-60249] [SS] Allow reuse of named streaming sources

  #59511·SMHodges opened Oct 15, 2026·

  ·

• [SPARK-60262][SQL] Fail Parquet reads where two requested fields select the same column

  #59510·andygrove opened Oct 15, 2026Member·

  ·
  3

• [SPARK-60044][SQL][4.2] Freeze the k-way merge ordering of GroupPartitionsExec when the merge is planned

  #59509·peter-toth opened Oct 15, 2026Contributor·

  ·

• [SPARK-60044][SQL][4.3] Freeze the k-way merge ordering of GroupPartitionsExec when the merge is planned

  #59508·peter-toth opened Oct 15, 2026Contributor·

  ·

• [SPARK-60240][SQL] Trim tuple_sketch_agg results to nominal k entries in every plan

  #59507·stojkomilos opened Oct 15, 2026·

  ·

• [MINOR][PS] Document missing rolling and expanding window APIs

  #59506·zhengruifeng opened Oct 15, 2026Contributor·

  ·

• [SPARK-60259][SQL] Treat Oracle broken synonyms (ORA-00980) as not selectable

  #59505·alekjarmov opened Oct 15, 2026Contributor·

  ·
  6

• [SPARK-60257][SDP][TEST] Test pipeline event responses missing result fields

  #59504·dahhs opened Oct 15, 2026·

  ·

• [SPARK-60258][SQL] Map SQL Server native JSON JDBC type to StringType

  #59503·alekjarmov opened Oct 15, 2026Contributor·

  ·
  3

• [SPARK-60256][CORE] Fail a pipelined group on a killed or commit-denied member task

  #59499·jerrypeng opened Oct 15, 2026Contributor·

  ·
  1

• [SQL] Offer conjuncts over a storage filter's key columns to the Parquet reader

  #59486·ForVic opened Oct 15, 2026Contributor·

  ·