Apache DataFusion Ballista 54.1.0 Changelog#

This release consists of 10 commits from 3 contributors. See credits at the end of this changelog for more information.

Fixed bugs:

  • fix: [branch-54] disable the SortMergeJoinExec broadcast conversion by default #2130 (andygrove)

  • fix: [branch-54] map a task’s partition through UnionExec when restricting file scans (backport of #2070) #2131 (andygrove)

  • fix: [branch-54] keep EmptyExec partition count intact across stage serialization (backport of #2062) #2132 (andygrove)

  • fix: [branch-54] send the shutdown notification before dropping the notifier (backport of #2107) #2237 (sandugood)

  • fix: [branch-54] bind the gRPC listener before registering with the scheduler (backport of #2225) #2236 (andygrove)

  • fix: [branch-54] keep GROUP BY-less aggregates when propagating empty stages (backport of #2194) #2235 (andygrove)

  • fix: [branch-54] spill sort shuffle writer when the memory pool rejects a reservation grow (backport of #2061) #2238 (andygrove)

  • fix: [branch-54] enable the executor client pool by default (backport of #2069) #2234 (andygrove)

  • fix: [branch-54] see through Shared wrapper when classifying task IO errors (backport of #2119) #2239 (goingforstudying-ctrl)

Other:

  • chore: [branch-54] upgrade DataFusion to 54.1.0 and bump Ballista version to 54.1.0 #2127 (andygrove)

Credits#

Thank you to everyone who contributed to this release. Here is a breakdown of commits (PRs merged) per contributor.

     8	Andy Grove
     1	sandugood
     1	goingforstudying-ctrl

Thank you also to everyone who contributed in other ways such as filing issues, reviewing PRs, and providing feedback on this release.