Apache DataFusion Ballista 0.7.0 Changelog#

Full Changelog

Breaking changes:

  • Make ExecutionPlan::execute Sync #2434 (tustvold)

  • Add Expr::Exists to represent EXISTS subquery expression #2339 (andygrove)

  • Remove dependency from LogicalPlan::TableScan to ExecutionPlan #2284 (andygrove)

  • Move logical expression type-coercion code from physical-expr crate to expr crate #2257 (andygrove)

  • feat: 2061 create external table ddl table partition cols #2099 [sql] (jychen7)

  • Reorganize the project folders #2081 (yahoNanJing)

  • Support more ScalarFunction in Ballista #2008 (Ted-Jiang)

  • Merge dataframe and dataframe imp #1998 (vchag)

  • Rename ExecutionContext to SessionContext, ExecutionContextState to SessionState, add TaskContext to support multi-tenancy configurations - Part 1 #1987 (mingmwang)

  • Add Coalesce function #1969 (msathis)

  • Add Create Schema functionality in SQL #1959 [sql] (matthewmturner)

  • remove sync constraint of SendableRecordBatchStream #1884 (doki23)

Implemented enhancements:

Fixed bugs:

  • Ballista integration tests no longer work #2440

  • Ballista crates cannot be released from DafaFusion 7.0.0 source release #1980

  • protobuf OctetLength should be deserialized as octet_length, not length #1834 (carols10cents)

Documentation updates:

Performance improvements:

Closed issues:

  • Make expected result string in unit tests more readable #2412

  • remove duplicated fn aggregate() in aggregate expression tests #2399

  • split distinct_expression.rs into count_distinct.rs and array_agg_distinct.rs #2385

  • move sql tests in context.rs to corresponding test files in datafustion/core/tests/sql #2328

  • Date32/Date64 as join keys for merge join #2314

  • Error precision and scale for decimal coercion in logic comparison #2232

  • Support Multiple row layout #2188

  • Discussion: Is Ballista a standalone system or framework #1916

Merged pull requests: