generator_funcs Expression Audits#

Audit notes for expressions in this category that have been audited. Absence of an entry means the expression has not been audited yet, not that it is unsupported. See the user guide Spark Expression Support for current support status.

explode#

  • Handled at the operator level as a GenerateExec (CometExplodeExec), not via the expression serde maps, so it is not auto-detected by the function-registry checkbox logic. Compatible for array and map inputs. Maps emit key/value columns, with a position column for posexplode.

explode_outer#

  • Same CometExplodeExec path as explode. Compatible for array and map inputs; empty and NULL collections both emit one null-valued row per Spark’s outer semantics, which the planner requests as DataFusion’s NullHandling::PreserveAndExpandEmpty. Map entries reuse the list unnest path and expand into key/value columns.

posexplode#

  • Handled at the operator level as a GenerateExec (CometExplodeExec), like explode. Compatible for array and map inputs. Maps emit key/value columns, with a position column for posexplode.

posexplode_outer#

  • Same CometExplodeExec path as posexplode. Compatible for array and map inputs; empty and NULL collections both emit one row with null pos and null generated columns per Spark’s outer semantics, which the planner requests as DataFusion’s NullHandling::PreserveAndExpandEmpty.