Expression Compatibility (Spark 4.1)

Compatibility notes for Comet running on Apache Spark 4.1. Expressions that are not 100% Spark-compatible fall back to Spark by default and can be enabled by setting spark.comet.expression.EXPRNAME.allowIncompatible=true, where EXPRNAME is the Spark expression class name. See the Comet Supported Expressions Guide for more information on this configuration setting.

• Aggregate Expressions
• Array Expressions
• Date/Time Expressions
• Map Expressions
• Math Expressions
• Miscellaneous Expressions
• String Expressions
• Struct Expressions
• URL Expressions
• Cast