Math Expressions#
Abs#
The following cases are not supported by Comet and always fall back to Spark, regardless of any allowIncompatible setting:
Only integral, floating-point, and decimal types are supported
Rand#
The following cases are not supported by Comet and always fall back to Spark, regardless of any allowIncompatible setting:
The
seedargument must be a literal value
Randn#
The following cases are not supported by Comet and always fall back to Spark, regardless of any allowIncompatible setting:
The
seedargument must be a literal value
Round#
The following cases have no native implementation and always run in the JVM using Spark’s code-generated implementation (inside the Comet pipeline):
Float and double inputs. Spark rounds them through a BigDecimal built from
java.lang.Double.toString()rather than from the exact binary value, and that shortened decimal string can round differently than the value it came fromNegative-scale decimal inputs, which are only creatable with spark.sql.legacy.allowNegativeScaleOfDecimal=true