Package org.apache.datafusion
package org.apache.datafusion
-
ClassDescriptionConfiguration knobs for Arrow IPC sources passed to
SessionContext.registerArrow(String, String, ArrowReadOptions)andSessionContext.readArrow(String, ArrowReadOptions).Configuration knobs for Avro sources passed toSessionContext.registerAvro(String, String, AvroReadOptions)andSessionContext.readAvro(String, AvroReadOptions).Configuration for DataFusion's built-inCacheManager.Builder forCacheManagerOptions.The value of a scalar UDF argument or result: either a per-rowColumnarValue.Arrayof lengthrowCount, or aColumnarValue.Scalar(length-1 vector) that the framework broadcasts.Per-row Arrow vector of length equal to the batch row count.Length-1 Arrow vector representing a single value broadcast across all rows.Invalid or unrecognised DataFusion configuration option.Configuration knobs for CSV sources passed toSessionContext.registerCsv(String, String, CsvReadOptions)andSessionContext.readCsv(String, CsvReadOptions).Configuration knobs for writing CSV, passed toDataFrame.writeCsv(String, CsvWriteOptions).A lazy representation of a query plan, mirroring the Rust DataFusionDataFrame.Base unchecked exception for every error surfaced from the native DataFusion side.Runtime execution failure: a UDF threw, a join task panicked, an external (non-DataFusion) error propagated up, or an FFI-level failure surfaced.Compression of a file-format source.IO-shaped failure: a local filesystem read failed, an object store request failed, or a parquet / arrow / avro decoder reported a malformed file.Configuration knobs for writing JSON, passed toDataFrame.writeJson(String, JsonWriteOptions).Snapshot of session-wide memory usage fromSessionContext.memoryUsage().Loads thedatafusion_jninative library on demand.Configuration knobs for newline-delimited JSON sources passed toSessionContext.registerJson(String, String, NdJsonReadOptions)andSessionContext.readJson(String, NdJsonReadOptions).The requested feature is recognised by DataFusion but not implemented yet.Google Cloud Storage.Listing-capable HTTP / WebDAV store.Amazon S3 (and any S3-compatible endpoint such as MinIO, Cloudflare R2, Wasabi).Configuration knobs for parquet sources passed toSessionContext.registerParquet(String, String, ParquetReadOptions)andSessionContext.readParquet(String, ParquetReadOptions).Configuration knobs for writing parquet, passed toDataFrame.writeParquet(String, ParquetWriteOptions).SQL parsing, logical planning, or schema-resolution failure.The DataFusion runtime exhausted a configured resource budget — typically the memory pool, but applies to any guard upstream surfaces asDataFusionError::ResourcesExhausted.Snapshot of the underlying Tokio runtime fromSessionContext.runtimeStats().A Java-implemented scalar SQL function.Bundle of inputs passed toScalarFunction.evaluate(org.apache.arrow.memory.BufferAllocator, org.apache.datafusion.ScalarFunctionArgs): the per-argColumnarValues (in declared order) and the batch row count DataFusion is driving.A scalar UDF registration handle: pairs aScalarFunctionimplementation with the metadata DataFusion needs to dispatch SQL calls to it.A DataFusion session context.Builder for a configuredSessionContext.ATableProviderthat pairs a fixedSchemawith a function that opens a freshArrowReaderfor each scan.A single sort key passed toDataFrame.sort(SortExpr...), mirroring DataFusion'sexpr::Sort{ expr, asc, nulls_first }.A Java-implemented table that can be registered with aSessionContextviaSessionContext.registerTable(String, TableProvider).Configuration knobs forDataFrame.unnestColumns(UnnestOptions, String...), mirroring DataFusion'sUnnestOptions.Volatility classification for a UDF.