Package org.apache.datafusion
package org.apache.datafusion
-
ClassDescriptionConfiguration knobs for Arrow IPC sources passed to
SessionContext.registerArrow(String, String, ArrowReadOptions)andSessionContext.readArrow(String, ArrowReadOptions).Configuration knobs for Avro sources passed toSessionContext.registerAvro(String, String, AvroReadOptions)andSessionContext.readAvro(String, AvroReadOptions).The value of a scalar UDF argument or result: either a per-rowColumnarValue.Arrayof lengthrowCount, or aColumnarValue.Scalar(length-1 vector) that the framework broadcasts.Per-row Arrow vector of length equal to the batch row count.Length-1 Arrow vector representing a single value broadcast across all rows.Configuration knobs for CSV sources passed toSessionContext.registerCsv(String, String, CsvReadOptions)andSessionContext.readCsv(String, CsvReadOptions).Configuration knobs for writing CSV, passed toDataFrame.writeCsv(String, CsvWriteOptions).A lazy representation of a query plan, mirroring the Rust DataFusionDataFrame.Compression of a file-format source.Configuration knobs for writing JSON, passed toDataFrame.writeJson(String, JsonWriteOptions).Configuration knobs for newline-delimited JSON sources passed toSessionContext.registerJson(String, String, NdJsonReadOptions)andSessionContext.readJson(String, NdJsonReadOptions).Google Cloud Storage.Listing-capable HTTP / WebDAV store.Amazon S3 (and any S3-compatible endpoint such as MinIO, Cloudflare R2, Wasabi).Configuration knobs for parquet sources passed toSessionContext.registerParquet(String, String, ParquetReadOptions)andSessionContext.readParquet(String, ParquetReadOptions).Configuration knobs for writing parquet, passed toDataFrame.writeParquet(String, ParquetWriteOptions).A Java-implemented scalar SQL function.Bundle of inputs passed toScalarFunction.evaluate(org.apache.arrow.memory.BufferAllocator, org.apache.datafusion.ScalarFunctionArgs): the per-argColumnarValues (in declared order) and the batch row count DataFusion is driving.A scalar UDF registration handle: pairs aScalarFunctionimplementation with the metadata DataFusion needs to dispatch SQL calls to it.A DataFusion session context.Builder for a configuredSessionContext.ATableProviderthat pairs a fixedSchemawith a function that opens a freshArrowReaderfor each scan.A Java-implemented table that can be registered with aSessionContextviaSessionContext.registerTable(String, TableProvider).Configuration knobs forDataFrame.unnestColumns(UnnestOptions, String...), mirroring DataFusion'sUnnestOptions.Volatility classification for a UDF.