Metrics#
DataFusion operators expose runtime metrics so you can understand where time is spent and how much data flows through the pipeline. See more in EXPLAIN ANALYZE.
Common Metrics#
BaselineMetrics#
BaselineMetrics are available in most physical operators to capture common measurements.
Metric |
Description |
|---|---|
elapsed_compute |
CPU time the operator actively spends processing work. |
output_rows |
Total number of rows the operator produces. |
output_bytes |
Memory usage of all output batches. Note: This value may be overestimated. If multiple output |
output_batches |
Total number of output batches the operator produces. |
Operator-specific Metrics#
TODO