Data Source Audits#
This section records audits of Comet’s native data source paths, the scans and writers for Parquet and Iceberg, in the same way that the Expression Audits record audits of expressions. Each page holds dated entries per component. An entry records:
what was audited, at which commit, against which Spark and library versions, and how
the issues the audit filed, and the open issues it confirmed
what was checked and matched, so that it is not re-audited without a reason
the candidates that did not reproduce, so that they are not chased again
the differences that are bugs in Spark or iceberg-java rather than in Comet
what the audit did not cover
A later audit of the same area adds a new dated entry instead of editing an old one, so the history stays visible. The open issues that users can hit are listed in the Known Issues sections of the Parquet and Iceberg guides.