When the same predicate is applied to the same Parquet file, the resulting row selection is deterministic. Returning and caching the RowSelection allows downstream consumers to reuse it, avoiding redundant filtering and improving read performance.
I believe this feature will require changes in both arrow-rs and datafusion.
When the same predicate is applied to the same Parquet file, the resulting row selection is deterministic. Returning and caching the RowSelection allows downstream consumers to reuse it, avoiding redundant filtering and improving read performance.
I believe this feature will require changes in both arrow-rs and datafusion.