From 47 Minutes to 5 Minutes: Fixing the Small File Problem on a 100 GB Delta Table

A streaming pipeline kept creating tiny Parquet files. The cluster was not the problem. The data layout was.