The table had 40,000 tiny files. The small file problem in Databricks, explained

Why Delta tables slowly fill up with tiny files, why that makes every query slower, and how OPTIMIZE and VACUUM quietly fix it.